2024-04-25T19:10:05.260 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T19:10:05.261 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/asok_dump_tree} --archive /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673308 --owner scheduled_pdonnell@teuthology -- /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673308/orig.config.yaml 2024-04-25T19:10:05.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T19:10:05.391 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673308 branch: wip-pdonnell-testing-20240425.015853-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/asok_dump_tree} email: pdonnell@redhat.com first_in_suite: false job_id: '7673308' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240425.015853-debug ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240425.015853-debug sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 owner: scheduled_pdonnell@teuthology priority: 85 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1880 sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 sleep_before_teardown: 0 subset: 178/512 suite: fs suite_branch: wip-pdonnell-testing-20240425.015853-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi131.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMmNVierOx5ZdfB74xyhCCqlmze747qz1LrRfJJ52Q0bCSwr4TaX0AwhcXAcmt1PHoIUeLx/z9uFNauFrXQEraw= smithi195.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC1l2APQy72uV07B0uBNl0Ku2t3V1FkWbRZ347Ym+Djf5zMMgvpEFheK6AXtiPJkwBVGg5krBEpKrbkMs3hBErU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_dump_tree teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_10:00:23 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T19:10:05.391 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa; will attempt to use it 2024-04-25T19:10:05.392 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks 2024-04-25T19:10:05.392 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T19:10:05.393 INFO:teuthology.task.internal:Checking packages... 2024-04-25T19:10:05.416 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '994e2f20102a20fa9a27966c14b625cc01884df8' 2024-04-25T19:10:05.416 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T19:10:05.417 INFO:teuthology.packaging:ref: None 2024-04-25T19:10:05.417 INFO:teuthology.packaging:tag: None 2024-04-25T19:10:05.417 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240425.015853-debug 2024-04-25T19:10:05.417 INFO:teuthology.packaging:sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T19:10:05.417 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240425.015853-debug 2024-04-25T19:10:05.666 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3291.g994e2f20 2024-04-25T19:10:05.668 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T19:10:05.676 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T19:10:05.676 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T19:10:05.721 INFO:teuthology.task.internal:Saving configuration 2024-04-25T19:10:05.738 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T19:10:05.762 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T19:10:05.788 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673308', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 19:05:03.490698', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMmNVierOx5ZdfB74xyhCCqlmze747qz1LrRfJJ52Q0bCSwr4TaX0AwhcXAcmt1PHoIUeLx/z9uFNauFrXQEraw='} 2024-04-25T19:10:05.809 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673308', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 19:05:03.491951', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC1l2APQy72uV07B0uBNl0Ku2t3V1FkWbRZ347Ym+Djf5zMMgvpEFheK6AXtiPJkwBVGg5krBEpKrbkMs3hBErU='} 2024-04-25T19:10:05.809 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T19:10:05.815 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-25T19:10:05.815 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-25T19:10:05.815 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T19:10:05.931 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc4a8af8f70>, signals=[15]) 2024-04-25T19:10:05.931 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T19:10:05.938 INFO:teuthology.task.internal:Opening connections... 2024-04-25T19:10:05.938 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi131.front.sepia.ceph.com 2024-04-25T19:10:05.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T19:10:06.018 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T19:10:06.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T19:10:06.094 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T19:10:06.101 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2024-04-25T19:10:06.119 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2024-04-25T19:10:06.119 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2024-04-25T19:10:06.176 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2024-04-25T19:10:06.176 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="9" 2024-04-25T19:10:06.176 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2024-04-25T19:10:06.176 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2024-04-25T19:10:06.176 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="9" 2024-04-25T19:10:06.176 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el9" 2024-04-25T19:10:06.176 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T19:10:06.176 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2024-04-25T19:10:06.177 INFO:teuthology.orchestra.run.smithi131.stdout:LOGO="fedora-logo-icon" 2024-04-25T19:10:06.177 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T19:10:06.177 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2024-04-25T19:10:06.177 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T19:10:06.177 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T19:10:06.177 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T19:10:06.177 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2024-04-25T19:10:06.199 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2024-04-25T19:10:06.216 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2024-04-25T19:10:06.217 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-04-25T19:10:06.273 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2024-04-25T19:10:06.273 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2024-04-25T19:10:06.273 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2024-04-25T19:10:06.274 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2024-04-25T19:10:06.274 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2024-04-25T19:10:06.274 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2024-04-25T19:10:06.274 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T19:10:06.274 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2024-04-25T19:10:06.274 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2024-04-25T19:10:06.274 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T19:10:06.274 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2024-04-25T19:10:06.274 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T19:10:06.274 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T19:10:06.274 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T19:10:06.274 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-04-25T19:10:06.299 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T19:10:06.309 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T19:10:06.328 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T19:10:06.329 DEBUG:teuthology.orchestra.run.smithi131:> test '!' -e /home/ubuntu/cephtest 2024-04-25T19:10:06.331 DEBUG:teuthology.orchestra.run.smithi195:> test '!' -e /home/ubuntu/cephtest 2024-04-25T19:10:06.346 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T19:10:06.362 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T19:10:06.363 DEBUG:teuthology.orchestra.run.smithi131:> test -z $(ls -A /var/lib/ceph) 2024-04-25T19:10:06.387 DEBUG:teuthology.orchestra.run.smithi195:> test -z $(ls -A /var/lib/ceph) 2024-04-25T19:10:06.499 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T19:10:06.551 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T19:10:06.610 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-04-25T19:10:06.610 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-04-25T19:10:06.611 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-04-25T19:10:06.611 DEBUG:teuthology.orchestra.run.smithi131:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T19:10:06.611 DEBUG:teuthology.orchestra.run.smithi195:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T19:10:06.627 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T19:10:06.628 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-04-25T19:10:06.631 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T19:10:06.631 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-04-25T19:10:06.805 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T19:10:06.805 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-25T19:10:06.806 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2024-04-25T19:10:06.823 INFO:teuthology.orchestra.run.smithi131.stdout:5.14.0-437.el9.x86_64 2024-04-25T19:10:06.823 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T19:10:06.823 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-25T19:10:06.824 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum upgrade -y linux-firmware 2024-04-25T19:10:06.877 DEBUG:teuthology.task.kernel:sha1 for client.1 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T19:10:06.877 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-25T19:10:06.877 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-04-25T19:10:06.894 INFO:teuthology.orchestra.run.smithi195.stdout:5.14.0-437.el9.x86_64 2024-04-25T19:10:06.895 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T19:10:06.895 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-25T19:10:06.895 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum upgrade -y linux-firmware 2024-04-25T19:10:09.248 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-25T19:10:09.294 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - BaseOS 8.8 MB/s | 8.0 MB 00:00 2024-04-25T19:10:11.058 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-04-25T19:10:11.329 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:00 2024-04-25T19:10:15.291 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - CRB 9.1 MB/s | 6.2 MB 00:00 2024-04-25T19:10:15.471 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-25T19:10:17.170 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 16 kB 00:00 2024-04-25T19:10:17.823 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 16 kB 00:01 2024-04-25T19:10:20.391 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 8.6 MB/s | 21 MB 00:02 2024-04-25T19:10:21.904 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 4.5 MB/s | 21 MB 00:04 2024-04-25T19:10:25.532 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-25T19:10:26.970 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-04-25T19:10:27.566 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-25T19:10:27.567 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-04-25T19:10:27.567 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-25T19:10:27.689 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-04-25T19:10:27.690 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T19:10:27.833 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-25T19:10:27.833 DEBUG:teuthology.orchestra.run.smithi195:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-25T19:10:27.835 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi195.front.sepia.ceph.com to complete... 2024-04-25T19:10:28.955 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-25T19:10:28.956 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-04-25T19:10:28.956 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-25T19:10:29.087 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-25T19:10:29.087 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T19:10:29.238 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-25T19:10:29.238 DEBUG:teuthology.orchestra.run.smithi131:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-25T19:10:29.241 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi131.front.sepia.ceph.com to complete... 2024-04-25T19:10:48.172 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25 19:10:48 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-25T19:10:48.172 INFO:teuthology.orchestra.run.smithi195.stderr:FINISHED --2024-04-25 19:10:48-- 2024-04-25T19:10:48.172 INFO:teuthology.orchestra.run.smithi195.stderr:Total wall clock time: 20s 2024-04-25T19:10:48.172 INFO:teuthology.orchestra.run.smithi195.stderr:Downloaded: 1 files, 341M in 20s (17.1 MB/s) 2024-04-25T19:10:48.175 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-04-25T19:10:48.175 DEBUG:teuthology.orchestra.run.smithi195:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-25T19:10:50.255 INFO:teuthology.orchestra.run.smithi195.stdout:Verifying... ######################################## 2024-04-25T19:10:50.473 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing... ######################################## 2024-04-25T19:10:50.589 INFO:teuthology.orchestra.run.smithi195.stdout:Updating / installing... 2024-04-25T19:10:52.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25 19:10:52 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-25T19:10:52.649 INFO:teuthology.orchestra.run.smithi131.stderr:FINISHED --2024-04-25 19:10:52-- 2024-04-25T19:10:52.649 INFO:teuthology.orchestra.run.smithi131.stderr:Total wall clock time: 23s 2024-04-25T19:10:52.649 INFO:teuthology.orchestra.run.smithi131.stderr:Downloaded: 1 files, 341M in 23s (14.9 MB/s) 2024-04-25T19:10:52.652 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-25T19:10:52.652 DEBUG:teuthology.orchestra.run.smithi131:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-25T19:10:54.758 INFO:teuthology.orchestra.run.smithi131.stdout:Verifying... ######################################## 2024-04-25T19:10:54.899 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing... ######################################## 2024-04-25T19:10:55.018 INFO:teuthology.orchestra.run.smithi131.stdout:Updating / installing... 2024-04-25T19:10:58.524 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-25T19:11:02.991 INFO:teuthology.orchestra.run.smithi131.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-25T19:11:37.839 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi195.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-25T19:11:37.840 DEBUG:teuthology.orchestra.run.smithi195:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-25T19:11:37.932 INFO:teuthology.orchestra.run.smithi195.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-25T19:11:37.932 INFO:teuthology.orchestra.run.smithi195.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-25T19:11:37.932 INFO:teuthology.orchestra.run.smithi195.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T19:11:37.932 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-25T19:11:37.932 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-25T19:11:37.932 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-25T19:11:37.932 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-25T19:11:37.932 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-25T19:11:37.932 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-25T19:11:37.933 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-25T19:11:37.933 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-25T19:11:37.933 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-25T19:11:37.933 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-25T19:11:37.933 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-25T19:11:37.933 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-25T19:11:37.933 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-25T19:11:37.933 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-25T19:11:37.933 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-25T19:11:37.933 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-25T19:11:37.934 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-25T19:11:37.934 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-25T19:11:37.934 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-25T19:11:37.934 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-25T19:11:37.934 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-25T19:11:37.934 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-25T19:11:37.934 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-25T19:11:37.934 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-25T19:11:37.934 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-25T19:11:37.934 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-25T19:11:37.934 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-25T19:11:37.935 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-25T19:11:37.935 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-25T19:11:37.935 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-25T19:11:37.935 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-25T19:11:37.935 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-25T19:11:37.935 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-25T19:11:37.935 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-25T19:11:37.935 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-25T19:11:37.935 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-25T19:11:37.935 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-25T19:11:37.935 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-25T19:11:37.935 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-25T19:11:37.935 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-25T19:11:37.935 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-25T19:11:37.936 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-25T19:11:37.936 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-25T19:11:37.936 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-25T19:11:37.936 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-25T19:11:37.936 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-25T19:11:37.936 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-25T19:11:37.936 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-25T19:11:37.936 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-25T19:11:37.936 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-25T19:11:37.936 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-25T19:11:37.936 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-25T19:11:37.936 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-25T19:11:37.937 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-25T19:11:37.937 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-25T19:11:37.937 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-25T19:11:37.937 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-25T19:11:37.937 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-25T19:11:37.937 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-25T19:11:37.937 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-25T19:11:37.937 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-25T19:11:37.937 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-25T19:11:37.937 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-25T19:11:37.937 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-25T19:11:37.937 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-25T19:11:37.937 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-25T19:11:37.937 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-25T19:11:37.938 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-25T19:11:37.938 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-25T19:11:37.938 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-25T19:11:37.938 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-25T19:11:37.938 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-25T19:11:37.938 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-25T19:11:37.938 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-25T19:11:37.938 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-25T19:11:37.938 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-25T19:11:37.938 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-25T19:11:37.938 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-25T19:11:37.938 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-25T19:11:37.938 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-25T19:11:37.938 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-25T19:11:37.939 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-25T19:11:37.939 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-25T19:11:37.939 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-25T19:11:37.939 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-25T19:11:37.939 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-25T19:11:37.939 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-25T19:11:37.939 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-25T19:11:37.939 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-25T19:11:37.939 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-25T19:11:37.939 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-25T19:11:37.939 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-25T19:11:37.939 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-25T19:11:37.939 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-25T19:11:37.940 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-25T19:11:37.940 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-25T19:11:37.940 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-25T19:11:37.940 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-25T19:11:37.940 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-25T19:11:37.940 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-25T19:11:37.940 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-25T19:11:37.940 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-25T19:11:37.940 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-25T19:11:37.940 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-25T19:11:37.940 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-25T19:11:37.940 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-25T19:11:37.940 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-25T19:11:37.940 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-25T19:11:37.941 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-25T19:11:37.941 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-25T19:11:37.941 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-25T19:11:37.941 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-25T19:11:37.941 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-25T19:11:37.941 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-25T19:11:37.941 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-25T19:11:37.941 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-25T19:11:37.941 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-25T19:11:37.941 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-25T19:11:37.941 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-25T19:11:37.941 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-25T19:11:37.941 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-25T19:11:37.941 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-25T19:11:37.942 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-25T19:11:37.942 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-25T19:11:37.942 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-25T19:11:37.942 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-25T19:11:37.942 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-25T19:11:37.942 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-25T19:11:37.942 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-25T19:11:37.942 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-25T19:11:37.942 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-25T19:11:37.942 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-25T19:11:37.942 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-25T19:11:37.942 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-25T19:11:37.943 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-25T19:11:37.943 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-25T19:11:37.943 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-25T19:11:37.943 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-25T19:11:37.943 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-25T19:11:37.943 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-25T19:11:37.943 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-25T19:11:37.943 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-25T19:11:37.943 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-25T19:11:37.943 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-25T19:11:37.943 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-25T19:11:37.943 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-25T19:11:37.943 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-25T19:11:37.943 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-25T19:11:37.943 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-25T19:11:37.944 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-25T19:11:37.944 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-25T19:11:37.944 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-25T19:11:37.944 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-25T19:11:37.944 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-25T19:11:37.944 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-25T19:11:37.944 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-25T19:11:37.944 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-25T19:11:37.944 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-25T19:11:37.944 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-25T19:11:37.944 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-25T19:11:37.944 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-25T19:11:37.944 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-25T19:11:37.944 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-25T19:11:37.945 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-25T19:11:37.945 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-25T19:11:37.945 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-25T19:11:37.945 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-25T19:11:37.945 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-25T19:11:37.945 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-25T19:11:37.945 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-25T19:11:37.945 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-25T19:11:37.945 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-25T19:11:37.945 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-25T19:11:37.945 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-25T19:11:37.945 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-25T19:11:37.945 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-25T19:11:37.945 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-25T19:11:37.946 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-25T19:11:37.946 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-25T19:11:37.946 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-25T19:11:37.946 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-25T19:11:37.946 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-25T19:11:37.946 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-25T19:11:37.946 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-25T19:11:37.946 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-25T19:11:37.946 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-25T19:11:37.946 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-25T19:11:37.946 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-25T19:11:37.946 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-25T19:11:37.946 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-25T19:11:37.946 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-25T19:11:37.947 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-25T19:11:37.947 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-25T19:11:37.947 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-25T19:11:37.947 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-25T19:11:37.947 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-25T19:11:37.947 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-25T19:11:37.947 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-25T19:11:37.947 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-25T19:11:37.947 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-25T19:11:37.947 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-25T19:11:37.947 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-25T19:11:37.947 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-25T19:11:37.947 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-25T19:11:37.948 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-25T19:11:37.948 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-25T19:11:37.948 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-25T19:11:37.948 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-25T19:11:37.948 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-25T19:11:37.948 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-25T19:11:37.948 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-25T19:11:37.948 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-25T19:11:37.948 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-25T19:11:37.948 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-25T19:11:37.948 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-25T19:11:37.948 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-25T19:11:37.948 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-25T19:11:37.948 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-25T19:11:37.949 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-25T19:11:37.949 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-25T19:11:37.949 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-25T19:11:37.949 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-25T19:11:37.949 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-25T19:11:37.949 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-25T19:11:37.949 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-25T19:11:37.949 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-25T19:11:37.949 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-25T19:11:37.949 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-25T19:11:37.949 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-25T19:11:37.949 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-25T19:11:37.949 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-25T19:11:37.949 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-25T19:11:37.950 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-25T19:11:37.950 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-25T19:11:37.950 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-25T19:11:37.950 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-25T19:11:37.950 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-25T19:11:37.950 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-25T19:11:37.950 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-25T19:11:37.950 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-25T19:11:37.950 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-25T19:11:37.950 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-25T19:11:37.951 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-25T19:11:37.951 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-25T19:11:37.951 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-25T19:11:37.951 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-25T19:11:37.951 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-25T19:11:37.951 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-25T19:11:37.951 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-25T19:11:37.951 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-25T19:11:37.951 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-25T19:11:37.951 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-25T19:11:37.951 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-25T19:11:37.951 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-25T19:11:37.952 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-25T19:11:37.952 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-25T19:11:37.952 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-25T19:11:37.952 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-25T19:11:37.952 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-25T19:11:37.952 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-25T19:11:37.952 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-25T19:11:37.952 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-25T19:11:37.952 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-25T19:11:37.952 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-25T19:11:37.952 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-25T19:11:37.952 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-25T19:11:37.952 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-25T19:11:37.952 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-25T19:11:37.953 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-25T19:11:37.953 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-25T19:11:37.953 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-25T19:11:37.953 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-25T19:11:37.953 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-25T19:11:37.953 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-25T19:11:37.953 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-25T19:11:37.953 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-25T19:11:37.953 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-25T19:11:37.953 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-25T19:11:37.954 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-25T19:11:37.954 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-25T19:11:37.954 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-25T19:11:37.954 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-25T19:11:37.954 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-25T19:11:37.954 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-25T19:11:37.954 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-25T19:11:37.954 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-25T19:11:37.954 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-25T19:11:37.954 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-25T19:11:37.954 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-25T19:11:37.955 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-25T19:11:37.955 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-25T19:11:37.955 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-25T19:11:37.955 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-25T19:11:37.955 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-25T19:11:37.955 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-25T19:11:37.955 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-25T19:11:37.955 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-25T19:11:37.955 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-25T19:11:37.955 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-25T19:11:37.955 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-25T19:11:37.956 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-25T19:11:37.956 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-25T19:11:37.956 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-25T19:11:37.956 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-25T19:11:37.956 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-25T19:11:37.956 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-25T19:11:37.956 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-25T19:11:37.956 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-25T19:11:37.956 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-25T19:11:37.956 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-25T19:11:37.956 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-25T19:11:37.956 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-25T19:11:37.956 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-25T19:11:37.957 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-25T19:11:37.957 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-25T19:11:37.957 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-25T19:11:37.957 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-25T19:11:37.957 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-25T19:11:37.957 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-25T19:11:37.957 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-25T19:11:37.957 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-25T19:11:37.957 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-25T19:11:37.958 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-25T19:11:37.958 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-25T19:11:37.958 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-25T19:11:37.958 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-25T19:11:37.958 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-25T19:11:37.958 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-25T19:11:37.958 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-25T19:11:37.958 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-25T19:11:37.958 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-25T19:11:37.958 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-25T19:11:37.958 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-25T19:11:37.958 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-25T19:11:37.959 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-25T19:11:37.959 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-25T19:11:37.959 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-25T19:11:37.959 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-25T19:11:37.959 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-25T19:11:37.959 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-25T19:11:37.959 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-25T19:11:37.959 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-25T19:11:37.959 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-25T19:11:37.959 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-25T19:11:37.959 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-25T19:11:37.959 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-25T19:11:37.960 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-25T19:11:37.960 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-25T19:11:37.960 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-25T19:11:37.960 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-25T19:11:37.960 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-25T19:11:37.960 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-25T19:11:37.960 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-25T19:11:37.960 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-25T19:11:37.960 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-25T19:11:37.960 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-25T19:11:37.960 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-25T19:11:37.961 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-25T19:11:37.961 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-25T19:11:37.961 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-25T19:11:37.961 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-25T19:11:37.961 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-25T19:11:37.961 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-25T19:11:37.961 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-25T19:11:37.961 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-25T19:11:37.961 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-25T19:11:37.961 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-25T19:11:37.961 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-25T19:11:37.961 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-25T19:11:37.961 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-25T19:11:37.962 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-25T19:11:37.962 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-25T19:11:37.962 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-25T19:11:37.962 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-25T19:11:37.962 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-25T19:11:37.962 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-25T19:11:37.962 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-25T19:11:37.962 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-25T19:11:37.962 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-25T19:11:37.962 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-25T19:11:37.962 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-25T19:11:37.962 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-25T19:11:37.963 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-25T19:11:37.963 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-25T19:11:37.963 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-25T19:11:37.963 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-25T19:11:37.963 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-25T19:11:37.963 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-25T19:11:37.963 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-25T19:11:37.963 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-25T19:11:37.963 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-25T19:11:37.963 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-25T19:11:37.963 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-25T19:11:37.963 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-25T19:11:37.963 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-25T19:11:37.963 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-25T19:11:37.963 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-25T19:11:37.964 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-25T19:11:37.964 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-25T19:11:37.964 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-25T19:11:37.964 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-25T19:11:37.964 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-25T19:11:37.964 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-25T19:11:37.964 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-25T19:11:37.964 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-25T19:11:37.964 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-25T19:11:37.964 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-25T19:11:37.964 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-25T19:11:37.964 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-25T19:11:37.964 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-25T19:11:37.964 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-25T19:11:37.965 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-25T19:11:37.965 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-25T19:11:37.965 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-25T19:11:37.965 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-25T19:11:37.965 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-25T19:11:37.965 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-25T19:11:37.965 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-25T19:11:37.965 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-25T19:11:37.965 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-25T19:11:37.965 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-25T19:11:37.965 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-25T19:11:37.965 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-25T19:11:37.965 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-25T19:11:37.965 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-25T19:11:37.966 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-25T19:11:37.966 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-25T19:11:37.966 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-25T19:11:37.966 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-25T19:11:37.966 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-25T19:11:37.966 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-25T19:11:37.966 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-25T19:11:37.966 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-25T19:11:37.966 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-25T19:11:37.966 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-25T19:11:37.966 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-25T19:11:37.967 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-25T19:11:37.967 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-25T19:11:37.967 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-25T19:11:37.967 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-25T19:11:37.967 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-25T19:11:37.967 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-25T19:11:37.967 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-25T19:11:37.967 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-25T19:11:37.967 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-25T19:11:37.967 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-25T19:11:37.967 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-25T19:11:37.967 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-25T19:11:37.967 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-25T19:11:37.967 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-25T19:11:37.968 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-25T19:11:37.968 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-25T19:11:37.968 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-25T19:11:37.968 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-25T19:11:37.968 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-25T19:11:37.968 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-25T19:11:37.968 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-25T19:11:37.968 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-25T19:11:37.968 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-25T19:11:37.968 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-25T19:11:37.968 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-25T19:11:37.968 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-25T19:11:37.968 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-25T19:11:37.968 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-25T19:11:37.969 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-25T19:11:37.969 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-25T19:11:37.969 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-25T19:11:37.969 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-25T19:11:37.969 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-25T19:11:37.969 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-25T19:11:37.969 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-25T19:11:37.969 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-25T19:11:37.969 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-25T19:11:37.969 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-25T19:11:37.969 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-25T19:11:37.969 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-25T19:11:37.970 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-25T19:11:37.970 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-25T19:11:37.970 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-25T19:11:37.970 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-25T19:11:37.970 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-25T19:11:37.970 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-25T19:11:37.970 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-25T19:11:37.970 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-25T19:11:37.970 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-25T19:11:37.970 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-25T19:11:37.970 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-25T19:11:37.970 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-25T19:11:37.970 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-25T19:11:37.971 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-25T19:11:37.971 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-25T19:11:37.971 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-25T19:11:37.971 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-25T19:11:37.971 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-25T19:11:37.971 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-25T19:11:37.971 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-25T19:11:37.971 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-25T19:11:37.971 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-25T19:11:37.971 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-25T19:11:37.971 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-25T19:11:37.971 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-25T19:11:37.972 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-25T19:11:37.972 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-25T19:11:37.972 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-25T19:11:37.972 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-25T19:11:37.972 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-25T19:11:37.972 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-25T19:11:37.972 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-25T19:11:37.972 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-25T19:11:37.972 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-25T19:11:37.972 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-25T19:11:37.972 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-25T19:11:37.972 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-25T19:11:37.973 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-25T19:11:37.973 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-25T19:11:37.973 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-25T19:11:37.973 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-25T19:11:37.973 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-25T19:11:37.973 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-25T19:11:37.973 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-25T19:11:37.973 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-25T19:11:37.973 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-25T19:11:37.973 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-25T19:11:37.973 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-25T19:11:37.973 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-25T19:11:37.973 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-25T19:11:37.973 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-25T19:11:37.973 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-25T19:11:37.974 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-25T19:11:37.974 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-25T19:11:37.974 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-25T19:11:37.974 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-25T19:11:37.974 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-25T19:11:37.974 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-25T19:11:37.974 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-25T19:11:37.974 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-25T19:11:37.974 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-25T19:11:37.974 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-25T19:11:37.974 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-25T19:11:37.974 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-25T19:11:37.975 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-25T19:11:37.975 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-25T19:11:37.975 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-25T19:11:37.975 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-25T19:11:37.975 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-25T19:11:37.975 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-25T19:11:37.975 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-25T19:11:37.975 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-25T19:11:37.975 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-25T19:11:37.975 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-25T19:11:37.975 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-25T19:11:37.975 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-25T19:11:37.975 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-25T19:11:37.975 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-25T19:11:37.976 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-25T19:11:37.976 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-25T19:11:37.976 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-25T19:11:37.976 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-25T19:11:37.976 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-25T19:11:37.976 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-25T19:11:37.976 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-25T19:11:37.976 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-25T19:11:37.976 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-25T19:11:37.976 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-25T19:11:37.976 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-25T19:11:37.976 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-25T19:11:37.976 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-25T19:11:37.976 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-25T19:11:37.977 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-25T19:11:37.977 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-25T19:11:37.977 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-25T19:11:37.977 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-25T19:11:37.977 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-25T19:11:37.977 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-25T19:11:37.977 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-25T19:11:37.977 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-25T19:11:37.977 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-25T19:11:37.977 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-25T19:11:37.977 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-25T19:11:37.977 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-25T19:11:37.977 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-25T19:11:37.977 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-25T19:11:37.978 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-25T19:11:37.978 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-25T19:11:37.978 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-25T19:11:37.978 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-25T19:11:37.978 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-25T19:11:37.978 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-25T19:11:37.978 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-25T19:11:37.978 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-25T19:11:37.978 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-25T19:11:37.978 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-25T19:11:37.978 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-25T19:11:37.978 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-25T19:11:37.978 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-25T19:11:37.978 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-25T19:11:37.979 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-25T19:11:37.979 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-25T19:11:37.979 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-25T19:11:37.979 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-25T19:11:37.979 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-25T19:11:37.979 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-25T19:11:37.979 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-25T19:11:37.979 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-25T19:11:37.979 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-25T19:11:37.979 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-25T19:11:37.979 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-25T19:11:37.979 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-25T19:11:37.979 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-25T19:11:37.979 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-25T19:11:37.980 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-25T19:11:37.980 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-25T19:11:37.980 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-25T19:11:37.980 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-25T19:11:37.980 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-25T19:11:37.980 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-25T19:11:37.980 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-25T19:11:37.980 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-25T19:11:37.980 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-25T19:11:37.980 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-25T19:11:37.980 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-25T19:11:37.980 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-25T19:11:37.980 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-25T19:11:37.980 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-25T19:11:37.981 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-25T19:11:37.981 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-25T19:11:37.981 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-25T19:11:37.981 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-25T19:11:37.981 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-25T19:11:37.981 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-25T19:11:37.981 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-25T19:11:37.981 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-25T19:11:37.981 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-25T19:11:37.981 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-25T19:11:37.981 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-25T19:11:37.981 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-25T19:11:37.981 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-25T19:11:37.981 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-25T19:11:37.982 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-25T19:11:37.982 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-25T19:11:37.982 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-25T19:11:37.982 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-25T19:11:37.982 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-25T19:11:37.982 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-25T19:11:37.982 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-25T19:11:37.982 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-25T19:11:37.982 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-25T19:11:37.982 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-25T19:11:37.982 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-25T19:11:37.982 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-25T19:11:37.982 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-25T19:11:37.982 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-25T19:11:37.983 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-25T19:11:37.983 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-25T19:11:37.983 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-25T19:11:37.983 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-25T19:11:37.983 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-25T19:11:37.983 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-25T19:11:37.983 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-25T19:11:37.983 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-25T19:11:37.983 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-25T19:11:37.983 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-25T19:11:37.983 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-25T19:11:37.983 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-25T19:11:37.983 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-25T19:11:37.983 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-25T19:11:37.983 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-25T19:11:37.984 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-25T19:11:37.984 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-25T19:11:37.984 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-25T19:11:37.984 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-25T19:11:37.984 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-25T19:11:37.984 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-25T19:11:37.984 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-25T19:11:37.984 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-25T19:11:37.984 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-25T19:11:37.984 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-25T19:11:37.984 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-25T19:11:37.984 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-25T19:11:37.984 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-25T19:11:37.984 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-25T19:11:37.985 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-25T19:11:37.985 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-25T19:11:37.985 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-25T19:11:37.985 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-25T19:11:37.985 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-25T19:11:37.985 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-25T19:11:37.985 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-25T19:11:37.985 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-25T19:11:37.985 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-25T19:11:37.985 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-25T19:11:37.985 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-25T19:11:37.985 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-25T19:11:37.985 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-25T19:11:37.985 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-25T19:11:37.986 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-25T19:11:37.986 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-25T19:11:37.986 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-25T19:11:37.986 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-25T19:11:37.986 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-25T19:11:37.986 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-25T19:11:37.986 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-25T19:11:37.986 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-25T19:11:37.986 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-25T19:11:37.986 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-25T19:11:37.986 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-25T19:11:37.986 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-25T19:11:37.986 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-25T19:11:37.986 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-25T19:11:37.987 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-25T19:11:37.987 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-25T19:11:37.987 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-25T19:11:37.987 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-25T19:11:37.987 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-25T19:11:37.987 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-25T19:11:37.987 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-25T19:11:37.987 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-25T19:11:37.987 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-25T19:11:37.987 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-25T19:11:37.988 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-25T19:11:37.988 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-25T19:11:37.988 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-25T19:11:37.988 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-25T19:11:37.988 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-25T19:11:37.988 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-25T19:11:37.988 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-25T19:11:37.988 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-25T19:11:37.988 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-25T19:11:37.988 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-25T19:11:37.988 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-25T19:11:37.988 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-25T19:11:37.988 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-25T19:11:37.988 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-25T19:11:37.989 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-25T19:11:37.989 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-25T19:11:37.989 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-25T19:11:37.989 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-25T19:11:37.989 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-25T19:11:37.989 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-25T19:11:37.989 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-25T19:11:37.989 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-25T19:11:37.989 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-25T19:11:37.989 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-25T19:11:37.989 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-25T19:11:37.989 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-25T19:11:37.989 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-25T19:11:37.989 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-25T19:11:37.990 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-25T19:11:37.990 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-25T19:11:37.990 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-25T19:11:37.990 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-25T19:11:37.990 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-25T19:11:37.990 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-25T19:11:37.990 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-25T19:11:37.990 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-25T19:11:37.990 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-25T19:11:37.990 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-25T19:11:37.990 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-25T19:11:37.990 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-25T19:11:37.991 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-25T19:11:37.991 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-25T19:11:37.991 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-25T19:11:37.991 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-25T19:11:37.991 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-25T19:11:37.991 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-25T19:11:37.991 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-25T19:11:37.991 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-25T19:11:37.991 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-25T19:11:37.991 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-25T19:11:37.991 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-25T19:11:37.991 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-25T19:11:37.991 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-25T19:11:37.991 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-25T19:11:37.992 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-25T19:11:37.992 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-25T19:11:37.992 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-25T19:11:37.992 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-25T19:11:37.992 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-25T19:11:37.992 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-25T19:11:37.992 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-25T19:11:37.992 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-25T19:11:37.992 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-25T19:11:37.992 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-25T19:11:37.992 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-25T19:11:37.992 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-25T19:11:37.993 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-25T19:11:37.993 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-25T19:11:37.993 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-25T19:11:37.993 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-25T19:11:37.993 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-25T19:11:37.993 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-25T19:11:37.993 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-25T19:11:37.993 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-25T19:11:37.993 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-25T19:11:37.993 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-25T19:11:37.993 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-25T19:11:37.993 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-25T19:11:37.994 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-25T19:11:37.994 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-25T19:11:37.994 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-25T19:11:37.994 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-25T19:11:37.994 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-25T19:11:37.994 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-25T19:11:37.994 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-25T19:11:37.994 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-25T19:11:37.994 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-25T19:11:37.994 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-25T19:11:37.995 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-25T19:11:37.995 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-25T19:11:37.995 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-25T19:11:37.995 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-25T19:11:37.995 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-25T19:11:37.995 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-25T19:11:37.995 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-25T19:11:37.995 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-25T19:11:37.995 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-25T19:11:37.995 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-25T19:11:37.995 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-25T19:11:37.995 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-25T19:11:37.996 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-25T19:11:37.996 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-25T19:11:37.996 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-25T19:11:37.996 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-25T19:11:37.996 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-25T19:11:37.996 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-25T19:11:37.996 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-25T19:11:37.996 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-25T19:11:37.996 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-25T19:11:37.996 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-25T19:11:37.996 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-25T19:11:37.996 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-25T19:11:37.997 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-25T19:11:37.997 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-25T19:11:37.997 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-25T19:11:37.997 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-25T19:11:37.997 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-25T19:11:37.997 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-25T19:11:37.997 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-25T19:11:37.997 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-25T19:11:37.997 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-25T19:11:37.997 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-25T19:11:37.997 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-25T19:11:37.997 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-25T19:11:37.998 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-25T19:11:37.998 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-25T19:11:37.998 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-25T19:11:37.998 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-25T19:11:37.998 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-25T19:11:37.998 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-25T19:11:37.998 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-25T19:11:37.998 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-25T19:11:37.998 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-25T19:11:37.998 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-25T19:11:37.998 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-25T19:11:37.999 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-25T19:11:37.999 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-25T19:11:37.999 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-25T19:11:37.999 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-25T19:11:37.999 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-25T19:11:37.999 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-25T19:11:37.999 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-25T19:11:37.999 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-25T19:11:37.999 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-25T19:11:37.999 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-25T19:11:37.999 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-25T19:11:37.999 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-25T19:11:37.999 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-25T19:11:38.000 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-25T19:11:38.000 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-25T19:11:38.000 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-25T19:11:38.000 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-25T19:11:38.000 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-25T19:11:38.000 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-25T19:11:38.000 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-25T19:11:38.000 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-25T19:11:38.000 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-25T19:11:38.000 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-25T19:11:38.000 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-25T19:11:38.000 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-25T19:11:38.000 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-25T19:11:38.000 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-25T19:11:38.000 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-25T19:11:38.000 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-25T19:11:38.001 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-25T19:11:38.001 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-25T19:11:38.001 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-25T19:11:38.001 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-25T19:11:38.001 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-25T19:11:38.001 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-25T19:11:38.001 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-25T19:11:38.001 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-25T19:11:38.001 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-25T19:11:38.001 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-25T19:11:38.001 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-25T19:11:38.001 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-25T19:11:38.001 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-25T19:11:38.001 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-25T19:11:38.002 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-25T19:11:38.002 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-25T19:11:38.002 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-25T19:11:38.002 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-25T19:11:38.002 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-25T19:11:38.002 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-25T19:11:38.002 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-25T19:11:38.002 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-25T19:11:38.002 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-25T19:11:38.002 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-25T19:11:38.002 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-25T19:11:38.002 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-25T19:11:38.002 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-25T19:11:38.003 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-25T19:11:38.003 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-25T19:11:38.003 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-25T19:11:38.003 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-25T19:11:38.003 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-25T19:11:38.003 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-25T19:11:38.003 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-25T19:11:38.003 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-25T19:11:38.003 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-25T19:11:38.003 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-25T19:11:38.003 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-25T19:11:38.003 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-25T19:11:38.003 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-25T19:11:38.003 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-25T19:11:38.004 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-25T19:11:38.004 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-25T19:11:38.004 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-25T19:11:38.004 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-25T19:11:38.004 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-25T19:11:38.004 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-25T19:11:38.004 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-25T19:11:38.004 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-25T19:11:38.004 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-25T19:11:38.004 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-25T19:11:38.004 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-25T19:11:38.004 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-25T19:11:38.005 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-25T19:11:38.005 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-25T19:11:38.005 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-25T19:11:38.005 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-25T19:11:38.005 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-25T19:11:38.005 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-25T19:11:38.005 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-25T19:11:38.005 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-25T19:11:38.005 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-25T19:11:38.005 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-25T19:11:38.005 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-25T19:11:38.005 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-25T19:11:38.006 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-25T19:11:38.006 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-25T19:11:38.006 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-25T19:11:38.006 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-25T19:11:38.006 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-25T19:11:38.006 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-25T19:11:38.006 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-25T19:11:38.006 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-25T19:11:38.006 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-25T19:11:38.006 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-25T19:11:38.006 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-25T19:11:38.006 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-25T19:11:38.006 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-25T19:11:38.007 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-25T19:11:38.007 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-25T19:11:38.007 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-25T19:11:38.007 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-25T19:11:38.007 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-25T19:11:38.007 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-25T19:11:38.007 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-25T19:11:38.007 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-25T19:11:38.007 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-25T19:11:38.007 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-25T19:11:38.007 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-25T19:11:38.007 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-25T19:11:38.008 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-25T19:11:38.008 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-25T19:11:38.008 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-25T19:11:38.008 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-25T19:11:38.008 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-25T19:11:38.008 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-25T19:11:38.008 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-25T19:11:38.008 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-25T19:11:38.008 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-25T19:11:38.008 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-25T19:11:38.008 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-25T19:11:38.008 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-25T19:11:38.008 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-25T19:11:38.008 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-25T19:11:38.008 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-25T19:11:38.009 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-25T19:11:38.009 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-25T19:11:38.009 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-25T19:11:38.009 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-25T19:11:38.009 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-25T19:11:38.009 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-25T19:11:38.009 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-25T19:11:38.009 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-25T19:11:38.009 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-25T19:11:38.009 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-25T19:11:38.009 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-25T19:11:38.009 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-25T19:11:38.009 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-25T19:11:38.010 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-25T19:11:38.010 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-25T19:11:38.010 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-25T19:11:38.010 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-25T19:11:38.010 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-25T19:11:38.010 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-25T19:11:38.010 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-25T19:11:38.010 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-25T19:11:38.010 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-25T19:11:38.010 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-25T19:11:38.010 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-25T19:11:38.010 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-25T19:11:38.010 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-25T19:11:38.011 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-25T19:11:38.011 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-25T19:11:38.011 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-25T19:11:38.011 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-25T19:11:38.011 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-25T19:11:38.011 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-25T19:11:38.011 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-25T19:11:38.011 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-25T19:11:38.011 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-25T19:11:38.011 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-25T19:11:38.011 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-25T19:11:38.011 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-25T19:11:38.011 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-25T19:11:38.012 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-25T19:11:38.012 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-25T19:11:38.012 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-25T19:11:38.012 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-25T19:11:38.012 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-25T19:11:38.012 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-25T19:11:38.012 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-25T19:11:38.012 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-25T19:11:38.012 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-25T19:11:38.012 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-25T19:11:38.012 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-25T19:11:38.012 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-25T19:11:38.012 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-25T19:11:38.013 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-25T19:11:38.013 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-25T19:11:38.013 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-25T19:11:38.013 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-25T19:11:38.013 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-25T19:11:38.013 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-25T19:11:38.013 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-25T19:11:38.013 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-25T19:11:38.013 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-25T19:11:38.013 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-25T19:11:38.013 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-25T19:11:38.013 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-25T19:11:38.014 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-25T19:11:38.014 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-25T19:11:38.014 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-25T19:11:38.014 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-25T19:11:38.014 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-25T19:11:38.014 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-25T19:11:38.014 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-25T19:11:38.014 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-25T19:11:38.014 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-25T19:11:38.014 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-25T19:11:38.014 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-25T19:11:38.014 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-25T19:11:38.015 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-25T19:11:38.015 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-25T19:11:38.015 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-25T19:11:38.015 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-25T19:11:38.015 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-25T19:11:38.015 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-25T19:11:38.015 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-25T19:11:38.015 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-25T19:11:38.015 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-25T19:11:38.015 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-25T19:11:38.015 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-25T19:11:38.015 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-25T19:11:38.015 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-25T19:11:38.015 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-25T19:11:38.015 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-25T19:11:38.016 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-25T19:11:38.016 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-25T19:11:38.016 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-25T19:11:38.016 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-25T19:11:38.016 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-25T19:11:38.016 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-25T19:11:38.016 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-25T19:11:38.016 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-25T19:11:38.016 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-25T19:11:38.016 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-25T19:11:38.016 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-25T19:11:38.016 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-25T19:11:38.016 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-25T19:11:38.016 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-25T19:11:38.017 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-25T19:11:38.017 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-25T19:11:38.017 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-25T19:11:38.017 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-25T19:11:38.017 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-25T19:11:38.017 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-25T19:11:38.017 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-25T19:11:38.017 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-25T19:11:38.017 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-25T19:11:38.017 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-25T19:11:38.017 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-25T19:11:38.017 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-25T19:11:38.017 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-25T19:11:38.017 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-25T19:11:38.018 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-25T19:11:38.018 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-25T19:11:38.018 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-25T19:11:38.018 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-25T19:11:38.018 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-25T19:11:38.018 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-25T19:11:38.018 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-25T19:11:38.018 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-25T19:11:38.018 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-25T19:11:38.018 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-25T19:11:38.018 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-25T19:11:38.018 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-25T19:11:38.018 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-25T19:11:38.018 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-25T19:11:38.019 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-25T19:11:38.019 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-25T19:11:38.019 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-25T19:11:38.019 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-25T19:11:38.019 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-25T19:11:38.019 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-25T19:11:38.019 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-25T19:11:38.019 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-25T19:11:38.019 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-25T19:11:38.019 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-25T19:11:38.019 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-25T19:11:38.019 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-25T19:11:38.019 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-25T19:11:38.019 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-25T19:11:38.020 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-25T19:11:38.020 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-25T19:11:38.020 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-25T19:11:38.020 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-25T19:11:38.020 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-25T19:11:38.020 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-25T19:11:38.020 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-25T19:11:38.020 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-25T19:11:38.020 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-25T19:11:38.020 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-25T19:11:38.020 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-25T19:11:38.020 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-25T19:11:38.020 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-25T19:11:38.020 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-25T19:11:38.020 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-25T19:11:38.021 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-25T19:11:38.021 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-25T19:11:38.021 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-25T19:11:38.021 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-25T19:11:38.021 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-25T19:11:38.021 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-25T19:11:38.021 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-25T19:11:38.021 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-25T19:11:38.021 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-25T19:11:38.021 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-25T19:11:38.021 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-25T19:11:38.021 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-25T19:11:38.021 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-25T19:11:38.021 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-25T19:11:38.021 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-25T19:11:38.022 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-25T19:11:38.022 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-25T19:11:38.022 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-25T19:11:38.022 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-25T19:11:38.022 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-25T19:11:38.022 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-25T19:11:38.022 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-25T19:11:38.022 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-25T19:11:38.022 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-25T19:11:38.022 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-25T19:11:38.022 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-25T19:11:38.022 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-25T19:11:38.022 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-25T19:11:38.023 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-25T19:11:38.023 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-25T19:11:38.023 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-25T19:11:38.023 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-25T19:11:38.023 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-25T19:11:38.023 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-25T19:11:38.023 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-25T19:11:38.023 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-25T19:11:38.023 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-25T19:11:38.023 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-25T19:11:38.023 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-25T19:11:38.023 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-25T19:11:38.023 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-25T19:11:38.023 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-25T19:11:38.023 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-25T19:11:38.024 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-25T19:11:38.024 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-25T19:11:38.024 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-25T19:11:38.024 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-25T19:11:38.024 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-25T19:11:38.024 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-25T19:11:38.024 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-25T19:11:38.024 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-25T19:11:38.024 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-25T19:11:38.024 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-25T19:11:38.024 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-25T19:11:38.024 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-25T19:11:38.024 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-25T19:11:38.024 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-25T19:11:38.024 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-25T19:11:38.025 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-25T19:11:38.025 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-25T19:11:38.025 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-25T19:11:38.025 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-25T19:11:38.025 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-25T19:11:38.025 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-25T19:11:38.025 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-25T19:11:38.025 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-25T19:11:38.025 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-25T19:11:38.026 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-25T19:11:38.026 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-25T19:11:38.026 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-25T19:11:38.026 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-25T19:11:38.026 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-25T19:11:38.026 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-25T19:11:38.026 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-25T19:11:38.026 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-25T19:11:38.026 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-25T19:11:38.026 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-25T19:11:38.026 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-25T19:11:38.026 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-25T19:11:38.026 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-25T19:11:38.026 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-25T19:11:38.027 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-25T19:11:38.027 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-25T19:11:38.027 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-25T19:11:38.027 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-25T19:11:38.027 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-25T19:11:38.027 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-25T19:11:38.027 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-25T19:11:38.027 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-25T19:11:38.027 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-25T19:11:38.027 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-25T19:11:38.028 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-25T19:11:38.028 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-25T19:11:38.028 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-25T19:11:38.028 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-25T19:11:38.028 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-25T19:11:38.028 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-25T19:11:38.028 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-25T19:11:38.028 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-25T19:11:38.028 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-25T19:11:38.028 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-25T19:11:38.028 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-25T19:11:38.028 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-25T19:11:38.028 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-25T19:11:38.028 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-25T19:11:38.029 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-25T19:11:38.029 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-25T19:11:38.029 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-25T19:11:38.029 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-25T19:11:38.029 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-25T19:11:38.029 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-25T19:11:38.029 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-25T19:11:38.029 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-25T19:11:38.029 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-25T19:11:38.029 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-25T19:11:38.029 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-25T19:11:38.030 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-25T19:11:38.030 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-25T19:11:38.030 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-25T19:11:38.030 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-25T19:11:38.030 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-25T19:11:38.030 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-25T19:11:38.030 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-25T19:11:38.030 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-25T19:11:38.030 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-25T19:11:38.030 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-25T19:11:38.030 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-25T19:11:38.030 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-25T19:11:38.031 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-25T19:11:38.031 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-25T19:11:38.031 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-25T19:11:38.031 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-25T19:11:38.031 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-25T19:11:38.031 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-25T19:11:38.031 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-25T19:11:38.031 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-25T19:11:38.031 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-25T19:11:38.031 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-25T19:11:38.031 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-25T19:11:38.032 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-25T19:11:38.032 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-25T19:11:38.032 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-25T19:11:38.032 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-25T19:11:38.032 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-25T19:11:38.032 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-25T19:11:38.032 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-25T19:11:38.032 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-25T19:11:38.032 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-25T19:11:38.032 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-25T19:11:38.032 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-25T19:11:38.032 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-25T19:11:38.032 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-25T19:11:38.032 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-25T19:11:38.033 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-25T19:11:38.033 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-25T19:11:38.033 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-25T19:11:38.033 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-25T19:11:38.033 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-25T19:11:38.033 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-25T19:11:38.033 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-25T19:11:38.033 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-25T19:11:38.033 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-25T19:11:38.033 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-25T19:11:38.033 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-25T19:11:38.034 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-25T19:11:38.034 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-25T19:11:38.034 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-25T19:11:38.034 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-25T19:11:38.034 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-25T19:11:38.034 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-25T19:11:38.034 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-25T19:11:38.034 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-25T19:11:38.034 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-25T19:11:38.034 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-25T19:11:38.034 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-25T19:11:38.034 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-25T19:11:38.034 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-25T19:11:38.035 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-25T19:11:38.035 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-25T19:11:38.035 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-25T19:11:38.035 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-25T19:11:38.035 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-25T19:11:38.035 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-25T19:11:38.035 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-25T19:11:38.035 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-25T19:11:38.035 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-25T19:11:38.035 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-25T19:11:38.035 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-25T19:11:38.035 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-25T19:11:38.035 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-25T19:11:38.035 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-25T19:11:38.035 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-25T19:11:38.036 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-25T19:11:38.036 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-25T19:11:38.036 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-25T19:11:38.036 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-25T19:11:38.036 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-25T19:11:38.036 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-25T19:11:38.036 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-25T19:11:38.036 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-25T19:11:38.036 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-25T19:11:38.036 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-25T19:11:38.036 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-25T19:11:38.036 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-25T19:11:38.036 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-25T19:11:38.036 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-25T19:11:38.037 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-25T19:11:38.037 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-25T19:11:38.037 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-25T19:11:38.037 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-25T19:11:38.037 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-25T19:11:38.037 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-25T19:11:38.037 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-25T19:11:38.037 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-25T19:11:38.037 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-25T19:11:38.037 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-25T19:11:38.037 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-25T19:11:38.037 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-25T19:11:38.037 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-25T19:11:38.037 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-25T19:11:38.037 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-25T19:11:38.038 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-25T19:11:38.038 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-25T19:11:38.038 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-25T19:11:38.038 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-25T19:11:38.038 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-25T19:11:38.038 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-25T19:11:38.038 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-25T19:11:38.038 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-25T19:11:38.038 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-25T19:11:38.038 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-25T19:11:38.038 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-25T19:11:38.038 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-25T19:11:38.039 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-25T19:11:38.039 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-25T19:11:38.039 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-25T19:11:38.039 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-25T19:11:38.039 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-25T19:11:38.039 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-25T19:11:38.039 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-25T19:11:38.039 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-25T19:11:38.039 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-25T19:11:38.039 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-25T19:11:38.039 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-25T19:11:38.039 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-25T19:11:38.039 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-25T19:11:38.040 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-25T19:11:38.040 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-25T19:11:38.040 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-25T19:11:38.040 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-25T19:11:38.040 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-25T19:11:38.040 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-25T19:11:38.040 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-25T19:11:38.040 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-25T19:11:38.040 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-25T19:11:38.040 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-25T19:11:38.040 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-25T19:11:38.040 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-25T19:11:38.041 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-25T19:11:38.041 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-25T19:11:38.041 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-25T19:11:38.041 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-25T19:11:38.041 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-25T19:11:38.041 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-25T19:11:38.041 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-25T19:11:38.041 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-25T19:11:38.041 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-25T19:11:38.041 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-25T19:11:38.041 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-25T19:11:38.041 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-25T19:11:38.041 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-25T19:11:38.041 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-25T19:11:38.041 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-25T19:11:38.042 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-25T19:11:38.042 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-25T19:11:38.042 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-25T19:11:38.042 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-25T19:11:38.042 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-25T19:11:38.042 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-25T19:11:38.042 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-25T19:11:38.042 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-25T19:11:38.042 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-25T19:11:38.042 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-25T19:11:38.042 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-25T19:11:38.043 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-25T19:11:38.043 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-25T19:11:38.043 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-25T19:11:38.043 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-25T19:11:38.043 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-25T19:11:38.043 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-25T19:11:38.043 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-25T19:11:38.043 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-25T19:11:38.043 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-25T19:11:38.043 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-25T19:11:38.043 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-25T19:11:38.043 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-25T19:11:38.043 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-25T19:11:38.044 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-25T19:11:38.044 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-25T19:11:38.044 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-25T19:11:38.044 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-25T19:11:38.044 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-25T19:11:38.044 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-25T19:11:38.044 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-25T19:11:38.044 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-25T19:11:38.044 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-25T19:11:38.044 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-25T19:11:38.044 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-25T19:11:38.044 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-25T19:11:38.044 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-25T19:11:38.044 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-25T19:11:38.044 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-25T19:11:38.045 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-25T19:11:38.045 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-25T19:11:38.045 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-25T19:11:38.045 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-25T19:11:38.045 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-25T19:11:38.045 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-25T19:11:38.045 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-25T19:11:38.045 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-25T19:11:38.045 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-25T19:11:38.045 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-25T19:11:38.045 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-25T19:11:38.045 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-25T19:11:38.046 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-25T19:11:38.046 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-25T19:11:38.046 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-25T19:11:38.046 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-25T19:11:38.046 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-25T19:11:38.046 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-25T19:11:38.046 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-25T19:11:38.046 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-25T19:11:38.046 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-25T19:11:38.046 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-25T19:11:38.046 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-25T19:11:38.046 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-25T19:11:38.046 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-25T19:11:38.046 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-25T19:11:38.047 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-25T19:11:38.047 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-25T19:11:38.047 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-25T19:11:38.047 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-25T19:11:38.047 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-25T19:11:38.047 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-25T19:11:38.047 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-25T19:11:38.047 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-25T19:11:38.047 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-25T19:11:38.047 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-25T19:11:38.047 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-25T19:11:38.047 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-25T19:11:38.048 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-25T19:11:38.048 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-25T19:11:38.048 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-25T19:11:38.048 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-25T19:11:38.048 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-25T19:11:38.048 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-25T19:11:38.048 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-25T19:11:38.048 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-25T19:11:38.048 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-25T19:11:38.048 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-25T19:11:38.048 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-25T19:11:38.048 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-25T19:11:38.048 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-25T19:11:38.049 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-25T19:11:38.049 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-25T19:11:38.049 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-25T19:11:38.049 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-25T19:11:38.049 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-25T19:11:38.049 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-25T19:11:38.049 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-25T19:11:38.049 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-25T19:11:38.049 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-25T19:11:38.049 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-25T19:11:38.049 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-25T19:11:38.049 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-25T19:11:38.049 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-25T19:11:38.049 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-25T19:11:38.050 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-25T19:11:38.050 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-25T19:11:38.050 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-25T19:11:38.050 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-25T19:11:38.050 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-25T19:11:38.050 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-25T19:11:38.050 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-25T19:11:38.050 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-25T19:11:38.050 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-25T19:11:38.050 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-25T19:11:38.050 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-25T19:11:38.050 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-25T19:11:38.050 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-25T19:11:38.050 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-25T19:11:38.051 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-25T19:11:38.051 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-25T19:11:38.051 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-25T19:11:38.051 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-25T19:11:38.051 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-25T19:11:38.051 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-25T19:11:38.051 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-25T19:11:38.051 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-25T19:11:38.051 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-25T19:11:38.051 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-25T19:11:38.051 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-25T19:11:38.051 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-25T19:11:38.051 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-25T19:11:38.051 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-25T19:11:38.051 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-25T19:11:38.052 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-25T19:11:38.052 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-25T19:11:38.052 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-25T19:11:38.052 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-25T19:11:38.052 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-25T19:11:38.052 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-25T19:11:38.052 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-25T19:11:38.052 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-25T19:11:38.052 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-25T19:11:38.052 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-25T19:11:38.052 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-25T19:11:38.052 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-25T19:11:38.052 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-25T19:11:38.052 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-25T19:11:38.052 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-25T19:11:38.053 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-25T19:11:38.053 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-25T19:11:38.053 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-25T19:11:38.053 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-25T19:11:38.053 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-25T19:11:38.053 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-25T19:11:38.053 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-25T19:11:38.053 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-25T19:11:38.053 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-25T19:11:38.053 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-25T19:11:38.053 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-25T19:11:38.053 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-25T19:11:38.053 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-25T19:11:38.053 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-25T19:11:38.053 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-25T19:11:38.054 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-25T19:11:38.054 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-25T19:11:38.054 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-25T19:11:38.054 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-25T19:11:38.054 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-25T19:11:38.054 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-25T19:11:38.054 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-25T19:11:38.054 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-25T19:11:38.054 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-25T19:11:38.054 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-25T19:11:38.054 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-25T19:11:38.054 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-25T19:11:38.054 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-25T19:11:38.054 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-25T19:11:38.055 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-25T19:11:38.055 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-25T19:11:38.055 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-25T19:11:38.055 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-25T19:11:38.055 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-25T19:11:38.055 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-25T19:11:38.055 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-25T19:11:38.055 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-25T19:11:38.055 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-25T19:11:38.055 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-25T19:11:38.055 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-25T19:11:38.055 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-25T19:11:38.055 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-25T19:11:38.055 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-25T19:11:38.056 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-25T19:11:38.056 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-25T19:11:38.056 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-25T19:11:38.056 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-25T19:11:38.056 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-25T19:11:38.056 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-25T19:11:38.056 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-25T19:11:38.056 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-25T19:11:38.056 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-25T19:11:38.056 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-25T19:11:38.056 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-25T19:11:38.056 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-25T19:11:38.056 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-25T19:11:38.056 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-25T19:11:38.057 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-25T19:11:38.057 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-25T19:11:38.057 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-25T19:11:38.057 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-25T19:11:38.057 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-25T19:11:38.057 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-25T19:11:38.057 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-25T19:11:38.057 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-25T19:11:38.057 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-25T19:11:38.057 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-25T19:11:38.057 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-25T19:11:38.057 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-25T19:11:38.057 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-25T19:11:38.057 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-25T19:11:38.057 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-25T19:11:38.057 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-25T19:11:38.058 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-25T19:11:38.058 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-25T19:11:38.058 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-25T19:11:38.058 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-25T19:11:38.058 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-25T19:11:38.058 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-25T19:11:38.058 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-25T19:11:38.058 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-25T19:11:38.058 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-25T19:11:38.058 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-25T19:11:38.058 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-25T19:11:38.058 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-25T19:11:38.058 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-25T19:11:38.058 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-25T19:11:38.059 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-25T19:11:38.059 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-25T19:11:38.059 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-25T19:11:38.059 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-25T19:11:38.059 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-25T19:11:38.059 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-25T19:11:38.059 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-25T19:11:38.059 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-25T19:11:38.059 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-25T19:11:38.059 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-25T19:11:38.059 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-25T19:11:38.059 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-25T19:11:38.059 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-25T19:11:38.059 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-25T19:11:38.060 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-25T19:11:38.060 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-25T19:11:38.060 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-25T19:11:38.060 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-25T19:11:38.060 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-25T19:11:38.060 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-25T19:11:38.060 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-25T19:11:38.060 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-25T19:11:38.060 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-25T19:11:38.060 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-25T19:11:38.061 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-25T19:11:38.061 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-25T19:11:38.061 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-25T19:11:38.061 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-25T19:11:38.061 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-25T19:11:38.061 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-25T19:11:38.061 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-25T19:11:38.061 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-25T19:11:38.061 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-25T19:11:38.061 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-25T19:11:38.061 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-25T19:11:38.061 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-25T19:11:38.061 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-25T19:11:38.061 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-25T19:11:38.062 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-25T19:11:38.062 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-25T19:11:38.062 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-25T19:11:38.062 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-25T19:11:38.062 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-25T19:11:38.062 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-25T19:11:38.062 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-25T19:11:38.062 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-25T19:11:38.062 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-25T19:11:38.062 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-25T19:11:38.062 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-25T19:11:38.063 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-25T19:11:38.063 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-25T19:11:38.063 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-25T19:11:38.063 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-25T19:11:38.063 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-25T19:11:38.063 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-25T19:11:38.063 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-25T19:11:38.063 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-25T19:11:38.063 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-25T19:11:38.063 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-25T19:11:38.063 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-25T19:11:38.063 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-25T19:11:38.063 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-25T19:11:38.064 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-25T19:11:38.064 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-25T19:11:38.064 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-25T19:11:38.064 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-25T19:11:38.064 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-25T19:11:38.064 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-25T19:11:38.064 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-25T19:11:38.064 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-25T19:11:38.064 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-25T19:11:38.064 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-25T19:11:38.064 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-25T19:11:38.064 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-25T19:11:38.064 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-25T19:11:38.064 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-25T19:11:38.065 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-25T19:11:38.065 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-25T19:11:38.065 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-25T19:11:38.065 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-25T19:11:38.065 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-25T19:11:38.065 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-25T19:11:38.065 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-25T19:11:38.065 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-25T19:11:38.065 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-25T19:11:38.065 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-25T19:11:38.065 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-25T19:11:38.065 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-25T19:11:38.065 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-25T19:11:38.065 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-25T19:11:38.065 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-25T19:11:38.066 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-25T19:11:38.066 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-25T19:11:38.066 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-25T19:11:38.066 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-25T19:11:38.066 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-25T19:11:38.066 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-25T19:11:38.066 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-25T19:11:38.066 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-25T19:11:38.066 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-25T19:11:38.066 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-25T19:11:38.066 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-25T19:11:38.066 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-25T19:11:38.066 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-25T19:11:38.067 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-25T19:11:38.067 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-25T19:11:38.067 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-25T19:11:38.067 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-25T19:11:38.067 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-25T19:11:38.067 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-25T19:11:38.067 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-25T19:11:38.067 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-25T19:11:38.067 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-25T19:11:38.067 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-25T19:11:38.068 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-25T19:11:38.068 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-25T19:11:38.068 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-25T19:11:38.068 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-25T19:11:38.068 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-25T19:11:38.068 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-25T19:11:38.068 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-25T19:11:38.068 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-25T19:11:38.068 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-25T19:11:38.068 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-25T19:11:38.068 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-25T19:11:38.068 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-25T19:11:38.068 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-25T19:11:38.069 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-25T19:11:38.069 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-25T19:11:38.069 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-25T19:11:38.069 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-25T19:11:38.069 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-25T19:11:38.069 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-25T19:11:38.069 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-25T19:11:38.069 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-25T19:11:38.069 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-25T19:11:38.069 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-25T19:11:38.070 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-25T19:11:38.070 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-25T19:11:38.070 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-25T19:11:38.070 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-25T19:11:38.070 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-25T19:11:38.070 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-25T19:11:38.070 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-25T19:11:38.070 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-25T19:11:38.070 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-25T19:11:38.070 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-25T19:11:38.070 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-25T19:11:38.070 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-25T19:11:38.071 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-25T19:11:38.071 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-25T19:11:38.071 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-25T19:11:38.071 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-25T19:11:38.071 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-25T19:11:38.071 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-25T19:11:38.071 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-25T19:11:38.071 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-25T19:11:38.071 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-25T19:11:38.071 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-25T19:11:38.071 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-25T19:11:38.071 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-25T19:11:38.071 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-25T19:11:38.071 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-25T19:11:38.071 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-25T19:11:38.072 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-25T19:11:38.072 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-25T19:11:38.072 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-25T19:11:38.072 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-25T19:11:38.072 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-25T19:11:38.072 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-25T19:11:38.072 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-25T19:11:38.072 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-25T19:11:38.072 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-25T19:11:38.072 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-25T19:11:38.072 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-25T19:11:38.072 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-25T19:11:38.072 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-25T19:11:38.072 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-25T19:11:38.073 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-25T19:11:38.073 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-25T19:11:38.073 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-25T19:11:38.073 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-25T19:11:38.073 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-25T19:11:38.073 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-25T19:11:38.073 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-25T19:11:38.073 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-25T19:11:38.073 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-25T19:11:38.073 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-25T19:11:38.073 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-25T19:11:38.073 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-25T19:11:38.073 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-25T19:11:38.073 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-25T19:11:38.074 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-25T19:11:38.074 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-25T19:11:38.074 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-25T19:11:38.074 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-25T19:11:38.074 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-25T19:11:38.074 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-25T19:11:38.074 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-25T19:11:38.074 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-25T19:11:38.074 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-25T19:11:38.074 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-25T19:11:38.074 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-25T19:11:38.074 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-25T19:11:38.075 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-25T19:11:38.075 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-25T19:11:38.075 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-25T19:11:38.075 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-25T19:11:38.075 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-25T19:11:38.075 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-25T19:11:38.075 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-25T19:11:38.075 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-25T19:11:38.075 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-25T19:11:38.075 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-25T19:11:38.075 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-25T19:11:38.075 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-25T19:11:38.075 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-25T19:11:38.075 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-25T19:11:38.076 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-25T19:11:38.076 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-25T19:11:38.076 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-25T19:11:38.076 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-25T19:11:38.076 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-25T19:11:38.076 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-25T19:11:38.076 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-25T19:11:38.076 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-25T19:11:38.076 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-25T19:11:38.076 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-25T19:11:38.076 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-25T19:11:38.076 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-25T19:11:38.076 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-25T19:11:38.076 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-25T19:11:38.077 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-25T19:11:38.077 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-25T19:11:38.077 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-25T19:11:38.077 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-25T19:11:38.077 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-25T19:11:38.077 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-25T19:11:38.077 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-25T19:11:38.077 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-25T19:11:38.077 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-25T19:11:38.077 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-25T19:11:38.077 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-25T19:11:38.077 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-25T19:11:38.078 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-25T19:11:38.078 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-25T19:11:38.078 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-25T19:11:38.078 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-25T19:11:38.078 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-25T19:11:38.078 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-25T19:11:38.078 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-25T19:11:38.078 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-25T19:11:38.078 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-25T19:11:38.078 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-25T19:11:38.078 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-25T19:11:38.078 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-25T19:11:38.078 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-25T19:11:38.078 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-25T19:11:38.079 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-25T19:11:38.079 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-25T19:11:38.079 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-25T19:11:38.079 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-25T19:11:38.079 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-25T19:11:38.079 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-25T19:11:38.079 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-25T19:11:38.079 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-25T19:11:38.079 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-25T19:11:38.079 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-25T19:11:38.079 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-25T19:11:38.079 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-25T19:11:38.080 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-25T19:11:38.080 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-25T19:11:38.080 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-25T19:11:38.080 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-25T19:11:38.080 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-25T19:11:38.080 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-25T19:11:38.080 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-25T19:11:38.080 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-25T19:11:38.080 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-25T19:11:38.080 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-25T19:11:38.080 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-25T19:11:38.080 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-25T19:11:38.080 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-25T19:11:38.080 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-25T19:11:38.081 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-25T19:11:38.081 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-25T19:11:38.085 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-25T19:11:38.085 DEBUG:teuthology.orchestra.run.smithi195:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-25T19:11:38.108 INFO:teuthology.orchestra.run.smithi195.stdout:postinstall scriptlet (using /bin/sh): 2024-04-25T19:11:38.108 INFO:teuthology.orchestra.run.smithi195.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-25T19:11:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-25T19:11:38.108 INFO:teuthology.orchestra.run.smithi195.stdout:fi 2024-04-25T19:11:38.108 INFO:teuthology.orchestra.run.smithi195.stdout:for file in vmlinuz System.map config; do 2024-04-25T19:11:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-25T19:11:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-25T19:11:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: fi 2024-04-25T19:11:38.108 INFO:teuthology.orchestra.run.smithi195.stdout:done 2024-04-25T19:11:38.109 INFO:teuthology.orchestra.run.smithi195.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-25T19:11:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-25T19:11:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-25T19:11:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-25T19:11:38.109 INFO:teuthology.orchestra.run.smithi195.stdout:fi 2024-04-25T19:11:38.109 INFO:teuthology.orchestra.run.smithi195.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-25T19:11:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-25T19:11:38.109 INFO:teuthology.orchestra.run.smithi195.stdout:fi 2024-04-25T19:11:38.109 INFO:teuthology.orchestra.run.smithi195.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-25T19:11:38.109 INFO:teuthology.orchestra.run.smithi195.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-25T19:11:38.109 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-25T19:11:38.109 INFO:teuthology.orchestra.run.smithi195.stdout:fi 2024-04-25T19:11:38.110 DEBUG:teuthology.orchestra.run.smithi195:> sudo rpm -qi grub2-tools 2024-04-25T19:11:38.178 INFO:teuthology.orchestra.run.smithi195.stdout:Name : grub2-tools 2024-04-25T19:11:38.179 INFO:teuthology.orchestra.run.smithi195.stdout:Epoch : 1 2024-04-25T19:11:38.179 INFO:teuthology.orchestra.run.smithi195.stdout:Version : 2.06 2024-04-25T19:11:38.179 INFO:teuthology.orchestra.run.smithi195.stdout:Release : 68.el9 2024-04-25T19:11:38.179 INFO:teuthology.orchestra.run.smithi195.stdout:Architecture: x86_64 2024-04-25T19:11:38.179 INFO:teuthology.orchestra.run.smithi195.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-25T19:11:38.179 INFO:teuthology.orchestra.run.smithi195.stdout:Group : Unspecified 2024-04-25T19:11:38.179 INFO:teuthology.orchestra.run.smithi195.stdout:Size : 8264254 2024-04-25T19:11:38.179 INFO:teuthology.orchestra.run.smithi195.stdout:License : GPLv3+ 2024-04-25T19:11:38.179 INFO:teuthology.orchestra.run.smithi195.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-25T19:11:38.179 INFO:teuthology.orchestra.run.smithi195.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-25T19:11:38.179 INFO:teuthology.orchestra.run.smithi195.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-25T19:11:38.179 INFO:teuthology.orchestra.run.smithi195.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-25T19:11:38.179 INFO:teuthology.orchestra.run.smithi195.stdout:Packager : builder@centos.org 2024-04-25T19:11:38.179 INFO:teuthology.orchestra.run.smithi195.stdout:Vendor : CentOS 2024-04-25T19:11:38.180 INFO:teuthology.orchestra.run.smithi195.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-25T19:11:38.180 INFO:teuthology.orchestra.run.smithi195.stdout:Summary : Support tools for GRUB. 2024-04-25T19:11:38.180 INFO:teuthology.orchestra.run.smithi195.stdout:Description : 2024-04-25T19:11:38.180 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:11:38.180 INFO:teuthology.orchestra.run.smithi195.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-25T19:11:38.180 INFO:teuthology.orchestra.run.smithi195.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-25T19:11:38.180 INFO:teuthology.orchestra.run.smithi195.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-25T19:11:38.180 INFO:teuthology.orchestra.run.smithi195.stdout:hardware devices. 2024-04-25T19:11:38.180 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:11:38.180 INFO:teuthology.orchestra.run.smithi195.stdout:This subpackage provides tools for support of all platforms. 2024-04-25T19:11:38.181 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-25T19:11:38.181 INFO:teuthology.task.kernel:Updating grub on smithi195 to boot 6.9.0-rc3-g806ec36b2112 2024-04-25T19:11:38.181 DEBUG:teuthology.orchestra.run.smithi195:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-25T19:11:38.771 INFO:teuthology.orchestra.run.smithi195.stderr:Generating grub configuration file ... 2024-04-25T19:11:40.126 INFO:teuthology.orchestra.run.smithi195.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-25T19:11:40.149 INFO:teuthology.orchestra.run.smithi195.stderr:done 2024-04-25T19:11:40.151 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2024-04-25T19:11:40.173 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.4I4obHTJc1 2024-04-25T19:11:40.174 DEBUG:teuthology.orchestra.run.smithi195:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4I4obHTJc1 2024-04-25T19:11:40.241 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.4I4obHTJc1 2024-04-25T19:11:40.384 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.4I4obHTJc1 is 6KB 2024-04-25T19:11:40.433 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.4I4obHTJc1 2024-04-25T19:11:40.447 DEBUG:teuthology.orchestra.run.smithi195:> sudo /bin/ls /boot/loader/entries || true 2024-04-25T19:11:40.509 INFO:teuthology.orchestra.run.smithi195.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-25T19:11:40.509 INFO:teuthology.orchestra.run.smithi195.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-25T19:11:40.509 INFO:teuthology.orchestra.run.smithi195.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-25T19:11:40.509 INFO:teuthology.orchestra.run.smithi195.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-25T19:11:40.511 DEBUG:teuthology.orchestra.run.smithi195:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-25T19:11:40.655 DEBUG:teuthology.orchestra.run.smithi195:> sudo shutdown -r now 2024-04-25T19:11:42.341 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi131.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-25T19:11:42.341 DEBUG:teuthology.orchestra.run.smithi131:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-25T19:11:42.423 INFO:teuthology.orchestra.run.smithi131.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-25T19:11:42.423 INFO:teuthology.orchestra.run.smithi131.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-25T19:11:42.423 INFO:teuthology.orchestra.run.smithi131.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T19:11:42.423 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-25T19:11:42.423 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-25T19:11:42.423 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-25T19:11:42.423 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-25T19:11:42.423 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-25T19:11:42.423 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-25T19:11:42.423 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-25T19:11:42.423 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-25T19:11:42.423 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-25T19:11:42.424 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-25T19:11:42.424 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-25T19:11:42.424 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-25T19:11:42.424 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-25T19:11:42.424 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-25T19:11:42.424 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-25T19:11:42.424 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-25T19:11:42.424 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-25T19:11:42.424 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-25T19:11:42.424 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-25T19:11:42.424 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-25T19:11:42.424 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-25T19:11:42.424 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-25T19:11:42.425 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-25T19:11:42.425 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-25T19:11:42.425 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-25T19:11:42.425 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-25T19:11:42.425 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-25T19:11:42.425 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-25T19:11:42.425 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-25T19:11:42.425 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-25T19:11:42.425 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-25T19:11:42.425 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-25T19:11:42.425 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-25T19:11:42.425 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-25T19:11:42.425 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-25T19:11:42.425 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-25T19:11:42.425 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-25T19:11:42.426 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-25T19:11:42.426 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-25T19:11:42.426 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-25T19:11:42.426 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-25T19:11:42.426 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-25T19:11:42.426 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-25T19:11:42.426 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-25T19:11:42.426 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-25T19:11:42.426 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-25T19:11:42.426 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-25T19:11:42.426 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-25T19:11:42.426 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-25T19:11:42.427 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-25T19:11:42.427 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-25T19:11:42.427 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-25T19:11:42.427 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-25T19:11:42.427 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-25T19:11:42.427 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-25T19:11:42.427 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-25T19:11:42.427 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-25T19:11:42.427 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-25T19:11:42.427 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-25T19:11:42.427 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-25T19:11:42.427 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-25T19:11:42.427 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-25T19:11:42.427 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-25T19:11:42.427 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-25T19:11:42.428 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-25T19:11:42.428 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-25T19:11:42.428 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-25T19:11:42.428 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-25T19:11:42.428 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-25T19:11:42.428 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-25T19:11:42.428 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-25T19:11:42.428 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-25T19:11:42.428 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-25T19:11:42.428 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-25T19:11:42.428 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-25T19:11:42.428 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-25T19:11:42.428 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-25T19:11:42.428 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-25T19:11:42.429 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-25T19:11:42.429 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-25T19:11:42.429 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-25T19:11:42.429 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-25T19:11:42.429 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-25T19:11:42.429 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-25T19:11:42.429 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-25T19:11:42.429 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-25T19:11:42.429 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-25T19:11:42.429 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-25T19:11:42.429 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-25T19:11:42.429 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-25T19:11:42.429 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-25T19:11:42.429 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-25T19:11:42.429 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-25T19:11:42.430 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-25T19:11:42.430 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-25T19:11:42.430 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-25T19:11:42.430 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-25T19:11:42.430 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-25T19:11:42.430 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-25T19:11:42.430 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-25T19:11:42.430 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-25T19:11:42.430 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-25T19:11:42.430 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-25T19:11:42.430 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-25T19:11:42.430 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-25T19:11:42.430 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-25T19:11:42.430 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-25T19:11:42.431 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-25T19:11:42.431 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-25T19:11:42.431 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-25T19:11:42.431 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-25T19:11:42.431 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-25T19:11:42.431 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-25T19:11:42.431 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-25T19:11:42.431 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-25T19:11:42.431 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-25T19:11:42.431 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-25T19:11:42.431 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-25T19:11:42.431 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-25T19:11:42.431 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-25T19:11:42.431 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-25T19:11:42.432 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-25T19:11:42.432 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-25T19:11:42.432 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-25T19:11:42.432 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-25T19:11:42.432 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-25T19:11:42.432 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-25T19:11:42.432 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-25T19:11:42.432 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-25T19:11:42.432 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-25T19:11:42.432 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-25T19:11:42.432 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-25T19:11:42.432 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-25T19:11:42.432 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-25T19:11:42.432 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-25T19:11:42.433 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-25T19:11:42.433 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-25T19:11:42.433 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-25T19:11:42.433 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-25T19:11:42.433 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-25T19:11:42.433 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-25T19:11:42.433 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-25T19:11:42.433 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-25T19:11:42.433 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-25T19:11:42.433 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-25T19:11:42.433 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-25T19:11:42.433 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-25T19:11:42.433 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-25T19:11:42.433 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-25T19:11:42.434 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-25T19:11:42.434 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-25T19:11:42.434 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-25T19:11:42.434 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-25T19:11:42.434 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-25T19:11:42.434 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-25T19:11:42.434 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-25T19:11:42.434 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-25T19:11:42.434 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-25T19:11:42.434 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-25T19:11:42.434 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-25T19:11:42.435 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-25T19:11:42.435 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-25T19:11:42.435 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-25T19:11:42.435 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-25T19:11:42.435 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-25T19:11:42.435 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-25T19:11:42.435 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-25T19:11:42.435 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-25T19:11:42.435 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-25T19:11:42.435 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-25T19:11:42.435 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-25T19:11:42.435 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-25T19:11:42.435 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-25T19:11:42.435 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-25T19:11:42.436 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-25T19:11:42.436 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-25T19:11:42.436 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-25T19:11:42.436 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-25T19:11:42.436 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-25T19:11:42.436 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-25T19:11:42.436 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-25T19:11:42.436 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-25T19:11:42.436 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-25T19:11:42.436 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-25T19:11:42.436 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-25T19:11:42.436 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-25T19:11:42.436 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-25T19:11:42.436 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-25T19:11:42.436 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-25T19:11:42.437 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-25T19:11:42.437 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-25T19:11:42.437 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-25T19:11:42.437 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-25T19:11:42.437 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-25T19:11:42.437 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-25T19:11:42.437 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-25T19:11:42.437 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-25T19:11:42.437 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-25T19:11:42.437 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-25T19:11:42.437 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-25T19:11:42.437 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-25T19:11:42.437 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-25T19:11:42.438 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-25T19:11:42.438 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-25T19:11:42.438 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-25T19:11:42.438 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-25T19:11:42.438 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-25T19:11:42.438 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-25T19:11:42.438 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-25T19:11:42.438 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-25T19:11:42.438 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-25T19:11:42.438 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-25T19:11:42.438 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-25T19:11:42.438 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-25T19:11:42.438 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-25T19:11:42.439 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-25T19:11:42.439 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-25T19:11:42.439 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-25T19:11:42.439 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-25T19:11:42.439 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-25T19:11:42.439 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-25T19:11:42.439 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-25T19:11:42.439 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-25T19:11:42.439 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-25T19:11:42.439 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-25T19:11:42.439 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-25T19:11:42.439 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-25T19:11:42.439 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-25T19:11:42.439 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-25T19:11:42.440 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-25T19:11:42.440 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-25T19:11:42.440 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-25T19:11:42.440 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-25T19:11:42.440 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-25T19:11:42.440 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-25T19:11:42.440 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-25T19:11:42.440 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-25T19:11:42.440 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-25T19:11:42.440 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-25T19:11:42.440 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-25T19:11:42.440 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-25T19:11:42.440 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-25T19:11:42.440 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-25T19:11:42.441 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-25T19:11:42.441 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-25T19:11:42.441 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-25T19:11:42.441 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-25T19:11:42.441 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-25T19:11:42.441 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-25T19:11:42.441 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-25T19:11:42.441 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-25T19:11:42.441 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-25T19:11:42.441 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-25T19:11:42.441 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-25T19:11:42.441 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-25T19:11:42.441 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-25T19:11:42.441 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-25T19:11:42.441 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-25T19:11:42.442 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-25T19:11:42.442 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-25T19:11:42.442 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-25T19:11:42.442 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-25T19:11:42.442 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-25T19:11:42.442 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-25T19:11:42.442 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-25T19:11:42.442 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-25T19:11:42.442 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-25T19:11:42.442 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-25T19:11:42.442 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-25T19:11:42.442 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-25T19:11:42.442 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-25T19:11:42.443 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-25T19:11:42.443 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-25T19:11:42.443 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-25T19:11:42.443 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-25T19:11:42.443 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-25T19:11:42.443 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-25T19:11:42.443 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-25T19:11:42.443 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-25T19:11:42.443 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-25T19:11:42.443 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-25T19:11:42.443 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-25T19:11:42.443 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-25T19:11:42.443 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-25T19:11:42.443 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-25T19:11:42.443 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-25T19:11:42.444 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-25T19:11:42.444 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-25T19:11:42.444 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-25T19:11:42.444 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-25T19:11:42.444 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-25T19:11:42.444 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-25T19:11:42.444 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-25T19:11:42.444 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-25T19:11:42.444 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-25T19:11:42.444 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-25T19:11:42.444 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-25T19:11:42.444 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-25T19:11:42.444 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-25T19:11:42.444 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-25T19:11:42.444 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-25T19:11:42.445 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-25T19:11:42.445 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-25T19:11:42.445 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-25T19:11:42.445 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-25T19:11:42.445 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-25T19:11:42.445 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-25T19:11:42.445 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-25T19:11:42.445 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-25T19:11:42.445 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-25T19:11:42.445 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-25T19:11:42.445 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-25T19:11:42.445 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-25T19:11:42.445 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-25T19:11:42.445 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-25T19:11:42.445 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-25T19:11:42.446 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-25T19:11:42.446 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-25T19:11:42.446 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-25T19:11:42.446 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-25T19:11:42.446 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-25T19:11:42.446 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-25T19:11:42.446 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-25T19:11:42.446 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-25T19:11:42.446 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-25T19:11:42.446 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-25T19:11:42.446 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-25T19:11:42.446 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-25T19:11:42.446 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-25T19:11:42.446 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-25T19:11:42.447 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-25T19:11:42.447 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-25T19:11:42.447 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-25T19:11:42.447 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-25T19:11:42.447 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-25T19:11:42.447 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-25T19:11:42.447 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-25T19:11:42.447 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-25T19:11:42.447 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-25T19:11:42.447 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-25T19:11:42.447 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-25T19:11:42.447 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-25T19:11:42.447 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-25T19:11:42.447 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-25T19:11:42.447 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-25T19:11:42.448 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-25T19:11:42.448 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-25T19:11:42.448 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-25T19:11:42.448 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-25T19:11:42.448 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-25T19:11:42.448 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-25T19:11:42.448 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-25T19:11:42.448 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-25T19:11:42.448 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-25T19:11:42.448 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-25T19:11:42.448 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-25T19:11:42.448 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-25T19:11:42.448 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-25T19:11:42.448 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-25T19:11:42.448 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-25T19:11:42.449 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-25T19:11:42.449 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-25T19:11:42.449 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-25T19:11:42.449 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-25T19:11:42.449 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-25T19:11:42.449 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-25T19:11:42.449 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-25T19:11:42.449 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-25T19:11:42.449 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-25T19:11:42.449 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-25T19:11:42.449 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-25T19:11:42.449 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-25T19:11:42.449 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-25T19:11:42.449 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-25T19:11:42.449 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-25T19:11:42.450 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-25T19:11:42.450 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-25T19:11:42.450 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-25T19:11:42.450 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-25T19:11:42.450 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-25T19:11:42.450 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-25T19:11:42.450 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-25T19:11:42.450 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-25T19:11:42.450 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-25T19:11:42.450 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-25T19:11:42.450 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-25T19:11:42.450 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-25T19:11:42.450 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-25T19:11:42.451 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-25T19:11:42.451 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-25T19:11:42.451 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-25T19:11:42.451 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-25T19:11:42.451 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-25T19:11:42.451 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-25T19:11:42.451 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-25T19:11:42.451 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-25T19:11:42.451 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-25T19:11:42.451 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-25T19:11:42.451 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-25T19:11:42.451 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-25T19:11:42.451 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-25T19:11:42.451 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-25T19:11:42.452 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-25T19:11:42.452 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-25T19:11:42.452 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-25T19:11:42.452 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-25T19:11:42.452 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-25T19:11:42.452 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-25T19:11:42.452 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-25T19:11:42.452 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-25T19:11:42.452 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-25T19:11:42.452 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-25T19:11:42.452 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-25T19:11:42.452 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-25T19:11:42.452 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-25T19:11:42.452 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-25T19:11:42.453 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-25T19:11:42.453 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-25T19:11:42.453 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-25T19:11:42.453 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-25T19:11:42.453 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-25T19:11:42.453 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-25T19:11:42.453 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-25T19:11:42.453 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-25T19:11:42.453 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-25T19:11:42.453 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-25T19:11:42.453 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-25T19:11:42.453 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-25T19:11:42.453 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-25T19:11:42.453 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-25T19:11:42.454 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-25T19:11:42.454 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-25T19:11:42.454 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-25T19:11:42.454 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-25T19:11:42.454 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-25T19:11:42.454 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-25T19:11:42.454 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-25T19:11:42.454 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-25T19:11:42.454 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-25T19:11:42.454 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-25T19:11:42.454 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-25T19:11:42.454 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-25T19:11:42.454 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-25T19:11:42.454 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-25T19:11:42.455 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-25T19:11:42.455 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-25T19:11:42.455 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-25T19:11:42.455 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-25T19:11:42.455 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-25T19:11:42.455 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-25T19:11:42.455 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-25T19:11:42.455 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-25T19:11:42.455 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-25T19:11:42.455 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-25T19:11:42.455 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-25T19:11:42.455 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-25T19:11:42.455 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-25T19:11:42.455 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-25T19:11:42.455 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-25T19:11:42.456 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-25T19:11:42.456 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-25T19:11:42.456 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-25T19:11:42.456 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-25T19:11:42.456 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-25T19:11:42.456 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-25T19:11:42.456 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-25T19:11:42.456 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-25T19:11:42.456 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-25T19:11:42.456 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-25T19:11:42.456 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-25T19:11:42.456 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-25T19:11:42.456 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-25T19:11:42.457 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-25T19:11:42.457 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-25T19:11:42.457 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-25T19:11:42.457 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-25T19:11:42.457 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-25T19:11:42.457 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-25T19:11:42.457 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-25T19:11:42.457 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-25T19:11:42.457 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-25T19:11:42.457 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-25T19:11:42.457 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-25T19:11:42.457 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-25T19:11:42.457 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-25T19:11:42.457 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-25T19:11:42.457 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-25T19:11:42.458 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-25T19:11:42.458 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-25T19:11:42.458 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-25T19:11:42.458 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-25T19:11:42.458 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-25T19:11:42.458 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-25T19:11:42.458 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-25T19:11:42.458 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-25T19:11:42.458 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-25T19:11:42.458 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-25T19:11:42.458 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-25T19:11:42.458 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-25T19:11:42.458 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-25T19:11:42.458 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-25T19:11:42.459 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-25T19:11:42.459 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-25T19:11:42.459 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-25T19:11:42.459 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-25T19:11:42.459 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-25T19:11:42.459 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-25T19:11:42.459 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-25T19:11:42.459 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-25T19:11:42.459 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-25T19:11:42.459 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-25T19:11:42.459 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-25T19:11:42.459 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-25T19:11:42.459 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-25T19:11:42.459 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-25T19:11:42.460 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-25T19:11:42.460 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-25T19:11:42.460 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-25T19:11:42.460 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-25T19:11:42.460 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-25T19:11:42.460 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-25T19:11:42.460 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-25T19:11:42.460 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-25T19:11:42.460 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-25T19:11:42.460 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-25T19:11:42.460 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-25T19:11:42.460 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-25T19:11:42.460 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-25T19:11:42.460 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-25T19:11:42.461 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-25T19:11:42.461 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-25T19:11:42.461 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-25T19:11:42.461 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-25T19:11:42.461 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-25T19:11:42.461 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-25T19:11:42.461 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-25T19:11:42.461 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-25T19:11:42.461 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-25T19:11:42.461 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-25T19:11:42.461 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-25T19:11:42.461 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-25T19:11:42.461 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-25T19:11:42.461 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-25T19:11:42.461 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-25T19:11:42.462 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-25T19:11:42.462 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-25T19:11:42.462 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-25T19:11:42.462 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-25T19:11:42.462 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-25T19:11:42.462 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-25T19:11:42.462 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-25T19:11:42.462 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-25T19:11:42.462 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-25T19:11:42.462 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-25T19:11:42.462 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-25T19:11:42.462 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-25T19:11:42.463 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-25T19:11:42.463 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-25T19:11:42.463 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-25T19:11:42.463 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-25T19:11:42.463 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-25T19:11:42.463 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-25T19:11:42.463 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-25T19:11:42.463 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-25T19:11:42.463 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-25T19:11:42.463 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-25T19:11:42.463 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-25T19:11:42.463 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-25T19:11:42.463 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-25T19:11:42.463 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-25T19:11:42.464 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-25T19:11:42.464 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-25T19:11:42.464 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-25T19:11:42.464 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-25T19:11:42.464 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-25T19:11:42.464 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-25T19:11:42.464 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-25T19:11:42.464 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-25T19:11:42.464 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-25T19:11:42.464 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-25T19:11:42.464 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-25T19:11:42.464 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-25T19:11:42.464 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-25T19:11:42.464 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-25T19:11:42.465 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-25T19:11:42.465 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-25T19:11:42.465 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-25T19:11:42.465 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-25T19:11:42.465 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-25T19:11:42.465 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-25T19:11:42.465 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-25T19:11:42.465 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-25T19:11:42.465 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-25T19:11:42.465 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-25T19:11:42.465 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-25T19:11:42.465 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-25T19:11:42.465 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-25T19:11:42.465 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-25T19:11:42.466 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-25T19:11:42.466 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-25T19:11:42.466 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-25T19:11:42.466 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-25T19:11:42.466 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-25T19:11:42.466 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-25T19:11:42.466 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-25T19:11:42.466 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-25T19:11:42.466 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-25T19:11:42.466 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-25T19:11:42.466 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-25T19:11:42.466 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-25T19:11:42.466 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-25T19:11:42.466 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-25T19:11:42.467 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-25T19:11:42.467 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-25T19:11:42.467 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-25T19:11:42.467 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-25T19:11:42.467 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-25T19:11:42.467 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-25T19:11:42.467 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-25T19:11:42.467 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-25T19:11:42.467 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-25T19:11:42.467 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-25T19:11:42.467 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-25T19:11:42.467 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-25T19:11:42.467 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-25T19:11:42.467 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-25T19:11:42.468 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-25T19:11:42.468 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-25T19:11:42.468 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-25T19:11:42.468 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-25T19:11:42.468 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-25T19:11:42.468 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-25T19:11:42.468 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-25T19:11:42.468 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-25T19:11:42.468 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-25T19:11:42.468 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-25T19:11:42.468 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-25T19:11:42.468 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-25T19:11:42.468 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-25T19:11:42.468 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-25T19:11:42.469 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-25T19:11:42.469 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-25T19:11:42.469 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-25T19:11:42.469 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-25T19:11:42.469 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-25T19:11:42.469 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-25T19:11:42.469 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-25T19:11:42.469 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-25T19:11:42.469 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-25T19:11:42.469 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-25T19:11:42.469 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-25T19:11:42.469 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-25T19:11:42.469 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-25T19:11:42.469 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-25T19:11:42.470 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-25T19:11:42.470 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-25T19:11:42.470 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-25T19:11:42.470 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-25T19:11:42.470 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-25T19:11:42.470 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-25T19:11:42.470 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-25T19:11:42.470 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-25T19:11:42.470 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-25T19:11:42.470 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-25T19:11:42.470 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-25T19:11:42.470 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-25T19:11:42.470 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-25T19:11:42.471 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-25T19:11:42.471 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-25T19:11:42.471 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-25T19:11:42.471 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-25T19:11:42.471 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-25T19:11:42.471 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-25T19:11:42.471 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-25T19:11:42.471 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-25T19:11:42.471 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-25T19:11:42.471 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-25T19:11:42.471 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-25T19:11:42.471 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-25T19:11:42.471 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-25T19:11:42.471 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-25T19:11:42.471 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-25T19:11:42.472 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-25T19:11:42.472 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-25T19:11:42.472 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-25T19:11:42.472 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-25T19:11:42.472 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-25T19:11:42.472 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-25T19:11:42.472 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-25T19:11:42.472 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-25T19:11:42.472 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-25T19:11:42.472 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-25T19:11:42.472 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-25T19:11:42.472 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-25T19:11:42.472 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-25T19:11:42.472 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-25T19:11:42.473 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-25T19:11:42.473 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-25T19:11:42.473 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-25T19:11:42.473 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-25T19:11:42.473 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-25T19:11:42.473 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-25T19:11:42.473 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-25T19:11:42.473 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-25T19:11:42.473 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-25T19:11:42.473 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-25T19:11:42.473 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-25T19:11:42.473 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-25T19:11:42.473 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-25T19:11:42.473 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-25T19:11:42.474 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-25T19:11:42.474 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-25T19:11:42.474 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-25T19:11:42.474 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-25T19:11:42.474 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-25T19:11:42.474 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-25T19:11:42.474 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-25T19:11:42.474 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-25T19:11:42.474 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-25T19:11:42.474 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-25T19:11:42.474 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-25T19:11:42.474 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-25T19:11:42.474 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-25T19:11:42.474 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-25T19:11:42.475 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-25T19:11:42.475 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-25T19:11:42.475 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-25T19:11:42.475 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-25T19:11:42.475 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-25T19:11:42.475 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-25T19:11:42.475 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-25T19:11:42.475 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-25T19:11:42.475 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-25T19:11:42.475 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-25T19:11:42.475 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-25T19:11:42.475 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-25T19:11:42.475 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-25T19:11:42.475 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-25T19:11:42.476 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-25T19:11:42.476 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-25T19:11:42.476 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-25T19:11:42.476 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-25T19:11:42.476 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-25T19:11:42.476 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-25T19:11:42.476 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-25T19:11:42.476 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-25T19:11:42.476 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-25T19:11:42.476 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-25T19:11:42.476 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-25T19:11:42.476 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-25T19:11:42.476 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-25T19:11:42.476 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-25T19:11:42.477 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-25T19:11:42.477 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-25T19:11:42.477 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-25T19:11:42.477 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-25T19:11:42.477 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-25T19:11:42.477 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-25T19:11:42.477 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-25T19:11:42.477 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-25T19:11:42.477 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-25T19:11:42.477 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-25T19:11:42.477 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-25T19:11:42.477 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-25T19:11:42.477 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-25T19:11:42.477 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-25T19:11:42.477 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-25T19:11:42.478 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-25T19:11:42.478 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-25T19:11:42.478 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-25T19:11:42.478 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-25T19:11:42.478 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-25T19:11:42.478 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-25T19:11:42.478 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-25T19:11:42.478 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-25T19:11:42.478 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-25T19:11:42.478 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-25T19:11:42.478 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-25T19:11:42.478 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-25T19:11:42.478 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-25T19:11:42.478 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-25T19:11:42.479 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-25T19:11:42.479 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-25T19:11:42.479 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-25T19:11:42.479 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-25T19:11:42.479 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-25T19:11:42.479 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-25T19:11:42.479 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-25T19:11:42.479 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-25T19:11:42.479 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-25T19:11:42.479 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-25T19:11:42.479 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-25T19:11:42.479 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-25T19:11:42.479 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-25T19:11:42.479 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-25T19:11:42.480 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-25T19:11:42.480 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-25T19:11:42.480 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-25T19:11:42.480 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-25T19:11:42.480 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-25T19:11:42.480 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-25T19:11:42.480 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-25T19:11:42.480 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-25T19:11:42.480 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-25T19:11:42.480 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-25T19:11:42.480 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-25T19:11:42.480 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-25T19:11:42.480 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-25T19:11:42.480 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-25T19:11:42.481 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-25T19:11:42.481 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-25T19:11:42.481 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-25T19:11:42.481 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-25T19:11:42.481 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-25T19:11:42.481 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-25T19:11:42.481 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-25T19:11:42.481 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-25T19:11:42.481 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-25T19:11:42.481 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-25T19:11:42.481 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-25T19:11:42.481 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-25T19:11:42.481 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-25T19:11:42.481 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-25T19:11:42.481 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-25T19:11:42.482 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-25T19:11:42.482 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-25T19:11:42.482 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-25T19:11:42.482 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-25T19:11:42.482 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-25T19:11:42.482 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-25T19:11:42.482 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-25T19:11:42.482 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-25T19:11:42.482 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-25T19:11:42.482 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-25T19:11:42.482 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-25T19:11:42.482 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-25T19:11:42.482 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-25T19:11:42.483 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-25T19:11:42.483 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-25T19:11:42.483 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-25T19:11:42.483 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-25T19:11:42.483 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-25T19:11:42.483 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-25T19:11:42.483 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-25T19:11:42.483 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-25T19:11:42.483 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-25T19:11:42.483 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-25T19:11:42.483 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-25T19:11:42.483 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-25T19:11:42.483 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-25T19:11:42.483 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-25T19:11:42.483 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-25T19:11:42.484 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-25T19:11:42.484 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-25T19:11:42.484 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-25T19:11:42.484 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-25T19:11:42.484 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-25T19:11:42.484 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-25T19:11:42.484 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-25T19:11:42.484 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-25T19:11:42.484 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-25T19:11:42.484 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-25T19:11:42.484 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-25T19:11:42.484 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-25T19:11:42.484 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-25T19:11:42.484 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-25T19:11:42.484 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-25T19:11:42.484 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-25T19:11:42.485 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-25T19:11:42.485 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-25T19:11:42.485 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-25T19:11:42.485 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-25T19:11:42.485 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-25T19:11:42.485 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-25T19:11:42.485 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-25T19:11:42.485 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-25T19:11:42.485 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-25T19:11:42.485 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-25T19:11:42.485 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-25T19:11:42.485 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-25T19:11:42.485 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-25T19:11:42.485 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-25T19:11:42.485 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-25T19:11:42.486 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-25T19:11:42.486 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-25T19:11:42.486 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-25T19:11:42.486 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-25T19:11:42.486 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-25T19:11:42.486 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-25T19:11:42.486 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-25T19:11:42.486 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-25T19:11:42.486 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-25T19:11:42.486 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-25T19:11:42.486 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-25T19:11:42.486 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-25T19:11:42.486 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-25T19:11:42.487 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-25T19:11:42.487 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-25T19:11:42.487 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-25T19:11:42.487 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-25T19:11:42.487 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-25T19:11:42.487 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-25T19:11:42.487 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-25T19:11:42.487 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-25T19:11:42.487 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-25T19:11:42.487 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-25T19:11:42.487 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-25T19:11:42.487 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-25T19:11:42.487 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-25T19:11:42.487 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-25T19:11:42.488 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-25T19:11:42.488 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-25T19:11:42.488 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-25T19:11:42.488 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-25T19:11:42.488 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-25T19:11:42.488 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-25T19:11:42.488 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-25T19:11:42.488 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-25T19:11:42.488 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-25T19:11:42.488 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-25T19:11:42.488 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-25T19:11:42.488 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-25T19:11:42.488 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-25T19:11:42.488 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-25T19:11:42.488 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-25T19:11:42.489 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-25T19:11:42.489 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-25T19:11:42.489 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-25T19:11:42.489 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-25T19:11:42.489 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-25T19:11:42.489 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-25T19:11:42.489 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-25T19:11:42.489 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-25T19:11:42.489 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-25T19:11:42.489 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-25T19:11:42.489 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-25T19:11:42.489 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-25T19:11:42.489 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-25T19:11:42.489 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-25T19:11:42.489 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-25T19:11:42.490 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-25T19:11:42.490 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-25T19:11:42.490 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-25T19:11:42.490 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-25T19:11:42.490 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-25T19:11:42.490 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-25T19:11:42.490 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-25T19:11:42.490 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-25T19:11:42.490 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-25T19:11:42.490 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-25T19:11:42.490 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-25T19:11:42.490 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-25T19:11:42.490 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-25T19:11:42.490 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-25T19:11:42.491 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-25T19:11:42.491 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-25T19:11:42.491 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-25T19:11:42.491 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-25T19:11:42.491 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-25T19:11:42.491 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-25T19:11:42.491 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-25T19:11:42.491 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-25T19:11:42.491 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-25T19:11:42.491 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-25T19:11:42.491 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-25T19:11:42.491 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-25T19:11:42.491 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-25T19:11:42.491 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-25T19:11:42.491 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-25T19:11:42.492 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-25T19:11:42.492 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-25T19:11:42.492 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-25T19:11:42.492 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-25T19:11:42.492 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-25T19:11:42.492 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-25T19:11:42.492 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-25T19:11:42.492 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-25T19:11:42.492 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-25T19:11:42.492 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-25T19:11:42.492 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-25T19:11:42.492 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-25T19:11:42.492 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-25T19:11:42.492 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-25T19:11:42.492 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-25T19:11:42.492 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-25T19:11:42.493 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-25T19:11:42.493 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-25T19:11:42.493 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-25T19:11:42.493 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-25T19:11:42.493 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-25T19:11:42.493 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-25T19:11:42.493 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-25T19:11:42.493 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-25T19:11:42.493 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-25T19:11:42.493 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-25T19:11:42.493 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-25T19:11:42.493 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-25T19:11:42.493 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-25T19:11:42.493 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-25T19:11:42.494 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-25T19:11:42.494 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-25T19:11:42.494 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-25T19:11:42.494 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-25T19:11:42.494 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-25T19:11:42.494 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-25T19:11:42.494 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-25T19:11:42.494 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-25T19:11:42.494 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-25T19:11:42.494 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-25T19:11:42.494 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-25T19:11:42.494 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-25T19:11:42.494 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-25T19:11:42.494 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-25T19:11:42.495 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-25T19:11:42.495 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-25T19:11:42.495 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-25T19:11:42.495 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-25T19:11:42.495 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-25T19:11:42.495 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-25T19:11:42.495 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-25T19:11:42.495 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-25T19:11:42.495 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-25T19:11:42.495 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-25T19:11:42.495 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-25T19:11:42.495 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-25T19:11:42.495 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-25T19:11:42.495 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-25T19:11:42.495 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-25T19:11:42.496 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-25T19:11:42.496 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-25T19:11:42.496 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-25T19:11:42.496 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-25T19:11:42.496 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-25T19:11:42.496 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-25T19:11:42.496 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-25T19:11:42.496 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-25T19:11:42.496 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-25T19:11:42.496 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-25T19:11:42.496 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-25T19:11:42.496 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-25T19:11:42.496 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-25T19:11:42.496 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-25T19:11:42.496 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-25T19:11:42.497 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-25T19:11:42.497 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-25T19:11:42.497 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-25T19:11:42.497 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-25T19:11:42.497 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-25T19:11:42.497 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-25T19:11:42.497 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-25T19:11:42.497 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-25T19:11:42.497 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-25T19:11:42.497 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-25T19:11:42.497 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-25T19:11:42.497 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-25T19:11:42.497 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-25T19:11:42.497 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-25T19:11:42.497 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-25T19:11:42.498 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-25T19:11:42.498 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-25T19:11:42.498 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-25T19:11:42.498 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-25T19:11:42.498 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-25T19:11:42.498 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-25T19:11:42.498 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-25T19:11:42.498 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-25T19:11:42.498 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-25T19:11:42.498 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-25T19:11:42.498 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-25T19:11:42.498 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-25T19:11:42.498 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-25T19:11:42.499 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-25T19:11:42.499 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-25T19:11:42.499 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-25T19:11:42.499 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-25T19:11:42.499 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-25T19:11:42.499 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-25T19:11:42.499 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-25T19:11:42.499 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-25T19:11:42.499 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-25T19:11:42.499 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-25T19:11:42.499 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-25T19:11:42.499 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-25T19:11:42.499 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-25T19:11:42.499 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-25T19:11:42.500 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-25T19:11:42.500 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-25T19:11:42.500 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-25T19:11:42.500 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-25T19:11:42.500 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-25T19:11:42.500 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-25T19:11:42.500 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-25T19:11:42.500 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-25T19:11:42.500 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-25T19:11:42.500 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-25T19:11:42.500 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-25T19:11:42.500 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-25T19:11:42.500 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-25T19:11:42.500 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-25T19:11:42.500 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-25T19:11:42.501 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-25T19:11:42.501 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-25T19:11:42.501 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-25T19:11:42.501 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-25T19:11:42.501 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-25T19:11:42.501 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-25T19:11:42.501 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-25T19:11:42.501 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-25T19:11:42.501 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-25T19:11:42.501 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-25T19:11:42.501 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-25T19:11:42.501 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-25T19:11:42.501 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-25T19:11:42.501 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-25T19:11:42.501 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-25T19:11:42.502 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-25T19:11:42.502 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-25T19:11:42.502 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-25T19:11:42.502 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-25T19:11:42.502 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-25T19:11:42.502 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-25T19:11:42.502 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-25T19:11:42.502 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-25T19:11:42.502 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-25T19:11:42.502 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-25T19:11:42.502 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-25T19:11:42.502 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-25T19:11:42.502 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-25T19:11:42.503 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-25T19:11:42.503 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-25T19:11:42.503 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-25T19:11:42.503 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-25T19:11:42.503 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-25T19:11:42.503 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-25T19:11:42.503 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-25T19:11:42.503 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-25T19:11:42.503 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-25T19:11:42.503 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-25T19:11:42.503 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-25T19:11:42.503 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-25T19:11:42.503 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-25T19:11:42.503 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-25T19:11:42.503 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-25T19:11:42.504 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-25T19:11:42.504 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-25T19:11:42.504 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-25T19:11:42.504 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-25T19:11:42.504 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-25T19:11:42.504 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-25T19:11:42.504 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-25T19:11:42.504 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-25T19:11:42.504 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-25T19:11:42.504 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-25T19:11:42.504 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-25T19:11:42.504 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-25T19:11:42.504 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-25T19:11:42.504 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-25T19:11:42.505 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-25T19:11:42.505 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-25T19:11:42.505 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-25T19:11:42.505 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-25T19:11:42.505 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-25T19:11:42.505 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-25T19:11:42.505 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-25T19:11:42.505 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-25T19:11:42.505 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-25T19:11:42.505 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-25T19:11:42.505 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-25T19:11:42.505 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-25T19:11:42.505 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-25T19:11:42.505 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-25T19:11:42.506 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-25T19:11:42.506 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-25T19:11:42.506 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-25T19:11:42.506 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-25T19:11:42.506 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-25T19:11:42.506 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-25T19:11:42.506 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-25T19:11:42.506 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-25T19:11:42.506 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-25T19:11:42.506 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-25T19:11:42.506 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-25T19:11:42.506 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-25T19:11:42.506 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-25T19:11:42.507 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-25T19:11:42.507 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-25T19:11:42.507 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-25T19:11:42.507 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-25T19:11:42.507 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-25T19:11:42.507 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-25T19:11:42.507 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-25T19:11:42.507 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-25T19:11:42.507 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-25T19:11:42.507 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-25T19:11:42.507 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-25T19:11:42.507 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-25T19:11:42.507 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-25T19:11:42.507 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-25T19:11:42.508 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-25T19:11:42.508 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-25T19:11:42.508 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-25T19:11:42.508 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-25T19:11:42.508 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-25T19:11:42.508 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-25T19:11:42.508 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-25T19:11:42.508 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-25T19:11:42.508 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-25T19:11:42.508 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-25T19:11:42.508 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-25T19:11:42.508 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-25T19:11:42.508 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-25T19:11:42.508 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-25T19:11:42.508 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-25T19:11:42.509 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-25T19:11:42.509 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-25T19:11:42.509 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-25T19:11:42.509 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-25T19:11:42.509 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-25T19:11:42.509 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-25T19:11:42.509 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-25T19:11:42.509 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-25T19:11:42.509 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-25T19:11:42.509 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-25T19:11:42.509 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-25T19:11:42.509 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-25T19:11:42.509 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-25T19:11:42.509 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-25T19:11:42.510 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-25T19:11:42.510 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-25T19:11:42.510 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-25T19:11:42.510 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-25T19:11:42.510 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-25T19:11:42.510 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-25T19:11:42.510 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-25T19:11:42.510 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-25T19:11:42.510 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-25T19:11:42.510 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-25T19:11:42.510 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-25T19:11:42.510 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-25T19:11:42.510 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-25T19:11:42.511 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-25T19:11:42.511 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-25T19:11:42.511 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-25T19:11:42.511 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-25T19:11:42.511 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-25T19:11:42.511 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-25T19:11:42.511 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-25T19:11:42.511 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-25T19:11:42.511 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-25T19:11:42.511 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-25T19:11:42.511 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-25T19:11:42.511 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-25T19:11:42.511 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-25T19:11:42.511 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-25T19:11:42.511 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-25T19:11:42.512 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-25T19:11:42.512 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-25T19:11:42.512 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-25T19:11:42.512 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-25T19:11:42.512 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-25T19:11:42.512 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-25T19:11:42.512 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-25T19:11:42.512 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-25T19:11:42.512 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-25T19:11:42.512 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-25T19:11:42.512 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-25T19:11:42.512 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-25T19:11:42.512 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-25T19:11:42.512 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-25T19:11:42.512 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-25T19:11:42.513 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-25T19:11:42.513 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-25T19:11:42.513 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-25T19:11:42.513 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-25T19:11:42.513 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-25T19:11:42.513 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-25T19:11:42.513 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-25T19:11:42.513 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-25T19:11:42.513 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-25T19:11:42.513 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-25T19:11:42.513 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-25T19:11:42.513 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-25T19:11:42.513 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-25T19:11:42.513 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-25T19:11:42.514 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-25T19:11:42.514 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-25T19:11:42.514 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-25T19:11:42.514 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-25T19:11:42.514 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-25T19:11:42.514 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-25T19:11:42.514 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-25T19:11:42.514 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-25T19:11:42.514 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-25T19:11:42.514 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-25T19:11:42.514 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-25T19:11:42.514 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-25T19:11:42.514 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-25T19:11:42.515 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-25T19:11:42.515 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-25T19:11:42.515 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-25T19:11:42.515 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-25T19:11:42.515 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-25T19:11:42.515 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-25T19:11:42.515 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-25T19:11:42.515 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-25T19:11:42.515 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-25T19:11:42.515 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-25T19:11:42.515 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-25T19:11:42.515 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-25T19:11:42.515 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-25T19:11:42.515 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-25T19:11:42.515 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-25T19:11:42.516 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-25T19:11:42.516 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-25T19:11:42.516 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-25T19:11:42.516 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-25T19:11:42.516 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-25T19:11:42.516 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-25T19:11:42.516 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-25T19:11:42.516 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-25T19:11:42.516 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-25T19:11:42.516 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-25T19:11:42.516 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-25T19:11:42.516 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-25T19:11:42.516 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-25T19:11:42.516 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-25T19:11:42.517 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-25T19:11:42.517 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-25T19:11:42.517 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-25T19:11:42.517 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-25T19:11:42.517 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-25T19:11:42.517 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-25T19:11:42.517 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-25T19:11:42.517 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-25T19:11:42.517 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-25T19:11:42.517 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-25T19:11:42.517 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-25T19:11:42.517 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-25T19:11:42.517 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-25T19:11:42.517 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-25T19:11:42.518 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-25T19:11:42.518 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-25T19:11:42.518 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-25T19:11:42.518 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-25T19:11:42.518 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-25T19:11:42.518 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-25T19:11:42.518 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-25T19:11:42.518 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-25T19:11:42.518 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-25T19:11:42.518 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-25T19:11:42.518 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-25T19:11:42.518 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-25T19:11:42.518 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-25T19:11:42.518 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-25T19:11:42.519 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-25T19:11:42.519 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-25T19:11:42.519 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-25T19:11:42.519 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-25T19:11:42.519 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-25T19:11:42.519 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-25T19:11:42.519 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-25T19:11:42.519 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-25T19:11:42.519 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-25T19:11:42.519 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-25T19:11:42.519 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-25T19:11:42.519 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-25T19:11:42.519 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-25T19:11:42.520 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-25T19:11:42.520 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-25T19:11:42.520 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-25T19:11:42.520 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-25T19:11:42.520 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-25T19:11:42.520 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-25T19:11:42.520 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-25T19:11:42.520 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-25T19:11:42.520 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-25T19:11:42.520 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-25T19:11:42.520 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-25T19:11:42.520 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-25T19:11:42.520 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-25T19:11:42.520 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-25T19:11:42.521 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-25T19:11:42.521 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-25T19:11:42.521 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-25T19:11:42.521 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-25T19:11:42.521 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-25T19:11:42.521 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-25T19:11:42.521 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-25T19:11:42.521 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-25T19:11:42.521 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-25T19:11:42.521 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-25T19:11:42.521 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-25T19:11:42.521 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-25T19:11:42.521 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-25T19:11:42.521 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-25T19:11:42.521 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-25T19:11:42.522 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-25T19:11:42.522 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-25T19:11:42.522 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-25T19:11:42.522 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-25T19:11:42.522 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-25T19:11:42.522 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-25T19:11:42.522 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-25T19:11:42.522 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-25T19:11:42.522 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-25T19:11:42.522 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-25T19:11:42.522 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-25T19:11:42.522 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-25T19:11:42.522 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-25T19:11:42.522 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-25T19:11:42.523 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-25T19:11:42.523 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-25T19:11:42.523 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-25T19:11:42.523 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-25T19:11:42.523 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-25T19:11:42.523 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-25T19:11:42.523 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-25T19:11:42.523 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-25T19:11:42.523 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-25T19:11:42.523 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-25T19:11:42.523 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-25T19:11:42.523 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-25T19:11:42.523 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-25T19:11:42.523 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-25T19:11:42.523 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-25T19:11:42.524 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-25T19:11:42.524 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-25T19:11:42.524 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-25T19:11:42.524 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-25T19:11:42.524 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-25T19:11:42.524 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-25T19:11:42.524 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-25T19:11:42.524 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-25T19:11:42.524 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-25T19:11:42.524 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-25T19:11:42.524 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-25T19:11:42.524 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-25T19:11:42.524 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-25T19:11:42.524 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-25T19:11:42.525 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-25T19:11:42.525 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-25T19:11:42.525 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-25T19:11:42.525 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-25T19:11:42.525 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-25T19:11:42.525 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-25T19:11:42.525 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-25T19:11:42.525 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-25T19:11:42.525 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-25T19:11:42.525 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-25T19:11:42.525 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-25T19:11:42.525 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-25T19:11:42.525 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-25T19:11:42.525 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-25T19:11:42.525 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-25T19:11:42.526 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-25T19:11:42.526 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-25T19:11:42.526 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-25T19:11:42.526 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-25T19:11:42.526 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-25T19:11:42.526 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-25T19:11:42.526 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-25T19:11:42.526 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-25T19:11:42.526 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-25T19:11:42.526 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-25T19:11:42.526 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-25T19:11:42.526 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-25T19:11:42.526 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-25T19:11:42.526 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-25T19:11:42.527 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-25T19:11:42.527 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-25T19:11:42.527 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-25T19:11:42.527 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-25T19:11:42.527 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-25T19:11:42.527 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-25T19:11:42.527 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-25T19:11:42.527 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-25T19:11:42.527 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-25T19:11:42.527 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-25T19:11:42.527 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-25T19:11:42.527 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-25T19:11:42.527 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-25T19:11:42.527 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-25T19:11:42.528 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-25T19:11:42.528 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-25T19:11:42.528 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-25T19:11:42.528 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-25T19:11:42.528 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-25T19:11:42.528 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-25T19:11:42.528 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-25T19:11:42.528 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-25T19:11:42.528 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-25T19:11:42.528 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-25T19:11:42.528 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-25T19:11:42.528 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-25T19:11:42.528 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-25T19:11:42.528 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-25T19:11:42.528 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-25T19:11:42.529 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-25T19:11:42.529 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-25T19:11:42.529 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-25T19:11:42.529 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-25T19:11:42.529 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-25T19:11:42.529 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-25T19:11:42.529 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-25T19:11:42.529 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-25T19:11:42.529 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-25T19:11:42.529 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-25T19:11:42.529 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-25T19:11:42.529 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-25T19:11:42.529 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-25T19:11:42.529 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-25T19:11:42.530 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-25T19:11:42.530 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-25T19:11:42.530 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-25T19:11:42.530 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-25T19:11:42.530 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-25T19:11:42.530 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-25T19:11:42.530 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-25T19:11:42.530 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-25T19:11:42.530 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-25T19:11:42.530 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-25T19:11:42.530 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-25T19:11:42.530 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-25T19:11:42.530 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-25T19:11:42.531 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-25T19:11:42.531 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-25T19:11:42.531 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-25T19:11:42.531 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-25T19:11:42.531 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-25T19:11:42.531 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-25T19:11:42.531 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-25T19:11:42.531 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-25T19:11:42.531 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-25T19:11:42.531 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-25T19:11:42.531 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-25T19:11:42.531 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-25T19:11:42.531 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-25T19:11:42.531 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-25T19:11:42.532 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-25T19:11:42.532 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-25T19:11:42.532 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-25T19:11:42.532 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-25T19:11:42.532 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-25T19:11:42.532 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-25T19:11:42.532 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-25T19:11:42.532 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-25T19:11:42.532 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-25T19:11:42.532 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-25T19:11:42.532 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-25T19:11:42.532 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-25T19:11:42.532 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-25T19:11:42.532 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-25T19:11:42.532 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-25T19:11:42.533 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-25T19:11:42.533 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-25T19:11:42.533 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-25T19:11:42.533 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-25T19:11:42.533 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-25T19:11:42.533 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-25T19:11:42.533 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-25T19:11:42.533 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-25T19:11:42.533 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-25T19:11:42.533 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-25T19:11:42.533 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-25T19:11:42.533 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-25T19:11:42.533 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-25T19:11:42.533 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-25T19:11:42.533 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-25T19:11:42.534 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-25T19:11:42.534 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-25T19:11:42.534 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-25T19:11:42.534 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-25T19:11:42.534 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-25T19:11:42.534 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-25T19:11:42.534 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-25T19:11:42.534 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-25T19:11:42.534 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-25T19:11:42.534 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-25T19:11:42.534 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-25T19:11:42.535 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-25T19:11:42.535 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-25T19:11:42.535 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-25T19:11:42.535 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-25T19:11:42.535 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-25T19:11:42.535 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-25T19:11:42.535 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-25T19:11:42.535 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-25T19:11:42.535 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-25T19:11:42.535 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-25T19:11:42.535 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-25T19:11:42.535 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-25T19:11:42.535 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-25T19:11:42.535 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-25T19:11:42.536 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-25T19:11:42.536 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-25T19:11:42.536 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-25T19:11:42.536 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-25T19:11:42.536 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-25T19:11:42.536 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-25T19:11:42.536 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-25T19:11:42.536 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-25T19:11:42.536 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-25T19:11:42.536 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-25T19:11:42.536 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-25T19:11:42.536 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-25T19:11:42.536 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-25T19:11:42.537 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-25T19:11:42.537 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-25T19:11:42.537 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-25T19:11:42.537 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-25T19:11:42.537 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-25T19:11:42.537 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-25T19:11:42.537 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-25T19:11:42.537 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-25T19:11:42.537 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-25T19:11:42.537 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-25T19:11:42.537 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-25T19:11:42.537 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-25T19:11:42.537 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-25T19:11:42.537 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-25T19:11:42.537 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-25T19:11:42.538 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-25T19:11:42.538 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-25T19:11:42.538 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-25T19:11:42.538 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-25T19:11:42.538 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-25T19:11:42.538 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-25T19:11:42.538 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-25T19:11:42.538 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-25T19:11:42.538 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-25T19:11:42.538 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-25T19:11:42.538 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-25T19:11:42.538 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-25T19:11:42.538 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-25T19:11:42.538 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-25T19:11:42.539 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-25T19:11:42.539 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-25T19:11:42.539 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-25T19:11:42.539 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-25T19:11:42.539 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-25T19:11:42.539 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-25T19:11:42.539 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-25T19:11:42.539 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-25T19:11:42.539 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-25T19:11:42.539 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-25T19:11:42.539 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-25T19:11:42.539 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-25T19:11:42.539 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-25T19:11:42.540 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-25T19:11:42.540 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-25T19:11:42.540 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-25T19:11:42.540 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-25T19:11:42.540 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-25T19:11:42.540 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-25T19:11:42.540 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-25T19:11:42.540 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-25T19:11:42.540 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-25T19:11:42.540 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-25T19:11:42.540 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-25T19:11:42.540 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-25T19:11:42.540 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-25T19:11:42.540 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-25T19:11:42.540 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-25T19:11:42.541 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-25T19:11:42.541 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-25T19:11:42.541 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-25T19:11:42.541 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-25T19:11:42.541 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-25T19:11:42.541 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-25T19:11:42.541 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-25T19:11:42.541 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-25T19:11:42.541 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-25T19:11:42.541 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-25T19:11:42.541 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-25T19:11:42.541 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-25T19:11:42.541 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-25T19:11:42.541 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-25T19:11:42.541 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-25T19:11:42.542 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-25T19:11:42.542 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-25T19:11:42.542 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-25T19:11:42.542 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-25T19:11:42.542 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-25T19:11:42.542 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-25T19:11:42.542 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-25T19:11:42.542 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-25T19:11:42.542 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-25T19:11:42.542 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-25T19:11:42.542 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-25T19:11:42.542 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-25T19:11:42.542 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-25T19:11:42.542 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-25T19:11:42.543 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-25T19:11:42.543 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-25T19:11:42.543 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-25T19:11:42.543 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-25T19:11:42.543 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-25T19:11:42.543 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-25T19:11:42.543 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-25T19:11:42.543 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-25T19:11:42.543 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-25T19:11:42.543 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-25T19:11:42.543 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-25T19:11:42.543 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-25T19:11:42.543 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-25T19:11:42.543 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-25T19:11:42.544 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-25T19:11:42.544 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-25T19:11:42.544 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-25T19:11:42.544 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-25T19:11:42.544 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-25T19:11:42.544 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-25T19:11:42.544 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-25T19:11:42.544 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-25T19:11:42.544 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-25T19:11:42.544 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-25T19:11:42.544 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-25T19:11:42.544 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-25T19:11:42.544 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-25T19:11:42.544 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-25T19:11:42.544 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-25T19:11:42.545 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-25T19:11:42.545 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-25T19:11:42.545 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-25T19:11:42.545 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-25T19:11:42.545 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-25T19:11:42.545 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-25T19:11:42.545 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-25T19:11:42.545 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-25T19:11:42.545 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-25T19:11:42.545 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-25T19:11:42.545 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-25T19:11:42.545 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-25T19:11:42.545 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-25T19:11:42.545 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-25T19:11:42.546 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-25T19:11:42.546 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-25T19:11:42.546 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-25T19:11:42.546 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-25T19:11:42.546 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-25T19:11:42.546 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-25T19:11:42.546 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-25T19:11:42.546 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-25T19:11:42.546 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-25T19:11:42.546 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-25T19:11:42.546 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-25T19:11:42.546 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-25T19:11:42.546 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-25T19:11:42.546 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-25T19:11:42.547 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-25T19:11:42.547 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-25T19:11:42.547 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-25T19:11:42.547 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-25T19:11:42.547 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-25T19:11:42.547 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-25T19:11:42.547 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-25T19:11:42.547 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-25T19:11:42.547 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-25T19:11:42.547 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-25T19:11:42.547 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-25T19:11:42.547 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-25T19:11:42.547 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-25T19:11:42.547 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-25T19:11:42.548 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-25T19:11:42.548 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-25T19:11:42.548 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-25T19:11:42.548 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-25T19:11:42.548 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-25T19:11:42.548 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-25T19:11:42.548 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-25T19:11:42.548 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-25T19:11:42.548 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-25T19:11:42.548 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-25T19:11:42.548 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-25T19:11:42.548 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-25T19:11:42.548 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-25T19:11:42.548 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-25T19:11:42.548 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-25T19:11:42.549 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-25T19:11:42.549 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-25T19:11:42.549 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-25T19:11:42.549 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-25T19:11:42.549 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-25T19:11:42.549 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-25T19:11:42.549 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-25T19:11:42.549 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-25T19:11:42.549 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-25T19:11:42.549 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-25T19:11:42.549 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-25T19:11:42.549 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-25T19:11:42.549 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-25T19:11:42.549 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-25T19:11:42.550 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-25T19:11:42.550 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-25T19:11:42.550 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-25T19:11:42.550 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-25T19:11:42.550 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-25T19:11:42.550 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-25T19:11:42.550 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-25T19:11:42.550 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-25T19:11:42.550 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-25T19:11:42.550 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-25T19:11:42.550 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-25T19:11:42.550 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-25T19:11:42.550 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-25T19:11:42.550 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-25T19:11:42.551 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-25T19:11:42.551 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-25T19:11:42.551 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-25T19:11:42.551 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-25T19:11:42.551 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-25T19:11:42.551 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-25T19:11:42.551 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-25T19:11:42.551 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-25T19:11:42.551 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-25T19:11:42.551 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-25T19:11:42.551 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-25T19:11:42.551 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-25T19:11:42.551 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-25T19:11:42.552 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-25T19:11:42.552 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-25T19:11:42.552 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-25T19:11:42.552 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-25T19:11:42.552 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-25T19:11:42.552 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-25T19:11:42.552 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-25T19:11:42.552 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-25T19:11:42.552 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-25T19:11:42.552 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-25T19:11:42.552 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-25T19:11:42.552 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-25T19:11:42.552 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-25T19:11:42.552 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-25T19:11:42.552 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-25T19:11:42.553 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-25T19:11:42.553 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-25T19:11:42.553 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-25T19:11:42.553 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-25T19:11:42.553 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-25T19:11:42.553 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-25T19:11:42.553 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-25T19:11:42.553 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-25T19:11:42.553 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-25T19:11:42.553 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-25T19:11:42.553 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-25T19:11:42.553 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-25T19:11:42.553 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-25T19:11:42.553 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-25T19:11:42.554 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-25T19:11:42.554 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-25T19:11:42.554 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-25T19:11:42.554 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-25T19:11:42.554 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-25T19:11:42.554 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-25T19:11:42.554 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-25T19:11:42.554 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-25T19:11:42.554 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-25T19:11:42.554 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-25T19:11:42.554 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-25T19:11:42.554 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-25T19:11:42.554 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-25T19:11:42.554 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-25T19:11:42.555 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-25T19:11:42.555 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-25T19:11:42.555 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-25T19:11:42.555 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-25T19:11:42.555 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-25T19:11:42.555 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-25T19:11:42.555 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-25T19:11:42.555 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-25T19:11:42.555 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-25T19:11:42.555 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-25T19:11:42.555 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-25T19:11:42.555 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-25T19:11:42.555 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-25T19:11:42.556 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-25T19:11:42.556 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-25T19:11:42.556 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-25T19:11:42.556 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-25T19:11:42.556 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-25T19:11:42.556 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-25T19:11:42.556 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-25T19:11:42.556 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-25T19:11:42.556 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-25T19:11:42.556 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-25T19:11:42.556 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-25T19:11:42.556 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-25T19:11:42.556 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-25T19:11:42.556 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-25T19:11:42.556 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-25T19:11:42.557 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-25T19:11:42.557 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-25T19:11:42.557 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-25T19:11:42.557 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-25T19:11:42.557 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-25T19:11:42.557 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-25T19:11:42.557 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-25T19:11:42.557 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-25T19:11:42.557 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-25T19:11:42.557 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-25T19:11:42.557 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-25T19:11:42.557 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-25T19:11:42.557 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-25T19:11:42.557 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-25T19:11:42.558 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-25T19:11:42.558 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-25T19:11:42.558 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-25T19:11:42.558 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-25T19:11:42.558 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-25T19:11:42.558 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-25T19:11:42.558 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-25T19:11:42.558 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-25T19:11:42.558 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-25T19:11:42.558 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-25T19:11:42.558 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-25T19:11:42.558 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-25T19:11:42.558 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-25T19:11:42.558 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-25T19:11:42.559 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-25T19:11:42.559 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-25T19:11:42.559 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-25T19:11:42.559 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-25T19:11:42.559 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-25T19:11:42.559 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-25T19:11:42.559 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-25T19:11:42.559 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-25T19:11:42.559 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-25T19:11:42.559 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-25T19:11:42.559 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-25T19:11:42.559 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-25T19:11:42.559 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-25T19:11:42.559 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-25T19:11:42.560 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-25T19:11:42.560 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-25T19:11:42.560 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-25T19:11:42.560 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-25T19:11:42.560 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-25T19:11:42.560 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-25T19:11:42.560 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-25T19:11:42.560 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-25T19:11:42.560 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-25T19:11:42.560 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-25T19:11:42.560 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-25T19:11:42.560 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-25T19:11:42.564 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-25T19:11:42.564 DEBUG:teuthology.orchestra.run.smithi131:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-25T19:11:42.588 INFO:teuthology.orchestra.run.smithi131.stdout:postinstall scriptlet (using /bin/sh): 2024-04-25T19:11:42.588 INFO:teuthology.orchestra.run.smithi131.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-25T19:11:42.588 INFO:teuthology.orchestra.run.smithi131.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-25T19:11:42.588 INFO:teuthology.orchestra.run.smithi131.stdout:fi 2024-04-25T19:11:42.588 INFO:teuthology.orchestra.run.smithi131.stdout:for file in vmlinuz System.map config; do 2024-04-25T19:11:42.589 INFO:teuthology.orchestra.run.smithi131.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-25T19:11:42.589 INFO:teuthology.orchestra.run.smithi131.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-25T19:11:42.589 INFO:teuthology.orchestra.run.smithi131.stdout: fi 2024-04-25T19:11:42.589 INFO:teuthology.orchestra.run.smithi131.stdout:done 2024-04-25T19:11:42.589 INFO:teuthology.orchestra.run.smithi131.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-25T19:11:42.589 INFO:teuthology.orchestra.run.smithi131.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-25T19:11:42.589 INFO:teuthology.orchestra.run.smithi131.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-25T19:11:42.589 INFO:teuthology.orchestra.run.smithi131.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-25T19:11:42.589 INFO:teuthology.orchestra.run.smithi131.stdout:fi 2024-04-25T19:11:42.589 INFO:teuthology.orchestra.run.smithi131.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-25T19:11:42.589 INFO:teuthology.orchestra.run.smithi131.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-25T19:11:42.589 INFO:teuthology.orchestra.run.smithi131.stdout:fi 2024-04-25T19:11:42.589 INFO:teuthology.orchestra.run.smithi131.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-25T19:11:42.589 INFO:teuthology.orchestra.run.smithi131.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-25T19:11:42.590 INFO:teuthology.orchestra.run.smithi131.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-25T19:11:42.590 INFO:teuthology.orchestra.run.smithi131.stdout:fi 2024-04-25T19:11:42.591 DEBUG:teuthology.orchestra.run.smithi131:> sudo rpm -qi grub2-tools 2024-04-25T19:11:42.665 INFO:teuthology.orchestra.run.smithi131.stdout:Name : grub2-tools 2024-04-25T19:11:42.665 INFO:teuthology.orchestra.run.smithi131.stdout:Epoch : 1 2024-04-25T19:11:42.665 INFO:teuthology.orchestra.run.smithi131.stdout:Version : 2.06 2024-04-25T19:11:42.665 INFO:teuthology.orchestra.run.smithi131.stdout:Release : 68.el9 2024-04-25T19:11:42.665 INFO:teuthology.orchestra.run.smithi131.stdout:Architecture: x86_64 2024-04-25T19:11:42.665 INFO:teuthology.orchestra.run.smithi131.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-25T19:11:42.665 INFO:teuthology.orchestra.run.smithi131.stdout:Group : Unspecified 2024-04-25T19:11:42.666 INFO:teuthology.orchestra.run.smithi131.stdout:Size : 8264254 2024-04-25T19:11:42.666 INFO:teuthology.orchestra.run.smithi131.stdout:License : GPLv3+ 2024-04-25T19:11:42.666 INFO:teuthology.orchestra.run.smithi131.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-25T19:11:42.666 INFO:teuthology.orchestra.run.smithi131.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-25T19:11:42.666 INFO:teuthology.orchestra.run.smithi131.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-25T19:11:42.666 INFO:teuthology.orchestra.run.smithi131.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-25T19:11:42.666 INFO:teuthology.orchestra.run.smithi131.stdout:Packager : builder@centos.org 2024-04-25T19:11:42.666 INFO:teuthology.orchestra.run.smithi131.stdout:Vendor : CentOS 2024-04-25T19:11:42.666 INFO:teuthology.orchestra.run.smithi131.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-25T19:11:42.666 INFO:teuthology.orchestra.run.smithi131.stdout:Summary : Support tools for GRUB. 2024-04-25T19:11:42.666 INFO:teuthology.orchestra.run.smithi131.stdout:Description : 2024-04-25T19:11:42.666 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:11:42.666 INFO:teuthology.orchestra.run.smithi131.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-25T19:11:42.666 INFO:teuthology.orchestra.run.smithi131.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-25T19:11:42.667 INFO:teuthology.orchestra.run.smithi131.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-25T19:11:42.667 INFO:teuthology.orchestra.run.smithi131.stdout:hardware devices. 2024-04-25T19:11:42.667 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:11:42.667 INFO:teuthology.orchestra.run.smithi131.stdout:This subpackage provides tools for support of all platforms. 2024-04-25T19:11:42.668 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-25T19:11:42.668 INFO:teuthology.task.kernel:Updating grub on smithi131 to boot 6.9.0-rc3-g806ec36b2112 2024-04-25T19:11:42.668 DEBUG:teuthology.orchestra.run.smithi131:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-25T19:11:43.267 INFO:teuthology.orchestra.run.smithi131.stderr:Generating grub configuration file ... 2024-04-25T19:11:44.648 INFO:teuthology.orchestra.run.smithi131.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-25T19:11:44.679 INFO:teuthology.orchestra.run.smithi131.stderr:done 2024-04-25T19:11:44.682 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2024-04-25T19:11:44.698 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.7NeN6SWxQV 2024-04-25T19:11:44.699 DEBUG:teuthology.orchestra.run.smithi131:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.7NeN6SWxQV 2024-04-25T19:11:44.763 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.7NeN6SWxQV 2024-04-25T19:11:44.901 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.7NeN6SWxQV is 6KB 2024-04-25T19:11:44.950 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.7NeN6SWxQV 2024-04-25T19:11:44.964 DEBUG:teuthology.orchestra.run.smithi131:> sudo /bin/ls /boot/loader/entries || true 2024-04-25T19:11:45.025 INFO:teuthology.orchestra.run.smithi131.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-25T19:11:45.026 INFO:teuthology.orchestra.run.smithi131.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-25T19:11:45.026 INFO:teuthology.orchestra.run.smithi131.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-25T19:11:45.026 INFO:teuthology.orchestra.run.smithi131.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-25T19:11:45.027 DEBUG:teuthology.orchestra.run.smithi131:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-25T19:11:45.183 DEBUG:teuthology.orchestra.run.smithi131:> sudo shutdown -r now 2024-04-25T19:12:10.672 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-04-25T19:12:10.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-25T19:12:10.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T19:12:15.190 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-25T19:12:15.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-04-25T19:12:15.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T19:12:29.215 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-04-25T19:12:33.566 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-04-25T19:12:38.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-25T19:12:38.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T19:12:42.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-04-25T19:12:42.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T19:12:45.630 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-04-25T19:12:57.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-04-25T19:12:57.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T19:13:29.571 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-04-25T19:13:30.145 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-04-25T19:13:30.146 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-04-25T19:13:30.146 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2024-04-25T19:13:30.187 INFO:teuthology.orchestra.run.smithi131.stdout:6.9.0-rc3-g806ec36b2112 2024-04-25T19:13:30.187 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-25T19:13:30.187 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T19:13:30.187 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-25T19:13:31.188 DEBUG:teuthology.parallel:result is None 2024-04-25T19:13:38.221 DEBUG:teuthology.orchestra.remote:timed out 2024-04-25T19:13:50.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-25T19:13:50.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T19:13:50.638 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-04-25T19:13:51.262 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-25T19:13:51.262 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.9.0-rc3-g806ec36b2112"... 2024-04-25T19:13:51.262 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-04-25T19:13:51.314 INFO:teuthology.orchestra.run.smithi195.stdout:6.9.0-rc3-g806ec36b2112 2024-04-25T19:13:51.315 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-25T19:13:51.315 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T19:13:51.315 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-25T19:13:52.316 DEBUG:teuthology.parallel:result is None 2024-04-25T19:13:52.316 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T19:13:52.324 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T19:13:52.324 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T19:13:52.333 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T19:13:52.390 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T19:13:52.417 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T19:13:52.486 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T19:13:52.486 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T19:13:52.493 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T19:13:52.559 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T19:13:52.566 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T19:13:52.566 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T19:13:52.573 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T19:13:52.700 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T19:13:52.705 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T19:13:52.759 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T19:13:52.767 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T19:13:52.772 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T19:13:52.780 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T19:13:52.780 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T19:13:52.784 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T19:13:52.869 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T19:13:52.878 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T19:13:52.878 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T19:13:52.885 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T19:13:52.936 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T19:13:53.018 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T19:13:53.111 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T19:13:53.193 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T19:13:53.279 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:13:53.279 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T19:13:53.364 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T19:13:53.449 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T19:13:53.539 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T19:13:53.623 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T19:13:53.702 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:13:53.702 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T19:13:53.781 DEBUG:teuthology.orchestra.run.smithi131:> sudo service rsyslog restart 2024-04-25T19:13:53.788 DEBUG:teuthology.orchestra.run.smithi195:> sudo service rsyslog restart 2024-04-25T19:13:53.905 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T19:13:53.933 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T19:13:54.267 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T19:13:54.276 INFO:teuthology.task.internal:Starting timer... 2024-04-25T19:13:54.276 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T19:13:54.324 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T19:13:54.363 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-25T19:13:54.363 DEBUG:teuthology.orchestra.run.smithi131:> sudo service auditd rotate 2024-04-25T19:13:54.468 INFO:teuthology.orchestra.run.smithi131.stdout:Rotating logs: 2024-04-25T19:13:54.473 DEBUG:teuthology.orchestra.run.smithi195:> sudo service auditd rotate 2024-04-25T19:13:54.596 INFO:teuthology.orchestra.run.smithi195.stdout:Rotating logs: 2024-04-25T19:13:54.600 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T19:13:54.600 DEBUG:teuthology.orchestra.run.smithi131:> /usr/sbin/getenforce 2024-04-25T19:13:54.661 INFO:teuthology.orchestra.run.smithi131.stdout:Permissive 2024-04-25T19:13:54.662 DEBUG:teuthology.orchestra.run.smithi195:> /usr/sbin/getenforce 2024-04-25T19:13:54.719 INFO:teuthology.orchestra.run.smithi195.stdout:Permissive 2024-04-25T19:13:54.719 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi131.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi195.front.sepia.ceph.com': 'permissive'} 2024-04-25T19:13:54.719 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T19:13:54.802 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T19:13:54.802 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T19:13:54.878 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T19:13:54.879 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T19:13:54.879 DEBUG:teuthology.orchestra.run.smithi131:> sudo /usr/sbin/setenforce permissive 2024-04-25T19:13:54.949 DEBUG:teuthology.orchestra.run.smithi195:> sudo /usr/sbin/setenforce permissive 2024-04-25T19:13:55.032 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T19:13:55.042 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-25T19:13:55.047 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-25T19:13:55.169 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T19:13:55.183 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T19:13:55.184 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi131.front.sepia.ceph.com,smithi195.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T19:18:59.877 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi131.front.sepia.ceph.com'), Remote(name='ubuntu@smithi195.front.sepia.ceph.com')] 2024-04-25T19:18:59.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-04-25T19:18:59.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T19:18:59.989 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-04-25T19:19:00.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-04-25T19:19:00.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-25T19:19:00.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T19:19:00.244 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-04-25T19:19:00.386 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-25T19:19:00.387 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T19:19:00.397 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T19:19:00.397 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T19:19:00.398 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T19:19:00.406 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T19:19:00.406 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T19:19:00.492 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T19:19:00.496 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T19:19:00.533 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T19:19:00.533 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T19:19:00.600 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: ntpd: command not found 2024-04-25T19:19:00.607 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: ntpd: command not found 2024-04-25T19:19:00.632 INFO:teuthology.orchestra.run.smithi195.stdout:506 Cannot talk to daemon 2024-04-25T19:19:00.638 INFO:teuthology.orchestra.run.smithi131.stdout:506 Cannot talk to daemon 2024-04-25T19:19:00.671 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T19:19:00.676 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T19:19:00.711 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T19:19:00.716 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T19:19:00.842 INFO:teuthology.orchestra.run.smithi131.stderr:bash: line 1: ntpq: command not found 2024-04-25T19:19:00.849 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T19:19:00.850 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2024-04-25T19:19:00.850 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T19:19:00.850 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T19:19:00.850 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T19:19:00.850 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T19:19:00.851 INFO:teuthology.orchestra.run.smithi195.stderr:bash: line 1: ntpq: command not found 2024-04-25T19:19:00.860 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T19:19:00.860 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2024-04-25T19:19:00.860 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T19:19:00.860 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T19:19:00.860 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T19:19:00.860 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T19:19:00.861 INFO:teuthology.run_tasks:Running task install... 2024-04-25T19:19:00.873 DEBUG:teuthology.task.install:project ceph 2024-04-25T19:19:00.873 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}} 2024-04-25T19:19:00.873 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'} 2024-04-25T19:19:00.873 INFO:teuthology.task.install:Using flavor: default 2024-04-25T19:19:00.879 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T19:19:00.879 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T19:19:00.880 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'tag': None, 'wait_for_package': False} 2024-04-25T19:19:00.880 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T19:19:00.882 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'tag': None, 'wait_for_package': False} 2024-04-25T19:19:00.882 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T19:19:01.025 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/ 2024-04-25T19:19:01.025 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3291.g994e2f20 2024-04-25T19:19:01.031 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/ 2024-04-25T19:19:01.031 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3291.g994e2f20 2024-04-25T19:19:01.332 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T19:19:01.332 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:19:01.332 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T19:19:01.397 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T19:19:01.397 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:19:01.397 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T19:19:01.423 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T19:19:01.423 DEBUG:teuthology.orchestra.run.smithi195:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/994e2f20102a20fa9a27966c14b625cc01884df8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T19:19:01.486 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T19:19:01.486 DEBUG:teuthology.orchestra.run.smithi131:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/994e2f20102a20fa9a27966c14b625cc01884df8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T19:19:01.547 DEBUG:teuthology.orchestra.run.smithi195:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T19:19:01.615 DEBUG:teuthology.orchestra.run.smithi131:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T19:19:01.658 DEBUG:teuthology.orchestra.run.smithi195:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T19:19:01.725 DEBUG:teuthology.orchestra.run.smithi131:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T19:19:01.734 INFO:teuthology.orchestra.run.smithi195.stdout:check_obsoletes = 1 2024-04-25T19:19:01.738 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum clean all 2024-04-25T19:19:01.803 INFO:teuthology.orchestra.run.smithi131.stdout:check_obsoletes = 1 2024-04-25T19:19:01.807 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum clean all 2024-04-25T19:19:02.055 INFO:teuthology.orchestra.run.smithi195.stdout:48 files removed 2024-04-25T19:19:02.094 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T19:19:02.117 INFO:teuthology.orchestra.run.smithi131.stdout:48 files removed 2024-04-25T19:19:02.154 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T19:19:03.441 INFO:teuthology.orchestra.run.smithi131.stdout:ceph packages for x86_64 95 kB/s | 84 kB 00:00 2024-04-25T19:19:03.633 INFO:teuthology.orchestra.run.smithi195.stdout:ceph packages for x86_64 76 kB/s | 84 kB 00:01 2024-04-25T19:19:04.125 INFO:teuthology.orchestra.run.smithi131.stdout:ceph noarch packages 20 kB/s | 12 kB 00:00 2024-04-25T19:19:04.484 INFO:teuthology.orchestra.run.smithi195.stdout:ceph noarch packages 16 kB/s | 12 kB 00:00 2024-04-25T19:19:04.967 INFO:teuthology.orchestra.run.smithi131.stdout:ceph source packages 2.5 kB/s | 1.9 kB 00:00 2024-04-25T19:19:05.409 INFO:teuthology.orchestra.run.smithi195.stdout:ceph source packages 2.3 kB/s | 1.9 kB 00:00 2024-04-25T19:19:06.679 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - BaseOS 6.8 MB/s | 8.0 MB 00:01 2024-04-25T19:19:06.871 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.0 MB 00:01 2024-04-25T19:19:11.613 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - AppStream 5.1 MB/s | 19 MB 00:03 2024-04-25T19:19:11.689 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - AppStream 5.3 MB/s | 19 MB 00:03 2024-04-25T19:19:16.723 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - CRB 5.2 MB/s | 6.2 MB 00:01 2024-04-25T19:19:16.815 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 6.2 MB 00:01 2024-04-25T19:19:18.593 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 16 kB 00:00 2024-04-25T19:19:19.676 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - Extras packages 11 kB/s | 16 kB 00:01 2024-04-25T19:19:20.733 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-25T19:19:21.685 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-25T19:19:26.661 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-04-25T19:19:27.595 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-04-25T19:19:29.113 INFO:teuthology.orchestra.run.smithi195.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T19:19:29.114 INFO:teuthology.orchestra.run.smithi195.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T19:19:29.125 INFO:teuthology.orchestra.run.smithi195.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T19:19:29.126 INFO:teuthology.orchestra.run.smithi195.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T19:19:29.127 INFO:teuthology.orchestra.run.smithi195.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T19:19:29.128 INFO:teuthology.orchestra.run.smithi195.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T19:19:29.129 INFO:teuthology.orchestra.run.smithi195.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T19:19:29.132 INFO:teuthology.orchestra.run.smithi195.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T19:19:29.133 INFO:teuthology.orchestra.run.smithi195.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T19:19:29.198 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-25T19:19:29.219 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================= 2024-04-25T19:19:29.219 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-04-25T19:19:29.220 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================= 2024-04-25T19:19:29.220 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-04-25T19:19:29.220 INFO:teuthology.orchestra.run.smithi195.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T19:19:29.220 INFO:teuthology.orchestra.run.smithi195.stdout: ceph x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 6.6 k 2024-04-25T19:19:29.220 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.4 M 2024-04-25T19:19:29.220 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 863 k 2024-04-25T19:19:29.220 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 147 k 2024-04-25T19:19:29.220 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.5 M 2024-04-25T19:19:29.220 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 142 k 2024-04-25T19:19:29.220 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 3.5 M 2024-04-25T19:19:29.220 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 7.4 M 2024-04-25T19:19:29.220 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 49 k 2024-04-25T19:19:29.220 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 10 M 2024-04-25T19:19:29.221 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 43 M 2024-04-25T19:19:29.221 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-volume noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 273 k 2024-04-25T19:19:29.221 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 762 k 2024-04-25T19:19:29.221 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 224 k 2024-04-25T19:19:29.221 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-shell x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 27 k 2024-04-25T19:19:29.221 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-top noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 18 k 2024-04-25T19:19:29.221 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T19:19:29.221 INFO:teuthology.orchestra.run.smithi195.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T19:19:29.221 INFO:teuthology.orchestra.run.smithi195.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T19:19:29.221 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 32 k 2024-04-25T19:19:29.221 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 756 k 2024-04-25T19:19:29.221 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 127 k 2024-04-25T19:19:29.221 INFO:teuthology.orchestra.run.smithi195.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T19:19:29.221 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T19:19:29.222 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T19:19:29.222 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T19:19:29.222 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T19:19:29.222 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T19:19:29.222 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 161 k 2024-04-25T19:19:29.222 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 321 k 2024-04-25T19:19:29.222 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 298 k 2024-04-25T19:19:29.222 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 100 k 2024-04-25T19:19:29.222 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 86 k 2024-04-25T19:19:29.222 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.0 M 2024-04-25T19:19:29.222 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 169 k 2024-04-25T19:19:29.222 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T19:19:29.222 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrading: 2024-04-25T19:19:29.223 INFO:teuthology.orchestra.run.smithi195.stdout: librados2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.3 M 2024-04-25T19:19:29.223 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.1 M 2024-04-25T19:19:29.223 INFO:teuthology.orchestra.run.smithi195.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T19:19:29.223 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T19:19:29.223 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-04-25T19:19:29.223 INFO:teuthology.orchestra.run.smithi195.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T19:19:29.223 INFO:teuthology.orchestra.run.smithi195.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T19:19:29.223 INFO:teuthology.orchestra.run.smithi195.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T19:19:29.223 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 20 M 2024-04-25T19:19:29.223 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 34 k 2024-04-25T19:19:29.223 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 2.3 M 2024-04-25T19:19:29.223 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 249 k 2024-04-25T19:19:29.223 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 4.9 M 2024-04-25T19:19:29.223 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 18 M 2024-04-25T19:19:29.224 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 16 k 2024-04-25T19:19:29.224 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 25 k 2024-04-25T19:19:29.224 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T19:19:29.224 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T19:19:29.224 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T19:19:29.224 INFO:teuthology.orchestra.run.smithi195.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T19:19:29.224 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T19:19:29.224 INFO:teuthology.orchestra.run.smithi195.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T19:19:29.224 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T19:19:29.224 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T19:19:29.224 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 158 k 2024-04-25T19:19:29.224 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T19:19:29.224 INFO:teuthology.orchestra.run.smithi195.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T19:19:29.224 INFO:teuthology.orchestra.run.smithi195.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T19:19:29.224 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T19:19:29.225 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T19:19:29.225 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 497 k 2024-04-25T19:19:29.225 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T19:19:29.225 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.2 M 2024-04-25T19:19:29.225 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T19:19:29.225 INFO:teuthology.orchestra.run.smithi195.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T19:19:29.225 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T19:19:29.225 INFO:teuthology.orchestra.run.smithi195.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T19:19:29.225 INFO:teuthology.orchestra.run.smithi195.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T19:19:29.225 INFO:teuthology.orchestra.run.smithi195.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T19:19:29.225 INFO:teuthology.orchestra.run.smithi195.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T19:19:29.225 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T19:19:29.225 INFO:teuthology.orchestra.run.smithi195.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T19:19:29.225 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T19:19:29.225 INFO:teuthology.orchestra.run.smithi195.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T19:19:29.226 INFO:teuthology.orchestra.run.smithi195.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T19:19:29.226 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T19:19:29.226 INFO:teuthology.orchestra.run.smithi195.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T19:19:29.226 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T19:19:29.226 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T19:19:29.226 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T19:19:29.226 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 45 k 2024-04-25T19:19:29.226 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 135 k 2024-04-25T19:19:29.226 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T19:19:29.226 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T19:19:29.226 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T19:19:29.226 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T19:19:29.226 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T19:19:29.226 INFO:teuthology.orchestra.run.smithi195.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T19:19:29.227 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T19:19:29.227 INFO:teuthology.orchestra.run.smithi195.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T19:19:29.227 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T19:19:29.227 INFO:teuthology.orchestra.run.smithi195.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T19:19:29.227 INFO:teuthology.orchestra.run.smithi195.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T19:19:29.227 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T19:19:29.227 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T19:19:29.227 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T19:19:29.227 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T19:19:29.227 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T19:19:29.227 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T19:19:29.227 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T19:19:29.227 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T19:19:29.227 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T19:19:29.227 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T19:19:29.228 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T19:19:29.228 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T19:19:29.228 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T19:19:29.228 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T19:19:29.228 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T19:19:29.228 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T19:19:29.228 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T19:19:29.228 INFO:teuthology.orchestra.run.smithi195.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T19:19:29.228 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T19:19:29.228 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T19:19:29.228 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T19:19:29.228 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T19:19:29.228 INFO:teuthology.orchestra.run.smithi195.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T19:19:29.228 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T19:19:29.228 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T19:19:29.228 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T19:19:29.229 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T19:19:29.229 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T19:19:29.229 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T19:19:29.229 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T19:19:29.229 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T19:19:29.229 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T19:19:29.229 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T19:19:29.229 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T19:19:29.229 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T19:19:29.229 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T19:19:29.229 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T19:19:29.229 INFO:teuthology.orchestra.run.smithi195.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T19:19:29.229 INFO:teuthology.orchestra.run.smithi195.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T19:19:29.229 INFO:teuthology.orchestra.run.smithi195.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T19:19:29.229 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T19:19:29.229 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T19:19:29.230 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T19:19:29.230 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T19:19:29.230 INFO:teuthology.orchestra.run.smithi195.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T19:19:29.230 INFO:teuthology.orchestra.run.smithi195.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T19:19:29.230 INFO:teuthology.orchestra.run.smithi195.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T19:19:29.230 INFO:teuthology.orchestra.run.smithi195.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T19:19:29.230 INFO:teuthology.orchestra.run.smithi195.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T19:19:29.230 INFO:teuthology.orchestra.run.smithi195.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T19:19:29.230 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T19:19:29.230 INFO:teuthology.orchestra.run.smithi195.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T19:19:29.230 INFO:teuthology.orchestra.run.smithi195.stdout:Installing weak dependencies: 2024-04-25T19:19:29.230 INFO:teuthology.orchestra.run.smithi195.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T19:19:29.230 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:19:29.231 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-25T19:19:29.231 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================= 2024-04-25T19:19:29.231 INFO:teuthology.orchestra.run.smithi195.stdout:Install 148 Packages 2024-04-25T19:19:29.231 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrade 4 Packages 2024-04-25T19:19:29.231 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:19:29.231 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 214 M 2024-04-25T19:19:29.231 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-25T19:19:30.012 INFO:teuthology.orchestra.run.smithi131.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T19:19:30.014 INFO:teuthology.orchestra.run.smithi131.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T19:19:30.034 INFO:teuthology.orchestra.run.smithi131.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T19:19:30.036 INFO:teuthology.orchestra.run.smithi131.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T19:19:30.037 INFO:teuthology.orchestra.run.smithi131.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T19:19:30.038 INFO:teuthology.orchestra.run.smithi131.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T19:19:30.041 INFO:teuthology.orchestra.run.smithi131.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T19:19:30.044 INFO:teuthology.orchestra.run.smithi131.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T19:19:30.046 INFO:teuthology.orchestra.run.smithi131.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T19:19:30.117 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-25T19:19:30.136 INFO:teuthology.orchestra.run.smithi131.stdout:======================================================================================= 2024-04-25T19:19:30.137 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-04-25T19:19:30.137 INFO:teuthology.orchestra.run.smithi131.stdout:======================================================================================= 2024-04-25T19:19:30.137 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-04-25T19:19:30.137 INFO:teuthology.orchestra.run.smithi131.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T19:19:30.137 INFO:teuthology.orchestra.run.smithi131.stdout: ceph x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 6.6 k 2024-04-25T19:19:30.137 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.4 M 2024-04-25T19:19:30.137 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 863 k 2024-04-25T19:19:30.137 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 147 k 2024-04-25T19:19:30.137 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.5 M 2024-04-25T19:19:30.137 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 142 k 2024-04-25T19:19:30.137 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 3.5 M 2024-04-25T19:19:30.137 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 7.4 M 2024-04-25T19:19:30.138 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 49 k 2024-04-25T19:19:30.138 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 10 M 2024-04-25T19:19:30.138 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 43 M 2024-04-25T19:19:30.138 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-volume noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 273 k 2024-04-25T19:19:30.138 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 762 k 2024-04-25T19:19:30.138 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 224 k 2024-04-25T19:19:30.138 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-shell x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 27 k 2024-04-25T19:19:30.138 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-top noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 18 k 2024-04-25T19:19:30.138 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T19:19:30.138 INFO:teuthology.orchestra.run.smithi131.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T19:19:30.138 INFO:teuthology.orchestra.run.smithi131.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T19:19:30.138 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 32 k 2024-04-25T19:19:30.138 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 756 k 2024-04-25T19:19:30.138 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 127 k 2024-04-25T19:19:30.139 INFO:teuthology.orchestra.run.smithi131.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T19:19:30.139 INFO:teuthology.orchestra.run.smithi131.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T19:19:30.139 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T19:19:30.139 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T19:19:30.139 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T19:19:30.139 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T19:19:30.139 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 161 k 2024-04-25T19:19:30.139 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 321 k 2024-04-25T19:19:30.139 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 298 k 2024-04-25T19:19:30.139 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 100 k 2024-04-25T19:19:30.139 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 86 k 2024-04-25T19:19:30.139 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.0 M 2024-04-25T19:19:30.139 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 169 k 2024-04-25T19:19:30.140 INFO:teuthology.orchestra.run.smithi131.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T19:19:30.140 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrading: 2024-04-25T19:19:30.140 INFO:teuthology.orchestra.run.smithi131.stdout: librados2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.3 M 2024-04-25T19:19:30.140 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.1 M 2024-04-25T19:19:30.140 INFO:teuthology.orchestra.run.smithi131.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T19:19:30.140 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T19:19:30.140 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-04-25T19:19:30.140 INFO:teuthology.orchestra.run.smithi131.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T19:19:30.140 INFO:teuthology.orchestra.run.smithi131.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T19:19:30.140 INFO:teuthology.orchestra.run.smithi131.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T19:19:30.140 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 20 M 2024-04-25T19:19:30.140 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 34 k 2024-04-25T19:19:30.140 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 2.3 M 2024-04-25T19:19:30.140 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 249 k 2024-04-25T19:19:30.141 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 4.9 M 2024-04-25T19:19:30.141 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 18 M 2024-04-25T19:19:30.141 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 16 k 2024-04-25T19:19:30.141 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 25 k 2024-04-25T19:19:30.141 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T19:19:30.141 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T19:19:30.141 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T19:19:30.141 INFO:teuthology.orchestra.run.smithi131.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T19:19:30.141 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T19:19:30.141 INFO:teuthology.orchestra.run.smithi131.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T19:19:30.141 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T19:19:30.141 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T19:19:30.141 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 158 k 2024-04-25T19:19:30.141 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T19:19:30.142 INFO:teuthology.orchestra.run.smithi131.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T19:19:30.142 INFO:teuthology.orchestra.run.smithi131.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T19:19:30.142 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T19:19:30.142 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T19:19:30.142 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 497 k 2024-04-25T19:19:30.142 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T19:19:30.142 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.2 M 2024-04-25T19:19:30.142 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T19:19:30.142 INFO:teuthology.orchestra.run.smithi131.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T19:19:30.142 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T19:19:30.142 INFO:teuthology.orchestra.run.smithi131.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T19:19:30.142 INFO:teuthology.orchestra.run.smithi131.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T19:19:30.142 INFO:teuthology.orchestra.run.smithi131.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T19:19:30.143 INFO:teuthology.orchestra.run.smithi131.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T19:19:30.143 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T19:19:30.143 INFO:teuthology.orchestra.run.smithi131.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T19:19:30.143 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T19:19:30.143 INFO:teuthology.orchestra.run.smithi131.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T19:19:30.143 INFO:teuthology.orchestra.run.smithi131.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T19:19:30.143 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T19:19:30.143 INFO:teuthology.orchestra.run.smithi131.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T19:19:30.143 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T19:19:30.143 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T19:19:30.143 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T19:19:30.143 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 45 k 2024-04-25T19:19:30.143 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 135 k 2024-04-25T19:19:30.143 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T19:19:30.143 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T19:19:30.144 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T19:19:30.144 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T19:19:30.144 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T19:19:30.144 INFO:teuthology.orchestra.run.smithi131.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T19:19:30.144 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T19:19:30.144 INFO:teuthology.orchestra.run.smithi131.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T19:19:30.144 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T19:19:30.144 INFO:teuthology.orchestra.run.smithi131.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T19:19:30.144 INFO:teuthology.orchestra.run.smithi131.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T19:19:30.144 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T19:19:30.144 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T19:19:30.144 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T19:19:30.144 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T19:19:30.145 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T19:19:30.145 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T19:19:30.145 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T19:19:30.145 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T19:19:30.145 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T19:19:30.145 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T19:19:30.145 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T19:19:30.145 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T19:19:30.145 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T19:19:30.145 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T19:19:30.145 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T19:19:30.145 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T19:19:30.145 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T19:19:30.145 INFO:teuthology.orchestra.run.smithi131.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T19:19:30.145 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T19:19:30.146 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T19:19:30.146 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T19:19:30.146 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T19:19:30.146 INFO:teuthology.orchestra.run.smithi131.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T19:19:30.146 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T19:19:30.146 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T19:19:30.146 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T19:19:30.146 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T19:19:30.146 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T19:19:30.146 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T19:19:30.146 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T19:19:30.146 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T19:19:30.146 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T19:19:30.147 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T19:19:30.147 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T19:19:30.147 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T19:19:30.147 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T19:19:30.147 INFO:teuthology.orchestra.run.smithi131.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T19:19:30.147 INFO:teuthology.orchestra.run.smithi131.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T19:19:30.147 INFO:teuthology.orchestra.run.smithi131.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T19:19:30.147 INFO:teuthology.orchestra.run.smithi131.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T19:19:30.147 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T19:19:30.147 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T19:19:30.147 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T19:19:30.147 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T19:19:30.147 INFO:teuthology.orchestra.run.smithi131.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T19:19:30.147 INFO:teuthology.orchestra.run.smithi131.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T19:19:30.148 INFO:teuthology.orchestra.run.smithi131.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T19:19:30.148 INFO:teuthology.orchestra.run.smithi131.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T19:19:30.148 INFO:teuthology.orchestra.run.smithi131.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T19:19:30.148 INFO:teuthology.orchestra.run.smithi131.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T19:19:30.148 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T19:19:30.148 INFO:teuthology.orchestra.run.smithi131.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T19:19:30.148 INFO:teuthology.orchestra.run.smithi131.stdout:Installing weak dependencies: 2024-04-25T19:19:30.148 INFO:teuthology.orchestra.run.smithi131.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T19:19:30.148 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:19:30.148 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-04-25T19:19:30.148 INFO:teuthology.orchestra.run.smithi131.stdout:======================================================================================= 2024-04-25T19:19:30.148 INFO:teuthology.orchestra.run.smithi131.stdout:Install 148 Packages 2024-04-25T19:19:30.148 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrade 4 Packages 2024-04-25T19:19:30.148 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:19:30.149 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 214 M 2024-04-25T19:19:30.149 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-04-25T19:19:30.454 INFO:teuthology.orchestra.run.smithi195.stdout:(1/152): ceph-19.0.0-3291.g994e2f20.el9.x86_64. 18 kB/s | 6.6 kB 00:00 2024-04-25T19:19:30.771 INFO:teuthology.orchestra.run.smithi195.stdout:(2/152): ceph-base-19.0.0-3291.g994e2f20.el9.x8 7.9 MB/s | 5.4 MB 00:00 2024-04-25T19:19:30.821 INFO:teuthology.orchestra.run.smithi195.stdout:(3/152): ceph-immutable-object-cache-19.0.0-329 2.9 MB/s | 147 kB 00:00 2024-04-25T19:19:30.996 INFO:teuthology.orchestra.run.smithi195.stdout:(4/152): ceph-mds-19.0.0-3291.g994e2f20.el9.x86 13 MB/s | 2.3 MB 00:00 2024-04-25T19:19:31.072 INFO:teuthology.orchestra.run.smithi195.stdout:(5/152): ceph-fuse-19.0.0-3291.g994e2f20.el9.x8 1.4 MB/s | 863 kB 00:00 2024-04-25T19:19:31.147 INFO:teuthology.orchestra.run.smithi195.stdout:(6/152): ceph-mgr-19.0.0-3291.g994e2f20.el9.x86 10 MB/s | 1.5 MB 00:00 2024-04-25T19:19:31.855 INFO:teuthology.orchestra.run.smithi131.stdout:(1/152): ceph-19.0.0-3291.g994e2f20.el9.x86_64. 14 kB/s | 6.6 kB 00:00 2024-04-25T19:19:32.281 INFO:teuthology.orchestra.run.smithi195.stdout:(7/152): ceph-osd-19.0.0-3291.g994e2f20.el9.x86 16 MB/s | 18 MB 00:01 2024-04-25T19:19:32.304 INFO:teuthology.orchestra.run.smithi131.stdout:(2/152): ceph-fuse-19.0.0-3291.g994e2f20.el9.x8 1.9 MB/s | 863 kB 00:00 2024-04-25T19:19:32.789 INFO:teuthology.orchestra.run.smithi131.stdout:(3/152): ceph-base-19.0.0-3291.g994e2f20.el9.x8 3.9 MB/s | 5.4 MB 00:01 2024-04-25T19:19:33.230 INFO:teuthology.orchestra.run.smithi131.stdout:(4/152): ceph-mds-19.0.0-3291.g994e2f20.el9.x86 5.1 MB/s | 2.3 MB 00:00 2024-04-25T19:19:33.255 INFO:teuthology.orchestra.run.smithi131.stdout:(5/152): ceph-immutable-object-cache-19.0.0-329 155 kB/s | 147 kB 00:00 2024-04-25T19:19:33.422 INFO:teuthology.orchestra.run.smithi195.stdout:(8/152): ceph-mon-19.0.0-3291.g994e2f20.el9.x86 2.1 MB/s | 4.9 MB 00:02 2024-04-25T19:19:33.522 INFO:teuthology.orchestra.run.smithi195.stdout:(9/152): ceph-selinux-19.0.0-3291.g994e2f20.el9 254 kB/s | 25 kB 00:00 2024-04-25T19:19:33.531 INFO:teuthology.orchestra.run.smithi131.stdout:(6/152): ceph-mgr-19.0.0-3291.g994e2f20.el9.x86 5.0 MB/s | 1.5 MB 00:00 2024-04-25T19:19:33.689 INFO:teuthology.orchestra.run.smithi195.stdout:(10/152): ceph-radosgw-19.0.0-3291.g994e2f20.el 7.2 MB/s | 10 MB 00:01 2024-04-25T19:19:33.781 INFO:teuthology.orchestra.run.smithi195.stdout:(11/152): cephfs-mirror-19.0.0-3291.g994e2f20.e 2.4 MB/s | 224 kB 00:00 2024-04-25T19:19:33.886 INFO:teuthology.orchestra.run.smithi195.stdout:(12/152): cephfs-shell-19.0.0-3291.g994e2f20.el 262 kB/s | 27 kB 00:00 2024-04-25T19:19:33.957 INFO:teuthology.orchestra.run.smithi195.stdout:(13/152): libcephfs-devel-19.0.0-3291.g994e2f20 453 kB/s | 32 kB 00:00 2024-04-25T19:19:34.132 INFO:teuthology.orchestra.run.smithi195.stdout:(14/152): libcephfs2-19.0.0-3291.g994e2f20.el9. 4.2 MB/s | 756 kB 00:00 2024-04-25T19:19:34.323 INFO:teuthology.orchestra.run.smithi131.stdout:(7/152): ceph-mon-19.0.0-3291.g994e2f20.el9.x86 4.6 MB/s | 4.9 MB 00:01 2024-04-25T19:19:34.374 INFO:teuthology.orchestra.run.smithi195.stdout:(15/152): ceph-common-19.0.0-3291.g994e2f20.el9 4.6 MB/s | 20 MB 00:04 2024-04-25T19:19:34.416 INFO:teuthology.orchestra.run.smithi195.stdout:(16/152): libcephsqlite-19.0.0-3291.g994e2f20.e 558 kB/s | 158 kB 00:00 2024-04-25T19:19:34.483 INFO:teuthology.orchestra.run.smithi195.stdout:(17/152): librados-devel-19.0.0-3291.g994e2f20. 1.2 MB/s | 127 kB 00:00 2024-04-25T19:19:34.516 INFO:teuthology.orchestra.run.smithi195.stdout:(18/152): libradosstriper1-19.0.0-3291.g994e2f2 4.9 MB/s | 497 kB 00:00 2024-04-25T19:19:34.567 INFO:teuthology.orchestra.run.smithi195.stdout:(19/152): python3-ceph-argparse-19.0.0-3291.g99 916 kB/s | 45 kB 00:00 2024-04-25T19:19:34.650 INFO:teuthology.orchestra.run.smithi195.stdout:(20/152): python3-ceph-common-19.0.0-3291.g994e 1.6 MB/s | 135 kB 00:00 2024-04-25T19:19:34.718 INFO:teuthology.orchestra.run.smithi195.stdout:(21/152): python3-cephfs-19.0.0-3291.g994e2f20. 2.4 MB/s | 161 kB 00:00 2024-04-25T19:19:34.782 INFO:teuthology.orchestra.run.smithi131.stdout:(8/152): ceph-common-19.0.0-3291.g994e2f20.el9. 5.8 MB/s | 20 MB 00:03 2024-04-25T19:19:34.809 INFO:teuthology.orchestra.run.smithi195.stdout:(22/152): python3-rados-19.0.0-3291.g994e2f20.e 3.5 MB/s | 321 kB 00:00 2024-04-25T19:19:34.868 INFO:teuthology.orchestra.run.smithi195.stdout:(23/152): python3-rbd-19.0.0-3291.g994e2f20.el9 5.1 MB/s | 298 kB 00:00 2024-04-25T19:19:34.890 INFO:teuthology.orchestra.run.smithi131.stdout:(9/152): ceph-selinux-19.0.0-3291.g994e2f20.el9 234 kB/s | 25 kB 00:00 2024-04-25T19:19:34.919 INFO:teuthology.orchestra.run.smithi195.stdout:(24/152): python3-rgw-19.0.0-3291.g994e2f20.el9 2.0 MB/s | 100 kB 00:00 2024-04-25T19:19:34.994 INFO:teuthology.orchestra.run.smithi195.stdout:(25/152): rbd-fuse-19.0.0-3291.g994e2f20.el9.x8 1.1 MB/s | 86 kB 00:00 2024-04-25T19:19:35.694 INFO:teuthology.orchestra.run.smithi195.stdout:(26/152): rbd-mirror-19.0.0-3291.g994e2f20.el9. 4.4 MB/s | 3.0 MB 00:00 2024-04-25T19:19:35.715 INFO:teuthology.orchestra.run.smithi131.stdout:(10/152): ceph-osd-19.0.0-3291.g994e2f20.el9.x8 8.1 MB/s | 18 MB 00:02 2024-04-25T19:19:35.769 INFO:teuthology.orchestra.run.smithi195.stdout:(27/152): rbd-nbd-19.0.0-3291.g994e2f20.el9.x86 2.2 MB/s | 169 kB 00:00 2024-04-25T19:19:35.807 INFO:teuthology.orchestra.run.smithi131.stdout:(11/152): cephfs-mirror-19.0.0-3291.g994e2f20.e 2.4 MB/s | 224 kB 00:00 2024-04-25T19:19:35.844 INFO:teuthology.orchestra.run.smithi195.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3291.g 461 kB/s | 34 kB 00:00 2024-04-25T19:19:35.899 INFO:teuthology.orchestra.run.smithi131.stdout:(12/152): cephfs-shell-19.0.0-3291.g994e2f20.el 296 kB/s | 27 kB 00:00 2024-04-25T19:19:35.911 INFO:teuthology.orchestra.run.smithi195.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3291.g994e2f2 2.1 MB/s | 142 kB 00:00 2024-04-25T19:19:35.974 INFO:teuthology.orchestra.run.smithi131.stdout:(13/152): libcephfs-devel-19.0.0-3291.g994e2f20 429 kB/s | 32 kB 00:00 2024-04-25T19:19:36.141 INFO:teuthology.orchestra.run.smithi131.stdout:(14/152): ceph-radosgw-19.0.0-3291.g994e2f20.el 5.6 MB/s | 10 MB 00:01 2024-04-25T19:19:36.208 INFO:teuthology.orchestra.run.smithi131.stdout:(15/152): libcephfs2-19.0.0-3291.g994e2f20.el9. 3.2 MB/s | 756 kB 00:00 2024-04-25T19:19:36.242 INFO:teuthology.orchestra.run.smithi131.stdout:(16/152): libcephsqlite-19.0.0-3291.g994e2f20.e 1.6 MB/s | 158 kB 00:00 2024-04-25T19:19:36.334 INFO:teuthology.orchestra.run.smithi131.stdout:(17/152): librados-devel-19.0.0-3291.g994e2f20. 1.0 MB/s | 127 kB 00:00 2024-04-25T19:19:36.376 INFO:teuthology.orchestra.run.smithi131.stdout:(18/152): libradosstriper1-19.0.0-3291.g994e2f2 3.7 MB/s | 497 kB 00:00 2024-04-25T19:19:36.420 INFO:teuthology.orchestra.run.smithi195.stdout:(30/152): ceph-mgr-dashboard-19.0.0-3291.g994e2 7.0 MB/s | 3.5 MB 00:00 2024-04-25T19:19:36.476 INFO:teuthology.orchestra.run.smithi131.stdout:(19/152): python3-ceph-argparse-19.0.0-3291.g99 455 kB/s | 45 kB 00:00 2024-04-25T19:19:36.560 INFO:teuthology.orchestra.run.smithi131.stdout:(20/152): python3-ceph-common-19.0.0-3291.g994e 1.6 MB/s | 135 kB 00:00 2024-04-25T19:19:36.570 INFO:teuthology.orchestra.run.smithi195.stdout:(31/152): librgw2-19.0.0-3291.g994e2f20.el9.x86 2.5 MB/s | 5.2 MB 00:02 2024-04-25T19:19:36.677 INFO:teuthology.orchestra.run.smithi131.stdout:(21/152): python3-cephfs-19.0.0-3291.g994e2f20. 1.4 MB/s | 161 kB 00:00 2024-04-25T19:19:36.762 INFO:teuthology.orchestra.run.smithi195.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3291.g99 1.3 MB/s | 249 kB 00:00 2024-04-25T19:19:36.802 INFO:teuthology.orchestra.run.smithi131.stdout:(22/152): python3-rados-19.0.0-3291.g994e2f20.e 2.5 MB/s | 321 kB 00:00 2024-04-25T19:19:36.871 INFO:teuthology.orchestra.run.smithi195.stdout:(33/152): ceph-mgr-rook-19.0.0-3291.g994e2f20.e 458 kB/s | 49 kB 00:00 2024-04-25T19:19:36.911 INFO:teuthology.orchestra.run.smithi131.stdout:(23/152): python3-rbd-19.0.0-3291.g994e2f20.el9 2.7 MB/s | 298 kB 00:00 2024-04-25T19:19:36.971 INFO:teuthology.orchestra.run.smithi195.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3291.g9 166 kB/s | 16 kB 00:00 2024-04-25T19:19:37.103 INFO:teuthology.orchestra.run.smithi131.stdout:(24/152): librgw2-19.0.0-3291.g994e2f20.el9.x86 6.7 MB/s | 5.2 MB 00:00 2024-04-25T19:19:37.121 INFO:teuthology.orchestra.run.smithi195.stdout:(35/152): ceph-volume-19.0.0-3291.g994e2f20.el9 1.8 MB/s | 273 kB 00:00 2024-04-25T19:19:37.130 INFO:teuthology.orchestra.run.smithi131.stdout:(25/152): python3-rgw-19.0.0-3291.g994e2f20.el9 461 kB/s | 100 kB 00:00 2024-04-25T19:19:37.178 INFO:teuthology.orchestra.run.smithi131.stdout:(26/152): rbd-fuse-19.0.0-3291.g994e2f20.el9.x8 1.1 MB/s | 86 kB 00:00 2024-04-25T19:19:37.294 INFO:teuthology.orchestra.run.smithi131.stdout:(27/152): rbd-nbd-19.0.0-3291.g994e2f20.el9.x86 1.4 MB/s | 169 kB 00:00 2024-04-25T19:19:37.396 INFO:teuthology.orchestra.run.smithi131.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3291.g 339 kB/s | 34 kB 00:00 2024-04-25T19:19:37.488 INFO:teuthology.orchestra.run.smithi131.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3291.g994e2f2 1.5 MB/s | 142 kB 00:00 2024-04-25T19:19:37.573 INFO:teuthology.orchestra.run.smithi195.stdout:(36/152): ceph-mgr-diskprediction-local-19.0.0- 6.4 MB/s | 7.4 MB 00:01 2024-04-25T19:19:37.614 INFO:teuthology.orchestra.run.smithi195.stdout:(37/152): cephadm-19.0.0-3291.g994e2f20.el9.noa 1.5 MB/s | 762 kB 00:00 2024-04-25T19:19:37.647 INFO:teuthology.orchestra.run.smithi195.stdout:(38/152): cephfs-top-19.0.0-3291.g994e2f20.el9. 250 kB/s | 18 kB 00:00 2024-04-25T19:19:37.671 INFO:teuthology.orchestra.run.smithi131.stdout:(30/152): rbd-mirror-19.0.0-3291.g994e2f20.el9. 5.6 MB/s | 3.0 MB 00:00 2024-04-25T19:19:37.839 INFO:teuthology.orchestra.run.smithi195.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 358 kB/s | 80 kB 00:00 2024-04-25T19:19:37.898 INFO:teuthology.orchestra.run.smithi195.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 4.4 MB/s | 803 kB 00:00 2024-04-25T19:19:37.965 INFO:teuthology.orchestra.run.smithi195.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 195 kB 00:00 2024-04-25T19:19:37.980 INFO:teuthology.orchestra.run.smithi131.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3291.g994e2 7.2 MB/s | 3.5 MB 00:00 2024-04-25T19:19:37.998 INFO:teuthology.orchestra.run.smithi195.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-04-25T19:19:38.048 INFO:teuthology.orchestra.run.smithi195.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 2.2 MB/s | 106 kB 00:00 2024-04-25T19:19:38.080 INFO:teuthology.orchestra.run.smithi131.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3291.g99 2.5 MB/s | 249 kB 00:00 2024-04-25T19:19:38.099 INFO:teuthology.orchestra.run.smithi195.stdout:(44/152): python3-cryptography-36.0.1-4.el9.x86 9.4 MB/s | 1.2 MB 00:00 2024-04-25T19:19:38.124 INFO:teuthology.orchestra.run.smithi195.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-04-25T19:19:38.150 INFO:teuthology.orchestra.run.smithi195.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 2.5 MB/s | 125 kB 00:00 2024-04-25T19:19:38.183 INFO:teuthology.orchestra.run.smithi195.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 3.7 MB/s | 215 kB 00:00 2024-04-25T19:19:38.185 INFO:teuthology.orchestra.run.smithi131.stdout:(33/152): ceph-mgr-rook-19.0.0-3291.g994e2f20.e 475 kB/s | 49 kB 00:00 2024-04-25T19:19:38.225 INFO:teuthology.orchestra.run.smithi195.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 9.3 MB/s | 689 kB 00:00 2024-04-25T19:19:38.272 INFO:teuthology.orchestra.run.smithi131.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3291.g9 191 kB/s | 16 kB 00:00 2024-04-25T19:19:38.284 INFO:teuthology.orchestra.run.smithi195.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 9.8 MB/s | 943 kB 00:00 2024-04-25T19:19:38.337 INFO:teuthology.orchestra.run.smithi195.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-04-25T19:19:38.364 INFO:teuthology.orchestra.run.smithi131.stdout:(35/152): ceph-volume-19.0.0-3291.g994e2f20.el9 2.9 MB/s | 273 kB 00:00 2024-04-25T19:19:38.368 INFO:teuthology.orchestra.run.smithi195.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 262 kB/s | 21 kB 00:00 2024-04-25T19:19:38.401 INFO:teuthology.orchestra.run.smithi195.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 4.9 MB/s | 313 kB 00:00 2024-04-25T19:19:38.427 INFO:teuthology.orchestra.run.smithi195.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 594 kB/s | 33 kB 00:00 2024-04-25T19:19:38.477 INFO:teuthology.orchestra.run.smithi195.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 457 kB/s | 18 kB 00:00 2024-04-25T19:19:38.561 INFO:teuthology.orchestra.run.smithi195.stdout:(55/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2024-04-25T19:19:38.586 INFO:teuthology.orchestra.run.smithi195.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 112 kB/s | 11 kB 00:00 2024-04-25T19:19:38.611 INFO:teuthology.orchestra.run.smithi195.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.2 MB/s | 160 kB 00:00 2024-04-25T19:19:38.636 INFO:teuthology.orchestra.run.smithi195.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 942 kB/s | 45 kB 00:00 2024-04-25T19:19:38.697 INFO:teuthology.orchestra.run.smithi195.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-04-25T19:19:38.737 INFO:teuthology.orchestra.run.smithi195.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 6.1 MB/s | 582 kB 00:00 2024-04-25T19:19:38.762 INFO:teuthology.orchestra.run.smithi195.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 426 kB/s | 25 kB 00:00 2024-04-25T19:19:38.788 INFO:teuthology.orchestra.run.smithi195.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 966 kB/s | 47 kB 00:00 2024-04-25T19:19:38.821 INFO:teuthology.orchestra.run.smithi195.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.0 MB/s | 292 kB 00:00 2024-04-25T19:19:38.855 INFO:teuthology.orchestra.run.smithi195.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 2.9 MB/s | 188 kB 00:00 2024-04-25T19:19:38.880 INFO:teuthology.orchestra.run.smithi195.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 628 kB/s | 35 kB 00:00 2024-04-25T19:19:38.932 INFO:teuthology.orchestra.run.smithi131.stdout:(36/152): ceph-test-19.0.0-3291.g994e2f20.el9.x 11 MB/s | 43 MB 00:04 2024-04-25T19:19:38.982 INFO:teuthology.orchestra.run.smithi131.stdout:(37/152): cephadm-19.0.0-3291.g994e2f20.el9.noa 1.2 MB/s | 762 kB 00:00 2024-04-25T19:19:39.007 INFO:teuthology.orchestra.run.smithi131.stdout:(38/152): cephfs-top-19.0.0-3291.g994e2f20.el9. 245 kB/s | 18 kB 00:00 2024-04-25T19:19:39.031 INFO:teuthology.orchestra.run.smithi195.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2024-04-25T19:19:39.156 INFO:teuthology.orchestra.run.smithi195.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-04-25T19:19:39.214 INFO:teuthology.orchestra.run.smithi195.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 9.4 MB/s | 1.6 MB 00:00 2024-04-25T19:19:39.241 INFO:teuthology.orchestra.run.smithi131.stdout:(39/152): ceph-mgr-diskprediction-local-19.0.0- 4.7 MB/s | 7.4 MB 00:01 2024-04-25T19:19:39.265 INFO:teuthology.orchestra.run.smithi195.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 8.3 MB/s | 911 kB 00:00 2024-04-25T19:19:39.275 INFO:teuthology.orchestra.run.smithi131.stdout:(40/152): fuse-2.9.9-15.el9.x86_64.rpm 276 kB/s | 80 kB 00:00 2024-04-25T19:19:39.290 INFO:teuthology.orchestra.run.smithi195.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.9 MB/s | 133 kB 00:00 2024-04-25T19:19:39.350 INFO:teuthology.orchestra.run.smithi131.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 195 kB 00:00 2024-04-25T19:19:39.374 INFO:teuthology.orchestra.run.smithi195.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 14 MB/s | 1.0 MB 00:00 2024-04-25T19:19:39.409 INFO:teuthology.orchestra.run.smithi131.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.9 MB/s | 253 kB 00:00 2024-04-25T19:19:39.450 INFO:teuthology.orchestra.run.smithi131.stdout:(43/152): libgfortran-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 803 kB 00:00 2024-04-25T19:19:39.499 INFO:teuthology.orchestra.run.smithi195.stdout:(72/152): postgresql-server-13.14-1.el9.x86_64. 25 MB/s | 5.8 MB 00:00 2024-04-25T19:19:39.524 INFO:teuthology.orchestra.run.smithi195.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 642 kB/s | 87 kB 00:00 2024-04-25T19:19:39.567 INFO:teuthology.orchestra.run.smithi131.stdout:(44/152): python3-cryptography-36.0.1-4.el9.x86 5.7 MB/s | 1.2 MB 00:00 2024-04-25T19:19:39.583 INFO:teuthology.orchestra.run.smithi195.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 5.5 MB/s | 244 kB 00:00 2024-04-25T19:19:39.593 INFO:teuthology.orchestra.run.smithi131.stdout:(45/152): python3-ply-3.11-14.el9.noarch.rpm 589 kB/s | 106 kB 00:00 2024-04-25T19:19:39.618 INFO:teuthology.orchestra.run.smithi131.stdout:(46/152): python3-pycparser-2.20-6.el9.noarch.r 822 kB/s | 135 kB 00:00 2024-04-25T19:19:39.643 INFO:teuthology.orchestra.run.smithi131.stdout:(47/152): python3-requests-2.25.1-8.el9.noarch. 1.7 MB/s | 125 kB 00:00 2024-04-25T19:19:39.677 INFO:teuthology.orchestra.run.smithi131.stdout:(48/152): python3-urllib3-1.26.5-5.el9.noarch.r 3.7 MB/s | 215 kB 00:00 2024-04-25T19:19:39.708 INFO:teuthology.orchestra.run.smithi195.stdout:(75/152): python3-babel-2.9.1-2.el9.noarch.rpm 29 MB/s | 6.0 MB 00:00 2024-04-25T19:19:39.733 INFO:teuthology.orchestra.run.smithi195.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 1.8 MB/s | 248 kB 00:00 2024-04-25T19:19:39.735 INFO:teuthology.orchestra.run.smithi131.stdout:(49/152): automake-1.16.2-8.el9.noarch.rpm 5.9 MB/s | 689 kB 00:00 2024-04-25T19:19:39.767 INFO:teuthology.orchestra.run.smithi195.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 793 kB/s | 26 kB 00:00 2024-04-25T19:19:39.812 INFO:teuthology.orchestra.run.smithi131.stdout:(50/152): bison-3.7.4-5.el9.x86_64.rpm 5.5 MB/s | 943 kB 00:00 2024-04-25T19:19:39.822 INFO:teuthology.orchestra.run.smithi195.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 219 kB/s | 19 kB 00:00 2024-04-25T19:19:39.836 INFO:teuthology.orchestra.run.smithi131.stdout:(51/152): boost-program-options-1.75.0-8.el9.x8 699 kB/s | 107 kB 00:00 2024-04-25T19:19:39.859 INFO:teuthology.orchestra.run.smithi195.stdout:(79/152): python3-markupsafe-1.1.1-12.el9.x86_6 978 kB/s | 35 kB 00:00 2024-04-25T19:19:39.861 INFO:teuthology.orchestra.run.smithi131.stdout:(52/152): elfutils-libelf-devel-0.190-2.el9.x86 186 kB/s | 21 kB 00:00 2024-04-25T19:19:39.893 INFO:teuthology.orchestra.run.smithi195.stdout:(80/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 172 kB 00:00 2024-04-25T19:19:39.895 INFO:teuthology.orchestra.run.smithi131.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 313 kB 00:00 2024-04-25T19:19:39.920 INFO:teuthology.orchestra.run.smithi131.stdout:(54/152): flexiblas-3.0.4-8.el9.x86_64.rpm 397 kB/s | 33 kB 00:00 2024-04-25T19:19:39.960 INFO:teuthology.orchestra.run.smithi195.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.8 MB/s | 250 kB 00:00 2024-04-25T19:19:40.071 INFO:teuthology.orchestra.run.smithi131.stdout:(55/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-04-25T19:19:40.077 INFO:teuthology.orchestra.run.smithi195.stdout:(82/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 5.1 MB 00:00 2024-04-25T19:19:40.087 INFO:teuthology.orchestra.run.smithi131.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 72 kB/s | 11 kB 00:00 2024-04-25T19:19:40.110 INFO:teuthology.orchestra.run.smithi195.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 1.6 MB/s | 222 kB 00:00 2024-04-25T19:19:40.135 INFO:teuthology.orchestra.run.smithi195.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.4 MB/s | 77 kB 00:00 2024-04-25T19:19:40.146 INFO:teuthology.orchestra.run.smithi131.stdout:(57/152): flexiblas-openblas-openmp-3.0.4-8.el9 85 kB/s | 18 kB 00:00 2024-04-25T19:19:40.179 INFO:teuthology.orchestra.run.smithi131.stdout:(58/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-04-25T19:19:40.192 INFO:teuthology.orchestra.run.smithi195.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 530 kB/s | 42 kB 00:00 2024-04-25T19:19:40.197 INFO:teuthology.orchestra.run.smithi131.stdout:(59/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 421 kB/s | 45 kB 00:00 2024-04-25T19:19:40.236 INFO:teuthology.orchestra.run.smithi195.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-04-25T19:19:40.247 INFO:teuthology.orchestra.run.smithi131.stdout:(60/152): librdkafka-1.6.1-102.el9.x86_64.rpm 6.6 MB/s | 662 kB 00:00 2024-04-25T19:19:40.261 INFO:teuthology.orchestra.run.smithi195.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-04-25T19:19:40.272 INFO:teuthology.orchestra.run.smithi131.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 373 kB/s | 25 kB 00:00 2024-04-25T19:19:40.295 INFO:teuthology.orchestra.run.smithi195.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 4.8 MB/s | 279 kB 00:00 2024-04-25T19:19:40.314 INFO:teuthology.orchestra.run.smithi131.stdout:(62/152): libtool-2.4.6-45.el9.x86_64.rpm 5.2 MB/s | 582 kB 00:00 2024-04-25T19:19:40.320 INFO:teuthology.orchestra.run.smithi195.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 922 kB/s | 51 kB 00:00 2024-04-25T19:19:40.339 INFO:teuthology.orchestra.run.smithi131.stdout:(63/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 519 kB/s | 47 kB 00:00 2024-04-25T19:19:40.346 INFO:teuthology.orchestra.run.smithi195.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-04-25T19:19:40.373 INFO:teuthology.orchestra.run.smithi131.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.0 MB/s | 292 kB 00:00 2024-04-25T19:19:40.396 INFO:teuthology.orchestra.run.smithi195.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-04-25T19:19:40.398 INFO:teuthology.orchestra.run.smithi131.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 644 kB/s | 35 kB 00:00 2024-04-25T19:19:40.461 INFO:teuthology.orchestra.run.smithi131.stdout:(66/152): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-04-25T19:19:40.463 INFO:teuthology.orchestra.run.smithi195.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 847 kB/s | 44 kB 00:00 2024-04-25T19:19:40.571 INFO:teuthology.orchestra.run.smithi195.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-04-25T19:19:40.726 INFO:teuthology.orchestra.run.smithi131.stdout:(67/152): openblas-openmp-0.3.21-2.el9.x86_64.r 13 MB/s | 4.7 MB 00:00 2024-04-25T19:19:40.839 INFO:teuthology.orchestra.run.smithi195.stdout:(94/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-04-25T19:19:40.843 INFO:teuthology.orchestra.run.smithi131.stdout:(68/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-04-25T19:19:40.864 INFO:teuthology.orchestra.run.smithi195.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 129 kB/s | 36 kB 00:00 2024-04-25T19:19:40.910 INFO:teuthology.orchestra.run.smithi131.stdout:(69/152): postgresql-13.14-1.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-04-25T19:19:40.931 INFO:teuthology.orchestra.run.smithi195.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 735 kB/s | 47 kB 00:00 2024-04-25T19:19:40.951 INFO:teuthology.orchestra.run.smithi131.stdout:(70/152): postgresql-contrib-13.14-1.el9.x86_64 4.2 MB/s | 911 kB 00:00 2024-04-25T19:19:40.964 INFO:teuthology.orchestra.run.smithi195.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 3.0 MB/s | 305 kB 00:00 2024-04-25T19:19:40.977 INFO:teuthology.orchestra.run.smithi131.stdout:(71/152): postgresql-private-libs-13.14-1.el9.x 1.1 MB/s | 133 kB 00:00 2024-04-25T19:19:40.989 INFO:teuthology.orchestra.run.smithi195.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2024-04-25T19:19:41.015 INFO:teuthology.orchestra.run.smithi195.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.9 MB/s | 94 kB 00:00 2024-04-25T19:19:41.041 INFO:teuthology.orchestra.run.smithi195.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-25T19:19:41.066 INFO:teuthology.orchestra.run.smithi195.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 921 kB/s | 45 kB 00:00 2024-04-25T19:19:41.091 INFO:teuthology.orchestra.run.smithi195.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 456 kB/s | 22 kB 00:00 2024-04-25T19:19:41.101 INFO:teuthology.orchestra.run.smithi131.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 6.9 MB/s | 1.0 MB 00:00 2024-04-25T19:19:41.141 INFO:teuthology.orchestra.run.smithi195.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 11 MB/s | 863 kB 00:00 2024-04-25T19:19:41.177 INFO:teuthology.orchestra.run.smithi131.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 438 kB/s | 87 kB 00:00 2024-04-25T19:19:41.294 INFO:teuthology.orchestra.run.smithi131.stdout:(74/152): postgresql-server-13.14-1.el9.x86_64. 17 MB/s | 5.8 MB 00:00 2024-04-25T19:19:41.353 INFO:teuthology.orchestra.run.smithi131.stdout:(75/152): python3-devel-3.9.18-3.el9.x86_64.rpm 1.5 MB/s | 244 kB 00:00 2024-04-25T19:19:41.478 INFO:teuthology.orchestra.run.smithi131.stdout:(76/152): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-04-25T19:19:41.503 INFO:teuthology.orchestra.run.smithi131.stdout:(77/152): python3-jinja2-2.11.3-5.el9.noarch.rp 1.2 MB/s | 248 kB 00:00 2024-04-25T19:19:41.529 INFO:teuthology.orchestra.run.smithi131.stdout:(78/152): python3-jsonpatch-1.21-16.el9.noarch. 158 kB/s | 26 kB 00:00 2024-04-25T19:19:41.554 INFO:teuthology.orchestra.run.smithi131.stdout:(79/152): python3-jsonpointer-2.0-4.el9.noarch. 392 kB/s | 19 kB 00:00 2024-04-25T19:19:41.579 INFO:teuthology.orchestra.run.smithi131.stdout:(80/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.3 MB/s | 172 kB 00:00 2024-04-25T19:19:41.604 INFO:teuthology.orchestra.run.smithi131.stdout:(81/152): python3-markupsafe-1.1.1-12.el9.x86_6 466 kB/s | 35 kB 00:00 2024-04-25T19:19:41.638 INFO:teuthology.orchestra.run.smithi131.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.3 MB/s | 250 kB 00:00 2024-04-25T19:19:41.680 INFO:teuthology.orchestra.run.smithi131.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-04-25T19:19:41.747 INFO:teuthology.orchestra.run.smithi131.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 832 kB/s | 77 kB 00:00 2024-04-25T19:19:41.800 INFO:teuthology.orchestra.run.smithi195.stdout:(104/152): gperftools-libs-2.9.1-2.el9.x86_64.r 470 kB/s | 309 kB 00:00 2024-04-25T19:19:41.847 INFO:teuthology.orchestra.run.smithi131.stdout:(85/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 5.1 MB 00:00 2024-04-25T19:19:41.872 INFO:teuthology.orchestra.run.smithi131.stdout:(86/152): python3-prettytable-0.7.2-27.el9.noar 238 kB/s | 42 kB 00:00 2024-04-25T19:19:41.900 INFO:teuthology.orchestra.run.smithi195.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 196 kB/s | 19 kB 00:00 2024-04-25T19:19:41.906 INFO:teuthology.orchestra.run.smithi131.stdout:(87/152): python3-protobuf-3.14.0-13.el9.noarch 1.7 MB/s | 269 kB 00:00 2024-04-25T19:19:41.940 INFO:teuthology.orchestra.run.smithi131.stdout:(88/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.4 MB/s | 159 kB 00:00 2024-04-25T19:19:41.942 INFO:teuthology.orchestra.run.smithi195.stdout:(106/152): abseil-cpp-20211102.0-3.el9.x86_64.r 651 kB/s | 548 kB 00:00 2024-04-25T19:19:41.965 INFO:teuthology.orchestra.run.smithi131.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 279 kB 00:00 2024-04-25T19:19:41.990 INFO:teuthology.orchestra.run.smithi131.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 614 kB/s | 51 kB 00:00 2024-04-25T19:19:42.053 INFO:teuthology.orchestra.run.smithi131.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 624 kB/s | 54 kB 00:00 2024-04-25T19:19:42.059 INFO:teuthology.orchestra.run.smithi195.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 224 kB/s | 26 kB 00:00 2024-04-25T19:19:42.091 INFO:teuthology.orchestra.run.smithi131.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 418 kB/s | 42 kB 00:00 2024-04-25T19:19:42.166 INFO:teuthology.orchestra.run.smithi131.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 433 kB/s | 44 kB 00:00 2024-04-25T19:19:42.176 INFO:teuthology.orchestra.run.smithi195.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 419 kB/s | 49 kB 00:00 2024-04-25T19:19:42.233 INFO:teuthology.orchestra.run.smithi131.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-04-25T19:19:42.285 INFO:teuthology.orchestra.run.smithi195.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 627 kB/s | 67 kB 00:00 2024-04-25T19:19:42.308 INFO:teuthology.orchestra.run.smithi131.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 275 kB/s | 36 kB 00:00 2024-04-25T19:19:42.427 INFO:teuthology.orchestra.run.smithi195.stdout:(110/152): libarrow-9.0.0-10.el9.x86_64.rpm 8.4 MB/s | 4.4 MB 00:00 2024-04-25T19:19:42.460 INFO:teuthology.orchestra.run.smithi195.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 865 kB/s | 151 kB 00:00 2024-04-25T19:19:42.576 INFO:teuthology.orchestra.run.smithi131.stdout:(96/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-04-25T19:19:42.601 INFO:teuthology.orchestra.run.smithi131.stdout:(97/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 134 kB/s | 47 kB 00:00 2024-04-25T19:19:42.634 INFO:teuthology.orchestra.run.smithi131.stdout:(98/152): socat-1.7.4.1-5.el9.x86_64.rpm 959 kB/s | 305 kB 00:00 2024-04-25T19:19:42.644 INFO:teuthology.orchestra.run.smithi195.stdout:(112/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.8 MB/s | 838 kB 00:00 2024-04-25T19:19:42.689 INFO:teuthology.orchestra.run.smithi131.stdout:(99/152): uuid-1.6.2-55.el9.x86_64.rpm 691 kB/s | 58 kB 00:00 2024-04-25T19:19:42.695 INFO:teuthology.orchestra.run.smithi195.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 2.3 MB/s | 548 kB 00:00 2024-04-25T19:19:42.718 INFO:teuthology.orchestra.run.smithi131.stdout:(100/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 830 kB/s | 94 kB 00:00 2024-04-25T19:19:42.743 INFO:teuthology.orchestra.run.smithi131.stdout:(101/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 589 kB/s | 64 kB 00:00 2024-04-25T19:19:42.769 INFO:teuthology.orchestra.run.smithi131.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 460 kB/s | 22 kB 00:00 2024-04-25T19:19:42.770 INFO:teuthology.orchestra.run.smithi195.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 346 kB/s | 43 kB 00:00 2024-04-25T19:19:42.794 INFO:teuthology.orchestra.run.smithi131.stdout:(103/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 606 kB/s | 45 kB 00:00 2024-04-25T19:19:42.803 INFO:teuthology.orchestra.run.smithi195.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 298 kB/s | 32 kB 00:00 2024-04-25T19:19:42.844 INFO:teuthology.orchestra.run.smithi131.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 8.5 MB/s | 863 kB 00:00 2024-04-25T19:19:42.862 INFO:teuthology.orchestra.run.smithi195.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 166 kB/s | 15 kB 00:00 2024-04-25T19:19:42.921 INFO:teuthology.orchestra.run.smithi195.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-04-25T19:19:42.971 INFO:teuthology.orchestra.run.smithi195.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 3.3 MB/s | 358 kB 00:00 2024-04-25T19:19:43.046 INFO:teuthology.orchestra.run.smithi195.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-04-25T19:19:43.071 INFO:teuthology.orchestra.run.smithi195.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 354 kB/s | 35 kB 00:00 2024-04-25T19:19:43.120 INFO:teuthology.orchestra.run.smithi131.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 71 kB/s | 19 kB 00:00 2024-04-25T19:19:43.172 INFO:teuthology.orchestra.run.smithi195.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 1.6 MB/s | 206 kB 00:00 2024-04-25T19:19:43.272 INFO:teuthology.orchestra.run.smithi195.stdout:(122/152): python3-grpcio-1.46.7-10.el9.x86_64. 10 MB/s | 2.0 MB 00:00 2024-04-25T19:19:43.306 INFO:teuthology.orchestra.run.smithi195.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-04-25T19:19:43.398 INFO:teuthology.orchestra.run.smithi195.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 86 kB/s | 11 kB 00:00 2024-04-25T19:19:43.423 INFO:teuthology.orchestra.run.smithi195.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 152 kB/s | 18 kB 00:00 2024-04-25T19:19:43.486 INFO:teuthology.orchestra.run.smithi131.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 452 kB/s | 309 kB 00:00 2024-04-25T19:19:43.523 INFO:teuthology.orchestra.run.smithi195.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 186 kB/s | 23 kB 00:00 2024-04-25T19:19:43.548 INFO:teuthology.orchestra.run.smithi195.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 156 kB/s | 19 kB 00:00 2024-04-25T19:19:43.578 INFO:teuthology.orchestra.run.smithi131.stdout:(107/152): abseil-cpp-20211102.0-3.el9.x86_64.r 678 kB/s | 548 kB 00:00 2024-04-25T19:19:43.632 INFO:teuthology.orchestra.run.smithi195.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 183 kB/s | 20 kB 00:00 2024-04-25T19:19:43.720 INFO:teuthology.orchestra.run.smithi131.stdout:(108/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 111 kB/s | 26 kB 00:00 2024-04-25T19:19:43.746 INFO:teuthology.orchestra.run.smithi131.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 292 kB/s | 49 kB 00:00 2024-04-25T19:19:43.749 INFO:teuthology.orchestra.run.smithi195.stdout:(129/152): python3-kubernetes-26.1.0-2.el9.noar 5.1 MB/s | 1.0 MB 00:00 2024-04-25T19:19:43.774 INFO:teuthology.orchestra.run.smithi195.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 328 kB/s | 46 kB 00:00 2024-04-25T19:19:43.887 INFO:teuthology.orchestra.run.smithi195.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 576 kB/s | 79 kB 00:00 2024-04-25T19:19:43.917 INFO:teuthology.orchestra.run.smithi195.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 408 kB/s | 58 kB 00:00 2024-04-25T19:19:43.963 INFO:teuthology.orchestra.run.smithi131.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 312 kB/s | 67 kB 00:00 2024-04-25T19:19:44.000 INFO:teuthology.orchestra.run.smithi195.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-04-25T19:19:44.059 INFO:teuthology.orchestra.run.smithi195.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 116 kB/s | 16 kB 00:00 2024-04-25T19:19:44.079 INFO:teuthology.orchestra.run.smithi131.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 455 kB/s | 151 kB 00:00 2024-04-25T19:19:44.101 INFO:teuthology.orchestra.run.smithi195.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 903 kB/s | 90 kB 00:00 2024-04-25T19:19:44.160 INFO:teuthology.orchestra.run.smithi195.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 283 kB/s | 28 kB 00:00 2024-04-25T19:19:44.201 INFO:teuthology.orchestra.run.smithi195.stdout:(137/152): python3-repoze-lru-0.7-16.el9.noarch 309 kB/s | 31 kB 00:00 2024-04-25T19:19:44.271 INFO:teuthology.orchestra.run.smithi131.stdout:(112/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.7 MB/s | 838 kB 00:00 2024-04-25T19:19:44.293 INFO:teuthology.orchestra.run.smithi195.stdout:(138/152): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-04-25T19:19:44.319 INFO:teuthology.orchestra.run.smithi195.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 508 kB/s | 59 kB 00:00 2024-04-25T19:19:44.402 INFO:teuthology.orchestra.run.smithi195.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 332 kB/s | 36 kB 00:00 2024-04-25T19:19:44.413 INFO:teuthology.orchestra.run.smithi131.stdout:(113/152): libarrow-9.0.0-10.el9.x86_64.rpm 3.4 MB/s | 4.4 MB 00:01 2024-04-25T19:19:44.428 INFO:teuthology.orchestra.run.smithi195.stdout:(141/152): python3-typing-extensions-4.4.0-2.el 473 kB/s | 51 kB 00:00 2024-04-25T19:19:44.439 INFO:teuthology.orchestra.run.smithi131.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 261 kB/s | 43 kB 00:00 2024-04-25T19:19:44.520 INFO:teuthology.orchestra.run.smithi195.stdout:(142/152): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-04-25T19:19:44.545 INFO:teuthology.orchestra.run.smithi195.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 772 kB/s | 90 kB 00:00 2024-04-25T19:19:44.562 INFO:teuthology.orchestra.run.smithi131.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 219 kB/s | 32 kB 00:00 2024-04-25T19:19:44.589 INFO:teuthology.orchestra.run.smithi131.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 100 kB/s | 15 kB 00:00 2024-04-25T19:19:44.653 INFO:teuthology.orchestra.run.smithi195.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-04-25T19:19:44.679 INFO:teuthology.orchestra.run.smithi195.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 150 kB/s | 20 kB 00:00 2024-04-25T19:19:44.707 INFO:teuthology.orchestra.run.smithi131.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.2 MB/s | 172 kB 00:00 2024-04-25T19:19:44.740 INFO:teuthology.orchestra.run.smithi131.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 2.3 MB/s | 358 kB 00:00 2024-04-25T19:19:44.754 INFO:teuthology.orchestra.run.smithi195.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-04-25T19:19:44.846 INFO:teuthology.orchestra.run.smithi195.stdout:(147/152): thrift-0.15.0-2.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-04-25T19:19:44.881 INFO:teuthology.orchestra.run.smithi131.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.7 MB/s | 303 kB 00:00 2024-04-25T19:19:44.916 INFO:teuthology.orchestra.run.smithi131.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 202 kB/s | 35 kB 00:00 2024-04-25T19:19:45.000 INFO:teuthology.orchestra.run.smithi131.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 1.7 MB/s | 206 kB 00:00 2024-04-25T19:19:45.105 INFO:teuthology.orchestra.run.smithi195.stdout:(148/152): librados2-19.0.0-3291.g994e2f20.el9. 9.5 MB/s | 3.3 MB 00:00 2024-04-25T19:19:45.150 INFO:teuthology.orchestra.run.smithi131.stdout:(122/152): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-04-25T19:19:45.209 INFO:teuthology.orchestra.run.smithi131.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 695 kB/s | 144 kB 00:00 2024-04-25T19:19:45.242 INFO:teuthology.orchestra.run.smithi131.stdout:(124/152): python3-asyncssh-2.13.2-5.el9.noarch 472 kB/s | 548 kB 00:01 2024-04-25T19:19:45.276 INFO:teuthology.orchestra.run.smithi131.stdout:(125/152): python3-jaraco-8.2.1-3.el9.noarch.rp 85 kB/s | 11 kB 00:00 2024-04-25T19:19:45.310 INFO:teuthology.orchestra.run.smithi131.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 177 kB/s | 18 kB 00:00 2024-04-25T19:19:45.313 INFO:teuthology.orchestra.run.smithi195.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 6.5 MB/s | 1.3 MB 00:00 2024-04-25T19:19:45.335 INFO:teuthology.orchestra.run.smithi131.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 252 kB/s | 23 kB 00:00 2024-04-25T19:19:45.369 INFO:teuthology.orchestra.run.smithi131.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 212 kB/s | 19 kB 00:00 2024-04-25T19:19:45.402 INFO:teuthology.orchestra.run.smithi131.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 214 kB/s | 20 kB 00:00 2024-04-25T19:19:45.447 INFO:teuthology.orchestra.run.smithi195.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 18 MB/s | 2.4 MB 00:00 2024-04-25T19:19:45.469 INFO:teuthology.orchestra.run.smithi131.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 463 kB/s | 46 kB 00:00 2024-04-25T19:19:45.527 INFO:teuthology.orchestra.run.smithi131.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 634 kB/s | 79 kB 00:00 2024-04-25T19:19:45.570 INFO:teuthology.orchestra.run.smithi131.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 580 kB/s | 58 kB 00:00 2024-04-25T19:19:45.612 INFO:teuthology.orchestra.run.smithi131.stdout:(133/152): python3-kubernetes-26.1.0-2.el9.noar 3.7 MB/s | 1.0 MB 00:00 2024-04-25T19:19:45.645 INFO:teuthology.orchestra.run.smithi131.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-04-25T19:19:45.671 INFO:teuthology.orchestra.run.smithi131.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2024-04-25T19:19:45.713 INFO:teuthology.orchestra.run.smithi131.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 902 kB/s | 90 kB 00:00 2024-04-25T19:19:45.738 INFO:teuthology.orchestra.run.smithi131.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 308 kB/s | 28 kB 00:00 2024-04-25T19:19:45.772 INFO:teuthology.orchestra.run.smithi131.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 307 kB/s | 31 kB 00:00 2024-04-25T19:19:45.848 INFO:teuthology.orchestra.run.smithi131.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-04-25T19:19:45.880 INFO:teuthology.orchestra.run.smithi131.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 331 kB/s | 36 kB 00:00 2024-04-25T19:19:45.906 INFO:teuthology.orchestra.run.smithi131.stdout:(141/152): python3-rsa-4.9-2.el9.noarch.rpm 354 kB/s | 59 kB 00:00 2024-04-25T19:19:45.948 INFO:teuthology.orchestra.run.smithi131.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 520 kB/s | 51 kB 00:00 2024-04-25T19:19:45.990 INFO:teuthology.orchestra.run.smithi131.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-04-25T19:19:46.007 INFO:teuthology.orchestra.run.smithi131.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 896 kB/s | 90 kB 00:00 2024-04-25T19:19:46.065 INFO:teuthology.orchestra.run.smithi131.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-04-25T19:19:46.090 INFO:teuthology.orchestra.run.smithi131.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 200 kB/s | 20 kB 00:00 2024-04-25T19:19:46.124 INFO:teuthology.orchestra.run.smithi131.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2024-04-25T19:19:46.180 INFO:teuthology.orchestra.run.smithi195.stdout:(151/152): librbd1-19.0.0-3291.g994e2f20.el9.x8 2.3 MB/s | 3.1 MB 00:01 2024-04-25T19:19:46.258 INFO:teuthology.orchestra.run.smithi131.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 8.3 MB/s | 1.6 MB 00:00 2024-04-25T19:19:46.341 INFO:teuthology.orchestra.run.smithi131.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 16 MB/s | 1.3 MB 00:00 2024-04-25T19:19:46.480 INFO:teuthology.orchestra.run.smithi131.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 17 MB/s | 2.4 MB 00:00 2024-04-25T19:19:47.059 INFO:teuthology.orchestra.run.smithi131.stdout:(151/152): librados2-19.0.0-3291.g994e2f20.el9. 3.4 MB/s | 3.3 MB 00:00 2024-04-25T19:19:47.167 INFO:teuthology.orchestra.run.smithi131.stdout:(152/152): librbd1-19.0.0-3291.g994e2f20.el9.x8 3.0 MB/s | 3.1 MB 00:01 2024-04-25T19:19:47.178 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-04-25T19:19:47.179 INFO:teuthology.orchestra.run.smithi131.stdout:Total 13 MB/s | 214 MB 00:17 2024-04-25T19:19:50.004 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-04-25T19:19:50.248 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-04-25T19:19:50.248 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-04-25T19:19:50.672 INFO:teuthology.orchestra.run.smithi195.stdout:(152/152): ceph-test-19.0.0-3291.g994e2f20.el9. 2.5 MB/s | 43 MB 00:17 2024-04-25T19:19:50.687 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-25T19:19:50.688 INFO:teuthology.orchestra.run.smithi195.stdout:Total 10 MB/s | 214 MB 00:21 2024-04-25T19:19:52.909 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-04-25T19:19:52.910 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-04-25T19:19:53.616 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-25T19:19:53.850 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-25T19:19:53.850 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-25T19:19:56.509 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-25T19:19:56.510 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-25T19:19:59.453 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-04-25T19:19:59.553 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T19:19:59.680 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T19:19:59.945 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T19:20:00.025 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T19:20:00.085 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T19:20:00.215 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T19:20:00.668 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T19:20:00.799 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T19:20:00.993 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T19:20:01.025 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T19:20:01.154 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T19:20:01.200 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T19:20:01.519 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T19:20:01.589 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T19:20:01.639 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T19:20:01.804 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T19:20:01.831 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T19:20:01.949 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T19:20:01.983 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T19:20:02.054 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T19:20:02.353 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T19:20:02.408 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T19:20:02.605 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T19:20:02.727 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T19:20:02.767 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T19:20:02.814 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T19:20:02.914 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T19:20:02.970 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T19:20:03.032 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T19:20:03.076 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T19:20:03.115 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T19:20:03.229 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T19:20:03.286 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-25T19:20:03.302 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T19:20:03.334 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T19:20:03.378 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T19:20:03.390 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T19:20:03.447 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T19:20:03.496 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T19:20:03.537 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 31/156 2024-04-25T19:20:03.551 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T19:20:03.591 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 32/156 2024-04-25T19:20:03.623 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T19:20:03.628 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 33/156 2024-04-25T19:20:03.657 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T19:20:03.744 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T19:20:03.805 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T19:20:03.808 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T19:20:03.915 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T19:20:04.090 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T19:20:04.185 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T19:20:04.274 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T19:20:04.413 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T19:20:04.587 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T19:20:04.614 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T19:20:04.771 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T19:20:04.805 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T19:20:04.875 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T19:20:05.008 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T19:20:05.074 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T19:20:05.122 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T19:20:05.124 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T19:20:05.174 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 43/156 2024-04-25T19:20:05.184 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T19:20:05.210 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T19:20:05.244 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T19:20:05.369 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T19:20:05.394 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T19:20:05.496 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T19:20:05.502 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T19:20:05.520 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T19:20:05.573 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T19:20:05.600 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T19:20:05.651 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T19:20:05.766 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T19:20:05.814 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T19:20:05.854 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T19:20:05.919 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T19:20:05.923 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T19:20:05.970 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T19:20:05.979 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T19:20:06.064 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T19:20:06.138 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T19:20:06.186 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T19:20:06.317 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T19:20:06.344 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T19:20:06.362 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T19:20:06.402 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T19:20:06.411 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T19:20:06.439 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T19:20:06.496 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T19:20:06.514 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T19:20:06.583 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T19:20:06.636 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T19:20:06.647 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T19:20:06.680 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T19:20:06.695 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T19:20:06.728 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T19:20:06.735 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T19:20:06.762 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T19:20:06.796 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T19:20:06.853 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T19:20:06.949 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T19:20:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T19:20:06.988 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T19:20:07.047 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T19:20:07.152 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T19:20:07.156 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T19:20:07.190 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 31/156 2024-04-25T19:20:07.203 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T19:20:07.240 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T19:20:07.243 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 32/156 2024-04-25T19:20:07.303 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 33/156 2024-04-25T19:20:07.312 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T19:20:07.375 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T19:20:07.426 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T19:20:07.433 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T19:20:07.483 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T19:20:07.486 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T19:20:07.528 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T19:20:07.594 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T19:20:07.609 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T19:20:07.690 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T19:20:07.745 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T19:20:07.774 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T19:20:07.844 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T19:20:07.888 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T19:20:07.956 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T19:20:08.000 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T19:20:08.069 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T19:20:08.217 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T19:20:08.289 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T19:20:08.535 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T19:20:08.633 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T19:20:08.673 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T19:20:08.723 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T19:20:08.765 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 43/156 2024-04-25T19:20:08.839 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T19:20:09.098 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T19:20:09.187 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T19:20:09.250 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T19:20:09.272 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T19:20:09.305 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T19:20:09.338 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T19:20:09.369 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T19:20:09.405 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T19:20:09.445 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T19:20:09.459 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T19:20:09.510 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T19:20:09.524 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T19:20:09.578 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T19:20:09.621 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T19:20:09.640 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T19:20:09.665 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T19:20:09.700 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T19:20:09.894 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T19:20:09.901 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T19:20:09.937 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T19:20:09.959 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T19:20:09.997 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T19:20:10.053 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T19:20:10.057 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T19:20:10.181 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T19:20:10.229 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T19:20:10.281 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T19:20:10.319 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T19:20:10.352 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T19:20:10.535 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T19:20:10.715 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T19:20:10.759 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T19:20:10.797 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T19:20:10.857 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T19:20:10.920 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T19:20:10.921 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T19:20:10.988 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T19:20:11.054 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T19:20:11.069 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T19:20:11.101 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T19:20:11.151 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T19:20:11.226 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T19:20:11.274 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T19:20:11.416 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T19:20:11.480 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T19:20:11.531 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T19:20:11.601 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T19:20:11.749 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T19:20:11.817 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T19:20:12.704 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T19:20:12.771 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T19:20:12.805 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T19:20:12.834 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T19:20:12.848 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T19:20:12.888 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T19:20:12.892 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T19:20:13.019 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T19:20:13.086 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T19:20:13.187 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T19:20:13.252 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T19:20:13.282 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T19:20:13.334 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T19:20:13.440 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T19:20:13.474 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 100/156 2024-04-25T19:20:13.489 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T19:20:13.522 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T19:20:13.524 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T19:20:13.629 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T19:20:14.090 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T19:20:14.129 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T19:20:14.245 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T19:20:14.272 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 104/156 2024-04-25T19:20:14.454 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T19:20:14.595 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T19:20:16.218 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T19:20:16.313 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T19:20:16.364 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T19:20:16.408 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T19:20:16.803 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T19:20:16.840 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T19:20:16.851 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T19:20:16.886 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T19:20:16.988 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T19:20:17.025 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 100/156 2024-04-25T19:20:17.081 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T19:20:17.550 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T19:20:17.598 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T19:20:17.637 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T19:20:17.704 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T19:20:17.788 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T19:20:17.788 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T19:20:17.788 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T19:20:17.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:20:17.804 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T19:20:17.831 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 104/156 2024-04-25T19:20:17.833 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T19:20:20.847 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T19:20:20.886 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T19:20:21.575 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T19:20:21.623 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T19:20:21.784 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T19:20:21.784 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T19:20:21.784 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T19:20:21.784 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:20:21.823 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T19:20:31.197 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T19:20:31.197 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /sys 2024-04-25T19:20:31.197 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /proc 2024-04-25T19:20:31.197 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /mnt 2024-04-25T19:20:31.198 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /var/tmp 2024-04-25T19:20:31.198 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /home 2024-04-25T19:20:31.198 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /root 2024-04-25T19:20:31.198 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /tmp 2024-04-25T19:20:31.198 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:20:31.434 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T19:20:31.482 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T19:20:31.482 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T19:20:31.482 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T19:20:31.482 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:20:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T19:20:33.314 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T19:20:33.315 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T19:20:33.315 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T19:20:33.315 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T19:20:33.315 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T19:20:33.315 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:20:33.569 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T19:20:33.637 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T19:20:33.637 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T19:20:33.637 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T19:20:33.637 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T19:20:33.638 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T19:20:33.638 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:20:34.154 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T19:20:34.230 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T19:20:34.230 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T19:20:34.230 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T19:20:34.230 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T19:20:34.230 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T19:20:34.231 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:20:34.362 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T19:20:34.426 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T19:20:34.512 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T19:20:34.750 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T19:20:34.818 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T19:20:34.902 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T19:20:35.012 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T19:20:35.189 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T19:20:35.189 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /sys 2024-04-25T19:20:35.189 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /proc 2024-04-25T19:20:35.189 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /mnt 2024-04-25T19:20:35.189 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /var/tmp 2024-04-25T19:20:35.190 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /home 2024-04-25T19:20:35.190 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /root 2024-04-25T19:20:35.190 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /tmp 2024-04-25T19:20:35.190 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:20:35.203 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T19:20:35.254 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T19:20:35.299 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T19:20:35.342 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T19:20:35.431 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T19:20:35.476 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T19:20:35.477 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T19:20:35.477 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T19:20:35.477 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:20:36.014 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T19:20:36.054 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T19:20:36.110 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 124/156 2024-04-25T19:20:36.220 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 125/156 2024-04-25T19:20:36.255 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T19:20:37.197 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T19:20:37.278 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T19:20:37.278 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T19:20:37.278 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T19:20:37.279 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T19:20:37.279 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T19:20:37.279 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:20:37.517 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T19:20:37.548 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T19:20:37.591 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T19:20:37.619 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T19:20:37.619 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T19:20:37.619 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T19:20:37.619 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T19:20:37.619 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T19:20:37.619 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:20:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T19:20:38.202 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T19:20:38.202 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T19:20:38.202 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T19:20:38.203 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T19:20:38.203 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T19:20:38.203 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:20:38.332 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T19:20:38.391 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T19:20:38.465 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T19:20:38.699 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T19:20:38.717 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T19:20:38.749 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T19:20:38.752 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T19:20:38.837 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T19:20:38.898 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T19:20:38.946 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T19:20:39.086 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 129/156 2024-04-25T19:20:39.111 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T19:20:39.159 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T19:20:39.166 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T19:20:39.210 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T19:20:39.228 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T19:20:39.228 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T19:20:39.229 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T19:20:39.229 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T19:20:39.229 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T19:20:39.229 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:20:39.243 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T19:20:39.294 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T19:20:39.334 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T19:20:39.481 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 132/156 2024-04-25T19:20:39.569 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 133/156 2024-04-25T19:20:39.964 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T19:20:40.004 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T19:20:40.060 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 124/156 2024-04-25T19:20:40.168 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 125/156 2024-04-25T19:20:40.206 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T19:20:40.652 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T19:20:40.713 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T19:20:40.785 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T19:20:40.785 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T19:20:40.785 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T19:20:40.785 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T19:20:40.785 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T19:20:40.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:20:40.839 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T19:20:40.908 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T19:20:40.909 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T19:20:40.909 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T19:20:40.909 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:20:40.993 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T19:20:41.066 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T19:20:41.067 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T19:20:41.067 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T19:20:41.067 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T19:20:41.067 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T19:20:41.067 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:20:41.440 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T19:20:41.510 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T19:20:41.510 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T19:20:41.510 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T19:20:41.510 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T19:20:41.510 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T19:20:41.510 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:20:41.519 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T19:20:41.558 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T19:20:42.657 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T19:20:42.691 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T19:20:42.839 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T19:20:43.022 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 129/156 2024-04-25T19:20:43.052 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T19:20:43.121 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T19:20:43.121 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T19:20:43.121 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T19:20:43.121 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T19:20:43.121 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T19:20:43.121 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:20:43.186 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T19:20:43.224 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T19:20:43.376 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 132/156 2024-04-25T19:20:43.453 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 133/156 2024-04-25T19:20:44.557 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T19:20:44.615 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T19:20:44.684 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T19:20:44.684 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T19:20:44.684 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T19:20:44.684 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T19:20:44.684 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T19:20:44.684 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:20:44.739 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T19:20:44.811 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T19:20:44.811 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T19:20:44.811 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T19:20:44.811 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:20:44.881 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T19:20:44.957 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T19:20:44.957 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T19:20:44.957 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T19:20:44.957 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T19:20:44.957 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T19:20:44.957 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:20:45.324 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T19:20:45.421 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T19:20:45.421 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T19:20:45.421 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T19:20:45.421 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T19:20:45.421 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T19:20:45.421 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:20:46.214 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 139/156 2024-04-25T19:20:46.269 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 140/156 2024-04-25T19:20:46.376 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 141/156 2024-04-25T19:20:46.418 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T19:20:46.467 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T19:20:46.788 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 144/156 2024-04-25T19:20:46.843 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T19:20:46.871 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 146/156 2024-04-25T19:20:47.806 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T19:20:47.881 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T19:20:47.938 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T19:20:49.300 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 148/156 2024-04-25T19:20:49.403 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T19:20:49.510 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T19:20:49.708 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T19:20:49.771 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T19:20:49.772 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T19:20:49.894 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T19:20:49.941 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T19:20:49.942 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T19:20:50.106 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 139/156 2024-04-25T19:20:50.107 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T19:20:50.192 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 140/156 2024-04-25T19:20:50.240 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T19:20:50.280 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 141/156 2024-04-25T19:20:50.340 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T19:20:50.382 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T19:20:50.536 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T19:20:50.537 INFO:teuthology.orchestra.run.smithi131.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-25T19:20:50.537 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:20:50.700 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 144/156 2024-04-25T19:20:50.750 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T19:20:50.778 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 146/156 2024-04-25T19:20:51.749 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T19:20:51.802 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T19:20:51.858 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T19:20:53.199 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 148/156 2024-04-25T19:20:53.300 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T19:20:53.376 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T19:20:53.548 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T19:20:53.598 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T19:20:53.599 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T19:20:53.725 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T19:20:53.772 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T19:20:53.773 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T19:20:53.938 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T19:20:54.068 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T19:20:54.355 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T19:20:54.355 INFO:teuthology.orchestra.run.smithi195.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-25T19:20:54.355 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:20:56.479 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 1/156 2024-04-25T19:20:56.479 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2/156 2024-04-25T19:20:56.479 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 3/156 2024-04-25T19:20:56.479 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 4/156 2024-04-25T19:20:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 5/156 2024-04-25T19:20:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 6/156 2024-04-25T19:20:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 7/156 2024-04-25T19:20:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T19:20:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T19:20:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T19:20:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 11/156 2024-04-25T19:20:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 12/156 2024-04-25T19:20:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T19:20:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 14/156 2024-04-25T19:20:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 15/156 2024-04-25T19:20:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 16/156 2024-04-25T19:20:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 17/156 2024-04-25T19:20:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 18/156 2024-04-25T19:20:56.481 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 19/156 2024-04-25T19:20:56.481 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 20/156 2024-04-25T19:20:56.481 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 21/156 2024-04-25T19:20:56.481 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 22/156 2024-04-25T19:20:56.481 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 23/156 2024-04-25T19:20:56.481 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 24/156 2024-04-25T19:20:56.481 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 25/156 2024-04-25T19:20:56.481 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 26/156 2024-04-25T19:20:56.494 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 27/156 2024-04-25T19:20:56.494 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 28/156 2024-04-25T19:20:56.494 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 29/156 2024-04-25T19:20:56.494 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 30/156 2024-04-25T19:20:56.494 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 31/156 2024-04-25T19:20:56.494 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 32/156 2024-04-25T19:20:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 33/156 2024-04-25T19:20:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 34/156 2024-04-25T19:20:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 35/156 2024-04-25T19:20:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 36/156 2024-04-25T19:20:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 37/156 2024-04-25T19:20:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 38/156 2024-04-25T19:20:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 39/156 2024-04-25T19:20:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T19:20:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T19:20:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T19:20:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T19:20:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T19:20:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T19:20:56.496 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T19:20:56.496 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T19:20:56.496 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T19:20:56.496 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T19:20:56.496 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T19:20:56.496 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T19:20:56.496 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T19:20:56.496 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T19:20:56.496 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T19:20:56.496 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T19:20:56.496 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T19:20:56.496 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T19:20:56.496 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T19:20:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T19:20:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T19:20:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T19:20:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T19:20:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T19:20:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T19:20:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T19:20:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T19:20:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T19:20:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T19:20:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T19:20:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T19:20:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T19:20:56.498 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T19:20:56.498 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T19:20:56.498 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T19:20:56.498 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T19:20:56.498 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T19:20:56.498 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T19:20:56.498 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T19:20:56.498 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T19:20:56.498 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T19:20:56.498 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T19:20:56.498 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T19:20:56.498 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T19:20:56.498 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T19:20:56.499 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T19:20:56.499 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T19:20:56.499 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T19:20:56.499 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T19:20:56.499 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T19:20:56.499 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T19:20:56.499 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T19:20:56.500 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T19:20:56.500 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T19:20:56.500 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T19:20:56.500 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T19:20:56.500 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T19:20:56.501 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T19:20:56.501 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T19:20:56.501 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T19:20:56.501 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T19:20:56.501 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T19:20:56.501 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T19:20:56.501 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T19:20:56.501 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T19:20:56.501 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T19:20:56.502 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T19:20:56.502 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T19:20:56.502 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T19:20:56.502 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T19:20:56.502 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T19:20:56.502 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T19:20:56.502 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T19:20:56.502 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T19:20:56.502 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T19:20:56.502 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T19:20:56.502 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T19:20:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T19:20:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T19:20:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T19:20:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T19:20:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T19:20:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T19:20:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T19:20:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T19:20:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T19:20:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T19:20:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T19:20:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T19:20:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T19:20:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T19:20:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T19:20:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T19:20:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T19:20:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T19:20:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T19:20:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T19:20:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T19:20:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T19:20:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T19:20:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T19:20:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T19:20:56.505 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T19:20:56.505 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T19:20:56.505 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T19:20:56.505 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T19:20:56.505 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T19:20:56.505 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T19:20:56.505 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T19:20:56.505 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 149/156 2024-04-25T19:20:56.505 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T19:20:56.505 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 151/156 2024-04-25T19:20:56.505 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T19:20:56.505 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T19:20:56.505 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T19:20:56.505 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T19:20:58.957 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T19:20:58.957 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:20:58.958 INFO:teuthology.orchestra.run.smithi131.stdout:Upgraded: 2024-04-25T19:20:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T19:20:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T19:20:58.958 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-04-25T19:20:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T19:20:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T19:20:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T19:20:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T19:20:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T19:20:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T19:20:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T19:20:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T19:20:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T19:20:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T19:20:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T19:20:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T19:20:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T19:20:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T19:20:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T19:20:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T19:20:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T19:20:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T19:20:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T19:20:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T19:20:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T19:20:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T19:20:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T19:20:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T19:20:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T19:20:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T19:20:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T19:20:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T19:20:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T19:20:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T19:20:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T19:20:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T19:20:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T19:20:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T19:20:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T19:20:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T19:20:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T19:20:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T19:20:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T19:20:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T19:20:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T19:20:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T19:20:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T19:20:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T19:20:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T19:20:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T19:20:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T19:20:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T19:20:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T19:20:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T19:20:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T19:20:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T19:20:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T19:20:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T19:20:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T19:20:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T19:20:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T19:20:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T19:20:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T19:20:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T19:20:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T19:20:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T19:20:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T19:20:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T19:20:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T19:20:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T19:20:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T19:20:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T19:20:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T19:20:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T19:20:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T19:20:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T19:20:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T19:20:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T19:20:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T19:20:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T19:20:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T19:20:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T19:20:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T19:20:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T19:20:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T19:20:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T19:20:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T19:20:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T19:20:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T19:20:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T19:20:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T19:20:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T19:20:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T19:20:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T19:20:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T19:20:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T19:20:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T19:20:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T19:20:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T19:20:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T19:20:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T19:20:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T19:20:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T19:20:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T19:20:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T19:20:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T19:20:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T19:20:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T19:20:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T19:20:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T19:20:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T19:20:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T19:20:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T19:20:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T19:20:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T19:20:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T19:20:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:20:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T19:20:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T19:20:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T19:20:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T19:20:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T19:20:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T19:20:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T19:20:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:20:58.972 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-25T19:20:59.634 DEBUG:teuthology.parallel:result is None 2024-04-25T19:20:59.974 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 1/156 2024-04-25T19:20:59.974 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2/156 2024-04-25T19:20:59.974 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 3/156 2024-04-25T19:20:59.974 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 4/156 2024-04-25T19:20:59.974 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 5/156 2024-04-25T19:20:59.974 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 6/156 2024-04-25T19:20:59.974 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 7/156 2024-04-25T19:20:59.974 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T19:20:59.975 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T19:20:59.975 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T19:20:59.975 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 11/156 2024-04-25T19:20:59.975 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 12/156 2024-04-25T19:20:59.975 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T19:20:59.975 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 14/156 2024-04-25T19:20:59.975 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 15/156 2024-04-25T19:20:59.975 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 16/156 2024-04-25T19:20:59.975 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 17/156 2024-04-25T19:20:59.975 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 18/156 2024-04-25T19:20:59.975 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 19/156 2024-04-25T19:20:59.975 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 20/156 2024-04-25T19:20:59.975 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 21/156 2024-04-25T19:20:59.975 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 22/156 2024-04-25T19:20:59.975 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 23/156 2024-04-25T19:20:59.976 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 24/156 2024-04-25T19:20:59.976 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 25/156 2024-04-25T19:20:59.976 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 26/156 2024-04-25T19:20:59.976 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 27/156 2024-04-25T19:20:59.976 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 28/156 2024-04-25T19:20:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 29/156 2024-04-25T19:20:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 30/156 2024-04-25T19:20:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 31/156 2024-04-25T19:20:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 32/156 2024-04-25T19:20:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 33/156 2024-04-25T19:20:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 34/156 2024-04-25T19:20:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 35/156 2024-04-25T19:20:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 36/156 2024-04-25T19:20:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 37/156 2024-04-25T19:20:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 38/156 2024-04-25T19:20:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 39/156 2024-04-25T19:20:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T19:20:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T19:20:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T19:20:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T19:20:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T19:20:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T19:20:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T19:20:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T19:20:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T19:20:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T19:20:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T19:20:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T19:20:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T19:20:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T19:20:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T19:20:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T19:20:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T19:20:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T19:20:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T19:20:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T19:20:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T19:20:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T19:20:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T19:20:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T19:20:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T19:20:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T19:20:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T19:20:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T19:20:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T19:20:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T19:20:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T19:20:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T19:20:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T19:20:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T19:20:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T19:20:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T19:20:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T19:20:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T19:20:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T19:20:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T19:20:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T19:20:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T19:20:59.992 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T19:20:59.992 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T19:20:59.992 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T19:20:59.992 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T19:20:59.992 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T19:20:59.992 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T19:20:59.992 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T19:20:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T19:20:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T19:20:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T19:20:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T19:20:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T19:20:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T19:20:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T19:20:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T19:20:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T19:20:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T19:20:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T19:20:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T19:20:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T19:20:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T19:20:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T19:20:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T19:20:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T19:20:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T19:20:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T19:20:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T19:20:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T19:20:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T19:20:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T19:20:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T19:20:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T19:20:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T19:20:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T19:20:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T19:20:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T19:20:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T19:20:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T19:20:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T19:20:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T19:20:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T19:20:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T19:20:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T19:20:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T19:20:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T19:20:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T19:20:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T19:20:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T19:20:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T19:20:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T19:20:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T19:20:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T19:20:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T19:20:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T19:20:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T19:20:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T19:20:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T19:20:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T19:20:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T19:20:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T19:20:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T19:20:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T19:20:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T19:20:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T19:20:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T19:20:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T19:20:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T19:20:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 149/156 2024-04-25T19:20:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T19:20:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 151/156 2024-04-25T19:20:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T19:20:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T19:20:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T19:20:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T19:21:02.463 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T19:21:02.463 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:02.464 INFO:teuthology.orchestra.run.smithi195.stdout:Upgraded: 2024-04-25T19:21:02.464 INFO:teuthology.orchestra.run.smithi195.stdout: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.464 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.464 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T19:21:02.464 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T19:21:02.464 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-25T19:21:02.464 INFO:teuthology.orchestra.run.smithi195.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T19:21:02.464 INFO:teuthology.orchestra.run.smithi195.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T19:21:02.464 INFO:teuthology.orchestra.run.smithi195.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T19:21:02.464 INFO:teuthology.orchestra.run.smithi195.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T19:21:02.464 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.464 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.464 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.465 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.465 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T19:21:02.465 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.465 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.465 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.465 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T19:21:02.465 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T19:21:02.465 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T19:21:02.465 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T19:21:02.465 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T19:21:02.465 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.465 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.465 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T19:21:02.465 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.466 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.466 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.466 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T19:21:02.466 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T19:21:02.466 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.466 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.466 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T19:21:02.466 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T19:21:02.466 INFO:teuthology.orchestra.run.smithi195.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T19:21:02.466 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T19:21:02.466 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T19:21:02.466 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T19:21:02.467 INFO:teuthology.orchestra.run.smithi195.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T19:21:02.467 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T19:21:02.467 INFO:teuthology.orchestra.run.smithi195.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T19:21:02.467 INFO:teuthology.orchestra.run.smithi195.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T19:21:02.467 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T19:21:02.467 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T19:21:02.467 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.467 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.467 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.467 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T19:21:02.467 INFO:teuthology.orchestra.run.smithi195.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T19:21:02.467 INFO:teuthology.orchestra.run.smithi195.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T19:21:02.467 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T19:21:02.467 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T19:21:02.467 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.468 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.468 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T19:21:02.468 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.468 INFO:teuthology.orchestra.run.smithi195.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T19:21:02.468 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T19:21:02.468 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T19:21:02.468 INFO:teuthology.orchestra.run.smithi195.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T19:21:02.468 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T19:21:02.468 INFO:teuthology.orchestra.run.smithi195.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T19:21:02.468 INFO:teuthology.orchestra.run.smithi195.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T19:21:02.468 INFO:teuthology.orchestra.run.smithi195.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T19:21:02.468 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T19:21:02.468 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T19:21:02.468 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T19:21:02.469 INFO:teuthology.orchestra.run.smithi195.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T19:21:02.469 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T19:21:02.469 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T19:21:02.469 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T19:21:02.469 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T19:21:02.469 INFO:teuthology.orchestra.run.smithi195.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T19:21:02.469 INFO:teuthology.orchestra.run.smithi195.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T19:21:02.469 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T19:21:02.469 INFO:teuthology.orchestra.run.smithi195.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T19:21:02.469 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T19:21:02.469 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T19:21:02.469 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T19:21:02.469 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.469 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.469 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.470 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T19:21:02.470 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T19:21:02.470 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T19:21:02.470 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T19:21:02.470 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T19:21:02.470 INFO:teuthology.orchestra.run.smithi195.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T19:21:02.470 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T19:21:02.470 INFO:teuthology.orchestra.run.smithi195.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T19:21:02.470 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T19:21:02.470 INFO:teuthology.orchestra.run.smithi195.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T19:21:02.470 INFO:teuthology.orchestra.run.smithi195.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T19:21:02.470 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T19:21:02.471 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T19:21:02.471 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T19:21:02.471 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T19:21:02.471 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T19:21:02.471 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T19:21:02.471 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T19:21:02.471 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T19:21:02.471 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T19:21:02.471 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T19:21:02.471 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T19:21:02.471 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T19:21:02.471 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T19:21:02.471 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T19:21:02.472 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T19:21:02.472 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T19:21:02.472 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T19:21:02.472 INFO:teuthology.orchestra.run.smithi195.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T19:21:02.472 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T19:21:02.472 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T19:21:02.472 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T19:21:02.472 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T19:21:02.472 INFO:teuthology.orchestra.run.smithi195.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T19:21:02.472 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T19:21:02.472 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T19:21:02.472 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T19:21:02.472 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T19:21:02.472 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T19:21:02.473 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T19:21:02.473 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.473 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.473 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T19:21:02.473 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T19:21:02.473 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T19:21:02.473 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.473 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T19:21:02.473 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T19:21:02.473 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T19:21:02.473 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T19:21:02.473 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T19:21:02.473 INFO:teuthology.orchestra.run.smithi195.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T19:21:02.474 INFO:teuthology.orchestra.run.smithi195.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T19:21:02.474 INFO:teuthology.orchestra.run.smithi195.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T19:21:02.474 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T19:21:02.474 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T19:21:02.474 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T19:21:02.474 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T19:21:02.474 INFO:teuthology.orchestra.run.smithi195.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T19:21:02.474 INFO:teuthology.orchestra.run.smithi195.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T19:21:02.474 INFO:teuthology.orchestra.run.smithi195.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T19:21:02.474 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.474 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.474 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T19:21:02.474 INFO:teuthology.orchestra.run.smithi195.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T19:21:02.474 INFO:teuthology.orchestra.run.smithi195.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T19:21:02.475 INFO:teuthology.orchestra.run.smithi195.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T19:21:02.475 INFO:teuthology.orchestra.run.smithi195.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T19:21:02.475 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T19:21:02.475 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T19:21:02.475 INFO:teuthology.orchestra.run.smithi195.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T19:21:02.475 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:02.475 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-25T19:21:03.088 DEBUG:teuthology.parallel:result is None 2024-04-25T19:21:03.089 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T19:21:03.229 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T19:21:03.279 INFO:teuthology.orchestra.run.smithi131.stdout:19.0.0-3291.g994e2f20.el9 2024-04-25T19:21:03.280 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291.g994e2f20.el9 2024-04-25T19:21:03.280 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291.g994e2f20 is installed. 2024-04-25T19:21:03.282 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T19:21:03.419 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T19:21:03.476 INFO:teuthology.orchestra.run.smithi195.stdout:19.0.0-3291.g994e2f20.el9 2024-04-25T19:21:03.477 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291.g994e2f20.el9 2024-04-25T19:21:03.477 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291.g994e2f20 is installed. 2024-04-25T19:21:03.482 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T19:21:03.482 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:21:03.482 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T19:21:03.549 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:21:03.550 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T19:21:03.619 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T19:21:03.619 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:21:03.619 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T19:21:03.681 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T19:21:03.782 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:21:03.782 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T19:21:03.862 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T19:21:03.974 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T19:21:03.974 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:21:03.974 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T19:21:04.042 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T19:21:04.141 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:21:04.141 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T19:21:04.214 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T19:21:04.320 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T19:21:04.320 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:21:04.321 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T19:21:04.383 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T19:21:04.490 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:21:04.490 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T19:21:04.553 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T19:21:04.653 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T19:21:04.743 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T19:21:04.744 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 777 /var/log/ceph 2024-04-25T19:21:04.749 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 777 /var/log/ceph 2024-04-25T19:21:04.810 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T19:21:04.810 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T19:21:04.814 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T19:21:04.877 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T19:21:04.877 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T19:21:04.881 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T19:21:04.947 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T19:21:04.947 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T19:21:04.947 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T19:21:04.947 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:21:04.947 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T19:21:04.985 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T19:21:05.161 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T19:21:05.222 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:21:05.222 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T19:21:05.260 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T19:21:05.438 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T19:21:05.507 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T19:21:05.507 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T19:21:05.507 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673308', 'branch': 'wip-pdonnell-testing-20240425.015853-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/asok_dump_tree}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7673308', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240425.015853-debug'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240425.015853-debug', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 85, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1880, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'sleep_before_teardown': 0, 'subset': '178/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240425.015853-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi131.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMmNVierOx5ZdfB74xyhCCqlmze747qz1LrRfJJ52Q0bCSwr4TaX0AwhcXAcmt1PHoIUeLx/z9uFNauFrXQEraw=', 'smithi195.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC1l2APQy72uV07B0uBNl0Ku2t3V1FkWbRZ347Ym+Djf5zMMgvpEFheK6AXtiPJkwBVGg5krBEpKrbkMs3hBErU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_dump_tree']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_10:00:23', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T19:21:05.508 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T19:21:05.512 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T19:21:05.551 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T19:21:05.596 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T19:21:05.660 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:21:05.660 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T19:21:05.699 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T19:21:05.699 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_1 2024-04-25T19:21:05.780 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T19:21:05.780 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T19:21:05.780 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-04-25T19:21:05.780 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T19:21:05.780 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T19:21:05.780 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-04-25 19:20:51.052028573 +0000 2024-04-25T19:21:05.780 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-04-25 19:18:31.267999753 +0000 2024-04-25T19:21:05.781 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-04-25 19:18:31.267999753 +0000 2024-04-25T19:21:05.781 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-04-25 19:18:31.267999753 +0000 2024-04-25T19:21:05.781 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T19:21:05.881 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-04-25T19:21:05.881 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-04-25T19:21:05.881 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000575099 s, 890 kB/s 2024-04-25T19:21:05.884 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T19:21:05.926 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_2 2024-04-25T19:21:06.008 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T19:21:06.009 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T19:21:06.009 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-04-25T19:21:06.009 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T19:21:06.009 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T19:21:06.009 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-04-25 19:20:51.053028553 +0000 2024-04-25T19:21:06.009 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-04-25 19:18:31.909985648 +0000 2024-04-25T19:21:06.009 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-04-25 19:18:31.909985648 +0000 2024-04-25T19:21:06.009 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-04-25 19:18:31.909985648 +0000 2024-04-25T19:21:06.009 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T19:21:06.108 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-04-25T19:21:06.134 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-04-25T19:21:06.134 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000288442 s, 1.8 MB/s 2024-04-25T19:21:06.135 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T19:21:06.178 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_3 2024-04-25T19:21:06.269 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T19:21:06.269 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T19:21:06.270 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-04-25T19:21:06.270 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T19:21:06.270 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T19:21:06.270 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-04-25 19:20:51.054028532 +0000 2024-04-25T19:21:06.270 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-04-25 19:18:32.564971257 +0000 2024-04-25T19:21:06.270 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-04-25 19:18:32.564971257 +0000 2024-04-25T19:21:06.270 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-04-25 19:18:32.564971257 +0000 2024-04-25T19:21:06.270 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T19:21:06.333 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-04-25T19:21:06.333 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-04-25T19:21:06.333 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000458323 s, 1.1 MB/s 2024-04-25T19:21:06.336 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T19:21:06.387 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_4 2024-04-25T19:21:06.432 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T19:21:06.432 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T19:21:06.432 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-04-25T19:21:06.432 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T19:21:06.432 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T19:21:06.432 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-04-25 19:20:51.055028511 +0000 2024-04-25T19:21:06.432 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-04-25 19:18:33.166958031 +0000 2024-04-25T19:21:06.432 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-04-25 19:18:33.166958031 +0000 2024-04-25T19:21:06.433 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-04-25 19:18:33.166958031 +0000 2024-04-25T19:21:06.433 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T19:21:06.539 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-04-25T19:21:06.539 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-04-25T19:21:06.539 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000321873 s, 1.6 MB/s 2024-04-25T19:21:06.542 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T19:21:06.587 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T19:21:06.587 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:21:06.587 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T19:21:06.631 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T19:21:06.631 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_1 2024-04-25T19:21:06.711 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T19:21:06.711 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T19:21:06.711 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-04-25T19:21:06.711 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T19:21:06.711 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T19:21:06.711 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-25 19:20:54.805658340 +0000 2024-04-25T19:21:06.711 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-25 19:18:31.241869376 +0000 2024-04-25T19:21:06.711 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-25 19:18:31.241869376 +0000 2024-04-25T19:21:06.712 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-04-25 19:18:31.241869376 +0000 2024-04-25T19:21:06.712 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T19:21:06.809 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-25T19:21:06.809 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-25T19:21:06.809 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000218324 s, 2.3 MB/s 2024-04-25T19:21:06.812 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T19:21:06.852 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_2 2024-04-25T19:21:06.931 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T19:21:06.931 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T19:21:06.931 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-04-25T19:21:06.931 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T19:21:06.931 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T19:21:06.931 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-25 19:20:54.806658322 +0000 2024-04-25T19:21:06.931 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-25 19:18:31.834858266 +0000 2024-04-25T19:21:06.931 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-25 19:18:31.834858266 +0000 2024-04-25T19:21:06.931 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-04-25 19:18:31.834858266 +0000 2024-04-25T19:21:06.932 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T19:21:07.045 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-25T19:21:07.045 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-25T19:21:07.045 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000254462 s, 2.0 MB/s 2024-04-25T19:21:07.048 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T19:21:07.097 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_3 2024-04-25T19:21:07.137 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T19:21:07.137 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T19:21:07.137 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-04-25T19:21:07.137 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T19:21:07.137 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T19:21:07.137 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-25 19:20:54.807658303 +0000 2024-04-25T19:21:07.137 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-25 19:18:32.432847061 +0000 2024-04-25T19:21:07.138 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-25 19:18:32.432847061 +0000 2024-04-25T19:21:07.138 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-04-25 19:18:32.432847061 +0000 2024-04-25T19:21:07.138 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T19:21:07.236 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-25T19:21:07.236 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-25T19:21:07.236 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.0002319 s, 2.2 MB/s 2024-04-25T19:21:07.239 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T19:21:07.280 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_4 2024-04-25T19:21:07.371 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T19:21:07.371 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T19:21:07.371 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-04-25T19:21:07.371 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T19:21:07.371 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T19:21:07.372 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-25 19:20:54.807658303 +0000 2024-04-25T19:21:07.372 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-25 19:18:33.023835989 +0000 2024-04-25T19:21:07.372 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-25 19:18:33.023835989 +0000 2024-04-25T19:21:07.372 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-04-25 19:18:33.023835989 +0000 2024-04-25T19:21:07.372 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T19:21:07.442 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-25T19:21:07.443 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-25T19:21:07.443 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000250987 s, 2.0 MB/s 2024-04-25T19:21:07.446 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T19:21:07.495 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T19:21:07.496 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi195.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T19:21:07.496 INFO:tasks.ceph:Generating config... 2024-04-25T19:21:07.497 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T19:21:07.497 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T19:21:07.497 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T19:21:07.497 INFO:tasks.ceph:[client] pid file = 2024-04-25T19:21:07.497 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T19:21:07.497 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T19:21:07.497 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-25T19:21:07.498 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T19:21:07.498 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T19:21:07.498 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T19:21:07.498 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T19:21:07.498 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T19:21:07.498 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T19:21:07.498 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T19:21:07.498 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T19:21:07.498 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T19:21:07.498 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T19:21:07.498 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-25T19:21:07.499 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T19:21:07.499 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T19:21:07.499 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T19:21:07.499 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T19:21:07.499 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T19:21:07.499 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-25T19:21:07.499 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T19:21:07.499 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-25T19:21:07.499 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-25T19:21:07.499 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-25T19:21:07.499 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T19:21:07.499 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T19:21:07.500 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-25T19:21:07.500 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-25T19:21:07.500 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T19:21:07.500 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T19:21:07.500 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-25T19:21:07.500 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T19:21:07.500 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T19:21:07.500 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T19:21:07.500 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T19:21:07.500 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T19:21:07.500 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T19:21:07.501 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T19:21:07.501 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T19:21:07.700 INFO:teuthology.orchestra.run.smithi131.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T19:21:07.715 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T19:21:07.899 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T19:21:07.966 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.131'), ('mon.b', '172.21.15.195'), ('mon.c', '[v2:172.21.15.195:3301,v1:172.21.15.195:6790]')] 2024-04-25T19:21:07.967 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.131,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T19:21:07.967 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:21:07.968 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T19:21:08.012 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.131 --add b 172.21.15.195 --addv c '[v2:172.21.15.195:3301,v1:172.21.15.195:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T19:21:08.229 INFO:teuthology.orchestra.run.smithi131.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T19:21:08.229 INFO:teuthology.orchestra.run.smithi131.stdout:monmaptool: generated fsid 4ba607f8-c2c3-4d8d-85a8-7800763c470f 2024-04-25T19:21:08.229 INFO:teuthology.orchestra.run.smithi131.stdout:setting min_mon_release = quincy 2024-04-25T19:21:08.230 INFO:teuthology.orchestra.run.smithi131.stdout:epoch 0 2024-04-25T19:21:08.230 INFO:teuthology.orchestra.run.smithi131.stdout:fsid 4ba607f8-c2c3-4d8d-85a8-7800763c470f 2024-04-25T19:21:08.230 INFO:teuthology.orchestra.run.smithi131.stdout:last_changed 2024-04-25T19:21:08.228950+0000 2024-04-25T19:21:08.230 INFO:teuthology.orchestra.run.smithi131.stdout:created 2024-04-25T19:21:08.228950+0000 2024-04-25T19:21:08.230 INFO:teuthology.orchestra.run.smithi131.stdout:min_mon_release 17 (quincy) 2024-04-25T19:21:08.230 INFO:teuthology.orchestra.run.smithi131.stdout:election_strategy: 1 2024-04-25T19:21:08.230 INFO:teuthology.orchestra.run.smithi131.stdout:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2024-04-25T19:21:08.230 INFO:teuthology.orchestra.run.smithi131.stdout:1: [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon.b 2024-04-25T19:21:08.230 INFO:teuthology.orchestra.run.smithi131.stdout:2: [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] mon.c 2024-04-25T19:21:08.230 INFO:teuthology.orchestra.run.smithi131.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T19:21:08.239 DEBUG:teuthology.orchestra.run.smithi131:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T19:21:08.294 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4ba607f8-c2c3-4d8d-85a8-7800763c470f... 2024-04-25T19:21:08.295 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T19:21:08.300 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T19:21:08.416 INFO:teuthology.orchestra.run.smithi195.stdout:[global] 2024-04-25T19:21:08.416 INFO:teuthology.orchestra.run.smithi195.stdout: chdir = "" 2024-04-25T19:21:08.416 INFO:teuthology.orchestra.run.smithi195.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T19:21:08.416 INFO:teuthology.orchestra.run.smithi195.stdout: auth supported = cephx 2024-04-25T19:21:08.417 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.417 INFO:teuthology.orchestra.run.smithi195.stdout: filestore xattr use omap = true 2024-04-25T19:21:08.417 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.417 INFO:teuthology.orchestra.run.smithi195.stdout: mon clock drift allowed = 1.000 2024-04-25T19:21:08.417 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.417 INFO:teuthology.orchestra.run.smithi195.stdout: osd crush chooseleaf type = 0 2024-04-25T19:21:08.417 INFO:teuthology.orchestra.run.smithi195.stdout: auth debug = true 2024-04-25T19:21:08.417 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.417 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on old message = true 2024-04-25T19:21:08.417 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on bug = true 2024-04-25T19:21:08.417 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.417 INFO:teuthology.orchestra.run.smithi195.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T19:21:08.417 INFO:teuthology.orchestra.run.smithi195.stdout: mon pg warn max object skew = 0 2024-04-25T19:21:08.417 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.418 INFO:teuthology.orchestra.run.smithi195.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T19:21:08.418 INFO:teuthology.orchestra.run.smithi195.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T19:21:08.418 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.418 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default size = 2 2024-04-25T19:21:08.418 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.418 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow primary affinity = true 2024-04-25T19:21:08.418 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow pg remap = true 2024-04-25T19:21:08.418 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on legacy crush tunables = false 2024-04-25T19:21:08.418 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on crush straw calc version zero = false 2024-04-25T19:21:08.418 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on no sortbitwise = false 2024-04-25T19:21:08.418 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on osd down out interval zero = false 2024-04-25T19:21:08.418 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on too few osds = false 2024-04-25T19:21:08.418 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T19:21:08.418 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T19:21:08.419 INFO:teuthology.orchestra.run.smithi195.stdout: mon_allow_pool_size_one = true 2024-04-25T19:21:08.419 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.419 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T19:21:08.419 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.419 INFO:teuthology.orchestra.run.smithi195.stdout: osd default data pool replay window = 5 2024-04-25T19:21:08.419 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.419 INFO:teuthology.orchestra.run.smithi195.stdout: mon allow pool delete = true 2024-04-25T19:21:08.419 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.419 INFO:teuthology.orchestra.run.smithi195.stdout: mon cluster log file level = debug 2024-04-25T19:21:08.419 INFO:teuthology.orchestra.run.smithi195.stdout: debug asserts on shutdown = true 2024-04-25T19:21:08.419 INFO:teuthology.orchestra.run.smithi195.stdout: mon health detail to clog = false 2024-04-25T19:21:08.419 INFO:teuthology.orchestra.run.smithi195.stdout: mon host = "172.21.15.131,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]" 2024-04-25T19:21:08.419 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on skipped message = False 2024-04-25T19:21:08.419 INFO:teuthology.orchestra.run.smithi195.stdout: fsid = 4ba607f8-c2c3-4d8d-85a8-7800763c470f 2024-04-25T19:21:08.420 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.420 INFO:teuthology.orchestra.run.smithi195.stdout:[osd] 2024-04-25T19:21:08.420 INFO:teuthology.orchestra.run.smithi195.stdout: osd journal size = 100 2024-04-25T19:21:08.420 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.420 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub load threshold = 5.0 2024-04-25T19:21:08.420 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub max interval = 600 2024-04-25T19:21:08.420 INFO:teuthology.orchestra.run.smithi195.stdout: osd mclock profile = high_recovery_ops 2024-04-25T19:21:08.420 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.420 INFO:teuthology.orchestra.run.smithi195.stdout: osd recover clone overlap = true 2024-04-25T19:21:08.420 INFO:teuthology.orchestra.run.smithi195.stdout: osd recovery max chunk = 1048576 2024-04-25T19:21:08.420 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.420 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug shutdown = true 2024-04-25T19:21:08.420 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug op order = true 2024-04-25T19:21:08.420 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug verify stray on activate = true 2024-04-25T19:21:08.420 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug trim objects = true 2024-04-25T19:21:08.420 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.421 INFO:teuthology.orchestra.run.smithi195.stdout: osd open classes on start = true 2024-04-25T19:21:08.421 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug pg log writeout = true 2024-04-25T19:21:08.421 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.421 INFO:teuthology.orchestra.run.smithi195.stdout: osd deep scrub update digest min age = 30 2024-04-25T19:21:08.421 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.421 INFO:teuthology.orchestra.run.smithi195.stdout: osd map max advance = 10 2024-04-25T19:21:08.421 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.421 INFO:teuthology.orchestra.run.smithi195.stdout: journal zero on create = true 2024-04-25T19:21:08.421 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.421 INFO:teuthology.orchestra.run.smithi195.stdout: filestore ondisk finisher threads = 3 2024-04-25T19:21:08.421 INFO:teuthology.orchestra.run.smithi195.stdout: filestore apply finisher threads = 3 2024-04-25T19:21:08.421 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.421 INFO:teuthology.orchestra.run.smithi195.stdout: bdev debug aio = true 2024-04-25T19:21:08.421 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug misdirected ops = true 2024-04-25T19:21:08.421 INFO:teuthology.orchestra.run.smithi195.stdout: bdev async discard = True 2024-04-25T19:21:08.421 INFO:teuthology.orchestra.run.smithi195.stdout: bdev enable discard = True 2024-04-25T19:21:08.422 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore allocator = bitmap 2024-04-25T19:21:08.422 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore block size = 96636764160 2024-04-25T19:21:08.422 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore fsck on mount = True 2024-04-25T19:21:08.422 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluefs = 1/20 2024-04-25T19:21:08.422 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluestore = 1/20 2024-04-25T19:21:08.422 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-25T19:21:08.422 INFO:teuthology.orchestra.run.smithi195.stdout: debug osd = 20 2024-04-25T19:21:08.422 INFO:teuthology.orchestra.run.smithi195.stdout: debug rocksdb = 4/10 2024-04-25T19:21:08.422 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T19:21:08.422 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd full ratio = 0.9 2024-04-25T19:21:08.422 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd nearfull ratio = 0.8 2024-04-25T19:21:08.422 INFO:teuthology.orchestra.run.smithi195.stdout: osd failsafe full ratio = 0.95 2024-04-25T19:21:08.422 INFO:teuthology.orchestra.run.smithi195.stdout: osd objectstore = bluestore 2024-04-25T19:21:08.422 INFO:teuthology.orchestra.run.smithi195.stdout: osd op complaint time = 180 2024-04-25T19:21:08.422 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.423 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr] 2024-04-25T19:21:08.423 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-25T19:21:08.423 INFO:teuthology.orchestra.run.smithi195.stdout: debug mgr = 20 2024-04-25T19:21:08.423 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-04-25T19:21:08.423 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-04-25T19:21:08.423 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-04-25T19:21:08.423 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-04-25T19:21:08.423 INFO:teuthology.orchestra.run.smithi195.stdout: mgr/telemetry/nag = false 2024-04-25T19:21:08.423 INFO:teuthology.orchestra.run.smithi195.stdout: debug client = 20 2024-04-25T19:21:08.423 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.423 INFO:teuthology.orchestra.run.smithi195.stdout:[mon] 2024-04-25T19:21:08.423 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-25T19:21:08.423 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-04-25T19:21:08.423 INFO:teuthology.orchestra.run.smithi195.stdout: debug paxos = 20 2024-04-25T19:21:08.424 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-04-25T19:21:08.424 INFO:teuthology.orchestra.run.smithi195.stdout: mon data avail warn = 5 2024-04-25T19:21:08.424 INFO:teuthology.orchestra.run.smithi195.stdout: mon mgr mkfs grace = 240 2024-04-25T19:21:08.424 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-04-25T19:21:08.424 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd reporter subtree level = osd 2024-04-25T19:21:08.424 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd prime pg temp = true 2024-04-25T19:21:08.424 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-04-25T19:21:08.424 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.424 INFO:teuthology.orchestra.run.smithi195.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T19:21:08.424 INFO:teuthology.orchestra.run.smithi195.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T19:21:08.424 INFO:teuthology.orchestra.run.smithi195.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T19:21:08.424 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.424 INFO:teuthology.orchestra.run.smithi195.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T19:21:08.424 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T19:21:08.425 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T19:21:08.425 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.425 INFO:teuthology.orchestra.run.smithi195.stdout: # 1m isn't quite enough 2024-04-25T19:21:08.425 INFO:teuthology.orchestra.run.smithi195.stdout: mon_down_mkfs_grace = 2m 2024-04-25T19:21:08.425 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.425 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_filestore_osds = false 2024-04-25T19:21:08.425 INFO:teuthology.orchestra.run.smithi195.stdout: mon down mkfs grace = 300 2024-04-25T19:21:08.425 INFO:teuthology.orchestra.run.smithi195.stdout: mon op complaint time = 120 2024-04-25T19:21:08.425 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T19:21:08.425 INFO:teuthology.orchestra.run.smithi195.stdout:[client] 2024-04-25T19:21:08.425 INFO:teuthology.orchestra.run.smithi195.stdout: rgw cache enabled = true 2024-04-25T19:21:08.425 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable ops log = true 2024-04-25T19:21:08.425 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable usage log = true 2024-04-25T19:21:08.425 INFO:teuthology.orchestra.run.smithi195.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T19:21:08.425 INFO:teuthology.orchestra.run.smithi195.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T19:21:08.426 INFO:teuthology.orchestra.run.smithi195.stdout: client mount timeout = 600 2024-04-25T19:21:08.426 INFO:teuthology.orchestra.run.smithi195.stdout: debug client = 20 2024-04-25T19:21:08.426 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-25T19:21:08.426 INFO:teuthology.orchestra.run.smithi195.stdout: pid file = "" 2024-04-25T19:21:08.426 INFO:teuthology.orchestra.run.smithi195.stdout: rados mon op timeout = 900 2024-04-25T19:21:08.426 INFO:teuthology.orchestra.run.smithi195.stdout: rados osd op timeout = 900 2024-04-25T19:21:08.426 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.a] 2024-04-25T19:21:08.426 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.b] 2024-04-25T19:21:08.426 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.c] 2024-04-25T19:21:08.426 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.a] 2024-04-25T19:21:08.426 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.c] 2024-04-25T19:21:08.426 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.b] 2024-04-25T19:21:08.427 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.d] 2024-04-25T19:21:08.427 INFO:teuthology.orchestra.run.smithi195.stdout:[mds] 2024-04-25T19:21:08.427 INFO:teuthology.orchestra.run.smithi195.stdout: debug mds = 20 2024-04-25T19:21:08.427 INFO:teuthology.orchestra.run.smithi195.stdout: debug mds balancer = 20 2024-04-25T19:21:08.427 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-25T19:21:08.427 INFO:teuthology.orchestra.run.smithi195.stdout: mds debug frag = True 2024-04-25T19:21:08.427 INFO:teuthology.orchestra.run.smithi195.stdout: mds debug scatterstat = True 2024-04-25T19:21:08.427 INFO:teuthology.orchestra.run.smithi195.stdout: mds op complaint time = 180 2024-04-25T19:21:08.427 INFO:teuthology.orchestra.run.smithi195.stdout: mds verify scatter = True 2024-04-25T19:21:08.427 INFO:teuthology.orchestra.run.smithi195.stdout: osd op complaint time = 180 2024-04-25T19:21:08.427 INFO:teuthology.orchestra.run.smithi195.stdout: rados mon op timeout = 900 2024-04-25T19:21:08.427 INFO:teuthology.orchestra.run.smithi195.stdout: rados osd op timeout = 900 2024-04-25T19:21:08.428 INFO:teuthology.orchestra.run.smithi131.stdout:[global] 2024-04-25T19:21:08.428 INFO:teuthology.orchestra.run.smithi131.stdout: chdir = "" 2024-04-25T19:21:08.428 INFO:teuthology.orchestra.run.smithi131.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T19:21:08.428 INFO:teuthology.orchestra.run.smithi131.stdout: auth supported = cephx 2024-04-25T19:21:08.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.428 INFO:teuthology.orchestra.run.smithi131.stdout: filestore xattr use omap = true 2024-04-25T19:21:08.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.428 INFO:teuthology.orchestra.run.smithi131.stdout: mon clock drift allowed = 1.000 2024-04-25T19:21:08.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.428 INFO:teuthology.orchestra.run.smithi131.stdout: osd crush chooseleaf type = 0 2024-04-25T19:21:08.428 INFO:teuthology.orchestra.run.smithi131.stdout: auth debug = true 2024-04-25T19:21:08.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.428 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on old message = true 2024-04-25T19:21:08.428 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on bug = true 2024-04-25T19:21:08.429 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.429 INFO:teuthology.orchestra.run.smithi131.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T19:21:08.429 INFO:teuthology.orchestra.run.smithi131.stdout: mon pg warn max object skew = 0 2024-04-25T19:21:08.429 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.429 INFO:teuthology.orchestra.run.smithi131.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T19:21:08.429 INFO:teuthology.orchestra.run.smithi131.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T19:21:08.429 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.429 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default size = 2 2024-04-25T19:21:08.429 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.429 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow primary affinity = true 2024-04-25T19:21:08.429 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow pg remap = true 2024-04-25T19:21:08.429 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on legacy crush tunables = false 2024-04-25T19:21:08.429 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on crush straw calc version zero = false 2024-04-25T19:21:08.429 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on no sortbitwise = false 2024-04-25T19:21:08.429 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on osd down out interval zero = false 2024-04-25T19:21:08.430 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on too few osds = false 2024-04-25T19:21:08.430 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T19:21:08.430 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T19:21:08.430 INFO:teuthology.orchestra.run.smithi131.stdout: mon_allow_pool_size_one = true 2024-04-25T19:21:08.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.430 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T19:21:08.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.430 INFO:teuthology.orchestra.run.smithi131.stdout: osd default data pool replay window = 5 2024-04-25T19:21:08.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.430 INFO:teuthology.orchestra.run.smithi131.stdout: mon allow pool delete = true 2024-04-25T19:21:08.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.430 INFO:teuthology.orchestra.run.smithi131.stdout: mon cluster log file level = debug 2024-04-25T19:21:08.430 INFO:teuthology.orchestra.run.smithi131.stdout: debug asserts on shutdown = true 2024-04-25T19:21:08.430 INFO:teuthology.orchestra.run.smithi131.stdout: mon health detail to clog = false 2024-04-25T19:21:08.431 INFO:teuthology.orchestra.run.smithi131.stdout: mon host = "172.21.15.131,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]" 2024-04-25T19:21:08.431 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on skipped message = False 2024-04-25T19:21:08.431 INFO:teuthology.orchestra.run.smithi131.stdout: fsid = 4ba607f8-c2c3-4d8d-85a8-7800763c470f 2024-04-25T19:21:08.431 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.431 INFO:teuthology.orchestra.run.smithi131.stdout:[osd] 2024-04-25T19:21:08.431 INFO:teuthology.orchestra.run.smithi131.stdout: osd journal size = 100 2024-04-25T19:21:08.431 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.431 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub load threshold = 5.0 2024-04-25T19:21:08.431 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub max interval = 600 2024-04-25T19:21:08.431 INFO:teuthology.orchestra.run.smithi131.stdout: osd mclock profile = high_recovery_ops 2024-04-25T19:21:08.431 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.431 INFO:teuthology.orchestra.run.smithi131.stdout: osd recover clone overlap = true 2024-04-25T19:21:08.431 INFO:teuthology.orchestra.run.smithi131.stdout: osd recovery max chunk = 1048576 2024-04-25T19:21:08.431 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.431 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug shutdown = true 2024-04-25T19:21:08.431 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug op order = true 2024-04-25T19:21:08.432 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug verify stray on activate = true 2024-04-25T19:21:08.432 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug trim objects = true 2024-04-25T19:21:08.432 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.432 INFO:teuthology.orchestra.run.smithi131.stdout: osd open classes on start = true 2024-04-25T19:21:08.432 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug pg log writeout = true 2024-04-25T19:21:08.432 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.432 INFO:teuthology.orchestra.run.smithi131.stdout: osd deep scrub update digest min age = 30 2024-04-25T19:21:08.432 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.432 INFO:teuthology.orchestra.run.smithi131.stdout: osd map max advance = 10 2024-04-25T19:21:08.432 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.432 INFO:teuthology.orchestra.run.smithi131.stdout: journal zero on create = true 2024-04-25T19:21:08.432 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.432 INFO:teuthology.orchestra.run.smithi131.stdout: filestore ondisk finisher threads = 3 2024-04-25T19:21:08.432 INFO:teuthology.orchestra.run.smithi131.stdout: filestore apply finisher threads = 3 2024-04-25T19:21:08.432 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.432 INFO:teuthology.orchestra.run.smithi131.stdout: bdev debug aio = true 2024-04-25T19:21:08.433 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug misdirected ops = true 2024-04-25T19:21:08.433 INFO:teuthology.orchestra.run.smithi131.stdout: bdev async discard = True 2024-04-25T19:21:08.433 INFO:teuthology.orchestra.run.smithi131.stdout: bdev enable discard = True 2024-04-25T19:21:08.433 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore allocator = bitmap 2024-04-25T19:21:08.433 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore block size = 96636764160 2024-04-25T19:21:08.433 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore fsck on mount = True 2024-04-25T19:21:08.433 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluefs = 1/20 2024-04-25T19:21:08.433 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluestore = 1/20 2024-04-25T19:21:08.433 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-04-25T19:21:08.433 INFO:teuthology.orchestra.run.smithi131.stdout: debug osd = 20 2024-04-25T19:21:08.433 INFO:teuthology.orchestra.run.smithi131.stdout: debug rocksdb = 4/10 2024-04-25T19:21:08.433 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T19:21:08.433 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd full ratio = 0.9 2024-04-25T19:21:08.433 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd nearfull ratio = 0.8 2024-04-25T19:21:08.433 INFO:teuthology.orchestra.run.smithi131.stdout: osd failsafe full ratio = 0.95 2024-04-25T19:21:08.433 INFO:teuthology.orchestra.run.smithi131.stdout: osd objectstore = bluestore 2024-04-25T19:21:08.434 INFO:teuthology.orchestra.run.smithi131.stdout: osd op complaint time = 180 2024-04-25T19:21:08.434 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.434 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr] 2024-04-25T19:21:08.434 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-04-25T19:21:08.434 INFO:teuthology.orchestra.run.smithi131.stdout: debug mgr = 20 2024-04-25T19:21:08.434 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2024-04-25T19:21:08.434 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2024-04-25T19:21:08.434 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2024-04-25T19:21:08.434 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2024-04-25T19:21:08.434 INFO:teuthology.orchestra.run.smithi131.stdout: mgr/telemetry/nag = false 2024-04-25T19:21:08.434 INFO:teuthology.orchestra.run.smithi131.stdout: debug client = 20 2024-04-25T19:21:08.434 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.434 INFO:teuthology.orchestra.run.smithi131.stdout:[mon] 2024-04-25T19:21:08.434 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-04-25T19:21:08.434 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2024-04-25T19:21:08.435 INFO:teuthology.orchestra.run.smithi131.stdout: debug paxos = 20 2024-04-25T19:21:08.435 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2024-04-25T19:21:08.435 INFO:teuthology.orchestra.run.smithi131.stdout: mon data avail warn = 5 2024-04-25T19:21:08.435 INFO:teuthology.orchestra.run.smithi131.stdout: mon mgr mkfs grace = 240 2024-04-25T19:21:08.435 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2024-04-25T19:21:08.435 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd reporter subtree level = osd 2024-04-25T19:21:08.435 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd prime pg temp = true 2024-04-25T19:21:08.435 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2024-04-25T19:21:08.435 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.435 INFO:teuthology.orchestra.run.smithi131.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T19:21:08.435 INFO:teuthology.orchestra.run.smithi131.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T19:21:08.435 INFO:teuthology.orchestra.run.smithi131.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T19:21:08.435 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.435 INFO:teuthology.orchestra.run.smithi131.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T19:21:08.435 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T19:21:08.436 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T19:21:08.436 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.436 INFO:teuthology.orchestra.run.smithi131.stdout: # 1m isn't quite enough 2024-04-25T19:21:08.436 INFO:teuthology.orchestra.run.smithi131.stdout: mon_down_mkfs_grace = 2m 2024-04-25T19:21:08.436 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.436 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_filestore_osds = false 2024-04-25T19:21:08.436 INFO:teuthology.orchestra.run.smithi131.stdout: mon down mkfs grace = 300 2024-04-25T19:21:08.436 INFO:teuthology.orchestra.run.smithi131.stdout: mon op complaint time = 120 2024-04-25T19:21:08.436 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:08.436 INFO:teuthology.orchestra.run.smithi131.stdout:[client] 2024-04-25T19:21:08.436 INFO:teuthology.orchestra.run.smithi131.stdout: rgw cache enabled = true 2024-04-25T19:21:08.436 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable ops log = true 2024-04-25T19:21:08.436 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable usage log = true 2024-04-25T19:21:08.436 INFO:teuthology.orchestra.run.smithi131.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T19:21:08.436 INFO:teuthology.orchestra.run.smithi131.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T19:21:08.437 INFO:teuthology.orchestra.run.smithi131.stdout: client mount timeout = 600 2024-04-25T19:21:08.437 INFO:teuthology.orchestra.run.smithi131.stdout: debug client = 20 2024-04-25T19:21:08.437 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-04-25T19:21:08.437 INFO:teuthology.orchestra.run.smithi131.stdout: pid file = "" 2024-04-25T19:21:08.437 INFO:teuthology.orchestra.run.smithi131.stdout: rados mon op timeout = 900 2024-04-25T19:21:08.437 INFO:teuthology.orchestra.run.smithi131.stdout: rados osd op timeout = 900 2024-04-25T19:21:08.437 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.a] 2024-04-25T19:21:08.437 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.b] 2024-04-25T19:21:08.437 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.c] 2024-04-25T19:21:08.437 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.a] 2024-04-25T19:21:08.437 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.c] 2024-04-25T19:21:08.437 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.b] 2024-04-25T19:21:08.437 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.d] 2024-04-25T19:21:08.437 INFO:teuthology.orchestra.run.smithi131.stdout:[mds] 2024-04-25T19:21:08.437 INFO:teuthology.orchestra.run.smithi131.stdout: debug mds = 20 2024-04-25T19:21:08.437 INFO:teuthology.orchestra.run.smithi131.stdout: debug mds balancer = 20 2024-04-25T19:21:08.438 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-04-25T19:21:08.438 INFO:teuthology.orchestra.run.smithi131.stdout: mds debug frag = True 2024-04-25T19:21:08.438 INFO:teuthology.orchestra.run.smithi131.stdout: mds debug scatterstat = True 2024-04-25T19:21:08.438 INFO:teuthology.orchestra.run.smithi131.stdout: mds op complaint time = 180 2024-04-25T19:21:08.438 INFO:teuthology.orchestra.run.smithi131.stdout: mds verify scatter = True 2024-04-25T19:21:08.438 INFO:teuthology.orchestra.run.smithi131.stdout: osd op complaint time = 180 2024-04-25T19:21:08.438 INFO:teuthology.orchestra.run.smithi131.stdout: rados mon op timeout = 900 2024-04-25T19:21:08.438 INFO:teuthology.orchestra.run.smithi131.stdout: rados osd op timeout = 900 2024-04-25T19:21:08.459 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T19:21:08.459 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T19:21:08.658 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T19:21:08.658 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:21:08.658 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T19:21:08.707 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:21:08.707 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T19:21:08.754 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi131.front.sepia.ceph.com 2024-04-25T19:21:08.754 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:21:08.754 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T19:21:08.754 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T19:21:08.944 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:21:08.944 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T19:21:09.038 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T19:21:09.038 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:21:09.038 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T19:21:09.038 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T19:21:09.126 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:21:09.126 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T19:21:09.204 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T19:21:09.204 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T19:21:09.204 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T19:21:09.442 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T19:21:09.458 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T19:21:09.676 INFO:teuthology.orchestra.run.smithi195.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T19:21:09.689 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T19:21:09.690 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T19:21:09.929 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T19:21:09.945 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T19:21:10.027 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T19:21:10.262 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T19:21:10.277 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T19:21:10.359 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T19:21:10.600 INFO:teuthology.orchestra.run.smithi195.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T19:21:10.612 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T19:21:10.693 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T19:21:10.902 INFO:teuthology.orchestra.run.smithi195.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T19:21:10.915 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T19:21:10.999 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T19:21:11.000 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T19:21:11.188 INFO:teuthology.orchestra.run.smithi131.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T19:21:11.232 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-25T19:21:11.418 INFO:teuthology.orchestra.run.smithi131.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-25T19:21:11.476 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-25T19:21:11.668 INFO:teuthology.orchestra.run.smithi195.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-25T19:21:11.716 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-25T19:21:11.891 INFO:teuthology.orchestra.run.smithi195.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-25T19:21:11.931 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T19:21:11.932 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi195.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T19:21:11.932 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T19:21:12.018 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T19:21:12.019 INFO:tasks.ceph:role: osd.0 2024-04-25T19:21:12.019 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-25T19:21:12.019 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T19:21:12.108 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T19:21:12.108 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T19:21:12.108 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T19:21:12.108 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T19:21:12.108 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T19:21:12.108 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-04-25T19:21:12.108 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T19:21:12.108 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T19:21:12.108 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T19:21:12.108 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T19:21:12.516 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-04-25T19:21:12.523 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-04-25T19:21:12.524 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T19:21:12.697 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T19:21:12.788 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T19:21:12.867 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T19:21:12.867 INFO:tasks.ceph:role: osd.1 2024-04-25T19:21:12.867 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-25T19:21:12.867 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T19:21:12.954 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T19:21:12.955 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T19:21:12.955 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T19:21:12.955 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T19:21:12.955 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T19:21:12.955 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-04-25T19:21:12.955 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T19:21:12.955 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T19:21:12.955 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T19:21:12.955 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T19:21:13.310 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-04-25T19:21:13.315 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-04-25T19:21:13.315 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T19:21:13.434 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T19:21:13.510 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T19:21:13.580 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T19:21:13.580 INFO:tasks.ceph:role: osd.2 2024-04-25T19:21:13.580 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-25T19:21:13.581 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T19:21:13.670 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T19:21:13.670 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T19:21:13.670 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T19:21:13.670 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T19:21:13.670 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T19:21:13.670 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-04-25T19:21:13.670 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T19:21:13.670 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T19:21:13.670 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T19:21:13.670 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T19:21:14.061 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-04-25T19:21:14.068 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-04-25T19:21:14.068 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T19:21:14.227 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T19:21:14.318 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T19:21:14.399 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T19:21:14.399 INFO:tasks.ceph:role: osd.3 2024-04-25T19:21:14.400 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-25T19:21:14.400 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T19:21:14.487 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T19:21:14.487 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T19:21:14.487 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T19:21:14.487 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T19:21:14.487 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T19:21:14.487 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-04-25T19:21:14.487 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T19:21:14.488 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T19:21:14.488 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T19:21:14.488 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T19:21:14.893 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-04-25T19:21:14.899 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-04-25T19:21:14.900 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T19:21:15.036 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T19:21:15.117 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T19:21:15.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:15.322+0000 7f345f34c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T19:21:15.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:15.323+0000 7f345f34c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T19:21:15.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:15.323+0000 7f345f34c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T19:21:15.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:15.323+0000 7f345f34c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T19:21:15.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:15.323+0000 7f345f34c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T19:21:15.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:15.326+0000 7f345f34c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T19:21:18.612 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T19:21:18.695 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T19:21:18.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:18.890+0000 7fbb5400d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T19:21:18.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:18.890+0000 7fbb5400d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T19:21:18.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:18.890+0000 7fbb5400d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T19:21:18.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:18.890+0000 7fbb5400d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T19:21:18.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:18.890+0000 7fbb5400d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T19:21:18.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:18.893+0000 7fbb5400d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T19:21:22.142 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T19:21:22.226 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T19:21:22.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:22.430+0000 7fd3799fc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T19:21:22.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:22.431+0000 7fd3799fc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T19:21:22.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:22.431+0000 7fd3799fc640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T19:21:22.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:22.431+0000 7fd3799fc640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T19:21:22.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:22.431+0000 7fd3799fc640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T19:21:22.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:22.432+0000 7fd3799fc640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T19:21:25.423 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T19:21:25.504 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T19:21:25.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:25.697+0000 7f760663c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T19:21:25.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:25.698+0000 7f760663c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T19:21:25.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:25.698+0000 7f760663c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T19:21:25.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:25.698+0000 7f760663c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T19:21:25.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:25.698+0000 7f760663c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T19:21:25.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:25.700+0000 7f760663c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T19:21:28.922 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T19:21:29.004 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T19:21:29.094 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T19:21:29.095 INFO:tasks.ceph:role: osd.4 2024-04-25T19:21:29.095 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T19:21:29.095 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T19:21:29.177 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T19:21:29.178 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T19:21:29.178 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T19:21:29.178 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T19:21:29.178 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T19:21:29.178 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-04-25T19:21:29.178 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T19:21:29.178 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T19:21:29.178 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T19:21:29.178 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T19:21:29.212 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2024-04-25T19:21:29.218 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-04-25T19:21:29.218 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T19:21:29.320 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T19:21:29.404 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T19:21:29.488 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T19:21:29.488 INFO:tasks.ceph:role: osd.5 2024-04-25T19:21:29.488 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T19:21:29.488 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T19:21:29.568 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T19:21:29.568 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T19:21:29.568 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T19:21:29.569 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T19:21:29.569 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T19:21:29.569 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-04-25T19:21:29.569 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T19:21:29.569 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T19:21:29.569 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T19:21:29.569 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T19:21:29.602 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2024-04-25T19:21:29.607 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-04-25T19:21:29.607 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T19:21:29.709 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T19:21:29.785 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T19:21:29.859 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T19:21:29.859 INFO:tasks.ceph:role: osd.6 2024-04-25T19:21:29.859 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T19:21:29.859 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T19:21:29.941 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T19:21:29.941 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T19:21:29.941 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T19:21:29.941 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T19:21:29.941 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T19:21:29.941 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-04-25T19:21:29.941 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T19:21:29.941 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T19:21:29.941 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T19:21:29.941 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T19:21:29.973 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2024-04-25T19:21:29.979 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-04-25T19:21:29.979 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T19:21:30.078 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T19:21:30.149 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T19:21:30.223 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T19:21:30.224 INFO:tasks.ceph:role: osd.7 2024-04-25T19:21:30.224 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T19:21:30.224 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T19:21:30.304 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T19:21:30.305 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T19:21:30.305 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T19:21:30.305 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T19:21:30.305 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T19:21:30.305 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-04-25T19:21:30.305 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T19:21:30.305 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T19:21:30.305 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T19:21:30.305 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T19:21:30.338 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2024-04-25T19:21:30.343 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-04-25T19:21:30.343 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T19:21:30.446 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T19:21:30.523 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T19:21:30.726 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:30.725+0000 7fe065114640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T19:21:30.727 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:30.725+0000 7fe065114640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T19:21:30.727 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:30.725+0000 7fe065114640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T19:21:30.727 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:30.726+0000 7fe065114640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T19:21:30.727 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:30.726+0000 7fe065114640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T19:21:30.730 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:30.729+0000 7fe065114640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T19:21:33.943 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T19:21:34.026 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T19:21:34.223 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:34.220+0000 7f7cb6082640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T19:21:34.223 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:34.221+0000 7f7cb6082640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T19:21:34.223 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:34.221+0000 7f7cb6082640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T19:21:34.223 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:34.221+0000 7f7cb6082640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T19:21:34.223 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:34.221+0000 7f7cb6082640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T19:21:34.225 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:34.223+0000 7f7cb6082640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T19:21:35.509 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:21:35.516 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:21:37.199 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T19:21:37.277 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T19:21:37.476 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:37.473+0000 7f31aa823640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T19:21:37.476 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:37.474+0000 7f31aa823640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T19:21:37.477 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:37.474+0000 7f31aa823640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T19:21:37.477 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:37.474+0000 7f31aa823640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T19:21:37.477 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:37.474+0000 7f31aa823640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T19:21:37.478 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:37.476+0000 7f31aa823640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T19:21:40.467 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T19:21:40.548 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T19:21:40.749 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:40.745+0000 7f58316ff640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T19:21:40.749 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:40.746+0000 7f58316ff640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T19:21:40.750 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:40.746+0000 7f58316ff640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T19:21:40.750 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:40.746+0000 7f58316ff640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T19:21:40.750 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:40.746+0000 7f58316ff640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T19:21:40.750 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:40.749+0000 7f58316ff640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T19:21:43.718 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T19:21:43.800 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T19:21:43.800 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:21:43.800 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T19:21:43.892 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:21:43.892 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T19:21:43.975 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:21:43.976 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T19:21:44.105 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:21:44.105 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T19:21:44.189 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:21:44.189 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T19:21:44.276 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:21:44.276 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T19:21:44.364 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:21:44.364 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T19:21:44.447 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:21:44.447 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T19:21:44.535 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:21:44.535 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T19:21:44.618 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:21:44.618 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T19:21:44.704 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:21:44.704 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T19:21:44.785 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:21:44.785 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T19:21:44.866 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:21:44.867 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T19:21:44.941 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:21:44.942 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T19:21:45.018 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:21:45.018 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T19:21:45.073 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:21:45.074 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-25T19:21:45.122 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:21:45.122 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-25T19:21:45.180 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:21:45.180 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-25T19:21:45.238 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T19:21:45.238 DEBUG:teuthology.orchestra.run.smithi131:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T19:21:45.245 DEBUG:teuthology.orchestra.run.smithi195:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T19:21:45.325 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr.y] 2024-04-25T19:21:45.325 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQAlrSpm8cFSGhAAzZX5s8YMuNvdbiCd34TG5Q== 2024-04-25T19:21:45.325 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.a] 2024-04-25T19:21:45.325 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQAlrSpmqg5cNxAAWJ0TNKbWYEtA7s5RxJ6Fhg== 2024-04-25T19:21:45.325 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.c] 2024-04-25T19:21:45.325 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQAmrSpmYTSdDxAAe05MkvENoxxx/9CEAqVulw== 2024-04-25T19:21:45.325 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.0] 2024-04-25T19:21:45.325 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQArrSpmDyNSExAAq7QOaxXYhk0uJro2xsAnIQ== 2024-04-25T19:21:45.325 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.1] 2024-04-25T19:21:45.326 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQAurSpm5oMiNRAARATy+zVosunvnnyrj20Vag== 2024-04-25T19:21:45.326 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.2] 2024-04-25T19:21:45.326 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQAyrSpmaiGyGRAA7/TDEA2+LxFGdAssJD67yA== 2024-04-25T19:21:45.326 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.3] 2024-04-25T19:21:45.326 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQA1rSpmc3idKRAA46Dj8IuduRvkuZzZZcz+Pw== 2024-04-25T19:21:45.326 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr.x] 2024-04-25T19:21:45.326 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQAlrSpmc81JKBAA83A0rfzYE5nUkz0rH1KrSw== 2024-04-25T19:21:45.326 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.b] 2024-04-25T19:21:45.326 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQAmrSpmPcS8IxAA0/2QnmpsJxkbZGtvgPzigA== 2024-04-25T19:21:45.326 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.d] 2024-04-25T19:21:45.326 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQAmrSpmlTDINRAANW7Yrhyzj9B9tueRk+OALw== 2024-04-25T19:21:45.326 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.4] 2024-04-25T19:21:45.326 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQA6rSpmBf1IKxAA0WHniS5uxIAFRlmPXdovZQ== 2024-04-25T19:21:45.327 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.5] 2024-04-25T19:21:45.327 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQA+rSpmaa1EDRAA4sjV6lnWG2Wks2UMi+mDsg== 2024-04-25T19:21:45.327 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.6] 2024-04-25T19:21:45.327 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBBrSpmRAtbHBAAoX0qYn2X8UQvVhD9/8ESpQ== 2024-04-25T19:21:45.327 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.7] 2024-04-25T19:21:45.327 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBErSpm/ySRLBAAslPaxYOGkHT9/nOX04fVSA== 2024-04-25T19:21:45.327 INFO:teuthology.orchestra.run.smithi195.stdout:[client.0] 2024-04-25T19:21:45.327 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQAnrSpmvjE7CxAABw7VdVfflQSjatWfjdHUXQ== 2024-04-25T19:21:45.327 INFO:teuthology.orchestra.run.smithi195.stdout:[client.2] 2024-04-25T19:21:45.327 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQAnrSpm5+TmGBAA3du3m8geJUah6/gf6KfBww== 2024-04-25T19:21:45.327 INFO:teuthology.orchestra.run.smithi195.stdout:[client.1] 2024-04-25T19:21:45.327 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQAnrSpmSP3NJxAAJZ3U1F/vuUzN2tAHqtIreA== 2024-04-25T19:21:45.327 INFO:teuthology.orchestra.run.smithi195.stdout:[client.3] 2024-04-25T19:21:45.328 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQAnrSpm0pcbNRAAnUUEf+YKSh6BjpnN1NpC9w== 2024-04-25T19:21:45.328 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr.y] 2024-04-25T19:21:45.328 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAlrSpm8cFSGhAAzZX5s8YMuNvdbiCd34TG5Q== 2024-04-25T19:21:45.328 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.a] 2024-04-25T19:21:45.328 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAlrSpmqg5cNxAAWJ0TNKbWYEtA7s5RxJ6Fhg== 2024-04-25T19:21:45.328 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.c] 2024-04-25T19:21:45.329 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAmrSpmYTSdDxAAe05MkvENoxxx/9CEAqVulw== 2024-04-25T19:21:45.329 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.0] 2024-04-25T19:21:45.329 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQArrSpmDyNSExAAq7QOaxXYhk0uJro2xsAnIQ== 2024-04-25T19:21:45.329 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.1] 2024-04-25T19:21:45.329 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAurSpm5oMiNRAARATy+zVosunvnnyrj20Vag== 2024-04-25T19:21:45.329 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.2] 2024-04-25T19:21:45.329 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAyrSpmaiGyGRAA7/TDEA2+LxFGdAssJD67yA== 2024-04-25T19:21:45.329 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.3] 2024-04-25T19:21:45.329 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQA1rSpmc3idKRAA46Dj8IuduRvkuZzZZcz+Pw== 2024-04-25T19:21:45.329 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr.x] 2024-04-25T19:21:45.329 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAlrSpmc81JKBAA83A0rfzYE5nUkz0rH1KrSw== 2024-04-25T19:21:45.329 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.b] 2024-04-25T19:21:45.329 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAmrSpmPcS8IxAA0/2QnmpsJxkbZGtvgPzigA== 2024-04-25T19:21:45.329 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.d] 2024-04-25T19:21:45.330 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAmrSpmlTDINRAANW7Yrhyzj9B9tueRk+OALw== 2024-04-25T19:21:45.330 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.4] 2024-04-25T19:21:45.330 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQA6rSpmBf1IKxAA0WHniS5uxIAFRlmPXdovZQ== 2024-04-25T19:21:45.330 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.5] 2024-04-25T19:21:45.330 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQA+rSpmaa1EDRAA4sjV6lnWG2Wks2UMi+mDsg== 2024-04-25T19:21:45.330 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.6] 2024-04-25T19:21:45.330 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQBBrSpmRAtbHBAAoX0qYn2X8UQvVhD9/8ESpQ== 2024-04-25T19:21:45.330 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.7] 2024-04-25T19:21:45.330 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQBErSpm/ySRLBAAslPaxYOGkHT9/nOX04fVSA== 2024-04-25T19:21:45.330 INFO:teuthology.orchestra.run.smithi131.stdout:[client.0] 2024-04-25T19:21:45.330 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAnrSpmvjE7CxAABw7VdVfflQSjatWfjdHUXQ== 2024-04-25T19:21:45.330 INFO:teuthology.orchestra.run.smithi131.stdout:[client.2] 2024-04-25T19:21:45.330 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAnrSpm5+TmGBAA3du3m8geJUah6/gf6KfBww== 2024-04-25T19:21:45.330 INFO:teuthology.orchestra.run.smithi131.stdout:[client.1] 2024-04-25T19:21:45.331 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAnrSpmSP3NJxAAJZ3U1F/vuUzN2tAHqtIreA== 2024-04-25T19:21:45.331 INFO:teuthology.orchestra.run.smithi131.stdout:[client.3] 2024-04-25T19:21:45.331 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAnrSpm0pcbNRAAnUUEf+YKSh6BjpnN1NpC9w== 2024-04-25T19:21:45.332 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T19:21:45.380 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T19:21:45.598 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T19:21:45.604 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T19:21:45.813 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T19:21:45.818 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T19:21:46.034 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T19:21:46.041 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T19:21:46.255 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T19:21:46.259 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T19:21:46.474 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T19:21:46.479 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T19:21:46.687 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T19:21:46.693 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T19:21:46.902 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T19:21:46.907 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T19:21:47.109 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T19:21:47.114 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T19:21:47.309 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T19:21:47.315 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T19:21:47.530 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T19:21:47.537 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T19:21:47.746 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T19:21:47.754 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T19:21:47.965 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T19:21:47.972 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T19:21:48.176 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T19:21:48.184 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T19:21:48.389 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T19:21:48.394 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T19:21:48.612 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T19:21:48.619 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T19:21:48.828 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T19:21:48.835 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T19:21:49.045 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T19:21:49.050 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T19:21:49.259 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T19:21:49.259 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T19:21:49.347 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T19:21:49.568 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T19:21:49.650 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T19:21:49.736 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T19:21:49.956 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T19:21:50.030 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T19:21:50.110 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T19:21:50.332 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T19:21:50.404 DEBUG:teuthology.orchestra.run.smithi131:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T19:21:50.412 DEBUG:teuthology.orchestra.run.smithi195:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T19:21:50.464 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T19:21:50.465 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T19:21:50.465 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T19:21:50.470 INFO:tasks.ceph.mon.a:Started 2024-04-25T19:21:50.471 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T19:21:50.471 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T19:21:50.477 INFO:tasks.ceph.mon.b:Started 2024-04-25T19:21:50.477 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T19:21:50.477 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T19:21:50.485 INFO:tasks.ceph.mon.c:Started 2024-04-25T19:21:50.485 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T19:21:50.485 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T19:21:50.485 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T19:21:50.490 INFO:tasks.ceph.mgr.y:Started 2024-04-25T19:21:50.490 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T19:21:50.490 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T19:21:50.495 INFO:tasks.ceph.mgr.x:Started 2024-04-25T19:21:50.496 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T19:21:50.496 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T19:21:50.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.734+0000 7f319ee00640 1 Processor -- start 2024-04-25T19:21:50.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.734+0000 7f319ee00640 1 -- start start 2024-04-25T19:21:50.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.736+0000 7f319ee00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f319806e5d0 0x7f3198161960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:50.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.736+0000 7f319ee00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3198161ea0 0x7f31981622b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:50.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.736+0000 7f319ee00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f319806d070 con 0x7f319815e350 2024-04-25T19:21:50.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.736+0000 7f319ee00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f31981627f0 con 0x7f319806e5d0 2024-04-25T19:21:50.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.736+0000 7f319ee00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f319806d350 con 0x7f3198161ea0 2024-04-25T19:21:50.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.737+0000 7f319d000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3198161ea0 0x7f31981622b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:50.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.737+0000 7f319e400640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f319815e350 0x7f319815e760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.131:37482/0 (socket says 172.21.15.131:37482) 2024-04-25T19:21:50.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.737+0000 7f319e400640 1 -- 172.21.15.131:0/3277741530 learned_addr learned my addr 172.21.15.131:0/3277741530 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:21:50.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.737+0000 7f319da00640 1 --2- 172.21.15.131:0/3277741530 >> v2:172.21.15.131:3300/0 conn(0x7f319806e5d0 0x7f3198161960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:50.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.737+0000 7f319d000640 1 -- 172.21.15.131:0/3277741530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3198161ea0 msgr2=0x7f31981622b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T19:21:50.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.737+0000 7f319d000640 1 -- 172.21.15.131:0/3277741530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3198161ea0 msgr2=0x7f31981622b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T19:21:50.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.737+0000 7f319d000640 1 --2- 172.21.15.131:0/3277741530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3198161ea0 0x7f31981622b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T19:21:50.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.737+0000 7f319d000640 1 --2- 172.21.15.131:0/3277741530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3198161ea0 0x7f31981622b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T19:21:50.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.737+0000 7f319da00640 1 -- 172.21.15.131:0/3277741530 >> v2:172.21.15.131:3300/0 conn(0x7f319806e5d0 msgr2=0x7f3198161960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T19:21:50.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.737+0000 7f319da00640 1 -- 172.21.15.131:0/3277741530 >> v2:172.21.15.131:3300/0 conn(0x7f319806e5d0 msgr2=0x7f3198161960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T19:21:50.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.737+0000 7f319da00640 1 --2- 172.21.15.131:0/3277741530 >> v2:172.21.15.131:3300/0 conn(0x7f319806e5d0 0x7f3198161960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T19:21:50.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.737+0000 7f319da00640 1 --2- 172.21.15.131:0/3277741530 >> v2:172.21.15.131:3300/0 conn(0x7f319806e5d0 0x7f3198161960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T19:21:50.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.938+0000 7f319da00640 1 --2- 172.21.15.131:0/3277741530 >> v2:172.21.15.131:3300/0 conn(0x7f319806e5d0 0x7f3198161960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:50.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.938+0000 7f319da00640 1 -- 172.21.15.131:0/3277741530 >> v2:172.21.15.131:3300/0 conn(0x7f319806e5d0 msgr2=0x7f3198161960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T19:21:50.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.938+0000 7f319da00640 1 -- 172.21.15.131:0/3277741530 >> v2:172.21.15.131:3300/0 conn(0x7f319806e5d0 msgr2=0x7f3198161960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T19:21:50.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.938+0000 7f319da00640 1 --2- 172.21.15.131:0/3277741530 >> v2:172.21.15.131:3300/0 conn(0x7f319806e5d0 0x7f3198161960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T19:21:50.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.938+0000 7f319da00640 1 --2- 172.21.15.131:0/3277741530 >> v2:172.21.15.131:3300/0 conn(0x7f319806e5d0 0x7f3198161960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T19:21:50.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.939+0000 7f319d000640 1 --2- 172.21.15.131:0/3277741530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3198161ea0 0x7f31981622b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:50.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.940+0000 7f319d000640 1 -- 172.21.15.131:0/3277741530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3198161ea0 msgr2=0x7f31981622b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T19:21:50.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.940+0000 7f319d000640 1 -- 172.21.15.131:0/3277741530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3198161ea0 msgr2=0x7f31981622b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T19:21:50.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.940+0000 7f319d000640 1 --2- 172.21.15.131:0/3277741530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3198161ea0 0x7f31981622b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T19:21:50.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.940+0000 7f319d000640 1 --2- 172.21.15.131:0/3277741530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3198161ea0 0x7f31981622b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T19:21:51.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.998+0000 7f3197e00640 1 -- 172.21.15.131:0/3277741530 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3883850281 0 0) 0x7f319806d070 con 0x7f319815e350 2024-04-25T19:21:51.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:50.998+0000 7f3197e00640 1 -- 172.21.15.131:0/3277741530 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3180003520 con 0x7f319815e350 2024-04-25T19:21:51.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.000+0000 7f3197e00640 1 -- 172.21.15.131:0/3277741530 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2477470178 0 0) 0x7f3180003520 con 0x7f319815e350 2024-04-25T19:21:51.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.000+0000 7f3197e00640 1 -- 172.21.15.131:0/3277741530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3198161ea0 msgr2=0x7f31981622b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T19:21:51.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.000+0000 7f3197e00640 1 --2- 172.21.15.131:0/3277741530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3198161ea0 0x7f31981622b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:51.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.000+0000 7f3197e00640 1 -- 172.21.15.131:0/3277741530 >> v2:172.21.15.131:3300/0 conn(0x7f319806e5d0 msgr2=0x7f3198161960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T19:21:51.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.000+0000 7f3197e00640 1 --2- 172.21.15.131:0/3277741530 >> v2:172.21.15.131:3300/0 conn(0x7f319806e5d0 0x7f3198161960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:51.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.000+0000 7f3197e00640 1 -- 172.21.15.131:0/3277741530 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f319806d630 con 0x7f319815e350 2024-04-25T19:21:51.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.000+0000 7f3197e00640 1 -- 172.21.15.131:0/3277741530 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f31900019f0 con 0x7f319815e350 2024-04-25T19:21:51.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.000+0000 7f3197e00640 1 -- 172.21.15.131:0/3277741530 >> v1:172.21.15.195:6789/0 conn(0x7f319815e350 legacy=0x7f319815e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:51.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.000+0000 7f3197e00640 1 --2- 172.21.15.131:0/3277741530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3198161ea0 0x7f31800039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:51.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.001+0000 7f3197e00640 1 --2- 172.21.15.131:0/3277741530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3180003fe0 0x7f3180004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:51.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.001+0000 7f3197e00640 1 --2- 172.21.15.131:0/3277741530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3180004d40 0x7f3180005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:51.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.001+0000 7f3197e00640 1 -- 172.21.15.131:0/3277741530 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f31981627f0 con 0x7f3180004d40 2024-04-25T19:21:51.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.001+0000 7f3197e00640 1 -- 172.21.15.131:0/3277741530 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f319806d350 con 0x7f3180003fe0 2024-04-25T19:21:51.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.001+0000 7f3197e00640 1 -- 172.21.15.131:0/3277741530 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f318000bb70 con 0x7f3198161ea0 2024-04-25T19:21:51.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.001+0000 7f319d000640 1 --2- 172.21.15.131:0/3277741530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3180003fe0 0x7f3180004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:51.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.002+0000 7f319e400640 1 --2- 172.21.15.131:0/3277741530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3180004d40 0x7f3180005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:51.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.002+0000 7f319da00640 1 --2- 172.21.15.131:0/3277741530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3198161ea0 0x7f31800039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:51.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.003+0000 7f319d000640 1 -- 172.21.15.131:0/3277741530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3198161ea0 msgr2=0x7f31800039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:21:51.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.003+0000 7f319d000640 1 --2- 172.21.15.131:0/3277741530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3198161ea0 0x7f31800039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:51.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.003+0000 7f319d000640 1 -- 172.21.15.131:0/3277741530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3180004d40 msgr2=0x7f3180005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:21:51.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.003+0000 7f319d000640 1 --2- 172.21.15.131:0/3277741530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3180004d40 0x7f3180005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:51.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.003+0000 7f319d000640 1 -- 172.21.15.131:0/3277741530 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f319806d630 con 0x7f3180003fe0 2024-04-25T19:21:51.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.003+0000 7f319da00640 1 --2- 172.21.15.131:0/3277741530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3198161ea0 0x7f31800039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T19:21:51.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.003+0000 7f319e400640 1 --2- 172.21.15.131:0/3277741530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3180004d40 0x7f3180005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T19:21:51.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.006+0000 7f319d000640 1 --2- 172.21.15.131:0/3277741530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3180003fe0 0x7f3180004800 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f318400da90 tx=0x7f3180005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=973970c49b518cf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:21:51.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.007+0000 7f3197e00640 1 -- 172.21.15.131:0/3277741530 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3184038070 con 0x7f3180003fe0 2024-04-25T19:21:51.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.008+0000 7f3197e00640 1 -- 172.21.15.131:0/3277741530 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3184033410 con 0x7f3180003fe0 2024-04-25T19:21:51.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.008+0000 7f3197e00640 1 -- 172.21.15.131:0/3277741530 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318400d690 con 0x7f3180003fe0 2024-04-25T19:21:51.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.009+0000 7f319ee00640 1 -- 172.21.15.131:0/3277741530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3180003fe0 msgr2=0x7f3180004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:51.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.009+0000 7f319ee00640 1 --2- 172.21.15.131:0/3277741530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3180003fe0 0x7f3180004800 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f318400da90 tx=0x7f3180005830 comp rx=0 tx=0).stop 2024-04-25T19:21:51.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.010+0000 7f319e400640 1 -- 172.21.15.131:0/3277741530 reap_dead start 2024-04-25T19:21:51.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.010+0000 7f319ee00640 1 -- 172.21.15.131:0/3277741530 shutdown_connections 2024-04-25T19:21:51.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.010+0000 7f319ee00640 1 -- 172.21.15.131:0/3277741530 >> 172.21.15.131:0/3277741530 conn(0x7f31980d2840 msgr2=0x7f31980d2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:21:51.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.010+0000 7f319ee00640 1 -- 172.21.15.131:0/3277741530 shutdown_connections 2024-04-25T19:21:51.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.010+0000 7f319ee00640 1 -- 172.21.15.131:0/3277741530 wait complete. 2024-04-25T19:21:51.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.016+0000 7f319ee00640 1 Processor -- start 2024-04-25T19:21:51.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.016+0000 7f319ee00640 1 -- start start 2024-04-25T19:21:51.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.018+0000 7f319ee00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3180003fe0 0x7f319813b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:51.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.018+0000 7f319ee00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f319813ef00 0x7f3198139cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:51.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.018+0000 7f319ee00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31981f46b0 0x7f31981f4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:51.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.018+0000 7f319ee00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f319806eb60 con 0x7f319813ef00 2024-04-25T19:21:51.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.018+0000 7f319ee00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f319806e9e0 con 0x7f3180003fe0 2024-04-25T19:21:51.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.018+0000 7f319ee00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f31981445e0 con 0x7f31981f46b0 2024-04-25T19:21:51.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.018+0000 7f319da00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3180003fe0 0x7f319813b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:51.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.018+0000 7f319da00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3180003fe0 0x7f319813b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.131:59292/0 (socket says 172.21.15.131:59292) 2024-04-25T19:21:51.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.018+0000 7f319da00640 1 -- 172.21.15.131:0/783747746 learned_addr learned my addr 172.21.15.131:0/783747746 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:21:51.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.019+0000 7f319e400640 1 --2- 172.21.15.131:0/783747746 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31981f46b0 0x7f31981f4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:51.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.019+0000 7f319d000640 1 --2- 172.21.15.131:0/783747746 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f319813ef00 0x7f3198139cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:51.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.019+0000 7f319da00640 1 -- 172.21.15.131:0/783747746 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31981f46b0 msgr2=0x7f31981f4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:51.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.019+0000 7f319da00640 1 --2- 172.21.15.131:0/783747746 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31981f46b0 0x7f31981f4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:51.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.019+0000 7f319da00640 1 -- 172.21.15.131:0/783747746 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f319813ef00 msgr2=0x7f3198139cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:51.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.019+0000 7f319da00640 1 --2- 172.21.15.131:0/783747746 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f319813ef00 0x7f3198139cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:51.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.019+0000 7f319da00640 1 -- 172.21.15.131:0/783747746 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f319813dea0 con 0x7f3180003fe0 2024-04-25T19:21:51.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.019+0000 7f319e400640 1 --2- 172.21.15.131:0/783747746 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31981f46b0 0x7f31981f4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T19:21:51.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.019+0000 7f319da00640 1 --2- 172.21.15.131:0/783747746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3180003fe0 0x7f319813b900 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f318c012970 tx=0x7f318c012e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:21:51.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.020+0000 7f3195600640 1 -- 172.21.15.131:0/783747746 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c01b070 con 0x7f3180003fe0 2024-04-25T19:21:51.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.020+0000 7f3195600640 1 -- 172.21.15.131:0/783747746 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f318c010bc0 con 0x7f3180003fe0 2024-04-25T19:21:51.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.020+0000 7f3195600640 1 -- 172.21.15.131:0/783747746 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c015450 con 0x7f3180003fe0 2024-04-25T19:21:51.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.020+0000 7f319ee00640 1 -- 172.21.15.131:0/783747746 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f319813e140 con 0x7f3180003fe0 2024-04-25T19:21:51.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.020+0000 7f319ee00640 1 -- 172.21.15.131:0/783747746 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f319813e700 con 0x7f3180003fe0 2024-04-25T19:21:51.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.020+0000 7f3195600640 1 -- 172.21.15.131:0/783747746 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f318c01e070 con 0x7f3180003fe0 2024-04-25T19:21:51.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.020+0000 7f3195600640 1 -- 172.21.15.131:0/783747746 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f318c003ab0 con 0x7f3180003fe0 2024-04-25T19:21:51.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.022+0000 7f319ee00640 1 -- 172.21.15.131:0/783747746 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3198076c60 con 0x7f3180003fe0 2024-04-25T19:21:51.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.027+0000 7f3195600640 1 -- 172.21.15.131:0/783747746 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f318c025070 con 0x7f3180003fe0 2024-04-25T19:21:51.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.100+0000 7f319ee00640 1 -- 172.21.15.131:0/783747746 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f31981625d0 con 0x7f3180003fe0 2024-04-25T19:21:51.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.111+0000 7f3195600640 1 -- 172.21.15.131:0/783747746 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f318c003e10 con 0x7f3180003fe0 2024-04-25T19:21:51.113 INFO:teuthology.orchestra.run.smithi131.stderr:adjusted tunables profile to default 2024-04-25T19:21:51.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.112+0000 7f319ee00640 1 -- 172.21.15.131:0/783747746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3180003fe0 msgr2=0x7f319813b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:51.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.112+0000 7f319ee00640 1 --2- 172.21.15.131:0/783747746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3180003fe0 0x7f319813b900 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f318c012970 tx=0x7f318c012e30 comp rx=0 tx=0).stop 2024-04-25T19:21:51.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.112+0000 7f319ee00640 1 -- 172.21.15.131:0/783747746 shutdown_connections 2024-04-25T19:21:51.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.112+0000 7f319ee00640 1 --2- 172.21.15.131:0/783747746 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31981f46b0 0x7f31981f4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:51.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.112+0000 7f319ee00640 1 --2- 172.21.15.131:0/783747746 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f319813ef00 0x7f3198139cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:51.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.112+0000 7f319ee00640 1 --2- 172.21.15.131:0/783747746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3180003fe0 0x7f319813b900 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:51.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.112+0000 7f319ee00640 1 -- 172.21.15.131:0/783747746 >> 172.21.15.131:0/783747746 conn(0x7f31980d2840 msgr2=0x7f3198142780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:21:51.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.113+0000 7f319ee00640 1 -- 172.21.15.131:0/783747746 shutdown_connections 2024-04-25T19:21:51.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:51.113+0000 7f319ee00640 1 -- 172.21.15.131:0/783747746 wait complete. 2024-04-25T19:21:51.140 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T19:21:51.140 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T19:21:51.140 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:21:51.140 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T19:21:51.170 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:51.169+0000 7fdf85c1b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T19:21:51.171 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-25T19:21:51.170+0000 7fa6bae0d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T19:21:51.216 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:21:51.216 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T19:21:51.328 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:21:51.328 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T19:21:51.367 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-25T19:21:51.365+0000 7fa6bae0d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T19:21:51.384 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:51.382+0000 7fdf85c1b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T19:21:51.434 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-25T19:21:51.432+0000 7fa6bae0d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T19:21:51.442 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:21:51.442 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T19:21:51.450 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:51.449+0000 7fdf85c1b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T19:21:51.519 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:21:51.519 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T19:21:51.597 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:21:51.597 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T19:21:51.673 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:21:51.673 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T19:21:51.747 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-25T19:21:51.746+0000 7fa6bae0d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T19:21:51.755 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:51.754+0000 7fdf85c1b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T19:21:51.785 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:21:51.785 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T19:21:51.803 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-25T19:21:51.801+0000 7fa6bae0d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T19:21:51.815 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:51.814+0000 7fdf85c1b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T19:21:51.889 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new d3eb3b71-ee14-4ddd-ab93-eae503ae2afc 0 2024-04-25T19:21:52.191 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.190+0000 7fe4d1200640 1 Processor -- start 2024-04-25T19:21:52.192 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.190+0000 7fe4d1200640 1 -- start start 2024-04-25T19:21:52.194 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.192+0000 7fe4d1200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4cc0d56c0 0x7fe4cc0b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:52.194 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.193+0000 7fe4d1200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe4cc160440 0x7fe4cc06db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:52.194 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.193+0000 7fe4d1200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4cc06e4b0 con 0x7fe4cc06e0a0 2024-04-25T19:21:52.194 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.193+0000 7fe4d1200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fe4cc0d43f0 con 0x7fe4cc160440 2024-04-25T19:21:52.194 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.193+0000 7fe4d1200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe4cc0d37e0 con 0x7fe4cc0d56c0 2024-04-25T19:21:52.194 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.193+0000 7fe4cb400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4cc0d56c0 0x7fe4cc0b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:52.195 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.193+0000 7fe4cbe00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fe4cc06e0a0 0x7fe4cc0d0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:50760/0 (socket says 172.21.15.195:50760) 2024-04-25T19:21:52.195 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.193+0000 7fe4cbe00640 1 -- 172.21.15.195:0/2250302887 learned_addr learned my addr 172.21.15.195:0/2250302887 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-04-25T19:21:52.195 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.193+0000 7fe4caa00640 1 --2- 172.21.15.195:0/2250302887 >> v2:172.21.15.131:3300/0 conn(0x7fe4cc160440 0x7fe4cc06db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:52.196 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.193+0000 7fe4ca000640 1 -- 172.21.15.195:0/2250302887 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2845122211 0 0) 0x7fe4c4001490 con 0x7fe4cc06e0a0 2024-04-25T19:21:52.196 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.193+0000 7fe4ca000640 1 -- 172.21.15.195:0/2250302887 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4b0003520 con 0x7fe4cc06e0a0 2024-04-25T19:21:52.196 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.193+0000 7fe4cb400640 1 -- 172.21.15.195:0/2250302887 >> v2:172.21.15.131:3300/0 conn(0x7fe4cc160440 msgr2=0x7fe4cc06db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:21:52.196 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.193+0000 7fe4cb400640 1 --2- 172.21.15.195:0/2250302887 >> v2:172.21.15.131:3300/0 conn(0x7fe4cc160440 0x7fe4cc06db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:52.196 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.193+0000 7fe4cb400640 1 -- 172.21.15.195:0/2250302887 >> v1:172.21.15.195:6789/0 conn(0x7fe4cc06e0a0 legacy=0x7fe4cc0d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:52.196 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.194+0000 7fe4cb400640 1 -- 172.21.15.195:0/2250302887 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4cc0d3ac0 con 0x7fe4cc0d56c0 2024-04-25T19:21:52.196 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.195+0000 7fe4cb400640 1 --2- 172.21.15.195:0/2250302887 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4cc0d56c0 0x7fe4cc0b4cb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0097a0 tx=0x7fe4bc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a65f858af8f57307 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:21:52.197 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.195+0000 7fe4ca000640 1 -- 172.21.15.195:0/2250302887 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc037070 con 0x7fe4cc0d56c0 2024-04-25T19:21:52.197 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.195+0000 7fe4ca000640 1 -- 172.21.15.195:0/2250302887 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4bc032440 con 0x7fe4cc0d56c0 2024-04-25T19:21:52.197 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.195+0000 7fe4ca000640 1 -- 172.21.15.195:0/2250302887 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc032810 con 0x7fe4cc0d56c0 2024-04-25T19:21:52.197 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.196+0000 7fe4d1200640 1 -- 172.21.15.195:0/2250302887 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4cc0d56c0 msgr2=0x7fe4cc0b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:52.198 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.196+0000 7fe4d1200640 1 --2- 172.21.15.195:0/2250302887 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4cc0d56c0 0x7fe4cc0b4cb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0097a0 tx=0x7fe4bc02a180 comp rx=0 tx=0).stop 2024-04-25T19:21:52.198 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.196+0000 7fe4d1200640 1 -- 172.21.15.195:0/2250302887 shutdown_connections 2024-04-25T19:21:52.198 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.196+0000 7fe4d1200640 1 --2- 172.21.15.195:0/2250302887 >> v2:172.21.15.131:3300/0 conn(0x7fe4cc160440 0x7fe4cc06db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:52.198 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.196+0000 7fe4d1200640 1 --2- 172.21.15.195:0/2250302887 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4cc0d56c0 0x7fe4cc0b4cb0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:52.198 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.196+0000 7fe4d1200640 1 -- 172.21.15.195:0/2250302887 >> 172.21.15.195:0/2250302887 conn(0x7fe4cc0d2c20 msgr2=0x7fe4cc0d5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:21:52.198 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.196+0000 7fe4d1200640 1 -- 172.21.15.195:0/2250302887 shutdown_connections 2024-04-25T19:21:52.198 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.196+0000 7fe4d1200640 1 -- 172.21.15.195:0/2250302887 wait complete. 2024-04-25T19:21:52.199 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.198+0000 7fe4d1200640 1 Processor -- start 2024-04-25T19:21:52.199 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.198+0000 7fe4d1200640 1 -- start start 2024-04-25T19:21:52.202 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.200+0000 7fe4d1200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4cc06e0a0 0x7fe4cc1f5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:52.202 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.200+0000 7fe4d1200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4cc160440 0x7fe4cc1f6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:52.202 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.200+0000 7fe4d1200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4cc0caae0 0x7fe4cc0caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:52.202 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.200+0000 7fe4d1200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc0ba270 con 0x7fe4cc06e0a0 2024-04-25T19:21:52.202 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.200+0000 7fe4d1200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc0d4080 con 0x7fe4cc0caae0 2024-04-25T19:21:52.202 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.200+0000 7fe4d1200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe4cc0d4880 con 0x7fe4cc160440 2024-04-25T19:21:52.202 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.200+0000 7fe4caa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4cc160440 0x7fe4cc1f6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:52.202 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.200+0000 7fe4cbe00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4cc0caae0 0x7fe4cc0caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:52.203 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.200+0000 7fe4caa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4cc160440 0x7fe4cc1f6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:39872/0 (socket says 172.21.15.195:39872) 2024-04-25T19:21:52.203 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.200+0000 7fe4caa00640 1 -- 172.21.15.195:0/3508920889 learned_addr learned my addr 172.21.15.195:0/3508920889 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T19:21:52.203 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.200+0000 7fe4cb400640 1 --2- 172.21.15.195:0/3508920889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4cc06e0a0 0x7fe4cc1f5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:52.203 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.201+0000 7fe4cbe00640 1 -- 172.21.15.195:0/3508920889 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4cc160440 msgr2=0x7fe4cc1f6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:52.203 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.201+0000 7fe4cbe00640 1 --2- 172.21.15.195:0/3508920889 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4cc160440 0x7fe4cc1f6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:52.203 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.201+0000 7fe4cbe00640 1 -- 172.21.15.195:0/3508920889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4cc06e0a0 msgr2=0x7fe4cc1f5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:52.203 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.201+0000 7fe4cbe00640 1 --2- 172.21.15.195:0/3508920889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4cc06e0a0 0x7fe4cc1f5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:52.203 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.201+0000 7fe4cbe00640 1 -- 172.21.15.195:0/3508920889 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4cc0cb430 con 0x7fe4cc0caae0 2024-04-25T19:21:52.203 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.201+0000 7fe4cbe00640 1 --2- 172.21.15.195:0/3508920889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4cc0caae0 0x7fe4cc0caef0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe4c400c9f0 tx=0x7fe4c400ceb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:21:52.204 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.201+0000 7fe4c3400640 1 -- 172.21.15.195:0/3508920889 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4017070 con 0x7fe4cc0caae0 2024-04-25T19:21:52.204 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.201+0000 7fe4c3400640 1 -- 172.21.15.195:0/3508920889 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c400ab70 con 0x7fe4cc0caae0 2024-04-25T19:21:52.205 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.201+0000 7fe4d1200640 1 -- 172.21.15.195:0/3508920889 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4cc0cd000 con 0x7fe4cc0caae0 2024-04-25T19:21:52.205 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.201+0000 7fe4c3400640 1 -- 172.21.15.195:0/3508920889 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4012400 con 0x7fe4cc0caae0 2024-04-25T19:21:52.205 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.201+0000 7fe4d1200640 1 -- 172.21.15.195:0/3508920889 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4cc0cd5c0 con 0x7fe4cc0caae0 2024-04-25T19:21:52.205 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.202+0000 7fe4c3400640 1 -- 172.21.15.195:0/3508920889 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe4c401a070 con 0x7fe4cc0caae0 2024-04-25T19:21:52.205 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.202+0000 7fe4c3400640 1 -- 172.21.15.195:0/3508920889 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fe4c401cb30 con 0x7fe4cc0caae0 2024-04-25T19:21:52.205 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.202+0000 7fe4d1200640 1 -- 172.21.15.195:0/3508920889 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4cc0b8770 con 0x7fe4cc0caae0 2024-04-25T19:21:52.206 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.205+0000 7fe4c3400640 1 -- 172.21.15.195:0/3508920889 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fe4cc0b8770 con 0x7fe4cc0caae0 2024-04-25T19:21:52.284 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.283+0000 7fe4d1200640 1 -- 172.21.15.195:0/3508920889 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d3eb3b71-ee14-4ddd-ab93-eae503ae2afc", "id": 0} v 0) -- 0x7fe4cc076c60 con 0x7fe4cc0caae0 2024-04-25T19:21:52.292 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.291+0000 7fe4c3400640 1 -- 172.21.15.195:0/3508920889 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d3eb3b71-ee14-4ddd-ab93-eae503ae2afc", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fe4c4021070 con 0x7fe4cc0caae0 2024-04-25T19:21:52.293 INFO:teuthology.orchestra.run.smithi195.stdout:0 2024-04-25T19:21:52.295 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.293+0000 7fe4d1200640 1 -- 172.21.15.195:0/3508920889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4cc0caae0 msgr2=0x7fe4cc0caef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:52.295 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.293+0000 7fe4d1200640 1 --2- 172.21.15.195:0/3508920889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4cc0caae0 0x7fe4cc0caef0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe4c400c9f0 tx=0x7fe4c400ceb0 comp rx=0 tx=0).stop 2024-04-25T19:21:52.295 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.293+0000 7fe4d1200640 1 -- 172.21.15.195:0/3508920889 shutdown_connections 2024-04-25T19:21:52.295 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.293+0000 7fe4d1200640 1 --2- 172.21.15.195:0/3508920889 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4cc160440 0x7fe4cc1f6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:52.295 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.293+0000 7fe4d1200640 1 --2- 172.21.15.195:0/3508920889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4cc0caae0 0x7fe4cc0caef0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:52.295 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.293+0000 7fe4d1200640 1 --2- 172.21.15.195:0/3508920889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4cc06e0a0 0x7fe4cc1f5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:52.295 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.293+0000 7fe4d1200640 1 -- 172.21.15.195:0/3508920889 >> 172.21.15.195:0/3508920889 conn(0x7fe4cc0d2c20 msgr2=0x7fe4cc15bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:21:52.296 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.293+0000 7fe4d1200640 1 -- 172.21.15.195:0/3508920889 shutdown_connections 2024-04-25T19:21:52.296 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.293+0000 7fe4d1200640 1 -- 172.21.15.195:0/3508920889 wait complete. 2024-04-25T19:21:52.319 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 6d038d7a-8cbd-4525-8348-031fde89415b 1 2024-04-25T19:21:52.560 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.558+0000 7f6482000640 1 Processor -- start 2024-04-25T19:21:52.560 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.558+0000 7f6482000640 1 -- start start 2024-04-25T19:21:52.562 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.561+0000 7f6482000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f647c06dce0 0x7f647c15f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:52.562 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.561+0000 7f6482000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f647c162650 con 0x7f647c155350 2024-04-25T19:21:52.562 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.561+0000 7f6482000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f647c162930 con 0x7f647c161ce0 2024-04-25T19:21:52.563 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.561+0000 7f6482000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f647c162c10 con 0x7f647c06dce0 2024-04-25T19:21:52.563 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.561+0000 7f6473e00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f647c161ce0 0x7f647c06d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:50772/0 (socket says 172.21.15.195:50772) 2024-04-25T19:21:52.563 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.561+0000 7f6473e00640 1 -- 172.21.15.195:0/486433238 learned_addr learned my addr 172.21.15.195:0/486433238 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-04-25T19:21:52.563 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.561+0000 7f647be00640 1 --2- 172.21.15.195:0/486433238 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f647c06dce0 0x7f647c15f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:52.564 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.562+0000 7f647be00640 1 -- 172.21.15.195:0/486433238 >> v1:172.21.15.195:6789/0 conn(0x7f647c161ce0 legacy=0x7f647c06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:52.564 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.562+0000 7f647be00640 1 -- 172.21.15.195:0/486433238 >> v1:172.21.15.131:6789/0 conn(0x7f647c155350 legacy=0x7f647c15f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:52.564 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.562+0000 7f647aa00640 1 -- 172.21.15.195:0/486433238 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 40865954 0 0) 0x7f647c162930 con 0x7f647c161ce0 2024-04-25T19:21:52.564 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.562+0000 7f647be00640 1 -- 172.21.15.195:0/486433238 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c15e890 con 0x7f647c06dce0 2024-04-25T19:21:52.564 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.563+0000 7f647be00640 1 --2- 172.21.15.195:0/486433238 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f647c06dce0 0x7f647c15f8b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f647c162d90 tx=0x7f647402a6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66f146cd38fb1018 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:21:52.564 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.563+0000 7f647aa00640 1 -- 172.21.15.195:0/486433238 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6474007740 con 0x7f647c06dce0 2024-04-25T19:21:52.564 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.563+0000 7f647aa00640 1 -- 172.21.15.195:0/486433238 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64740078e0 con 0x7f647c06dce0 2024-04-25T19:21:52.565 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.563+0000 7f647aa00640 1 -- 172.21.15.195:0/486433238 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6474007cb0 con 0x7f647c06dce0 2024-04-25T19:21:52.565 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.564+0000 7f6482000640 1 -- 172.21.15.195:0/486433238 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f647c06dce0 msgr2=0x7f647c15f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:52.566 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.564+0000 7f6482000640 1 --2- 172.21.15.195:0/486433238 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f647c06dce0 0x7f647c15f8b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f647c162d90 tx=0x7f647402a6c0 comp rx=0 tx=0).stop 2024-04-25T19:21:52.566 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.564+0000 7f6482000640 1 -- 172.21.15.195:0/486433238 shutdown_connections 2024-04-25T19:21:52.566 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.564+0000 7f6482000640 1 --2- 172.21.15.195:0/486433238 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f647c06dce0 0x7f647c15f8b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:52.566 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.564+0000 7f6482000640 1 -- 172.21.15.195:0/486433238 >> 172.21.15.195:0/486433238 conn(0x7f647c073120 msgr2=0x7f647c073530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:21:52.566 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.564+0000 7f6482000640 1 -- 172.21.15.195:0/486433238 shutdown_connections 2024-04-25T19:21:52.566 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.564+0000 7f6482000640 1 -- 172.21.15.195:0/486433238 wait complete. 2024-04-25T19:21:52.567 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.566+0000 7f6482000640 1 Processor -- start 2024-04-25T19:21:52.567 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.566+0000 7f6482000640 1 -- start start 2024-04-25T19:21:52.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.568+0000 7f6482000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f647c155350 0x7f647c155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:52.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.568+0000 7f6482000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f647c161ce0 0x7f647c157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:52.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.568+0000 7f6482000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f647c15d450 0x7f647c1580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:52.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.568+0000 7f6482000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f647c070930 con 0x7f647c155350 2024-04-25T19:21:52.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.568+0000 7f6482000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f647c0707b0 con 0x7f647c15d450 2024-04-25T19:21:52.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.568+0000 7f6482000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f647c1620f0 con 0x7f647c161ce0 2024-04-25T19:21:52.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.568+0000 7f6473e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f647c161ce0 0x7f647c157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:52.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.568+0000 7f647be00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f647c15d450 0x7f647c1580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:52.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.568+0000 7f6473e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f647c161ce0 0x7f647c157bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:39880/0 (socket says 172.21.15.195:39880) 2024-04-25T19:21:52.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.568+0000 7f6473e00640 1 -- 172.21.15.195:0/3656078237 learned_addr learned my addr 172.21.15.195:0/3656078237 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T19:21:52.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.568+0000 7f647b400640 1 --2- 172.21.15.195:0/3656078237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f647c155350 0x7f647c155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:52.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.569+0000 7f647be00640 1 -- 172.21.15.195:0/3656078237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f647c161ce0 msgr2=0x7f647c157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:52.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.569+0000 7f647be00640 1 --2- 172.21.15.195:0/3656078237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f647c161ce0 0x7f647c157bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:52.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.569+0000 7f647be00640 1 -- 172.21.15.195:0/3656078237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f647c155350 msgr2=0x7f647c155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:52.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.569+0000 7f647be00640 1 --2- 172.21.15.195:0/3656078237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f647c155350 0x7f647c155810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:52.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.569+0000 7f647be00640 1 -- 172.21.15.195:0/3656078237 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c14b950 con 0x7f647c15d450 2024-04-25T19:21:52.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.569+0000 7f647b400640 1 --2- 172.21.15.195:0/3656078237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f647c155350 0x7f647c155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T19:21:52.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.569+0000 7f6473e00640 1 --2- 172.21.15.195:0/3656078237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f647c161ce0 0x7f647c157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T19:21:52.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.569+0000 7f647be00640 1 --2- 172.21.15.195:0/3656078237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f647c15d450 0x7f647c1580f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6474031000 tx=0x7f6474004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:21:52.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.569+0000 7f6473400640 1 -- 172.21.15.195:0/3656078237 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6474040070 con 0x7f647c15d450 2024-04-25T19:21:52.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.569+0000 7f6473400640 1 -- 172.21.15.195:0/3656078237 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6474031c80 con 0x7f647c15d450 2024-04-25T19:21:52.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.569+0000 7f6482000640 1 -- 172.21.15.195:0/3656078237 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647c156060 con 0x7f647c15d450 2024-04-25T19:21:52.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.569+0000 7f6473400640 1 -- 172.21.15.195:0/3656078237 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64740456a0 con 0x7f647c15d450 2024-04-25T19:21:52.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.569+0000 7f6482000640 1 -- 172.21.15.195:0/3656078237 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f647c156620 con 0x7f647c15d450 2024-04-25T19:21:52.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.570+0000 7f6473400640 1 -- 172.21.15.195:0/3656078237 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6474039040 con 0x7f647c15d450 2024-04-25T19:21:52.573 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.570+0000 7f6473400640 1 -- 172.21.15.195:0/3656078237 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f647403c7d0 con 0x7f647c15d450 2024-04-25T19:21:52.573 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.571+0000 7f6482000640 1 -- 172.21.15.195:0/3656078237 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f647c0761c0 con 0x7f647c15d450 2024-04-25T19:21:52.574 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.573+0000 7f6473400640 1 -- 172.21.15.195:0/3656078237 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f6474053020 con 0x7f647c15d450 2024-04-25T19:21:52.653 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.652+0000 7f6482000640 1 -- 172.21.15.195:0/3656078237 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6d038d7a-8cbd-4525-8348-031fde89415b", "id": 1} v 0) -- 0x7f647c050740 con 0x7f647c15d450 2024-04-25T19:21:52.659 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.658+0000 7f6473400640 1 -- 172.21.15.195:0/3656078237 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6d038d7a-8cbd-4525-8348-031fde89415b", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f6474007840 con 0x7f647c15d450 2024-04-25T19:21:52.660 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-04-25T19:21:52.660 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.659+0000 7f6482000640 1 -- 172.21.15.195:0/3656078237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f647c15d450 msgr2=0x7f647c1580f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:52.660 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.659+0000 7f6482000640 1 --2- 172.21.15.195:0/3656078237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f647c15d450 0x7f647c1580f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6474031000 tx=0x7f6474004a40 comp rx=0 tx=0).stop 2024-04-25T19:21:52.661 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.660+0000 7f6482000640 1 -- 172.21.15.195:0/3656078237 shutdown_connections 2024-04-25T19:21:52.661 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.660+0000 7f6482000640 1 --2- 172.21.15.195:0/3656078237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f647c161ce0 0x7f647c157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:52.661 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.660+0000 7f6482000640 1 --2- 172.21.15.195:0/3656078237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f647c15d450 0x7f647c1580f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:52.661 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.660+0000 7f6482000640 1 --2- 172.21.15.195:0/3656078237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f647c155350 0x7f647c155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:52.662 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.660+0000 7f6482000640 1 -- 172.21.15.195:0/3656078237 >> 172.21.15.195:0/3656078237 conn(0x7f647c073120 msgr2=0x7f647c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:21:52.662 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.660+0000 7f6482000640 1 -- 172.21.15.195:0/3656078237 shutdown_connections 2024-04-25T19:21:52.662 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.660+0000 7f6482000640 1 -- 172.21.15.195:0/3656078237 wait complete. 2024-04-25T19:21:52.682 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 3cb06a2f-7f35-4e0f-bbdf-654793d2c10a 2 2024-04-25T19:21:52.806 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:52.805+0000 7fdf85c1b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T19:21:52.829 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-25T19:21:52.827+0000 7fa6bae0d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T19:21:52.914 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:52.913+0000 7fdf85c1b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T19:21:52.916 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.915+0000 7fc64dc00640 1 Processor -- start 2024-04-25T19:21:52.916 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.915+0000 7fc64dc00640 1 -- start start 2024-04-25T19:21:52.919 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.917+0000 7fc64dc00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc64806ccd0 0x7fc64815e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:52.919 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.917+0000 7fc64dc00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc648163fa0 0x7fc6481643b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:52.919 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.917+0000 7fc64dc00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6481609b0 con 0x7fc648161710 2024-04-25T19:21:52.919 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.917+0000 7fc64dc00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fc648164cd0 con 0x7fc648163fa0 2024-04-25T19:21:52.919 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.917+0000 7fc64dc00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fc648160c30 con 0x7fc64806ccd0 2024-04-25T19:21:52.920 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.918+0000 7fc63fe00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc64806ccd0 0x7fc64815e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:52.920 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.918+0000 7fc63fe00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc64806ccd0 0x7fc64815e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:56838/0 (socket says 172.21.15.195:56838) 2024-04-25T19:21:52.920 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.918+0000 7fc63fe00640 1 -- 172.21.15.195:0/1782258804 learned_addr learned my addr 172.21.15.195:0/1782258804 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T19:21:52.920 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.918+0000 7fc647400640 1 --2- 172.21.15.195:0/1782258804 >> v2:172.21.15.131:3300/0 conn(0x7fc648163fa0 0x7fc6481643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:52.920 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.918+0000 7fc63fe00640 1 -- 172.21.15.195:0/1782258804 >> v2:172.21.15.131:3300/0 conn(0x7fc648163fa0 msgr2=0x7fc6481643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:21:52.920 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.918+0000 7fc63fe00640 1 --2- 172.21.15.195:0/1782258804 >> v2:172.21.15.131:3300/0 conn(0x7fc648163fa0 0x7fc6481643b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:52.920 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.918+0000 7fc63fe00640 1 -- 172.21.15.195:0/1782258804 >> v1:172.21.15.131:6789/0 conn(0x7fc648161710 legacy=0x7fc64806c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:21:52.921 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.918+0000 7fc63fe00640 1 -- 172.21.15.195:0/1782258804 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc648160f10 con 0x7fc64806ccd0 2024-04-25T19:21:52.922 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.919+0000 7fc63fe00640 1 --2- 172.21.15.195:0/1782258804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc64806ccd0 0x7fc64815e080 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc6480d2770 tx=0x7fc63002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd24743d74087531 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:21:52.922 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.920+0000 7fc646000640 1 -- 172.21.15.195:0/1782258804 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630037070 con 0x7fc64806ccd0 2024-04-25T19:21:52.922 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.920+0000 7fc646000640 1 -- 172.21.15.195:0/1782258804 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc630032440 con 0x7fc64806ccd0 2024-04-25T19:21:52.922 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.920+0000 7fc646000640 1 -- 172.21.15.195:0/1782258804 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630032810 con 0x7fc64806ccd0 2024-04-25T19:21:52.922 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.921+0000 7fc64dc00640 1 -- 172.21.15.195:0/1782258804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc64806ccd0 msgr2=0x7fc64815e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:52.922 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.921+0000 7fc64dc00640 1 --2- 172.21.15.195:0/1782258804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc64806ccd0 0x7fc64815e080 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc6480d2770 tx=0x7fc63002a1a0 comp rx=0 tx=0).stop 2024-04-25T19:21:52.923 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.921+0000 7fc64dc00640 1 -- 172.21.15.195:0/1782258804 shutdown_connections 2024-04-25T19:21:52.923 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.921+0000 7fc64dc00640 1 --2- 172.21.15.195:0/1782258804 >> v2:172.21.15.131:3300/0 conn(0x7fc648163fa0 0x7fc6481643b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:52.923 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.921+0000 7fc64dc00640 1 --2- 172.21.15.195:0/1782258804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc64806ccd0 0x7fc64815e080 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:52.923 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.921+0000 7fc64dc00640 1 -- 172.21.15.195:0/1782258804 >> 172.21.15.195:0/1782258804 conn(0x7fc6480d5d90 msgr2=0x7fc6480d61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:21:52.923 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.921+0000 7fc64dc00640 1 -- 172.21.15.195:0/1782258804 shutdown_connections 2024-04-25T19:21:52.923 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.921+0000 7fc64dc00640 1 -- 172.21.15.195:0/1782258804 wait complete. 2024-04-25T19:21:52.924 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.923+0000 7fc64dc00640 1 Processor -- start 2024-04-25T19:21:52.924 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.923+0000 7fc64dc00640 1 -- start start 2024-04-25T19:21:52.928 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.925+0000 7fc64dc00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc648161710 0x7fc6480c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:52.928 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.925+0000 7fc64dc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc648163fa0 0x7fc6480b95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:52.928 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.925+0000 7fc64dc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6480baae0 0x7fc648145280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:52.928 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.925+0000 7fc64dc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc648164a70 con 0x7fc648163fa0 2024-04-25T19:21:52.928 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.925+0000 7fc64dc00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc6481648f0 con 0x7fc648161710 2024-04-25T19:21:52.928 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.925+0000 7fc64dc00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc6480d49f0 con 0x7fc6480baae0 2024-04-25T19:21:52.928 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.925+0000 7fc646a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc648161710 0x7fc6480c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:52.928 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.925+0000 7fc646a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc648161710 0x7fc6480c96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:56854/0 (socket says 172.21.15.195:56854) 2024-04-25T19:21:52.928 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.925+0000 7fc646a00640 1 -- 172.21.15.195:0/687503859 learned_addr learned my addr 172.21.15.195:0/687503859 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T19:21:52.929 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.925+0000 7fc647400640 1 --2- 172.21.15.195:0/687503859 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6480baae0 0x7fc648145280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:52.929 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.926+0000 7fc63fe00640 1 --2- 172.21.15.195:0/687503859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc648163fa0 0x7fc6480b95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:52.929 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.926+0000 7fc646a00640 1 -- 172.21.15.195:0/687503859 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6480baae0 msgr2=0x7fc648145280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:52.929 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.926+0000 7fc646a00640 1 --2- 172.21.15.195:0/687503859 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6480baae0 0x7fc648145280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:52.929 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.926+0000 7fc646a00640 1 -- 172.21.15.195:0/687503859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc648163fa0 msgr2=0x7fc6480b95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:52.929 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.926+0000 7fc646a00640 1 --2- 172.21.15.195:0/687503859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc648163fa0 0x7fc6480b95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:52.929 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.926+0000 7fc646a00640 1 -- 172.21.15.195:0/687503859 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6480c9c30 con 0x7fc648161710 2024-04-25T19:21:52.929 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.926+0000 7fc646a00640 1 --2- 172.21.15.195:0/687503859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc648161710 0x7fc6480c96f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc63800b3c0 tx=0x7fc63800b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:21:52.929 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.926+0000 7fc63ea00640 1 -- 172.21.15.195:0/687503859 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638011830 con 0x7fc648161710 2024-04-25T19:21:52.929 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.926+0000 7fc63ea00640 1 -- 172.21.15.195:0/687503859 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc638016070 con 0x7fc648161710 2024-04-25T19:21:52.929 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.926+0000 7fc63ea00640 1 -- 172.21.15.195:0/687503859 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638011c30 con 0x7fc648161710 2024-04-25T19:21:52.929 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.926+0000 7fc64dc00640 1 -- 172.21.15.195:0/687503859 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6480cc470 con 0x7fc648161710 2024-04-25T19:21:52.929 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.926+0000 7fc64dc00640 1 -- 172.21.15.195:0/687503859 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6480ba2e0 con 0x7fc648161710 2024-04-25T19:21:52.929 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.927+0000 7fc63ea00640 1 -- 172.21.15.195:0/687503859 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc63801b460 con 0x7fc648161710 2024-04-25T19:21:52.929 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.927+0000 7fc63ea00640 1 -- 172.21.15.195:0/687503859 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fc638011dd0 con 0x7fc648161710 2024-04-25T19:21:52.930 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.928+0000 7fc64dc00640 1 -- 172.21.15.195:0/687503859 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc648050740 con 0x7fc648161710 2024-04-25T19:21:52.931 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:52.930+0000 7fc63ea00640 1 -- 172.21.15.195:0/687503859 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc63801a6e0 con 0x7fc648161710 2024-04-25T19:21:52.941 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-25T19:21:52.939+0000 7fa6bae0d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T19:21:52.969 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:52.968+0000 7fdf85c1b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T19:21:52.997 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-25T19:21:52.995+0000 7fa6bae0d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T19:21:53.011 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.010+0000 7fc64dc00640 1 -- 172.21.15.195:0/687503859 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3cb06a2f-7f35-4e0f-bbdf-654793d2c10a", "id": 2} v 0) -- 0x7fc6480ccac0 con 0x7fc648161710 2024-04-25T19:21:53.019 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.017+0000 7fc63ea00640 1 -- 172.21.15.195:0/687503859 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3cb06a2f-7f35-4e0f-bbdf-654793d2c10a", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fc63801aa50 con 0x7fc648161710 2024-04-25T19:21:53.019 INFO:teuthology.orchestra.run.smithi195.stdout:2 2024-04-25T19:21:53.020 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.019+0000 7fc64dc00640 1 -- 172.21.15.195:0/687503859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc648161710 msgr2=0x7fc6480c96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:53.021 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.019+0000 7fc64dc00640 1 --2- 172.21.15.195:0/687503859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc648161710 0x7fc6480c96f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc63800b3c0 tx=0x7fc63800b880 comp rx=0 tx=0).stop 2024-04-25T19:21:53.021 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.019+0000 7fc64dc00640 1 -- 172.21.15.195:0/687503859 shutdown_connections 2024-04-25T19:21:53.021 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.019+0000 7fc64dc00640 1 --2- 172.21.15.195:0/687503859 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6480baae0 0x7fc648145280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:53.021 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.019+0000 7fc64dc00640 1 --2- 172.21.15.195:0/687503859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc648163fa0 0x7fc6480b95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:53.021 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.019+0000 7fc64dc00640 1 --2- 172.21.15.195:0/687503859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc648161710 0x7fc6480c96f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:53.021 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.019+0000 7fc64dc00640 1 -- 172.21.15.195:0/687503859 >> 172.21.15.195:0/687503859 conn(0x7fc6480d5d90 msgr2=0x7fc6480d61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:21:53.021 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.019+0000 7fc64dc00640 1 -- 172.21.15.195:0/687503859 shutdown_connections 2024-04-25T19:21:53.021 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.019+0000 7fc64dc00640 1 -- 172.21.15.195:0/687503859 wait complete. 2024-04-25T19:21:53.042 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 24e40ad5-13b1-4ae6-9586-d2814758641f 3 2024-04-25T19:21:53.171 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:53.170+0000 7fdf85c1b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T19:21:53.205 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-25T19:21:53.203+0000 7fa6bae0d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T19:21:53.235 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:53.234+0000 7fdf85c1b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T19:21:53.270 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-25T19:21:53.268+0000 7fa6bae0d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T19:21:53.280 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.279+0000 7fccdfe00640 1 Processor -- start 2024-04-25T19:21:53.280 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.279+0000 7fccdfe00640 1 -- start start 2024-04-25T19:21:53.283 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.282+0000 7fccdfe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcce00d1340 0x7fcce0070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:53.283 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.282+0000 7fccdfe00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcce0070bb0 con 0x7fcce013ff60 2024-04-25T19:21:53.283 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.282+0000 7fccdfe00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcce015e340 con 0x7fcce00707a0 2024-04-25T19:21:53.283 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.282+0000 7fccdfe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcce00d02a0 con 0x7fcce00d1340 2024-04-25T19:21:53.284 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.282+0000 7fccde000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcce00d1340 0x7fcce0070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:53.284 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.282+0000 7fccdf400640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fcce00707a0 0x7fcce0140490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:50784/0 (socket says 172.21.15.195:50784) 2024-04-25T19:21:53.284 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.282+0000 7fccdf400640 1 -- 172.21.15.195:0/4253297228 learned_addr learned my addr 172.21.15.195:0/4253297228 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-04-25T19:21:53.285 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.282+0000 7fccdd600640 1 -- 172.21.15.195:0/4253297228 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2521475993 0 0) 0x7fcce015e340 con 0x7fcce00707a0 2024-04-25T19:21:53.285 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.283+0000 7fccdd600640 1 -- 172.21.15.195:0/4253297228 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccc4005730 con 0x7fcce00707a0 2024-04-25T19:21:53.285 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.283+0000 7fccde000640 1 -- 172.21.15.195:0/4253297228 >> v1:172.21.15.195:6789/0 conn(0x7fcce00707a0 legacy=0x7fcce0140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:53.285 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.283+0000 7fccde000640 1 -- 172.21.15.195:0/4253297228 >> v1:172.21.15.131:6789/0 conn(0x7fcce013ff60 legacy=0x7fcce015dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:53.285 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.283+0000 7fccde000640 1 -- 172.21.15.195:0/4253297228 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce00d0580 con 0x7fcce00d1340 2024-04-25T19:21:53.285 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.284+0000 7fccde000640 1 --2- 172.21.15.195:0/4253297228 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcce00d1340 0x7fcce0070260 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0097d0 tx=0x7fcccc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=448290a91dc598b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:21:53.285 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.284+0000 7fccdd600640 1 -- 172.21.15.195:0/4253297228 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc037070 con 0x7fcce00d1340 2024-04-25T19:21:53.285 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.284+0000 7fccdd600640 1 -- 172.21.15.195:0/4253297228 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcccc032440 con 0x7fcce00d1340 2024-04-25T19:21:53.285 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.284+0000 7fccdd600640 1 -- 172.21.15.195:0/4253297228 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc0327f0 con 0x7fcce00d1340 2024-04-25T19:21:53.287 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.285+0000 7fccdfe00640 1 -- 172.21.15.195:0/4253297228 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcce00d1340 msgr2=0x7fcce0070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:53.287 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.285+0000 7fccdfe00640 1 --2- 172.21.15.195:0/4253297228 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcce00d1340 0x7fcce0070260 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0097d0 tx=0x7fcccc02a180 comp rx=0 tx=0).stop 2024-04-25T19:21:53.287 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.285+0000 7fccdfe00640 1 -- 172.21.15.195:0/4253297228 shutdown_connections 2024-04-25T19:21:53.287 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.285+0000 7fccdfe00640 1 --2- 172.21.15.195:0/4253297228 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcce00d1340 0x7fcce0070260 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:53.287 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.285+0000 7fccdfe00640 1 -- 172.21.15.195:0/4253297228 >> 172.21.15.195:0/4253297228 conn(0x7fcce00b4260 msgr2=0x7fcce0072fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:21:53.287 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.285+0000 7fccdfe00640 1 -- 172.21.15.195:0/4253297228 shutdown_connections 2024-04-25T19:21:53.287 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.285+0000 7fccdfe00640 1 -- 172.21.15.195:0/4253297228 wait complete. 2024-04-25T19:21:53.289 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.288+0000 7fccdfe00640 1 Processor -- start 2024-04-25T19:21:53.289 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.288+0000 7fccdfe00640 1 -- start start 2024-04-25T19:21:53.292 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.289+0000 7fccdfe00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcce00d1340 0x7fcce0153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:53.292 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.289+0000 7fccdfe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcce013ff60 0x7fcce00b5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:53.292 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.289+0000 7fccdfe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcce00b5b50 0x7fcce013bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:53.292 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.289+0000 7fccdfe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcce00d0e20 con 0x7fcce00b5b50 2024-04-25T19:21:53.293 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.289+0000 7fccdfe00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcce00d0b40 con 0x7fcce00d1340 2024-04-25T19:21:53.293 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.289+0000 7fccdfe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcce015d600 con 0x7fcce013ff60 2024-04-25T19:21:53.293 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.289+0000 7fccdea00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcce00d1340 0x7fcce0153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:53.293 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.289+0000 7fccde000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcce013ff60 0x7fcce00b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:53.293 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.289+0000 7fccde000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcce013ff60 0x7fcce00b5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:39910/0 (socket says 172.21.15.195:39910) 2024-04-25T19:21:53.293 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.289+0000 7fccde000640 1 -- 172.21.15.195:0/2811784366 learned_addr learned my addr 172.21.15.195:0/2811784366 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T19:21:53.293 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.290+0000 7fccdf400640 1 --2- 172.21.15.195:0/2811784366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcce00b5b50 0x7fcce013bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:53.293 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.290+0000 7fccde000640 1 -- 172.21.15.195:0/2811784366 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcce00d1340 msgr2=0x7fcce0153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:53.293 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.290+0000 7fccde000640 1 --2- 172.21.15.195:0/2811784366 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcce00d1340 0x7fcce0153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:53.293 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.290+0000 7fccde000640 1 -- 172.21.15.195:0/2811784366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcce00b5b50 msgr2=0x7fcce013bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:53.293 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.290+0000 7fccde000640 1 --2- 172.21.15.195:0/2811784366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcce00b5b50 0x7fcce013bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:53.293 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.290+0000 7fccde000640 1 -- 172.21.15.195:0/2811784366 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce01613e0 con 0x7fcce013ff60 2024-04-25T19:21:53.293 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.290+0000 7fccde000640 1 --2- 172.21.15.195:0/2811784366 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcce013ff60 0x7fcce00b5610 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0097d0 tx=0x7fcccc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:21:53.294 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.290+0000 7fccd6a00640 1 -- 172.21.15.195:0/2811784366 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc037050 con 0x7fcce013ff60 2024-04-25T19:21:53.294 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.291+0000 7fccd6a00640 1 -- 172.21.15.195:0/2811784366 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcccc038040 con 0x7fcce013ff60 2024-04-25T19:21:53.294 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.291+0000 7fccd6a00640 1 -- 172.21.15.195:0/2811784366 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc004490 con 0x7fcce013ff60 2024-04-25T19:21:53.294 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.291+0000 7fccdfe00640 1 -- 172.21.15.195:0/2811784366 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce0160620 con 0x7fcce013ff60 2024-04-25T19:21:53.294 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.291+0000 7fccdfe00640 1 -- 172.21.15.195:0/2811784366 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce0160be0 con 0x7fcce013ff60 2024-04-25T19:21:53.294 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.291+0000 7fccd6a00640 1 -- 172.21.15.195:0/2811784366 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcccc03c6d0 con 0x7fcce013ff60 2024-04-25T19:21:53.294 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.291+0000 7fccd6a00640 1 -- 172.21.15.195:0/2811784366 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fcccc03e450 con 0x7fcce013ff60 2024-04-25T19:21:53.295 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.292+0000 7fccdfe00640 1 -- 172.21.15.195:0/2811784366 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcce0076c60 con 0x7fcce013ff60 2024-04-25T19:21:53.298 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.297+0000 7fccd6a00640 1 -- 172.21.15.195:0/2811784366 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fcccc03cb50 con 0x7fcce013ff60 2024-04-25T19:21:53.302 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:53.301+0000 7fdf85c1b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T19:21:53.337 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-25T19:21:53.335+0000 7fa6bae0d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T19:21:53.379 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.378+0000 7fccdfe00640 1 -- 172.21.15.195:0/2811784366 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd new", "uuid": "24e40ad5-13b1-4ae6-9586-d2814758641f", "id": 3} v 0) -- 0x7fcce0073a70 con 0x7fcce013ff60 2024-04-25T19:21:53.387 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.385+0000 7fccd6a00640 1 -- 172.21.15.195:0/2811784366 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "24e40ad5-13b1-4ae6-9586-d2814758641f", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fcccc03cdf0 con 0x7fcce013ff60 2024-04-25T19:21:53.387 INFO:teuthology.orchestra.run.smithi195.stdout:3 2024-04-25T19:21:53.388 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.387+0000 7fccdfe00640 1 -- 172.21.15.195:0/2811784366 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcce013ff60 msgr2=0x7fcce00b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:53.388 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.387+0000 7fccdfe00640 1 --2- 172.21.15.195:0/2811784366 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcce013ff60 0x7fcce00b5610 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0097d0 tx=0x7fcccc0046c0 comp rx=0 tx=0).stop 2024-04-25T19:21:53.388 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.387+0000 7fccdfe00640 1 -- 172.21.15.195:0/2811784366 shutdown_connections 2024-04-25T19:21:53.389 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.387+0000 7fccdfe00640 1 --2- 172.21.15.195:0/2811784366 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcce013ff60 0x7fcce00b5610 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:53.389 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.387+0000 7fccdfe00640 1 --2- 172.21.15.195:0/2811784366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcce00b5b50 0x7fcce013bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:53.389 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.387+0000 7fccdfe00640 1 --2- 172.21.15.195:0/2811784366 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcce00d1340 0x7fcce0153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:53.389 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.387+0000 7fccdfe00640 1 -- 172.21.15.195:0/2811784366 >> 172.21.15.195:0/2811784366 conn(0x7fcce00707a0 msgr2=0x7fcce00b0650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:21:53.389 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.387+0000 7fccdfe00640 1 -- 172.21.15.195:0/2811784366 shutdown_connections 2024-04-25T19:21:53.389 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.387+0000 7fccdfe00640 1 -- 172.21.15.195:0/2811784366 wait complete. 2024-04-25T19:21:53.410 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new cdb1a626-bcbd-4d86-9176-f93b23644451 4 2024-04-25T19:21:53.436 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:53.435+0000 7fdf85c1b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T19:21:53.473 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-25T19:21:53.471+0000 7fa6bae0d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T19:21:53.648 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.647+0000 7fd9f9c00640 1 Processor -- start 2024-04-25T19:21:53.649 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.647+0000 7fd9f9c00640 1 -- start start 2024-04-25T19:21:53.651 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.649+0000 7fd9f9c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd9f4160440 0x7fd9f406db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:53.651 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.650+0000 7fd9f9c00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9f406e4b0 con 0x7fd9f40d56c0 2024-04-25T19:21:53.651 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.650+0000 7fd9f9c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9f40b53c0 con 0x7fd9f406e0a0 2024-04-25T19:21:53.651 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.650+0000 7fd9f9c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd9f40d43f0 con 0x7fd9f4160440 2024-04-25T19:21:53.651 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.650+0000 7fd9ebe00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd9f4160440 0x7fd9f406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:53.651 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.650+0000 7fd9f9200640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fd9f406e0a0 0x7fd9f40b9260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:50798/0 (socket says 172.21.15.195:50798) 2024-04-25T19:21:53.651 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.650+0000 7fd9ebe00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd9f4160440 0x7fd9f406db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:56868/0 (socket says 172.21.15.195:56868) 2024-04-25T19:21:53.651 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.650+0000 7fd9f9200640 1 -- 172.21.15.195:0/784584033 learned_addr learned my addr 172.21.15.195:0/784584033 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-04-25T19:21:53.652 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.650+0000 7fd9f3400640 1 -- 172.21.15.195:0/784584033 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1134943587 0 0) 0x7fd9f40b53c0 con 0x7fd9f406e0a0 2024-04-25T19:21:53.652 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.650+0000 7fd9f3400640 1 -- 172.21.15.195:0/784584033 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9d8003520 con 0x7fd9f406e0a0 2024-04-25T19:21:53.652 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.650+0000 7fd9ebe00640 1 -- 172.21.15.195:0/784584033 >> v1:172.21.15.195:6789/0 conn(0x7fd9f406e0a0 legacy=0x7fd9f40b9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:53.652 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.650+0000 7fd9ebe00640 1 -- 172.21.15.195:0/784584033 >> v1:172.21.15.131:6789/0 conn(0x7fd9f40d56c0 legacy=0x7fd9f40b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:21:53.652 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.650+0000 7fd9ebe00640 1 -- 172.21.15.195:0/784584033 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f40d37e0 con 0x7fd9f4160440 2024-04-25T19:21:53.653 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.651+0000 7fd9ebe00640 1 --2- 172.21.15.195:0/784584033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9f4160440 0x7fd9f406db60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0097a0 tx=0x7fd9dc02a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8c6578848229f9f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:21:53.653 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.652+0000 7fd9f3400640 1 -- 172.21.15.195:0/784584033 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc037070 con 0x7fd9f4160440 2024-04-25T19:21:53.653 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.652+0000 7fd9f3400640 1 -- 172.21.15.195:0/784584033 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9dc032440 con 0x7fd9f4160440 2024-04-25T19:21:53.653 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.652+0000 7fd9f3400640 1 -- 172.21.15.195:0/784584033 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc032810 con 0x7fd9f4160440 2024-04-25T19:21:53.654 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.653+0000 7fd9f9c00640 1 -- 172.21.15.195:0/784584033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9f4160440 msgr2=0x7fd9f406db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:53.654 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.653+0000 7fd9f9c00640 1 --2- 172.21.15.195:0/784584033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9f4160440 0x7fd9f406db60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0097a0 tx=0x7fd9dc02a1e0 comp rx=0 tx=0).stop 2024-04-25T19:21:53.654 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.653+0000 7fd9f9c00640 1 -- 172.21.15.195:0/784584033 shutdown_connections 2024-04-25T19:21:53.654 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.653+0000 7fd9f9c00640 1 --2- 172.21.15.195:0/784584033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9f4160440 0x7fd9f406db60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:53.655 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.653+0000 7fd9f9c00640 1 -- 172.21.15.195:0/784584033 >> 172.21.15.195:0/784584033 conn(0x7fd9f40d2c20 msgr2=0x7fd9f40d5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:21:53.655 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.653+0000 7fd9f9c00640 1 -- 172.21.15.195:0/784584033 shutdown_connections 2024-04-25T19:21:53.655 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.653+0000 7fd9f9c00640 1 -- 172.21.15.195:0/784584033 wait complete. 2024-04-25T19:21:53.656 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.655+0000 7fd9f9c00640 1 Processor -- start 2024-04-25T19:21:53.656 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.655+0000 7fd9f9c00640 1 -- start start 2024-04-25T19:21:53.658 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.657+0000 7fd9f9c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9f406e0a0 0x7fd9f40d06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:53.659 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.657+0000 7fd9f9c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9f4160440 0x7fd9f41f98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:53.659 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.657+0000 7fd9f9c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9f41f9e30 0x7fd9f41f5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:53.659 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.657+0000 7fd9f9c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f40d4080 con 0x7fd9f41f9e30 2024-04-25T19:21:53.659 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.657+0000 7fd9f9c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f40d3da0 con 0x7fd9f406e0a0 2024-04-25T19:21:53.659 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.657+0000 7fd9f9c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd9f40d4880 con 0x7fd9f4160440 2024-04-25T19:21:53.659 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.657+0000 7fd9ebe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9f4160440 0x7fd9f41f98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:53.659 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.657+0000 7fd9f3e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9f406e0a0 0x7fd9f40d06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:53.659 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.657+0000 7fd9ebe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9f4160440 0x7fd9f41f98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:39924/0 (socket says 172.21.15.195:39924) 2024-04-25T19:21:53.659 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.657+0000 7fd9ebe00640 1 -- 172.21.15.195:0/687982656 learned_addr learned my addr 172.21.15.195:0/687982656 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T19:21:53.659 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.657+0000 7fd9f9200640 1 --2- 172.21.15.195:0/687982656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9f41f9e30 0x7fd9f41f5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:53.659 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.657+0000 7fd9ebe00640 1 -- 172.21.15.195:0/687982656 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9f406e0a0 msgr2=0x7fd9f40d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:53.659 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.657+0000 7fd9ebe00640 1 --2- 172.21.15.195:0/687982656 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9f406e0a0 0x7fd9f40d06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:53.659 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.657+0000 7fd9ebe00640 1 -- 172.21.15.195:0/687982656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9f41f9e30 msgr2=0x7fd9f41f5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:53.660 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.657+0000 7fd9ebe00640 1 --2- 172.21.15.195:0/687982656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9f41f9e30 0x7fd9f41f5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:53.660 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.657+0000 7fd9ebe00640 1 -- 172.21.15.195:0/687982656 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f41fa240 con 0x7fd9f4160440 2024-04-25T19:21:53.660 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.658+0000 7fd9ebe00640 1 --2- 172.21.15.195:0/687982656 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9f4160440 0x7fd9f41f98f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc000c00 tx=0x7fd9dc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:21:53.661 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.658+0000 7fd9f0c00640 1 -- 172.21.15.195:0/687982656 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc041070 con 0x7fd9f4160440 2024-04-25T19:21:53.661 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.658+0000 7fd9f0c00640 1 -- 172.21.15.195:0/687982656 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9dc03c870 con 0x7fd9f4160440 2024-04-25T19:21:53.661 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.658+0000 7fd9f0c00640 1 -- 172.21.15.195:0/687982656 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc037040 con 0x7fd9f4160440 2024-04-25T19:21:53.661 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.658+0000 7fd9f9c00640 1 -- 172.21.15.195:0/687982656 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9f40ac4c0 con 0x7fd9f4160440 2024-04-25T19:21:53.661 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.658+0000 7fd9f9c00640 1 -- 172.21.15.195:0/687982656 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9f40acca0 con 0x7fd9f4160440 2024-04-25T19:21:53.661 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.658+0000 7fd9f0c00640 1 -- 172.21.15.195:0/687982656 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd9dc044070 con 0x7fd9f4160440 2024-04-25T19:21:53.661 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.658+0000 7fd9f0c00640 1 -- 172.21.15.195:0/687982656 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fd9dc03d3f0 con 0x7fd9f4160440 2024-04-25T19:21:53.661 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.659+0000 7fd9f9c00640 1 -- 172.21.15.195:0/687982656 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9f40ac710 con 0x7fd9f4160440 2024-04-25T19:21:53.664 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.664+0000 7fd9f0c00640 1 -- 172.21.15.195:0/687982656 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd9f41fa240 con 0x7fd9f4160440 2024-04-25T19:21:53.744 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.742+0000 7fd9f9c00640 1 -- 172.21.15.195:0/687982656 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cdb1a626-bcbd-4d86-9176-f93b23644451", "id": 4} v 0) -- 0x7fd9f4076c60 con 0x7fd9f4160440 2024-04-25T19:21:53.753 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.752+0000 7fd9f0c00640 1 -- 172.21.15.195:0/687982656 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cdb1a626-bcbd-4d86-9176-f93b23644451", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fd9f406e4b0 con 0x7fd9f4160440 2024-04-25T19:21:53.753 INFO:teuthology.orchestra.run.smithi195.stdout:4 2024-04-25T19:21:53.755 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.753+0000 7fd9f9c00640 1 -- 172.21.15.195:0/687982656 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9f4160440 msgr2=0x7fd9f41f98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:53.755 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.753+0000 7fd9f9c00640 1 --2- 172.21.15.195:0/687982656 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9f4160440 0x7fd9f41f98f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc000c00 tx=0x7fd9dc0046c0 comp rx=0 tx=0).stop 2024-04-25T19:21:53.755 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.753+0000 7fd9f9c00640 1 -- 172.21.15.195:0/687982656 shutdown_connections 2024-04-25T19:21:53.755 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.753+0000 7fd9f9c00640 1 --2- 172.21.15.195:0/687982656 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9f4160440 0x7fd9f41f98f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:53.755 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.753+0000 7fd9f9c00640 1 --2- 172.21.15.195:0/687982656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9f41f9e30 0x7fd9f41f5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:53.755 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.753+0000 7fd9f9c00640 1 --2- 172.21.15.195:0/687982656 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9f406e0a0 0x7fd9f40d06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:53.755 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.753+0000 7fd9f9c00640 1 -- 172.21.15.195:0/687982656 >> 172.21.15.195:0/687982656 conn(0x7fd9f40d2c20 msgr2=0x7fd9f415f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:21:53.755 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.754+0000 7fd9f9c00640 1 -- 172.21.15.195:0/687982656 shutdown_connections 2024-04-25T19:21:53.755 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:53.754+0000 7fd9f9c00640 1 -- 172.21.15.195:0/687982656 wait complete. 2024-04-25T19:21:53.777 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 1b4d09c7-1bc1-47e0-928c-76c7da4e9100 5 2024-04-25T19:21:53.913 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:53.911+0000 7fdf85c1b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T19:21:53.926 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-25T19:21:53.924+0000 7fa6bae0d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T19:21:54.074 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.072+0000 7fb7f6400640 1 Processor -- start 2024-04-25T19:21:54.074 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.072+0000 7fb7f6400640 1 -- start start 2024-04-25T19:21:54.076 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.074+0000 7fb7f6400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb7f0160450 0x7fb7f00b7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:54.076 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.074+0000 7fb7f6400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7f00d2750 0x7fb7f00b3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:54.076 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.074+0000 7fb7f6400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7f01643b0 con 0x7fb7f00cfdf0 2024-04-25T19:21:54.076 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.074+0000 7fb7f6400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb7f00d1e20 con 0x7fb7f0160450 2024-04-25T19:21:54.076 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.074+0000 7fb7f6400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb7f0164f30 con 0x7fb7f00d2750 2024-04-25T19:21:54.076 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.074+0000 7fb7ef400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb7f0160450 0x7fb7f00b7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:54.076 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.075+0000 7fb7efe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7f00d2750 0x7fb7f00b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:54.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.075+0000 7fb7ef400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb7f0160450 0x7fb7f00b7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:56898/0 (socket says 172.21.15.195:56898) 2024-04-25T19:21:54.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.075+0000 7fb7e7e00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fb7f00cfdf0 0x7fb7f00d2040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:50804/0 (socket says 172.21.15.195:50804) 2024-04-25T19:21:54.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.075+0000 7fb7ef400640 1 -- 172.21.15.195:0/1325186297 learned_addr learned my addr 172.21.15.195:0/1325186297 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T19:21:54.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.075+0000 7fb7efe00640 1 -- 172.21.15.195:0/1325186297 >> v2:172.21.15.195:3300/0 conn(0x7fb7f0160450 msgr2=0x7fb7f00b7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:21:54.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.075+0000 7fb7efe00640 1 --2- 172.21.15.195:0/1325186297 >> v2:172.21.15.195:3300/0 conn(0x7fb7f0160450 0x7fb7f00b7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:54.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.075+0000 7fb7efe00640 1 -- 172.21.15.195:0/1325186297 >> v1:172.21.15.195:6789/0 conn(0x7fb7f00cfdf0 legacy=0x7fb7f00d2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:54.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.075+0000 7fb7efe00640 1 -- 172.21.15.195:0/1325186297 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f0164690 con 0x7fb7f00d2750 2024-04-25T19:21:54.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.075+0000 7fb7ef400640 1 --2- 172.21.15.195:0/1325186297 >> v2:172.21.15.195:3300/0 conn(0x7fb7f0160450 0x7fb7f00b7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T19:21:54.079 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.076+0000 7fb7efe00640 1 --2- 172.21.15.195:0/1325186297 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7f00d2750 0x7fb7f00b3150 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8009d90 tx=0x7fb7e802a550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2293b94796f046 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:21:54.079 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.076+0000 7fb7eea00640 1 -- 172.21.15.195:0/1325186297 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8007740 con 0x7fb7f00d2750 2024-04-25T19:21:54.079 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.076+0000 7fb7eea00640 1 -- 172.21.15.195:0/1325186297 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e80078e0 con 0x7fb7f00d2750 2024-04-25T19:21:54.079 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.076+0000 7fb7eea00640 1 -- 172.21.15.195:0/1325186297 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8007cb0 con 0x7fb7f00d2750 2024-04-25T19:21:54.079 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.077+0000 7fb7f6400640 1 -- 172.21.15.195:0/1325186297 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7f00d2750 msgr2=0x7fb7f00b3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:54.079 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.077+0000 7fb7f6400640 1 --2- 172.21.15.195:0/1325186297 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7f00d2750 0x7fb7f00b3150 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8009d90 tx=0x7fb7e802a550 comp rx=0 tx=0).stop 2024-04-25T19:21:54.079 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.077+0000 7fb7f6400640 1 -- 172.21.15.195:0/1325186297 shutdown_connections 2024-04-25T19:21:54.079 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.077+0000 7fb7f6400640 1 --2- 172.21.15.195:0/1325186297 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7f00d2750 0x7fb7f00b3150 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:54.079 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.077+0000 7fb7f6400640 1 --2- 172.21.15.195:0/1325186297 >> v2:172.21.15.195:3300/0 conn(0x7fb7f0160450 0x7fb7f00b7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:54.079 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.077+0000 7fb7f6400640 1 -- 172.21.15.195:0/1325186297 >> 172.21.15.195:0/1325186297 conn(0x7fb7f009b7d0 msgr2=0x7fb7f00b7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:21:54.080 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.077+0000 7fb7f6400640 1 -- 172.21.15.195:0/1325186297 shutdown_connections 2024-04-25T19:21:54.080 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.077+0000 7fb7f6400640 1 -- 172.21.15.195:0/1325186297 wait complete. 2024-04-25T19:21:54.081 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.080+0000 7fb7f6400640 1 Processor -- start 2024-04-25T19:21:54.081 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.080+0000 7fb7f6400640 1 -- start start 2024-04-25T19:21:54.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.081+0000 7fb7f6400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7f00cfdf0 0x7fb7f01545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:54.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.081+0000 7fb7f6400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7f0160450 0x7fb7f00b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:54.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.081+0000 7fb7f6400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7f0161680 0x7fb7f00b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:54.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.081+0000 7fb7f6400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f00b7cc0 con 0x7fb7f0160450 2024-04-25T19:21:54.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.081+0000 7fb7f6400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f0164c50 con 0x7fb7f00cfdf0 2024-04-25T19:21:54.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.081+0000 7fb7f6400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb7f0163fd0 con 0x7fb7f0161680 2024-04-25T19:21:54.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.081+0000 7fb7efe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7f0161680 0x7fb7f00b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:54.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.081+0000 7fb7ef400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7f00cfdf0 0x7fb7f01545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:54.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.081+0000 7fb7efe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7f0161680 0x7fb7f00b3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:39934/0 (socket says 172.21.15.195:39934) 2024-04-25T19:21:54.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.081+0000 7fb7efe00640 1 -- 172.21.15.195:0/1243496462 learned_addr learned my addr 172.21.15.195:0/1243496462 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T19:21:54.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.082+0000 7fb7e7e00640 1 --2- 172.21.15.195:0/1243496462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7f0160450 0x7fb7f00b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:54.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.082+0000 7fb7ef400640 1 -- 172.21.15.195:0/1243496462 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7f0161680 msgr2=0x7fb7f00b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:54.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.082+0000 7fb7ef400640 1 --2- 172.21.15.195:0/1243496462 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7f0161680 0x7fb7f00b3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:54.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.082+0000 7fb7ef400640 1 -- 172.21.15.195:0/1243496462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7f0160450 msgr2=0x7fb7f00b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:54.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.082+0000 7fb7ef400640 1 --2- 172.21.15.195:0/1243496462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7f0160450 0x7fb7f00b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:54.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.082+0000 7fb7ef400640 1 -- 172.21.15.195:0/1243496462 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f015bcb0 con 0x7fb7f00cfdf0 2024-04-25T19:21:54.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.082+0000 7fb7efe00640 1 --2- 172.21.15.195:0/1243496462 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7f0161680 0x7fb7f00b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T19:21:54.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.082+0000 7fb7e7e00640 1 --2- 172.21.15.195:0/1243496462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7f0160450 0x7fb7f00b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:21:54.086 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.082+0000 7fb7ef400640 1 --2- 172.21.15.195:0/1243496462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7f00cfdf0 0x7fb7f01545e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000e890 tx=0x7fb7e000ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:21:54.086 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.083+0000 7fb7e7400640 1 -- 172.21.15.195:0/1243496462 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0004030 con 0x7fb7f00cfdf0 2024-04-25T19:21:54.086 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.083+0000 7fb7e7400640 1 -- 172.21.15.195:0/1243496462 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e00041d0 con 0x7fb7f00cfdf0 2024-04-25T19:21:54.086 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.083+0000 7fb7e7400640 1 -- 172.21.15.195:0/1243496462 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e000c940 con 0x7fb7f00cfdf0 2024-04-25T19:21:54.086 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.083+0000 7fb7f6400640 1 -- 172.21.15.195:0/1243496462 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7f015bf70 con 0x7fb7f00cfdf0 2024-04-25T19:21:54.086 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.083+0000 7fb7f6400640 1 -- 172.21.15.195:0/1243496462 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7f015c530 con 0x7fb7f00cfdf0 2024-04-25T19:21:54.086 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.083+0000 7fb7e7400640 1 -- 172.21.15.195:0/1243496462 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb7e0005990 con 0x7fb7f00cfdf0 2024-04-25T19:21:54.086 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.083+0000 7fb7e7400640 1 -- 172.21.15.195:0/1243496462 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fb7e00093d0 con 0x7fb7f00cfdf0 2024-04-25T19:21:54.086 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.084+0000 7fb7f6400640 1 -- 172.21.15.195:0/1243496462 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7f0050740 con 0x7fb7f00cfdf0 2024-04-25T19:21:54.087 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.086+0000 7fb7e7400640 1 -- 172.21.15.195:0/1243496462 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb7e0017020 con 0x7fb7f00cfdf0 2024-04-25T19:21:54.161 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.160+0000 7fb7f6400640 1 -- 172.21.15.195:0/1243496462 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1b4d09c7-1bc1-47e0-928c-76c7da4e9100", "id": 5} v 0) -- 0x7fb7f00d2b50 con 0x7fb7f00cfdf0 2024-04-25T19:21:54.169 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.168+0000 7fb7e7400640 1 -- 172.21.15.195:0/1243496462 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1b4d09c7-1bc1-47e0-928c-76c7da4e9100", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fb7e0005c80 con 0x7fb7f00cfdf0 2024-04-25T19:21:54.169 INFO:teuthology.orchestra.run.smithi195.stdout:5 2024-04-25T19:21:54.170 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.169+0000 7fb7f6400640 1 -- 172.21.15.195:0/1243496462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7f00cfdf0 msgr2=0x7fb7f01545e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:54.170 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.169+0000 7fb7f6400640 1 --2- 172.21.15.195:0/1243496462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7f00cfdf0 0x7fb7f01545e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000e890 tx=0x7fb7e000ed50 comp rx=0 tx=0).stop 2024-04-25T19:21:54.171 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.169+0000 7fb7f6400640 1 -- 172.21.15.195:0/1243496462 shutdown_connections 2024-04-25T19:21:54.171 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.169+0000 7fb7f6400640 1 --2- 172.21.15.195:0/1243496462 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7f0161680 0x7fb7f00b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:54.171 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.169+0000 7fb7f6400640 1 --2- 172.21.15.195:0/1243496462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7f0160450 0x7fb7f00b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:54.171 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.169+0000 7fb7f6400640 1 --2- 172.21.15.195:0/1243496462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7f00cfdf0 0x7fb7f01545e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:54.171 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.169+0000 7fb7f6400640 1 -- 172.21.15.195:0/1243496462 >> 172.21.15.195:0/1243496462 conn(0x7fb7f009b7d0 msgr2=0x7fb7f00b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:21:54.171 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.169+0000 7fb7f6400640 1 -- 172.21.15.195:0/1243496462 shutdown_connections 2024-04-25T19:21:54.171 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.169+0000 7fb7f6400640 1 -- 172.21.15.195:0/1243496462 wait complete. 2024-04-25T19:21:54.193 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 8b363ae9-9f98-48c8-98ce-2eb085dc13c7 6 2024-04-25T19:21:54.223 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:54.222+0000 7fdf85c1b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T19:21:54.224 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-25T19:21:54.222+0000 7fa6bae0d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T19:21:54.285 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-25T19:21:54.283+0000 7fa6bae0d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T19:21:54.287 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:54.286+0000 7fdf85c1b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T19:21:54.414 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-25T19:21:54.412+0000 7fa6bae0d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T19:21:54.422 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:54.421+0000 7fdf85c1b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T19:21:54.432 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.431+0000 7f9d92e00640 1 Processor -- start 2024-04-25T19:21:54.433 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.432+0000 7f9d92e00640 1 -- start start 2024-04-25T19:21:54.436 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.434+0000 7f9d92e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d8c0b8060 0x7f9d8c0d44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:54.436 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.435+0000 7f9d92e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d8c1612a0 con 0x7f9d8c0d49e0 2024-04-25T19:21:54.436 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.435+0000 7f9d92e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d8c161580 con 0x7f9d8c1647c0 2024-04-25T19:21:54.436 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.435+0000 7f9d92e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9d8c164330 con 0x7f9d8c0b8060 2024-04-25T19:21:54.436 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.435+0000 7f9d91a00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f9d8c1647c0 0x7f9d8c0b7950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:50810/0 (socket says 172.21.15.195:50810) 2024-04-25T19:21:54.436 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.435+0000 7f9d91a00640 1 -- 172.21.15.195:0/228235057 learned_addr learned my addr 172.21.15.195:0/228235057 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-04-25T19:21:54.437 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.435+0000 7f9d91000640 1 --2- 172.21.15.195:0/228235057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d8c0b8060 0x7f9d8c0d44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:54.437 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.435+0000 7f9d8be00640 1 -- 172.21.15.195:0/228235057 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2609633446 0 0) 0x7f9d8c161580 con 0x7f9d8c1647c0 2024-04-25T19:21:54.437 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.435+0000 7f9d8be00640 1 -- 172.21.15.195:0/228235057 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d74003520 con 0x7f9d8c1647c0 2024-04-25T19:21:54.437 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.435+0000 7f9d91000640 1 -- 172.21.15.195:0/228235057 >> v1:172.21.15.195:6789/0 conn(0x7f9d8c1647c0 legacy=0x7f9d8c0b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:54.437 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.435+0000 7f9d91000640 1 -- 172.21.15.195:0/228235057 >> v1:172.21.15.131:6789/0 conn(0x7f9d8c0d49e0 legacy=0x7f9d8c160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:21:54.437 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.435+0000 7f9d91000640 1 -- 172.21.15.195:0/228235057 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d8c163ce0 con 0x7f9d8c0b8060 2024-04-25T19:21:54.438 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.436+0000 7f9d91000640 1 --2- 172.21.15.195:0/228235057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d8c0b8060 0x7f9d8c0d44a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9d780097d0 tx=0x7f9d7802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=882c1e44f040662b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:21:54.438 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.437+0000 7f9d8be00640 1 -- 172.21.15.195:0/228235057 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d78037070 con 0x7f9d8c0b8060 2024-04-25T19:21:54.438 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.437+0000 7f9d8be00640 1 -- 172.21.15.195:0/228235057 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d78032440 con 0x7f9d8c0b8060 2024-04-25T19:21:54.438 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.437+0000 7f9d8be00640 1 -- 172.21.15.195:0/228235057 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d78032810 con 0x7f9d8c0b8060 2024-04-25T19:21:54.439 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.438+0000 7f9d92e00640 1 -- 172.21.15.195:0/228235057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d8c0b8060 msgr2=0x7f9d8c0d44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:54.439 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.438+0000 7f9d92e00640 1 --2- 172.21.15.195:0/228235057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d8c0b8060 0x7f9d8c0d44a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9d780097d0 tx=0x7f9d7802a1c0 comp rx=0 tx=0).stop 2024-04-25T19:21:54.439 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.438+0000 7f9d92e00640 1 -- 172.21.15.195:0/228235057 shutdown_connections 2024-04-25T19:21:54.439 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.438+0000 7f9d92e00640 1 --2- 172.21.15.195:0/228235057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d8c0b8060 0x7f9d8c0d44a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:54.440 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.438+0000 7f9d92e00640 1 -- 172.21.15.195:0/228235057 >> 172.21.15.195:0/228235057 conn(0x7f9d8c0d2a10 msgr2=0x7f9d8c0d2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:21:54.440 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.438+0000 7f9d92e00640 1 -- 172.21.15.195:0/228235057 shutdown_connections 2024-04-25T19:21:54.440 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.438+0000 7f9d92e00640 1 -- 172.21.15.195:0/228235057 wait complete. 2024-04-25T19:21:54.442 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.441+0000 7f9d92e00640 1 Processor -- start 2024-04-25T19:21:54.442 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.441+0000 7f9d92e00640 1 -- start start 2024-04-25T19:21:54.444 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.443+0000 7f9d92e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d8c0d49e0 0x7f9d8c1f8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:54.444 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.443+0000 7f9d92e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d8c1647c0 0x7f9d8c0cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:54.445 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.443+0000 7f9d92e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d8c0cd250 0x7f9d8c14ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:54.445 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.443+0000 7f9d92e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9d8c164bd0 con 0x7f9d8c0cd250 2024-04-25T19:21:54.445 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.443+0000 7f9d92e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9d8c0d0b40 con 0x7f9d8c0d49e0 2024-04-25T19:21:54.445 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.443+0000 7f9d92e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9d8c0d4df0 con 0x7f9d8c1647c0 2024-04-25T19:21:54.445 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.443+0000 7f9d91a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d8c0d49e0 0x7f9d8c1f8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:54.445 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.443+0000 7f9d91000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d8c1647c0 0x7f9d8c0cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:54.445 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.443+0000 7f9d91000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d8c1647c0 0x7f9d8c0cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:39938/0 (socket says 172.21.15.195:39938) 2024-04-25T19:21:54.445 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.443+0000 7f9d91000640 1 -- 172.21.15.195:0/2105046959 learned_addr learned my addr 172.21.15.195:0/2105046959 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T19:21:54.445 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.443+0000 7f9d92400640 1 --2- 172.21.15.195:0/2105046959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d8c0cd250 0x7f9d8c14ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:54.445 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.443+0000 7f9d91a00640 1 -- 172.21.15.195:0/2105046959 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d8c1647c0 msgr2=0x7f9d8c0cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:54.445 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.443+0000 7f9d91a00640 1 --2- 172.21.15.195:0/2105046959 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d8c1647c0 0x7f9d8c0cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:54.445 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.443+0000 7f9d91a00640 1 -- 172.21.15.195:0/2105046959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d8c0cd250 msgr2=0x7f9d8c14ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:54.445 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.443+0000 7f9d91a00640 1 --2- 172.21.15.195:0/2105046959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d8c0cd250 0x7f9d8c14ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:54.446 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.443+0000 7f9d91a00640 1 -- 172.21.15.195:0/2105046959 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d8c14cfc0 con 0x7f9d8c0d49e0 2024-04-25T19:21:54.446 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.443+0000 7f9d91000640 1 --2- 172.21.15.195:0/2105046959 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d8c1647c0 0x7f9d8c0cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T19:21:54.447 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.444+0000 7f9d91a00640 1 --2- 172.21.15.195:0/2105046959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d8c0d49e0 0x7f9d8c1f8fd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000c390 tx=0x7f9d80001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:21:54.447 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.444+0000 7f9d89600640 1 -- 172.21.15.195:0/2105046959 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d80017070 con 0x7f9d8c0d49e0 2024-04-25T19:21:54.447 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.444+0000 7f9d89600640 1 -- 172.21.15.195:0/2105046959 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d80005ce0 con 0x7f9d8c0d49e0 2024-04-25T19:21:54.447 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.444+0000 7f9d89600640 1 -- 172.21.15.195:0/2105046959 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d800072f0 con 0x7f9d8c0d49e0 2024-04-25T19:21:54.447 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.444+0000 7f9d92e00640 1 -- 172.21.15.195:0/2105046959 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d8c14d2a0 con 0x7f9d8c0d49e0 2024-04-25T19:21:54.447 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.444+0000 7f9d92e00640 1 -- 172.21.15.195:0/2105046959 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d8c14d860 con 0x7f9d8c0d49e0 2024-04-25T19:21:54.448 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.445+0000 7f9d89600640 1 -- 172.21.15.195:0/2105046959 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9d8001a070 con 0x7f9d8c0d49e0 2024-04-25T19:21:54.448 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.445+0000 7f9d89600640 1 -- 172.21.15.195:0/2105046959 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f9d80007490 con 0x7f9d8c0d49e0 2024-04-25T19:21:54.448 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.445+0000 7f9d92e00640 1 -- 172.21.15.195:0/2105046959 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d8c076c60 con 0x7f9d8c0d49e0 2024-04-25T19:21:54.449 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.448+0000 7f9d89600640 1 -- 172.21.15.195:0/2105046959 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f9d80021020 con 0x7f9d8c0d49e0 2024-04-25T19:21:54.522 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.521+0000 7f9d92e00640 1 -- 172.21.15.195:0/2105046959 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8b363ae9-9f98-48c8-98ce-2eb085dc13c7", "id": 6} v 0) -- 0x7f9d8c0d3fc0 con 0x7f9d8c0d49e0 2024-04-25T19:21:54.528 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.527+0000 7f9d89600640 1 -- 172.21.15.195:0/2105046959 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8b363ae9-9f98-48c8-98ce-2eb085dc13c7", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f9d8001c440 con 0x7f9d8c0d49e0 2024-04-25T19:21:54.528 INFO:teuthology.orchestra.run.smithi195.stdout:6 2024-04-25T19:21:54.530 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.528+0000 7f9d92e00640 1 -- 172.21.15.195:0/2105046959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d8c0d49e0 msgr2=0x7f9d8c1f8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:54.530 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.528+0000 7f9d92e00640 1 --2- 172.21.15.195:0/2105046959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d8c0d49e0 0x7f9d8c1f8fd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000c390 tx=0x7f9d80001e70 comp rx=0 tx=0).stop 2024-04-25T19:21:54.530 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.529+0000 7f9d92e00640 1 -- 172.21.15.195:0/2105046959 shutdown_connections 2024-04-25T19:21:54.530 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.529+0000 7f9d92e00640 1 --2- 172.21.15.195:0/2105046959 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d8c1647c0 0x7f9d8c0cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:54.530 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.529+0000 7f9d92e00640 1 --2- 172.21.15.195:0/2105046959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d8c0cd250 0x7f9d8c14ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:54.530 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.529+0000 7f9d92e00640 1 --2- 172.21.15.195:0/2105046959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d8c0d49e0 0x7f9d8c1f8fd0 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000c390 tx=0x7f9d80001e70 comp rx=0 tx=0).stop 2024-04-25T19:21:54.530 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.529+0000 7f9d92e00640 1 -- 172.21.15.195:0/2105046959 >> 172.21.15.195:0/2105046959 conn(0x7f9d8c0d2a10 msgr2=0x7f9d8c0b7950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:21:54.530 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.529+0000 7f9d92e00640 1 -- 172.21.15.195:0/2105046959 shutdown_connections 2024-04-25T19:21:54.530 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.529+0000 7f9d92e00640 1 -- 172.21.15.195:0/2105046959 wait complete. 2024-04-25T19:21:54.554 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 646998b8-8951-4dad-9e5d-ff4e377cd149 7 2024-04-25T19:21:54.750 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-25T19:21:54.748+0000 7fa6bae0d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T19:21:54.763 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:54.762+0000 7fdf85c1b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T19:21:54.807 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-25T19:21:54.805+0000 7fa6bae0d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T19:21:54.822 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:54.821+0000 7fdf85c1b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T19:21:54.846 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.845+0000 7fb983200640 1 Processor -- start 2024-04-25T19:21:54.846 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.845+0000 7fb983200640 1 -- start start 2024-04-25T19:21:54.848 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.847+0000 7fb983200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb97c161a80 0x7fb97c161e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:54.848 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.847+0000 7fb983200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb97c0b6ba0 0x7fb97c0b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:54.848 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.847+0000 7fb983200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb97c144720 con 0x7fb97c144310 2024-04-25T19:21:54.848 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.847+0000 7fb983200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb97c06f640 con 0x7fb97c161a80 2024-04-25T19:21:54.849 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.847+0000 7fb983200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb97c1624d0 con 0x7fb97c0b6ba0 2024-04-25T19:21:54.849 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.847+0000 7fb981400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb97c161a80 0x7fb97c161e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:54.849 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.847+0000 7fb982800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb97c0b6ba0 0x7fb97c0b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:54.849 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.847+0000 7fb981e00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fb97c144310 0x7fb97c06fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:50822/0 (socket says 172.21.15.195:50822) 2024-04-25T19:21:54.849 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.847+0000 7fb981e00640 1 -- 172.21.15.195:0/3016331225 learned_addr learned my addr 172.21.15.195:0/3016331225 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-04-25T19:21:54.849 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.848+0000 7fb981400640 1 -- 172.21.15.195:0/3016331225 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb97c0b6ba0 msgr2=0x7fb97c0b6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:21:54.850 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.848+0000 7fb981400640 1 --2- 172.21.15.195:0/3016331225 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb97c0b6ba0 0x7fb97c0b6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:54.850 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.848+0000 7fb981400640 1 -- 172.21.15.195:0/3016331225 >> v1:172.21.15.195:6789/0 conn(0x7fb97c144310 legacy=0x7fb97c06fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:54.850 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.848+0000 7fb981400640 1 -- 172.21.15.195:0/3016331225 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb97c1627b0 con 0x7fb97c161a80 2024-04-25T19:21:54.850 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.848+0000 7fb982800640 1 --2- 172.21.15.195:0/3016331225 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb97c0b6ba0 0x7fb97c0b6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T19:21:54.850 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.848+0000 7fb980a00640 1 -- 172.21.15.195:0/3016331225 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2246229169 0 0) 0x7fb97c144720 con 0x7fb97c144310 2024-04-25T19:21:54.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.849+0000 7fb981400640 1 --2- 172.21.15.195:0/3016331225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb97c161a80 0x7fb97c161e90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0097a0 tx=0x7fb96c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=643f08e9bbc9bf11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:21:54.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.850+0000 7fb980a00640 1 -- 172.21.15.195:0/3016331225 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96c037070 con 0x7fb97c161a80 2024-04-25T19:21:54.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.850+0000 7fb980a00640 1 -- 172.21.15.195:0/3016331225 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb96c032440 con 0x7fb97c161a80 2024-04-25T19:21:54.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.850+0000 7fb980a00640 1 -- 172.21.15.195:0/3016331225 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96c032810 con 0x7fb97c161a80 2024-04-25T19:21:54.852 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.850+0000 7fb983200640 1 -- 172.21.15.195:0/3016331225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb97c161a80 msgr2=0x7fb97c161e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:54.852 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.850+0000 7fb983200640 1 --2- 172.21.15.195:0/3016331225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb97c161a80 0x7fb97c161e90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0097a0 tx=0x7fb96c02a180 comp rx=0 tx=0).stop 2024-04-25T19:21:54.852 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.851+0000 7fb983200640 1 -- 172.21.15.195:0/3016331225 shutdown_connections 2024-04-25T19:21:54.852 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.851+0000 7fb983200640 1 --2- 172.21.15.195:0/3016331225 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb97c0b6ba0 0x7fb97c0b6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:54.852 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.851+0000 7fb983200640 1 --2- 172.21.15.195:0/3016331225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb97c161a80 0x7fb97c161e90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:54.852 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.851+0000 7fb983200640 1 -- 172.21.15.195:0/3016331225 >> 172.21.15.195:0/3016331225 conn(0x7fb97c0b4260 msgr2=0x7fb97c072fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:21:54.852 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.851+0000 7fb983200640 1 -- 172.21.15.195:0/3016331225 shutdown_connections 2024-04-25T19:21:54.852 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.851+0000 7fb983200640 1 -- 172.21.15.195:0/3016331225 wait complete. 2024-04-25T19:21:54.854 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.853+0000 7fb983200640 1 Processor -- start 2024-04-25T19:21:54.854 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.853+0000 7fb983200640 1 -- start start 2024-04-25T19:21:54.857 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.854+0000 7fb983200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb97c144310 0x7fb97c1f6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:54.857 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.855+0000 7fb983200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb97c161a80 0x7fb97c0b5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:54.857 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.855+0000 7fb983200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb97c0b25f0 0x7fb97c0b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:54.857 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.855+0000 7fb983200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb97c1478d0 con 0x7fb97c0b25f0 2024-04-25T19:21:54.857 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.855+0000 7fb983200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb97c0b74f0 con 0x7fb97c161a80 2024-04-25T19:21:54.857 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.855+0000 7fb983200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb97c147a50 con 0x7fb97c144310 2024-04-25T19:21:54.857 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.855+0000 7fb981e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb97c144310 0x7fb97c1f6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:54.857 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.855+0000 7fb981400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb97c161a80 0x7fb97c0b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:54.857 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.855+0000 7fb981e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb97c144310 0x7fb97c1f6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:39966/0 (socket says 172.21.15.195:39966) 2024-04-25T19:21:54.858 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.855+0000 7fb981400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb97c161a80 0x7fb97c0b5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:56920/0 (socket says 172.21.15.195:56920) 2024-04-25T19:21:54.858 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.855+0000 7fb981e00640 1 -- 172.21.15.195:0/2245839264 learned_addr learned my addr 172.21.15.195:0/2245839264 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T19:21:54.858 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.855+0000 7fb981e00640 1 -- 172.21.15.195:0/2245839264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb97c161a80 msgr2=0x7fb97c0b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:54.858 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.855+0000 7fb981e00640 1 --2- 172.21.15.195:0/2245839264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb97c161a80 0x7fb97c0b5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:54.858 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.855+0000 7fb981e00640 1 -- 172.21.15.195:0/2245839264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb97c0b25f0 msgr2=0x7fb97c0b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:54.858 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.855+0000 7fb981e00640 1 --2- 172.21.15.195:0/2245839264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb97c0b25f0 0x7fb97c0b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:54.858 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.855+0000 7fb981e00640 1 -- 172.21.15.195:0/2245839264 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb97c0b2f40 con 0x7fb97c144310 2024-04-25T19:21:54.858 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.856+0000 7fb981e00640 1 --2- 172.21.15.195:0/2245839264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb97c144310 0x7fb97c1f6ed0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb97000c410 tx=0x7fb97000c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:21:54.858 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.856+0000 7fb976000640 1 -- 172.21.15.195:0/2245839264 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9700074e0 con 0x7fb97c144310 2024-04-25T19:21:54.858 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.856+0000 7fb976000640 1 -- 172.21.15.195:0/2245839264 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9700047e0 con 0x7fb97c144310 2024-04-25T19:21:54.858 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.856+0000 7fb976000640 1 -- 172.21.15.195:0/2245839264 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb970004bd0 con 0x7fb97c144310 2024-04-25T19:21:54.858 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.856+0000 7fb983200640 1 -- 172.21.15.195:0/2245839264 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb97c0b5e40 con 0x7fb97c144310 2024-04-25T19:21:54.858 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.856+0000 7fb983200640 1 -- 172.21.15.195:0/2245839264 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb97c1535d0 con 0x7fb97c144310 2024-04-25T19:21:54.859 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.856+0000 7fb976000640 1 -- 172.21.15.195:0/2245839264 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb970011070 con 0x7fb97c144310 2024-04-25T19:21:54.859 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.856+0000 7fb976000640 1 -- 172.21.15.195:0/2245839264 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fb970013a20 con 0x7fb97c144310 2024-04-25T19:21:54.859 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.857+0000 7fb983200640 1 -- 172.21.15.195:0/2245839264 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb97c1533c0 con 0x7fb97c144310 2024-04-25T19:21:54.860 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.860+0000 7fb976000640 1 -- 172.21.15.195:0/2245839264 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb97c0b2f40 con 0x7fb97c144310 2024-04-25T19:21:54.934 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.933+0000 7fb983200640 1 -- 172.21.15.195:0/2245839264 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd new", "uuid": "646998b8-8951-4dad-9e5d-ff4e377cd149", "id": 7} v 0) -- 0x7fb97c076c60 con 0x7fb97c144310 2024-04-25T19:21:54.941 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.940+0000 7fb976000640 1 -- 172.21.15.195:0/2245839264 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "646998b8-8951-4dad-9e5d-ff4e377cd149", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fb970004d70 con 0x7fb97c144310 2024-04-25T19:21:54.941 INFO:teuthology.orchestra.run.smithi195.stdout:7 2024-04-25T19:21:54.943 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.942+0000 7fb983200640 1 -- 172.21.15.195:0/2245839264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb97c144310 msgr2=0x7fb97c1f6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:54.943 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.942+0000 7fb983200640 1 --2- 172.21.15.195:0/2245839264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb97c144310 0x7fb97c1f6ed0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb97000c410 tx=0x7fb97000c8d0 comp rx=0 tx=0).stop 2024-04-25T19:21:54.943 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.942+0000 7fb983200640 1 -- 172.21.15.195:0/2245839264 shutdown_connections 2024-04-25T19:21:54.943 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.942+0000 7fb983200640 1 --2- 172.21.15.195:0/2245839264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb97c0b25f0 0x7fb97c0b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:54.943 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.942+0000 7fb983200640 1 --2- 172.21.15.195:0/2245839264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb97c161a80 0x7fb97c0b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:54.944 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.942+0000 7fb983200640 1 --2- 172.21.15.195:0/2245839264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb97c144310 0x7fb97c1f6ed0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:54.944 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.942+0000 7fb983200640 1 -- 172.21.15.195:0/2245839264 >> 172.21.15.195:0/2245839264 conn(0x7fb97c0b6ba0 msgr2=0x7fb97c0b4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:21:54.944 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.942+0000 7fb983200640 1 -- 172.21.15.195:0/2245839264 shutdown_connections 2024-04-25T19:21:54.944 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:21:54.942+0000 7fb983200640 1 -- 172.21.15.195:0/2245839264 wait complete. 2024-04-25T19:21:54.969 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T19:21:54.969 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T19:21:54.977 INFO:tasks.ceph.osd.0:Started 2024-04-25T19:21:54.977 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T19:21:54.977 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T19:21:54.986 INFO:tasks.ceph.osd.1:Started 2024-04-25T19:21:54.986 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T19:21:54.986 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T19:21:54.991 INFO:tasks.ceph.osd.2:Started 2024-04-25T19:21:54.991 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T19:21:54.992 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T19:21:54.992 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-25T19:21:54.990+0000 7fa6bae0d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T19:21:54.996 INFO:tasks.ceph.osd.3:Started 2024-04-25T19:21:54.996 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T19:21:54.997 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T19:21:55.004 INFO:tasks.ceph.osd.4:Started 2024-04-25T19:21:55.005 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T19:21:55.005 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T19:21:55.010 INFO:tasks.ceph.osd.5:Started 2024-04-25T19:21:55.011 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T19:21:55.011 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T19:21:55.015 INFO:tasks.ceph.osd.6:Started 2024-04-25T19:21:55.015 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T19:21:55.015 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T19:21:55.016 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:55.011+0000 7fdf85c1b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T19:21:55.021 INFO:tasks.ceph.osd.7:Started 2024-04-25T19:21:55.021 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:21:55.220 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-25T19:21:55.218+0000 7fa6bae0d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T19:21:55.228 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:55.227+0000 7fdf85c1b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T19:21:55.287 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-25T19:21:55.285+0000 7fa6bae0d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T19:21:55.292 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:55.292+0000 7fdf85c1b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T19:21:55.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.335+0000 7f4ea7200640 1 Processor -- start 2024-04-25T19:21:55.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.335+0000 7f4ea7200640 1 -- start start 2024-04-25T19:21:55.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.337+0000 7f4ea7200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4ea80b4ff0 0x7f4ea81611e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:55.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.337+0000 7f4ea7200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4ea808cd60 0x7f4ea808d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:55.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.337+0000 7f4ea7200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ea8161720 con 0x7f4ea8163d20 2024-04-25T19:21:55.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.337+0000 7f4ea7200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f4ea806e9d0 con 0x7f4ea80b4ff0 2024-04-25T19:21:55.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.337+0000 7f4ea7200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4ea808d6b0 con 0x7f4ea808cd60 2024-04-25T19:21:55.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.337+0000 7f4ea5e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4ea80b4ff0 0x7f4ea81611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:55.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.337+0000 7f4ea5e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4ea80b4ff0 0x7f4ea81611e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39412/0 (socket says 172.21.15.131:39412) 2024-04-25T19:21:55.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.337+0000 7f4ea5e00640 1 -- 172.21.15.131:0/1643143688 learned_addr learned my addr 172.21.15.131:0/1643143688 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:21:55.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.337+0000 7f4e9fe00640 1 --2- 172.21.15.131:0/1643143688 >> v2:172.21.15.195:3300/0 conn(0x7f4ea808cd60 0x7f4ea808d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:55.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.338+0000 7f4ea5e00640 1 -- 172.21.15.131:0/1643143688 >> v2:172.21.15.195:3300/0 conn(0x7f4ea808cd60 msgr2=0x7f4ea808d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:21:55.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.338+0000 7f4ea5e00640 1 --2- 172.21.15.131:0/1643143688 >> v2:172.21.15.195:3300/0 conn(0x7f4ea808cd60 0x7f4ea808d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:55.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.338+0000 7f4ea5e00640 1 -- 172.21.15.131:0/1643143688 >> v1:172.21.15.131:6789/0 conn(0x7f4ea8163d20 legacy=0x7f4ea8164130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:55.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.338+0000 7f4ea5e00640 1 -- 172.21.15.131:0/1643143688 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea806ddc0 con 0x7f4ea80b4ff0 2024-04-25T19:21:55.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.339+0000 7f4ea5e00640 1 --2- 172.21.15.131:0/1643143688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ea80b4ff0 0x7f4ea81611e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4e98009850 tx=0x7f4e9802a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72bcb61bbbbeb608 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:21:55.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.339+0000 7f4ea5400640 1 -- 172.21.15.131:0/1643143688 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e98004030 con 0x7f4ea80b4ff0 2024-04-25T19:21:55.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.339+0000 7f4ea5400640 1 -- 172.21.15.131:0/1643143688 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e980041d0 con 0x7f4ea80b4ff0 2024-04-25T19:21:55.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.339+0000 7f4ea5400640 1 -- 172.21.15.131:0/1643143688 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e98003610 con 0x7f4ea80b4ff0 2024-04-25T19:21:55.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.340+0000 7f4ea7200640 1 -- 172.21.15.131:0/1643143688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ea80b4ff0 msgr2=0x7f4ea81611e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:55.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.340+0000 7f4ea7200640 1 --2- 172.21.15.131:0/1643143688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ea80b4ff0 0x7f4ea81611e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4e98009850 tx=0x7f4e9802a1f0 comp rx=0 tx=0).stop 2024-04-25T19:21:55.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.340+0000 7f4ea7200640 1 -- 172.21.15.131:0/1643143688 shutdown_connections 2024-04-25T19:21:55.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.340+0000 7f4ea7200640 1 --2- 172.21.15.131:0/1643143688 >> v2:172.21.15.195:3300/0 conn(0x7f4ea808cd60 0x7f4ea808d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:55.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.340+0000 7f4ea7200640 1 --2- 172.21.15.131:0/1643143688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ea80b4ff0 0x7f4ea81611e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:55.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.340+0000 7f4ea7200640 1 -- 172.21.15.131:0/1643143688 >> 172.21.15.131:0/1643143688 conn(0x7f4ea80b5460 msgr2=0x7f4ea80b5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:21:55.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.340+0000 7f4ea7200640 1 -- 172.21.15.131:0/1643143688 shutdown_connections 2024-04-25T19:21:55.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.340+0000 7f4ea7200640 1 -- 172.21.15.131:0/1643143688 wait complete. 2024-04-25T19:21:55.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.342+0000 7f4ea7200640 1 Processor -- start 2024-04-25T19:21:55.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.342+0000 7f4ea7200640 1 -- start start 2024-04-25T19:21:55.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.344+0000 7f4ea7200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ea808cd60 0x7f4ea8147070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:55.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.344+0000 7f4ea7200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ea80b4ff0 0x7f4ea8162950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:55.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.344+0000 7f4ea7200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ea8163d20 0x7f4ea8162e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:55.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.344+0000 7f4ea7200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea806e660 con 0x7f4ea808cd60 2024-04-25T19:21:55.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.344+0000 7f4ea7200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea806e380 con 0x7f4ea80b4ff0 2024-04-25T19:21:55.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.344+0000 7f4ea7200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4ea80b9180 con 0x7f4ea8163d20 2024-04-25T19:21:55.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.344+0000 7f4ea5e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ea808cd60 0x7f4ea8147070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:55.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.344+0000 7f4ea5e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ea808cd60 0x7f4ea8147070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39422/0 (socket says 172.21.15.131:39422) 2024-04-25T19:21:55.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.344+0000 7f4ea5e00640 1 -- 172.21.15.131:0/2160258053 learned_addr learned my addr 172.21.15.131:0/2160258053 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:21:55.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.344+0000 7f4e9fe00640 1 --2- 172.21.15.131:0/2160258053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ea80b4ff0 0x7f4ea8162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:55.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.344+0000 7f4ea6800640 1 --2- 172.21.15.131:0/2160258053 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ea8163d20 0x7f4ea8162e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:55.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.344+0000 7f4ea5e00640 1 -- 172.21.15.131:0/2160258053 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ea8163d20 msgr2=0x7f4ea8162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:55.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.344+0000 7f4ea5e00640 1 --2- 172.21.15.131:0/2160258053 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ea8163d20 0x7f4ea8162e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:55.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.345+0000 7f4ea5e00640 1 -- 172.21.15.131:0/2160258053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ea80b4ff0 msgr2=0x7f4ea8162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:55.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.345+0000 7f4ea5e00640 1 --2- 172.21.15.131:0/2160258053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ea80b4ff0 0x7f4ea8162950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:55.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.345+0000 7f4ea5e00640 1 -- 172.21.15.131:0/2160258053 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea8147d40 con 0x7f4ea808cd60 2024-04-25T19:21:55.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.345+0000 7f4ea5e00640 1 --2- 172.21.15.131:0/2160258053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ea808cd60 0x7f4ea8147070 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4e9802a230 tx=0x7f4e980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:21:55.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.345+0000 7f4e9e000640 1 -- 172.21.15.131:0/2160258053 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e98041020 con 0x7f4ea808cd60 2024-04-25T19:21:55.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.345+0000 7f4e9e000640 1 -- 172.21.15.131:0/2160258053 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e98003c50 con 0x7f4ea808cd60 2024-04-25T19:21:55.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.345+0000 7f4e9e000640 1 -- 172.21.15.131:0/2160258053 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e98004030 con 0x7f4ea808cd60 2024-04-25T19:21:55.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.345+0000 7f4ea7200640 1 -- 172.21.15.131:0/2160258053 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ea8148020 con 0x7f4ea808cd60 2024-04-25T19:21:55.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.345+0000 7f4ea7200640 1 -- 172.21.15.131:0/2160258053 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ea815b1e0 con 0x7f4ea808cd60 2024-04-25T19:21:55.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.346+0000 7f4e9e000640 1 -- 172.21.15.131:0/2160258053 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4e98044020 con 0x7f4ea808cd60 2024-04-25T19:21:55.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.346+0000 7f4e9e000640 1 -- 172.21.15.131:0/2160258053 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f4e9803cb20 con 0x7f4ea808cd60 2024-04-25T19:21:55.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.346+0000 7f4ea7200640 1 -- 172.21.15.131:0/2160258053 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ea8050740 con 0x7f4ea808cd60 2024-04-25T19:21:55.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.349+0000 7f4e9e000640 1 -- 172.21.15.131:0/2160258053 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f4e9804b030 con 0x7f4ea808cd60 2024-04-25T19:21:55.377 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-25T19:21:55.375+0000 7fa6bae0d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T19:21:55.378 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:55.377+0000 7fdf85c1b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T19:21:55.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.413+0000 7f4ea7200640 1 -- 172.21.15.131:0/2160258053 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4ea80b6130 con 0x7f4ea808cd60 2024-04-25T19:21:55.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.414+0000 7f4e9e000640 1 -- 172.21.15.131:0/2160258053 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f4e9803ce00 con 0x7f4ea808cd60 2024-04-25T19:21:55.415 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:21:55.416 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":10,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:21:54.936103+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:21:55.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.415+0000 7f4ea7200640 1 -- 172.21.15.131:0/2160258053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ea808cd60 msgr2=0x7f4ea8147070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:55.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.415+0000 7f4ea7200640 1 --2- 172.21.15.131:0/2160258053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ea808cd60 0x7f4ea8147070 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4e9802a230 tx=0x7f4e980046c0 comp rx=0 tx=0).stop 2024-04-25T19:21:55.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.415+0000 7f4ea7200640 1 -- 172.21.15.131:0/2160258053 shutdown_connections 2024-04-25T19:21:55.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.415+0000 7f4ea7200640 1 --2- 172.21.15.131:0/2160258053 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ea8163d20 0x7f4ea8162e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:55.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.415+0000 7f4ea7200640 1 --2- 172.21.15.131:0/2160258053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ea80b4ff0 0x7f4ea8162950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:55.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.415+0000 7f4ea7200640 1 --2- 172.21.15.131:0/2160258053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ea808cd60 0x7f4ea8147070 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:55.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.415+0000 7f4ea7200640 1 -- 172.21.15.131:0/2160258053 >> 172.21.15.131:0/2160258053 conn(0x7f4ea80b5460 msgr2=0x7f4ea80d2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:21:55.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.415+0000 7f4ea7200640 1 -- 172.21.15.131:0/2160258053 shutdown_connections 2024-04-25T19:21:55.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:21:55.415+0000 7f4ea7200640 1 -- 172.21.15.131:0/2160258053 wait complete. 2024-04-25T19:21:55.431 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:55.430+0000 7fdf85c1b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T19:21:55.432 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-25T19:21:55.431+0000 7fa6bae0d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T19:21:55.437 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T19:21:55.438 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T19:21:55.759 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-04-25T19:21:55.757+0000 7faa2cd4c640 -1 Falling back to public interface 2024-04-25T19:21:55.762 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-04-25T19:21:55.761+0000 7f2406215640 -1 Falling back to public interface 2024-04-25T19:21:55.766 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-04-25T19:21:55.765+0000 7fb318cb5640 -1 Falling back to public interface 2024-04-25T19:21:55.788 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-04-25T19:21:55.786+0000 7f3796617640 -1 Falling back to public interface 2024-04-25T19:21:55.801 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-04-25T19:21:55.800+0000 7fce29b1d640 -1 Falling back to public interface 2024-04-25T19:21:55.816 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-04-25T19:21:55.815+0000 7f5819084640 -1 Falling back to public interface 2024-04-25T19:21:55.821 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-04-25T19:21:55.820+0000 7f271fa18640 -1 Falling back to public interface 2024-04-25T19:21:55.844 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-04-25T19:21:55.843+0000 7f256c416640 -1 Falling back to public interface 2024-04-25T19:21:55.979 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:55.978+0000 7fdf85c1b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T19:21:55.984 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-25T19:21:55.982+0000 7fa6bae0d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T19:21:56.113 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:56.112+0000 7fdf85c1b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T19:21:56.118 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-25T19:21:56.117+0000 7fa6bae0d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T19:21:56.243 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T19:21:56.488 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.486+0000 7fab07c00640 1 Processor -- start 2024-04-25T19:21:56.489 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.487+0000 7fab07c00640 1 -- start start 2024-04-25T19:21:56.491 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.488+0000 7fab07c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fab000b67d0 0x7fab00073a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:56.491 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.488+0000 7fab07c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fab00073f40 0x7fab00166370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:56.491 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.488+0000 7fab07c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab00074350 con 0x7fab000b58b0 2024-04-25T19:21:56.491 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.488+0000 7fab07c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fab000b6ed0 con 0x7fab000b67d0 2024-04-25T19:21:56.491 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.488+0000 7fab07c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fab000b4af0 con 0x7fab00073f40 2024-04-25T19:21:56.491 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.489+0000 7faaf7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fab000b67d0 0x7fab00073a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:56.492 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.489+0000 7faaf7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fab000b67d0 0x7fab00073a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39434/0 (socket says 172.21.15.131:39434) 2024-04-25T19:21:56.492 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.489+0000 7faaf7e00640 1 -- 172.21.15.131:0/3486890962 learned_addr learned my addr 172.21.15.131:0/3486890962 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:21:56.492 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.489+0000 7fab05c00640 1 --2- 172.21.15.131:0/3486890962 >> v2:172.21.15.195:3300/0 conn(0x7fab00073f40 0x7fab00166370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:56.492 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.489+0000 7faaf7e00640 1 -- 172.21.15.131:0/3486890962 >> v2:172.21.15.195:3300/0 conn(0x7fab00073f40 msgr2=0x7fab00166370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:21:56.492 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.489+0000 7faaf7e00640 1 --2- 172.21.15.131:0/3486890962 >> v2:172.21.15.195:3300/0 conn(0x7fab00073f40 0x7fab00166370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:56.492 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.489+0000 7faaf7e00640 1 -- 172.21.15.131:0/3486890962 >> v1:172.21.15.195:6789/0 conn(0x7fab000b58b0 legacy=0x7fab0006f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:21:56.492 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.489+0000 7faaf7e00640 1 -- 172.21.15.131:0/3486890962 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab000b4dd0 con 0x7fab000b67d0 2024-04-25T19:21:56.492 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.489+0000 7fab05c00640 1 --2- 172.21.15.131:0/3486890962 >> v2:172.21.15.195:3300/0 conn(0x7fab00073f40 0x7fab00166370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:21:56.493 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.490+0000 7faaf7e00640 1 --2- 172.21.15.131:0/3486890962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab000b67d0 0x7fab00073a00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fab000b6320 tx=0x7faae802c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346cc3774f77601e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:21:56.493 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.490+0000 7faaffe00640 1 -- 172.21.15.131:0/3486890962 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae8039070 con 0x7fab000b67d0 2024-04-25T19:21:56.493 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.490+0000 7faaffe00640 1 -- 172.21.15.131:0/3486890962 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faae8034640 con 0x7fab000b67d0 2024-04-25T19:21:56.494 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.490+0000 7faaffe00640 1 -- 172.21.15.131:0/3486890962 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae8034a10 con 0x7fab000b67d0 2024-04-25T19:21:56.494 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.491+0000 7fab07c00640 1 -- 172.21.15.131:0/3486890962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab000b67d0 msgr2=0x7fab00073a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:56.494 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.491+0000 7fab07c00640 1 --2- 172.21.15.131:0/3486890962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab000b67d0 0x7fab00073a00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fab000b6320 tx=0x7faae802c3d0 comp rx=0 tx=0).stop 2024-04-25T19:21:56.494 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.491+0000 7fab07c00640 1 -- 172.21.15.131:0/3486890962 shutdown_connections 2024-04-25T19:21:56.494 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.491+0000 7fab07c00640 1 --2- 172.21.15.131:0/3486890962 >> v2:172.21.15.195:3300/0 conn(0x7fab00073f40 0x7fab00166370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:56.494 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.491+0000 7fab07c00640 1 --2- 172.21.15.131:0/3486890962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab000b67d0 0x7fab00073a00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:56.494 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.491+0000 7fab07c00640 1 -- 172.21.15.131:0/3486890962 >> 172.21.15.131:0/3486890962 conn(0x7fab0006cfe0 msgr2=0x7fab000b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:21:56.494 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.491+0000 7fab07c00640 1 -- 172.21.15.131:0/3486890962 shutdown_connections 2024-04-25T19:21:56.494 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.491+0000 7fab07c00640 1 -- 172.21.15.131:0/3486890962 wait complete. 2024-04-25T19:21:56.495 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.494+0000 7fab07c00640 1 Processor -- start 2024-04-25T19:21:56.495 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.494+0000 7fab07c00640 1 -- start start 2024-04-25T19:21:56.499 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.496+0000 7fab07c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab00073f40 0x7fab0015f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:56.499 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.496+0000 7fab07c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab000b58b0 0x7fab0014f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:56.499 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.496+0000 7fab07c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab000b67d0 0x7fab001e6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:21:56.499 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.496+0000 7fab07c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fab000b6be0 con 0x7fab000b67d0 2024-04-25T19:21:56.499 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.496+0000 7fab07c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fab000b5390 con 0x7fab00073f40 2024-04-25T19:21:56.499 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.496+0000 7fab07c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fab0015c9d0 con 0x7fab000b58b0 2024-04-25T19:21:56.499 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.496+0000 7fab05c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab000b67d0 0x7fab001e6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:56.499 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.496+0000 7fab05c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab000b67d0 0x7fab001e6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39442/0 (socket says 172.21.15.131:39442) 2024-04-25T19:21:56.500 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.496+0000 7fab05c00640 1 -- 172.21.15.131:0/1546324006 learned_addr learned my addr 172.21.15.131:0/1546324006 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:21:56.500 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.496+0000 7fab05200640 1 --2- 172.21.15.131:0/1546324006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab00073f40 0x7fab0015f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:56.500 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.497+0000 7faaf7e00640 1 --2- 172.21.15.131:0/1546324006 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab000b58b0 0x7fab0014f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:21:56.500 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.497+0000 7fab05c00640 1 -- 172.21.15.131:0/1546324006 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab000b58b0 msgr2=0x7fab0014f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:56.500 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.497+0000 7fab05c00640 1 --2- 172.21.15.131:0/1546324006 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab000b58b0 0x7fab0014f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:56.500 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.497+0000 7fab05c00640 1 -- 172.21.15.131:0/1546324006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab00073f40 msgr2=0x7fab0015f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:56.500 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.497+0000 7fab05c00640 1 --2- 172.21.15.131:0/1546324006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab00073f40 0x7fab0015f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:56.500 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.497+0000 7fab05c00640 1 -- 172.21.15.131:0/1546324006 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab0015fee0 con 0x7fab000b67d0 2024-04-25T19:21:56.500 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.497+0000 7fab05c00640 1 --2- 172.21.15.131:0/1546324006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab000b67d0 0x7fab001e6830 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faaf800cd80 tx=0x7faaf800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:21:56.500 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.497+0000 7faafd600640 1 -- 172.21.15.131:0/1546324006 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf800f680 con 0x7fab000b67d0 2024-04-25T19:21:56.500 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.497+0000 7faafd600640 1 -- 172.21.15.131:0/1546324006 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf800f840 con 0x7fab000b67d0 2024-04-25T19:21:56.500 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.497+0000 7faafd600640 1 -- 172.21.15.131:0/1546324006 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf800fc30 con 0x7fab000b67d0 2024-04-25T19:21:56.500 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.497+0000 7fab07c00640 1 -- 172.21.15.131:0/1546324006 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab000ce5c0 con 0x7fab000b67d0 2024-04-25T19:21:56.500 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.497+0000 7fab07c00640 1 -- 172.21.15.131:0/1546324006 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab000ceb80 con 0x7fab000b67d0 2024-04-25T19:21:56.501 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.499+0000 7faafd600640 1 -- 172.21.15.131:0/1546324006 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 2) ==== 48416+0+0 (secure 0 0 0) 0x7faaf800e3e0 con 0x7fab000b67d0 2024-04-25T19:21:56.501 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.499+0000 7fab07c00640 1 -- 172.21.15.131:0/1546324006 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab000ce330 con 0x7fab000b67d0 2024-04-25T19:21:56.501 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.499+0000 7faafd600640 1 -- 172.21.15.131:0/1546324006 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7faaf8050360 con 0x7fab000b67d0 2024-04-25T19:21:56.503 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.501+0000 7faafd600640 1 -- 172.21.15.131:0/1546324006 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7faaf8014030 con 0x7fab000b67d0 2024-04-25T19:21:56.570 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.568+0000 7fab07c00640 1 -- 172.21.15.131:0/1546324006 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fab00158160 con 0x7fab000b67d0 2024-04-25T19:21:56.570 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.569+0000 7faafd600640 1 -- 172.21.15.131:0/1546324006 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fab00158160 con 0x7fab000b67d0 2024-04-25T19:21:56.571 INFO:teuthology.misc.health.smithi131.stdout: 2024-04-25T19:21:56.571 INFO:teuthology.misc.health.smithi131.stdout:{"epoch":10,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:21:54.936103+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:21:56.572 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.570+0000 7fab07c00640 1 -- 172.21.15.131:0/1546324006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab000b67d0 msgr2=0x7fab001e6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:21:56.572 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.570+0000 7fab07c00640 1 --2- 172.21.15.131:0/1546324006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab000b67d0 0x7fab001e6830 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faaf800cd80 tx=0x7faaf800a650 comp rx=0 tx=0).stop 2024-04-25T19:21:56.572 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.570+0000 7fab07c00640 1 -- 172.21.15.131:0/1546324006 shutdown_connections 2024-04-25T19:21:56.572 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.570+0000 7fab07c00640 1 --2- 172.21.15.131:0/1546324006 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab000b58b0 0x7fab0014f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:56.572 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.570+0000 7fab07c00640 1 --2- 172.21.15.131:0/1546324006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab000b67d0 0x7fab001e6830 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:56.572 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.570+0000 7fab07c00640 1 --2- 172.21.15.131:0/1546324006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab00073f40 0x7fab0015f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:21:56.572 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.570+0000 7fab07c00640 1 -- 172.21.15.131:0/1546324006 >> 172.21.15.131:0/1546324006 conn(0x7fab0006cfe0 msgr2=0x7fab00159260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:21:56.573 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.570+0000 7fab07c00640 1 -- 172.21.15.131:0/1546324006 shutdown_connections 2024-04-25T19:21:56.573 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:21:56.570+0000 7fab07c00640 1 -- 172.21.15.131:0/1546324006 wait complete. 2024-04-25T19:21:56.591 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T19:21:57.150 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:57.149+0000 7fdf25600640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T19:21:57.159 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T19:21:57.158+0000 7fdf25600640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T19:21:59.218 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-04-25T19:21:59.217+0000 7f271fa18640 -1 osd.0 0 log_to_monitors true 2024-04-25T19:21:59.221 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-04-25T19:21:59.220+0000 7f5819084640 -1 osd.3 0 log_to_monitors true 2024-04-25T19:21:59.304 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-04-25T19:21:59.302+0000 7faa2cd4c640 -1 osd.2 0 log_to_monitors true 2024-04-25T19:21:59.327 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-04-25T19:21:59.326+0000 7f2406215640 -1 osd.4 0 log_to_monitors true 2024-04-25T19:21:59.423 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-04-25T19:21:59.422+0000 7f3796617640 -1 osd.1 0 log_to_monitors true 2024-04-25T19:21:59.483 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-04-25T19:21:59.482+0000 7f256c416640 -1 osd.5 0 log_to_monitors true 2024-04-25T19:21:59.664 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-04-25T19:21:59.663+0000 7fb318cb5640 -1 osd.7 0 log_to_monitors true 2024-04-25T19:21:59.679 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-04-25T19:21:59.678+0000 7fce29b1d640 -1 osd.6 0 log_to_monitors true 2024-04-25T19:22:02.898 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-04-25T19:22:02.897+0000 7f2566c00640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T19:22:02.912 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-04-25T19:22:02.908+0000 7f255cc00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T19:22:02.913 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-04-25T19:22:02.909+0000 7fb313c00640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T19:22:02.919 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-04-25T19:22:02.916+0000 7fb309c00640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T19:22:02.927 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-04-25T19:22:02.926+0000 7f2400a00640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T19:22:02.935 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-04-25T19:22:02.934+0000 7fce24a00640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T19:22:02.935 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-04-25T19:22:02.934+0000 7f23f6a00640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T19:22:02.944 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-04-25T19:22:02.943+0000 7fce1aa00640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T19:22:03.398 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T19:22:03.464 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-04-25T19:22:03.462+0000 7f271a200640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T19:22:03.470 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-04-25T19:22:03.468+0000 7f2710200640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T19:22:03.470 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-04-25T19:22:03.467+0000 7faa28600640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T19:22:03.479 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-04-25T19:22:03.477+0000 7faa1dc00640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T19:22:03.499 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-04-25T19:22:03.497+0000 7f5814000640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T19:22:03.509 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-04-25T19:22:03.507+0000 7f580a000640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T19:22:03.575 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-04-25T19:22:03.573+0000 7f3791a00640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T19:22:03.589 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-04-25T19:22:03.587+0000 7f3787000640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T19:22:03.660 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.659+0000 7fb00be00640 1 Processor -- start 2024-04-25T19:22:03.661 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.659+0000 7fb00be00640 1 -- start start 2024-04-25T19:22:03.663 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.661+0000 7fb00be00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb00c160140 0x7fb00c0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:03.663 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.661+0000 7fb00be00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb00c163c50 0x7fb00c164060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:03.663 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.661+0000 7fb00be00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb00c06fa10 con 0x7fb00c1645a0 2024-04-25T19:22:03.663 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.661+0000 7fb00be00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb00c160550 con 0x7fb00c160140 2024-04-25T19:22:03.663 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.661+0000 7fb00be00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb00c0aee70 con 0x7fb00c163c50 2024-04-25T19:22:03.664 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.662+0000 7fb00aa00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb00c160140 0x7fb00c0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:03.664 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.662+0000 7fb002000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb00c163c50 0x7fb00c164060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:03.664 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.662+0000 7fb00aa00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb00c160140 0x7fb00c0ae640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.131:53488/0 (socket says 172.21.15.131:53488) 2024-04-25T19:22:03.664 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.662+0000 7fb00aa00640 1 -- 172.21.15.131:0/702125864 learned_addr learned my addr 172.21.15.131:0/702125864 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:03.664 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.662+0000 7fb002000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb00c163c50 0x7fb00c164060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.131:47666/0 (socket says 172.21.15.131:47666) 2024-04-25T19:22:03.665 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.662+0000 7fb002000640 1 -- 172.21.15.131:0/702125864 >> v2:172.21.15.195:3300/0 conn(0x7fb00c160140 msgr2=0x7fb00c0ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:03.665 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.663+0000 7fb002000640 1 --2- 172.21.15.131:0/702125864 >> v2:172.21.15.195:3300/0 conn(0x7fb00c160140 0x7fb00c0ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:03.665 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.663+0000 7fb002000640 1 -- 172.21.15.131:0/702125864 >> v1:172.21.15.195:6789/0 conn(0x7fb00c1645a0 legacy=0x7fb00c0b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:03.665 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.663+0000 7fb002000640 1 -- 172.21.15.131:0/702125864 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb00c06fcf0 con 0x7fb00c163c50 2024-04-25T19:22:03.665 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.663+0000 7fb00aa00640 1 --2- 172.21.15.131:0/702125864 >> v2:172.21.15.195:3300/0 conn(0x7fb00c160140 0x7fb00c0ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T19:22:03.665 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.664+0000 7fb002000640 1 --2- 172.21.15.131:0/702125864 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb00c163c50 0x7fb00c164060 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faff40097a0 tx=0x7faff402a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ded633d886767ccb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:03.666 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.664+0000 7fb00a000640 1 -- 172.21.15.131:0/702125864 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff4037070 con 0x7fb00c163c50 2024-04-25T19:22:03.666 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.664+0000 7fb00a000640 1 -- 172.21.15.131:0/702125864 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff402adb0 con 0x7fb00c163c50 2024-04-25T19:22:03.666 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.664+0000 7fb00a000640 1 -- 172.21.15.131:0/702125864 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff4032660 con 0x7fb00c163c50 2024-04-25T19:22:03.667 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.665+0000 7fb00be00640 1 -- 172.21.15.131:0/702125864 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb00c163c50 msgr2=0x7fb00c164060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:03.667 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.665+0000 7fb00be00640 1 --2- 172.21.15.131:0/702125864 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb00c163c50 0x7fb00c164060 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faff40097a0 tx=0x7faff402a060 comp rx=0 tx=0).stop 2024-04-25T19:22:03.667 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.665+0000 7fb00be00640 1 -- 172.21.15.131:0/702125864 shutdown_connections 2024-04-25T19:22:03.667 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.665+0000 7fb00be00640 1 --2- 172.21.15.131:0/702125864 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb00c163c50 0x7fb00c164060 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:03.667 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.665+0000 7fb00be00640 1 --2- 172.21.15.131:0/702125864 >> v2:172.21.15.195:3300/0 conn(0x7fb00c160140 0x7fb00c0ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:03.667 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.665+0000 7fb00be00640 1 -- 172.21.15.131:0/702125864 >> 172.21.15.131:0/702125864 conn(0x7fb00c0b3520 msgr2=0x7fb00c0b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:03.667 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.665+0000 7fb00be00640 1 -- 172.21.15.131:0/702125864 shutdown_connections 2024-04-25T19:22:03.668 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.665+0000 7fb00be00640 1 -- 172.21.15.131:0/702125864 wait complete. 2024-04-25T19:22:03.669 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.668+0000 7fb00be00640 1 Processor -- start 2024-04-25T19:22:03.669 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.668+0000 7fb00be00640 1 -- start start 2024-04-25T19:22:03.672 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.669+0000 7fb00be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb00c160140 0x7fb00c0b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:03.672 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.669+0000 7fb00be00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb00c163c50 0x7fb00c1566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:03.672 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.669+0000 7fb00be00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb00c1645a0 0x7fb00c146110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:03.672 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.669+0000 7fb00be00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb00c0b5da0 con 0x7fb00c160140 2024-04-25T19:22:03.672 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.669+0000 7fb00be00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb00c070340 con 0x7fb00c163c50 2024-04-25T19:22:03.672 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.669+0000 7fb00be00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb00c0aeb80 con 0x7fb00c1645a0 2024-04-25T19:22:03.672 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.670+0000 7fb00aa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb00c160140 0x7fb00c0b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:03.673 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.670+0000 7fb00aa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb00c160140 0x7fb00c0b1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40426/0 (socket says 172.21.15.131:40426) 2024-04-25T19:22:03.673 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.670+0000 7fb00aa00640 1 -- 172.21.15.131:0/4193903185 learned_addr learned my addr 172.21.15.131:0/4193903185 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:03.673 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.670+0000 7fb00b400640 1 --2- 172.21.15.131:0/4193903185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb00c1645a0 0x7fb00c146110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:03.673 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.670+0000 7fb002000640 1 --2- 172.21.15.131:0/4193903185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb00c163c50 0x7fb00c1566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:03.673 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.670+0000 7fb00aa00640 1 -- 172.21.15.131:0/4193903185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb00c1645a0 msgr2=0x7fb00c146110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:03.673 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.670+0000 7fb00aa00640 1 --2- 172.21.15.131:0/4193903185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb00c1645a0 0x7fb00c146110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:03.673 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.670+0000 7fb00aa00640 1 -- 172.21.15.131:0/4193903185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb00c163c50 msgr2=0x7fb00c1566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:03.673 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.670+0000 7fb00aa00640 1 --2- 172.21.15.131:0/4193903185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb00c163c50 0x7fb00c1566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:03.673 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.670+0000 7fb00aa00640 1 -- 172.21.15.131:0/4193903185 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb00c0b0a80 con 0x7fb00c160140 2024-04-25T19:22:03.673 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.671+0000 7fb00aa00640 1 --2- 172.21.15.131:0/4193903185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb00c160140 0x7fb00c0b1b20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faffc00e930 tx=0x7faffc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:03.674 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.671+0000 7fb003e00640 1 -- 172.21.15.131:0/4193903185 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faffc017070 con 0x7fb00c160140 2024-04-25T19:22:03.674 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.671+0000 7fb003e00640 1 -- 172.21.15.131:0/4193903185 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faffc00ca00 con 0x7fb00c160140 2024-04-25T19:22:03.674 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.671+0000 7fb003e00640 1 -- 172.21.15.131:0/4193903185 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faffc00cdf0 con 0x7fb00c160140 2024-04-25T19:22:03.674 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.671+0000 7fb00be00640 1 -- 172.21.15.131:0/4193903185 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb00c0b0d60 con 0x7fb00c160140 2024-04-25T19:22:03.674 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.671+0000 7fb00be00640 1 -- 172.21.15.131:0/4193903185 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb00c0b1320 con 0x7fb00c160140 2024-04-25T19:22:03.674 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.672+0000 7fb00be00640 1 -- 172.21.15.131:0/4193903185 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb00c06d990 con 0x7fb00c160140 2024-04-25T19:22:03.675 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.673+0000 7fb003e00640 1 -- 172.21.15.131:0/4193903185 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 4) ==== 96726+0+0 (secure 0 0 0) 0x7faffc01a070 con 0x7fb00c160140 2024-04-25T19:22:03.675 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.674+0000 7fb003e00640 1 --2- 172.21.15.131:0/4193903185 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fafe8074450 0x7fafe8076960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:03.676 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.674+0000 7fb003e00640 1 -- 172.21.15.131:0/4193903185 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7faffc0946d0 con 0x7fb00c160140 2024-04-25T19:22:03.676 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.674+0000 7fb002000640 1 --2- 172.21.15.131:0/4193903185 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fafe8074450 0x7fafe8076960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:03.677 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.676+0000 7fb002000640 1 --2- 172.21.15.131:0/4193903185 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fafe8074450 0x7fafe8076960 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faff4034000 tx=0x7faff402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:03.682 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.679+0000 7fb003e00640 1 -- 172.21.15.131:0/4193903185 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faffc05fc30 con 0x7fb00c160140 2024-04-25T19:22:03.868 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.866+0000 7fb00be00640 1 -- 172.21.15.131:0/4193903185 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb00c050740 con 0x7fb00c160140 2024-04-25T19:22:03.869 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.867+0000 7fb003e00640 1 -- 172.21.15.131:0/4193903185 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7faffc05f530 con 0x7fb00c160140 2024-04-25T19:22:03.869 INFO:teuthology.misc.health.smithi131.stdout: 2024-04-25T19:22:03.869 INFO:teuthology.misc.health.smithi131.stdout:{"epoch":12,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:22:01.170747+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:22:03.872 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.870+0000 7fb00be00640 1 -- 172.21.15.131:0/4193903185 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fafe8074450 msgr2=0x7fafe8076960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:03.872 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.870+0000 7fb00be00640 1 --2- 172.21.15.131:0/4193903185 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fafe8074450 0x7fafe8076960 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faff4034000 tx=0x7faff402e000 comp rx=0 tx=0).stop 2024-04-25T19:22:03.872 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.870+0000 7fb00be00640 1 -- 172.21.15.131:0/4193903185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb00c160140 msgr2=0x7fb00c0b1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:03.872 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.870+0000 7fb00be00640 1 --2- 172.21.15.131:0/4193903185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb00c160140 0x7fb00c0b1b20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faffc00e930 tx=0x7faffc00edf0 comp rx=0 tx=0).stop 2024-04-25T19:22:03.872 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.870+0000 7fb00be00640 1 -- 172.21.15.131:0/4193903185 shutdown_connections 2024-04-25T19:22:03.872 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.870+0000 7fb00be00640 1 --2- 172.21.15.131:0/4193903185 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fafe8074450 0x7fafe8076960 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:03.872 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.870+0000 7fb00be00640 1 --2- 172.21.15.131:0/4193903185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb00c1645a0 0x7fb00c146110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:03.872 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.870+0000 7fb00be00640 1 --2- 172.21.15.131:0/4193903185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb00c163c50 0x7fb00c1566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:03.872 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.870+0000 7fb00be00640 1 --2- 172.21.15.131:0/4193903185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb00c160140 0x7fb00c0b1b20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:03.872 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.870+0000 7fb00be00640 1 -- 172.21.15.131:0/4193903185 >> 172.21.15.131:0/4193903185 conn(0x7fb00c0b3520 msgr2=0x7fb00c0b6160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:03.872 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.870+0000 7fb00be00640 1 -- 172.21.15.131:0/4193903185 shutdown_connections 2024-04-25T19:22:03.873 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:03.870+0000 7fb00be00640 1 -- 172.21.15.131:0/4193903185 wait complete. 2024-04-25T19:22:03.891 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T19:22:05.649 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:22:05.658 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:22:10.698 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T19:22:10.961 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.959+0000 7f8678a00640 1 Processor -- start 2024-04-25T19:22:10.961 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.959+0000 7f8678a00640 1 -- start start 2024-04-25T19:22:10.964 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.961+0000 7f8678a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86740b8000 0x7f86740d4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:10.964 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.961+0000 7f8678a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f86740d28d0 0x7f86740d2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:10.964 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.961+0000 7f8678a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f86740d0800 0x7f86740d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:10.965 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.961+0000 7f8678a00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f86740b8410 con 0x7f86740d0800 2024-04-25T19:22:10.965 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.961+0000 7f8678a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f86740d3220 con 0x7f86740d28d0 2024-04-25T19:22:10.965 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.961+0000 7f8678a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f86740d49a0 con 0x7f86740b8000 2024-04-25T19:22:10.965 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.961+0000 7f8673e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f86740d0800 0x7f86740d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:10.965 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.961+0000 7f8673e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f86740d0800 0x7f86740d0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33748/0 (socket says 172.21.15.131:33748) 2024-04-25T19:22:10.965 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.961+0000 7f8673e00640 1 -- 172.21.15.131:0/1521931971 learned_addr learned my addr 172.21.15.131:0/1521931971 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:10.966 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.962+0000 7f866aa00640 1 --2- 172.21.15.131:0/1521931971 >> v2:172.21.15.195:3300/0 conn(0x7f86740d28d0 0x7f86740d2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:10.966 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.962+0000 7f8673400640 1 --2- 172.21.15.131:0/1521931971 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86740b8000 0x7f86740d4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:10.966 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.962+0000 7f8673e00640 1 -- 172.21.15.131:0/1521931971 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86740b8000 msgr2=0x7f86740d4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:10.966 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.962+0000 7f8673e00640 1 --2- 172.21.15.131:0/1521931971 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86740b8000 0x7f86740d4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:10.966 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.962+0000 7f8673e00640 1 -- 172.21.15.131:0/1521931971 >> v2:172.21.15.195:3300/0 conn(0x7f86740d28d0 msgr2=0x7f86740d2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:10.966 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.962+0000 7f8673e00640 1 --2- 172.21.15.131:0/1521931971 >> v2:172.21.15.195:3300/0 conn(0x7f86740d28d0 0x7f86740d2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:10.967 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.962+0000 7f8673e00640 1 -- 172.21.15.131:0/1521931971 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86740d54e0 con 0x7f86740d0800 2024-04-25T19:22:10.969 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.963+0000 7f8673e00640 1 --2- 172.21.15.131:0/1521931971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86740d0800 0x7f86740d0c10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f86740b8660 tx=0x7f866c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf9bd680c1e4d9e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:10.969 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.963+0000 7f8672a00640 1 -- 172.21.15.131:0/1521931971 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c037070 con 0x7f86740d0800 2024-04-25T19:22:10.969 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.963+0000 7f8672a00640 1 -- 172.21.15.131:0/1521931971 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f866c032440 con 0x7f86740d0800 2024-04-25T19:22:10.970 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.963+0000 7f8672a00640 1 -- 172.21.15.131:0/1521931971 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c032810 con 0x7f86740d0800 2024-04-25T19:22:10.970 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.964+0000 7f8678a00640 1 -- 172.21.15.131:0/1521931971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86740d0800 msgr2=0x7f86740d0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:10.970 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.964+0000 7f8678a00640 1 --2- 172.21.15.131:0/1521931971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86740d0800 0x7f86740d0c10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f86740b8660 tx=0x7f866c02a140 comp rx=0 tx=0).stop 2024-04-25T19:22:10.970 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.964+0000 7f8678a00640 1 -- 172.21.15.131:0/1521931971 shutdown_connections 2024-04-25T19:22:10.970 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.964+0000 7f8678a00640 1 --2- 172.21.15.131:0/1521931971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86740d0800 0x7f86740d0c10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:10.970 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.964+0000 7f8678a00640 1 --2- 172.21.15.131:0/1521931971 >> v2:172.21.15.195:3300/0 conn(0x7f86740d28d0 0x7f86740d2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:10.971 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.964+0000 7f8678a00640 1 --2- 172.21.15.131:0/1521931971 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86740b8000 0x7f86740d4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:10.971 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.964+0000 7f8678a00640 1 -- 172.21.15.131:0/1521931971 >> 172.21.15.131:0/1521931971 conn(0x7f867406e030 msgr2=0x7f867406e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:10.971 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.964+0000 7f8678a00640 1 -- 172.21.15.131:0/1521931971 shutdown_connections 2024-04-25T19:22:10.971 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.964+0000 7f8678a00640 1 -- 172.21.15.131:0/1521931971 wait complete. 2024-04-25T19:22:10.971 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.967+0000 7f8678a00640 1 Processor -- start 2024-04-25T19:22:10.971 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.967+0000 7f8678a00640 1 -- start start 2024-04-25T19:22:10.977 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.968+0000 7f8678a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86740b8000 0x7f867415d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:10.977 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.968+0000 7f8678a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86740d0800 0x7f86741f6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:10.977 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.968+0000 7f8678a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86740d28d0 0x7f8674156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:10.977 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.968+0000 7f8678a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f86740d5200 con 0x7f86740d28d0 2024-04-25T19:22:10.977 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.968+0000 7f8678a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f86740d4f20 con 0x7f86740d0800 2024-04-25T19:22:10.977 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.968+0000 7f8678a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f86741603e0 con 0x7f86740b8000 2024-04-25T19:22:10.978 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.969+0000 7f8673e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86740d28d0 0x7f8674156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:10.978 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.969+0000 7f8673e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86740d28d0 0x7f8674156dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33764/0 (socket says 172.21.15.131:33764) 2024-04-25T19:22:10.978 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.969+0000 7f8673e00640 1 -- 172.21.15.131:0/2087992203 learned_addr learned my addr 172.21.15.131:0/2087992203 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:10.978 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.969+0000 7f866aa00640 1 --2- 172.21.15.131:0/2087992203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86740d0800 0x7f86741f6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:10.978 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.969+0000 7f8673400640 1 --2- 172.21.15.131:0/2087992203 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86740b8000 0x7f867415d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:10.978 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.969+0000 7f8673e00640 1 -- 172.21.15.131:0/2087992203 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86740b8000 msgr2=0x7f867415d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:10.979 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.969+0000 7f8673e00640 1 --2- 172.21.15.131:0/2087992203 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86740b8000 0x7f867415d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:10.979 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.969+0000 7f8673e00640 1 -- 172.21.15.131:0/2087992203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86740d0800 msgr2=0x7f86741f6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:10.979 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.969+0000 7f8673e00640 1 --2- 172.21.15.131:0/2087992203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86740d0800 0x7f86741f6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:10.979 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.969+0000 7f8673e00640 1 -- 172.21.15.131:0/2087992203 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86740cf560 con 0x7f86740d28d0 2024-04-25T19:22:10.979 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.969+0000 7f866aa00640 1 --2- 172.21.15.131:0/2087992203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86740d0800 0x7f86741f6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:10.979 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.969+0000 7f8673e00640 1 --2- 172.21.15.131:0/2087992203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86740d28d0 0x7f8674156dd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f866c02a180 tx=0x7f866c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:10.980 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.970+0000 7f866be00640 1 -- 172.21.15.131:0/2087992203 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c037040 con 0x7f86740d28d0 2024-04-25T19:22:10.980 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.970+0000 7f866be00640 1 -- 172.21.15.131:0/2087992203 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f866c042070 con 0x7f86740d28d0 2024-04-25T19:22:10.980 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.970+0000 7f866be00640 1 -- 172.21.15.131:0/2087992203 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c030920 con 0x7f86740d28d0 2024-04-25T19:22:10.980 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.970+0000 7f8678a00640 1 -- 172.21.15.131:0/2087992203 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f867415c710 con 0x7f86740d28d0 2024-04-25T19:22:10.980 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.970+0000 7f8678a00640 1 -- 172.21.15.131:0/2087992203 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f867415ccd0 con 0x7f86740d28d0 2024-04-25T19:22:10.980 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.971+0000 7f8678a00640 1 -- 172.21.15.131:0/2087992203 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8674050740 con 0x7f86740d28d0 2024-04-25T19:22:10.981 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.972+0000 7f866be00640 1 -- 172.21.15.131:0/2087992203 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f866c030ac0 con 0x7f86740d28d0 2024-04-25T19:22:10.981 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.973+0000 7f866be00640 1 --2- 172.21.15.131:0/2087992203 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f86500744e0 0x7f86500769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:10.981 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.973+0000 7f866be00640 1 -- 172.21.15.131:0/2087992203 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f866c0b5700 con 0x7f86740d28d0 2024-04-25T19:22:10.981 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.974+0000 7f8673400640 1 --2- 172.21.15.131:0/2087992203 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f86500744e0 0x7f86500769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:10.981 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.975+0000 7f8673400640 1 --2- 172.21.15.131:0/2087992203 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f86500744e0 0x7f86500769f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f867408ee70 tx=0x7f866400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:10.982 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:10.980+0000 7f866be00640 1 -- 172.21.15.131:0/2087992203 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f866c07fc10 con 0x7f86740d28d0 2024-04-25T19:22:11.175 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:11.173+0000 7f8678a00640 1 -- 172.21.15.131:0/2087992203 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86740b7b50 con 0x7f86740d28d0 2024-04-25T19:22:11.177 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:11.175+0000 7f866be00640 1 -- 172.21.15.131:0/2087992203 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12908 (secure 0 0 0) 0x7f866c083f10 con 0x7f86740d28d0 2024-04-25T19:22:11.177 INFO:teuthology.misc.health.smithi131.stdout: 2024-04-25T19:22:11.177 INFO:teuthology.misc.health.smithi131.stdout:{"epoch":16,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:22:06.942529+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:22:11.180 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:11.177+0000 7f8678a00640 1 -- 172.21.15.131:0/2087992203 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f86500744e0 msgr2=0x7f86500769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:11.180 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:11.177+0000 7f8678a00640 1 --2- 172.21.15.131:0/2087992203 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f86500744e0 0x7f86500769f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f867408ee70 tx=0x7f866400b040 comp rx=0 tx=0).stop 2024-04-25T19:22:11.180 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:11.177+0000 7f8678a00640 1 -- 172.21.15.131:0/2087992203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86740d28d0 msgr2=0x7f8674156dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:11.180 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:11.177+0000 7f8678a00640 1 --2- 172.21.15.131:0/2087992203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86740d28d0 0x7f8674156dd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f866c02a180 tx=0x7f866c0046c0 comp rx=0 tx=0).stop 2024-04-25T19:22:11.180 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:11.178+0000 7f8678a00640 1 -- 172.21.15.131:0/2087992203 shutdown_connections 2024-04-25T19:22:11.180 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:11.178+0000 7f8678a00640 1 --2- 172.21.15.131:0/2087992203 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f86500744e0 0x7f86500769f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:11.180 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:11.178+0000 7f8678a00640 1 --2- 172.21.15.131:0/2087992203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86740d28d0 0x7f8674156dd0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:11.180 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:11.178+0000 7f8678a00640 1 --2- 172.21.15.131:0/2087992203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86740d0800 0x7f86741f6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:11.180 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:11.178+0000 7f8678a00640 1 --2- 172.21.15.131:0/2087992203 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86740b8000 0x7f867415d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:11.180 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:11.178+0000 7f8678a00640 1 -- 172.21.15.131:0/2087992203 >> 172.21.15.131:0/2087992203 conn(0x7f867406e030 msgr2=0x7f86740c95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:11.180 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:11.178+0000 7f8678a00640 1 -- 172.21.15.131:0/2087992203 shutdown_connections 2024-04-25T19:22:11.180 INFO:teuthology.misc.health.smithi131.stderr:2024-04-25T19:22:11.178+0000 7f8678a00640 1 -- 172.21.15.131:0/2087992203 wait complete. 2024-04-25T19:22:11.200 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T19:22:11.200 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T19:22:11.200 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T19:22:11.200 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T19:22:11.207 INFO:tasks.ceph.mds.a:Started 2024-04-25T19:22:11.207 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T19:22:11.207 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T19:22:11.213 INFO:tasks.ceph.mds.c:Started 2024-04-25T19:22:11.214 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T19:22:11.214 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T19:22:11.221 INFO:tasks.ceph.mds.b:Started 2024-04-25T19:22:11.222 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T19:22:11.222 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T19:22:11.229 INFO:tasks.ceph.mds.d:Started 2024-04-25T19:22:11.229 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T19:22:11.229 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:22:11.446 INFO:tasks.ceph.mds.d.smithi195.stdout:starting mds.d at 2024-04-25T19:22:11.447 INFO:tasks.ceph.mds.b.smithi195.stdout:starting mds.b at 2024-04-25T19:22:11.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.469+0000 7fd03b600640 1 Processor -- start 2024-04-25T19:22:11.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.469+0000 7fd03b600640 1 -- start start 2024-04-25T19:22:11.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.471+0000 7fd03b600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd03406dce0 0x7fd034163e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:11.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.471+0000 7fd03b600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd03416db50 con 0x7fd0340b5310 2024-04-25T19:22:11.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.471+0000 7fd03b600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd03416de00 con 0x7fd034163a50 2024-04-25T19:22:11.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.471+0000 7fd03b600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd03416e0e0 con 0x7fd03406dce0 2024-04-25T19:22:11.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.471+0000 7fd038c00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fd0340b5310 0x7fd03416d440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:56510/0 (socket says 172.21.15.131:56510) 2024-04-25T19:22:11.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.471+0000 7fd038c00640 1 -- 172.21.15.131:0/2610100076 learned_addr learned my addr 172.21.15.131:0/2610100076 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:11.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.471+0000 7fd039600640 1 --2- 172.21.15.131:0/2610100076 >> v2:172.21.15.195:3300/0 conn(0x7fd03406dce0 0x7fd034163e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:11.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.471+0000 7fd033400640 1 -- 172.21.15.131:0/2610100076 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1922637411 0 0) 0x7fd03416db50 con 0x7fd0340b5310 2024-04-25T19:22:11.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.484+0000 7fd033400640 1 -- 172.21.15.131:0/2610100076 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd01c003500 con 0x7fd0340b5310 2024-04-25T19:22:11.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.484+0000 7fd033400640 1 -- 172.21.15.131:0/2610100076 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2375462805 0 0) 0x7fd03416de00 con 0x7fd034163a50 2024-04-25T19:22:11.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.484+0000 7fd033400640 1 -- 172.21.15.131:0/2610100076 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd03416db50 con 0x7fd034163a50 2024-04-25T19:22:11.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.485+0000 7fd039600640 1 -- 172.21.15.131:0/2610100076 >> v1:172.21.15.195:6789/0 conn(0x7fd034163a50 legacy=0x7fd03406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:11.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.485+0000 7fd039600640 1 -- 172.21.15.131:0/2610100076 >> v1:172.21.15.131:6789/0 conn(0x7fd0340b5310 legacy=0x7fd03416d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:11.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.485+0000 7fd033400640 1 -- 172.21.15.131:0/2610100076 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2158709582 0 0) 0x7fd01c003500 con 0x7fd0340b5310 2024-04-25T19:22:11.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.485+0000 7fd039600640 1 -- 172.21.15.131:0/2610100076 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0340b4b10 con 0x7fd03406dce0 2024-04-25T19:22:11.490 INFO:tasks.ceph.mds.a.smithi131.stdout:starting mds.a at 2024-04-25T19:22:11.491 INFO:tasks.ceph.mds.c.smithi131.stdout:starting mds.c at 2024-04-25T19:22:11.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.486+0000 7fd039600640 1 --2- 172.21.15.131:0/2610100076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd03406dce0 0x7fd034163e60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd02c00b1c0 tx=0x7fd02c02a950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24a47960c1a82047 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:11.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.486+0000 7fd033400640 1 -- 172.21.15.131:0/2610100076 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02c037070 con 0x7fd03406dce0 2024-04-25T19:22:11.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.486+0000 7fd033400640 1 -- 172.21.15.131:0/2610100076 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd02c007dd0 con 0x7fd03406dce0 2024-04-25T19:22:11.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.486+0000 7fd033400640 1 -- 172.21.15.131:0/2610100076 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028001670 con 0x7fd03406dce0 2024-04-25T19:22:11.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.487+0000 7fd03b600640 1 -- 172.21.15.131:0/2610100076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd03406dce0 msgr2=0x7fd034163e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:11.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.487+0000 7fd03b600640 1 --2- 172.21.15.131:0/2610100076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd03406dce0 0x7fd034163e60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd02c00b1c0 tx=0x7fd02c02a950 comp rx=0 tx=0).stop 2024-04-25T19:22:11.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.487+0000 7fd03b600640 1 -- 172.21.15.131:0/2610100076 shutdown_connections 2024-04-25T19:22:11.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.487+0000 7fd03b600640 1 --2- 172.21.15.131:0/2610100076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd03406dce0 0x7fd034163e60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:11.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.487+0000 7fd03b600640 1 -- 172.21.15.131:0/2610100076 >> 172.21.15.131:0/2610100076 conn(0x7fd034073050 msgr2=0x7fd034073460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:11.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.487+0000 7fd03b600640 1 -- 172.21.15.131:0/2610100076 shutdown_connections 2024-04-25T19:22:11.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.487+0000 7fd03b600640 1 -- 172.21.15.131:0/2610100076 wait complete. 2024-04-25T19:22:11.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.491+0000 7fd03b600640 1 Processor -- start 2024-04-25T19:22:11.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.491+0000 7fd03b600640 1 -- start start 2024-04-25T19:22:11.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.493+0000 7fd03b600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0340b5310 0x7fd03416b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:11.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.493+0000 7fd03b600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd034163a50 0x7fd03415e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:11.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.493+0000 7fd03b600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0341660d0 0x7fd0341664e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:11.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.493+0000 7fd03b600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd034071460 con 0x7fd0341660d0 2024-04-25T19:22:11.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.493+0000 7fd03b600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd0340712e0 con 0x7fd034163a50 2024-04-25T19:22:11.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.493+0000 7fd03b600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd0340b5720 con 0x7fd0340b5310 2024-04-25T19:22:11.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.493+0000 7fd038c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0340b5310 0x7fd03416b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:11.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.493+0000 7fd039600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0341660d0 0x7fd0341664e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:11.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.493+0000 7fd038c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0340b5310 0x7fd03416b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.131:37878/0 (socket says 172.21.15.131:37878) 2024-04-25T19:22:11.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.493+0000 7fd038c00640 1 -- 172.21.15.131:0/3335430543 learned_addr learned my addr 172.21.15.131:0/3335430543 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:11.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.493+0000 7fd033e00640 1 --2- 172.21.15.131:0/3335430543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd034163a50 0x7fd03415e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:11.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.494+0000 7fd039600640 1 -- 172.21.15.131:0/3335430543 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0340b5310 msgr2=0x7fd03416b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:11.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.494+0000 7fd039600640 1 --2- 172.21.15.131:0/3335430543 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0340b5310 0x7fd03416b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:11.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.494+0000 7fd039600640 1 -- 172.21.15.131:0/3335430543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd034163a50 msgr2=0x7fd03415e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:11.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.494+0000 7fd039600640 1 --2- 172.21.15.131:0/3335430543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd034163a50 0x7fd03415e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:11.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.494+0000 7fd039600640 1 -- 172.21.15.131:0/3335430543 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd03420b5b0 con 0x7fd0341660d0 2024-04-25T19:22:11.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.494+0000 7fd038c00640 1 --2- 172.21.15.131:0/3335430543 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0340b5310 0x7fd03416b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T19:22:11.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.494+0000 7fd033e00640 1 --2- 172.21.15.131:0/3335430543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd034163a50 0x7fd03415e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T19:22:11.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.494+0000 7fd039600640 1 --2- 172.21.15.131:0/3335430543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0341660d0 0x7fd0341664e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd02c031000 tx=0x7fd02c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:11.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.494+0000 7fd030c00640 1 -- 172.21.15.131:0/3335430543 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02c042020 con 0x7fd0341660d0 2024-04-25T19:22:11.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.494+0000 7fd030c00640 1 -- 172.21.15.131:0/3335430543 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd02c009830 con 0x7fd0341660d0 2024-04-25T19:22:11.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.494+0000 7fd030c00640 1 -- 172.21.15.131:0/3335430543 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02c037040 con 0x7fd0341660d0 2024-04-25T19:22:11.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.494+0000 7fd03b600640 1 -- 172.21.15.131:0/3335430543 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd034166a20 con 0x7fd0341660d0 2024-04-25T19:22:11.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.495+0000 7fd03b600640 1 -- 172.21.15.131:0/3335430543 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd03420b850 con 0x7fd0341660d0 2024-04-25T19:22:11.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.496+0000 7fd03b600640 1 -- 172.21.15.131:0/3335430543 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd034050740 con 0x7fd0341660d0 2024-04-25T19:22:11.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.497+0000 7fd030c00640 1 -- 172.21.15.131:0/3335430543 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd02c045020 con 0x7fd0341660d0 2024-04-25T19:22:11.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.498+0000 7fd030c00640 1 --2- 172.21.15.131:0/3335430543 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd0140744b0 0x7fd0140769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:11.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.498+0000 7fd030c00640 1 -- 172.21.15.131:0/3335430543 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fd02c0b59e0 con 0x7fd0341660d0 2024-04-25T19:22:11.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.499+0000 7fd038c00640 1 --2- 172.21.15.131:0/3335430543 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd0140744b0 0x7fd0140769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:11.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.499+0000 7fd038c00640 1 --2- 172.21.15.131:0/3335430543 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd0140744b0 0x7fd0140769c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd028001eb0 tx=0x7fd028001490 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:11.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.503+0000 7fd030c00640 1 -- 172.21.15.131:0/3335430543 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd02c04c030 con 0x7fd0341660d0 2024-04-25T19:22:11.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.692+0000 7fd03b600640 1 -- 172.21.15.131:0/3335430543 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd0340b6500 con 0x7fd0341660d0 2024-04-25T19:22:11.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.693+0000 7fd030c00640 1 -- 172.21.15.131:0/3335430543 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12908 (secure 0 0 0) 0x7fd034166a20 con 0x7fd0341660d0 2024-04-25T19:22:11.694 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:11.694 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":16,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:22:06.942529+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:22:11.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.696+0000 7fd03b600640 1 -- 172.21.15.131:0/3335430543 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd0140744b0 msgr2=0x7fd0140769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:11.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.696+0000 7fd03b600640 1 --2- 172.21.15.131:0/3335430543 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd0140744b0 0x7fd0140769c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd028001eb0 tx=0x7fd028001490 comp rx=0 tx=0).stop 2024-04-25T19:22:11.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.696+0000 7fd03b600640 1 -- 172.21.15.131:0/3335430543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0341660d0 msgr2=0x7fd0341664e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:11.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.696+0000 7fd03b600640 1 --2- 172.21.15.131:0/3335430543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0341660d0 0x7fd0341664e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd02c031000 tx=0x7fd02c004a40 comp rx=0 tx=0).stop 2024-04-25T19:22:11.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.696+0000 7fd03b600640 1 -- 172.21.15.131:0/3335430543 shutdown_connections 2024-04-25T19:22:11.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.696+0000 7fd03b600640 1 --2- 172.21.15.131:0/3335430543 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd0140744b0 0x7fd0140769c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:11.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.696+0000 7fd03b600640 1 --2- 172.21.15.131:0/3335430543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0341660d0 0x7fd0341664e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:11.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.696+0000 7fd03b600640 1 --2- 172.21.15.131:0/3335430543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd034163a50 0x7fd03415e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:11.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.696+0000 7fd03b600640 1 --2- 172.21.15.131:0/3335430543 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0340b5310 0x7fd03416b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:11.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.696+0000 7fd03b600640 1 -- 172.21.15.131:0/3335430543 >> 172.21.15.131:0/3335430543 conn(0x7fd034073050 msgr2=0x7fd03416f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:11.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.696+0000 7fd03b600640 1 -- 172.21.15.131:0/3335430543 shutdown_connections 2024-04-25T19:22:11.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.696+0000 7fd03b600640 1 -- 172.21.15.131:0/3335430543 wait complete. 2024-04-25T19:22:11.719 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T19:22:04.178847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T19:22:11.719 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T19:22:11.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.980+0000 7fd061400640 1 Processor -- start 2024-04-25T19:22:11.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.980+0000 7fd061400640 1 -- start start 2024-04-25T19:22:11.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.982+0000 7fd061400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd05c06dce0 0x7fd05c15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:11.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.982+0000 7fd061400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd05c15ec90 0x7fd05c15f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:11.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.982+0000 7fd061400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd05c070000 con 0x7fd05c144340 2024-04-25T19:22:11.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.982+0000 7fd061400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd05c144750 con 0x7fd05c06dce0 2024-04-25T19:22:11.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.982+0000 7fd061400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd05c06f240 con 0x7fd05c15ec90 2024-04-25T19:22:11.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.982+0000 7fd05be00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fd05c144340 0x7fd05c06d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:56522/0 (socket says 172.21.15.131:56522) 2024-04-25T19:22:11.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.982+0000 7fd05be00640 1 -- 172.21.15.131:0/4074798943 learned_addr learned my addr 172.21.15.131:0/4074798943 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:11.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.983+0000 7fd053e00640 1 --2- 172.21.15.131:0/4074798943 >> v2:172.21.15.195:3300/0 conn(0x7fd05c06dce0 0x7fd05c15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:11.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.983+0000 7fd060a00640 1 --2- 172.21.15.131:0/4074798943 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd05c15ec90 0x7fd05c15f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:11.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.983+0000 7fd05b400640 1 -- 172.21.15.131:0/4074798943 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4137042922 0 0) 0x7fd05c070000 con 0x7fd05c144340 2024-04-25T19:22:11.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.983+0000 7fd05b400640 1 -- 172.21.15.131:0/4074798943 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd040003520 con 0x7fd05c144340 2024-04-25T19:22:11.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.983+0000 7fd05b400640 1 -- 172.21.15.131:0/4074798943 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 352722744 0 0) 0x7fd040003520 con 0x7fd05c144340 2024-04-25T19:22:11.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.983+0000 7fd05b400640 1 -- 172.21.15.131:0/4074798943 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd05c15ec90 msgr2=0x7fd05c15f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:11.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.983+0000 7fd05b400640 1 --2- 172.21.15.131:0/4074798943 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd05c15ec90 0x7fd05c15f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:11.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.983+0000 7fd05b400640 1 -- 172.21.15.131:0/4074798943 >> v2:172.21.15.195:3300/0 conn(0x7fd05c06dce0 msgr2=0x7fd05c15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:11.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.983+0000 7fd05b400640 1 --2- 172.21.15.131:0/4074798943 >> v2:172.21.15.195:3300/0 conn(0x7fd05c06dce0 0x7fd05c15e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:11.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.983+0000 7fd05b400640 1 -- 172.21.15.131:0/4074798943 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05c06f520 con 0x7fd05c144340 2024-04-25T19:22:11.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.983+0000 7fd05b400640 1 -- 172.21.15.131:0/4074798943 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7fd04c001670 con 0x7fd05c144340 2024-04-25T19:22:11.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.983+0000 7fd05b400640 1 -- 172.21.15.131:0/4074798943 >> v1:172.21.15.131:6789/0 conn(0x7fd05c144340 legacy=0x7fd05c06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:11.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.983+0000 7fd05b400640 1 --2- 172.21.15.131:0/4074798943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0400039b0 0x7fd040003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:11.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.983+0000 7fd05b400640 1 --2- 172.21.15.131:0/4074798943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd040004800 0x7fd040004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:11.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.983+0000 7fd05b400640 1 --2- 172.21.15.131:0/4074798943 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd05c15ec90 0x7fd040005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:11.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.984+0000 7fd05b400640 1 -- 172.21.15.131:0/4074798943 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c144750 con 0x7fd040004800 2024-04-25T19:22:11.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.984+0000 7fd05b400640 1 -- 172.21.15.131:0/4074798943 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c06f240 con 0x7fd0400039b0 2024-04-25T19:22:11.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.984+0000 7fd05b400640 1 -- 172.21.15.131:0/4074798943 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd04000b9f0 con 0x7fd05c15ec90 2024-04-25T19:22:11.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.984+0000 7fd053e00640 1 --2- 172.21.15.131:0/4074798943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd040004800 0x7fd040004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:11.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.984+0000 7fd05be00640 1 --2- 172.21.15.131:0/4074798943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0400039b0 0x7fd040003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:11.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.984+0000 7fd053e00640 1 -- 172.21.15.131:0/4074798943 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd05c15ec90 msgr2=0x7fd040005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:11.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.984+0000 7fd060a00640 1 --2- 172.21.15.131:0/4074798943 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd05c15ec90 0x7fd040005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:11.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.984+0000 7fd053e00640 1 --2- 172.21.15.131:0/4074798943 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd05c15ec90 0x7fd040005150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:11.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.984+0000 7fd053e00640 1 -- 172.21.15.131:0/4074798943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0400039b0 msgr2=0x7fd040003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:11.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.984+0000 7fd053e00640 1 --2- 172.21.15.131:0/4074798943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0400039b0 0x7fd040003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:11.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.984+0000 7fd053e00640 1 -- 172.21.15.131:0/4074798943 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd040003520 con 0x7fd040004800 2024-04-25T19:22:11.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.986+0000 7fd053e00640 1 --2- 172.21.15.131:0/4074798943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd040004800 0x7fd040004c10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd044009a90 tx=0x7fd040005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ecde8858593795 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:11.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.988+0000 7fd05b400640 1 -- 172.21.15.131:0/4074798943 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd044036070 con 0x7fd040004800 2024-04-25T19:22:11.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.988+0000 7fd05b400640 1 -- 172.21.15.131:0/4074798943 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd044031400 con 0x7fd040004800 2024-04-25T19:22:11.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.988+0000 7fd05b400640 1 -- 172.21.15.131:0/4074798943 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd044009690 con 0x7fd040004800 2024-04-25T19:22:11.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.989+0000 7fd061400640 1 -- 172.21.15.131:0/4074798943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd040004800 msgr2=0x7fd040004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:11.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.989+0000 7fd061400640 1 --2- 172.21.15.131:0/4074798943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd040004800 0x7fd040004c10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd044009a90 tx=0x7fd040005830 comp rx=0 tx=0).stop 2024-04-25T19:22:11.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.989+0000 7fd060a00640 1 -- 172.21.15.131:0/4074798943 reap_dead start 2024-04-25T19:22:11.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.989+0000 7fd061400640 1 -- 172.21.15.131:0/4074798943 shutdown_connections 2024-04-25T19:22:11.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.989+0000 7fd061400640 1 -- 172.21.15.131:0/4074798943 >> 172.21.15.131:0/4074798943 conn(0x7fd05c072f40 msgr2=0x7fd05c073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:11.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.989+0000 7fd061400640 1 -- 172.21.15.131:0/4074798943 shutdown_connections 2024-04-25T19:22:11.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.989+0000 7fd061400640 1 -- 172.21.15.131:0/4074798943 wait complete. 2024-04-25T19:22:11.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.991+0000 7fd061400640 1 Processor -- start 2024-04-25T19:22:11.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.992+0000 7fd061400640 1 -- start start 2024-04-25T19:22:11.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.993+0000 7fd061400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd040004800 0x7fd05c1582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:11.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.993+0000 7fd061400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd05c160350 0x7fd05c15fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:11.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.993+0000 7fd061400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd05c0b57d0 0x7fd05c1337e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:11.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.993+0000 7fd061400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c15f0a0 con 0x7fd05c160350 2024-04-25T19:22:11.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.993+0000 7fd061400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c06fae0 con 0x7fd05c0b57d0 2024-04-25T19:22:11.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.993+0000 7fd061400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd05c15f220 con 0x7fd040004800 2024-04-25T19:22:11.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.993+0000 7fd053e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd05c160350 0x7fd05c15fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:11.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.994+0000 7fd053e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd05c160350 0x7fd05c15fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33810/0 (socket says 172.21.15.131:33810) 2024-04-25T19:22:11.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.994+0000 7fd053e00640 1 -- 172.21.15.131:0/3598181388 learned_addr learned my addr 172.21.15.131:0/3598181388 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:11.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.994+0000 7fd05be00640 1 --2- 172.21.15.131:0/3598181388 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd040004800 0x7fd05c1582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:11.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.994+0000 7fd060a00640 1 --2- 172.21.15.131:0/3598181388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd05c0b57d0 0x7fd05c1337e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:11.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.994+0000 7fd053e00640 1 -- 172.21.15.131:0/3598181388 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd040004800 msgr2=0x7fd05c1582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:11.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.994+0000 7fd053e00640 1 --2- 172.21.15.131:0/3598181388 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd040004800 0x7fd05c1582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:11.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.994+0000 7fd053e00640 1 -- 172.21.15.131:0/3598181388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd05c0b57d0 msgr2=0x7fd05c1337e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:11.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.994+0000 7fd053e00640 1 --2- 172.21.15.131:0/3598181388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd05c0b57d0 0x7fd05c1337e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:12.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.994+0000 7fd053e00640 1 -- 172.21.15.131:0/3598181388 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05c158810 con 0x7fd05c160350 2024-04-25T19:22:12.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.994+0000 7fd060a00640 1 --2- 172.21.15.131:0/3598181388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd05c0b57d0 0x7fd05c1337e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:12.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.994+0000 7fd05be00640 1 --2- 172.21.15.131:0/3598181388 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd040004800 0x7fd05c1582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T19:22:12.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.994+0000 7fd053e00640 1 --2- 172.21.15.131:0/3598181388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd05c160350 0x7fd05c15fa20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd044034040 tx=0x7fd044004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:12.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.995+0000 7fd058c00640 1 -- 172.21.15.131:0/3598181388 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd044040020 con 0x7fd05c160350 2024-04-25T19:22:12.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.995+0000 7fd058c00640 1 -- 172.21.15.131:0/3598181388 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd044003ac0 con 0x7fd05c160350 2024-04-25T19:22:12.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.995+0000 7fd061400640 1 -- 172.21.15.131:0/3598181388 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd05c0b4730 con 0x7fd05c160350 2024-04-25T19:22:12.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.995+0000 7fd058c00640 1 -- 172.21.15.131:0/3598181388 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd044036040 con 0x7fd05c160350 2024-04-25T19:22:12.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.995+0000 7fd061400640 1 -- 172.21.15.131:0/3598181388 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd05c0b4cf0 con 0x7fd05c160350 2024-04-25T19:22:12.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.996+0000 7fd061400640 1 -- 172.21.15.131:0/3598181388 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd05c076c60 con 0x7fd05c160350 2024-04-25T19:22:12.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.997+0000 7fd058c00640 1 -- 172.21.15.131:0/3598181388 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd044043020 con 0x7fd05c160350 2024-04-25T19:22:12.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.998+0000 7fd058c00640 1 --2- 172.21.15.131:0/3598181388 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd0380744b0 0x7fd0380769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:12.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.998+0000 7fd058c00640 1 -- 172.21.15.131:0/3598181388 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fd0440b55b0 con 0x7fd05c160350 2024-04-25T19:22:12.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:11.999+0000 7fd05be00640 1 --2- 172.21.15.131:0/3598181388 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd0380744b0 0x7fd0380769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:12.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.000+0000 7fd05be00640 1 --2- 172.21.15.131:0/3598181388 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd0380744b0 0x7fd0380769c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd04c001050 tx=0x7fd04c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:12.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.003+0000 7fd058c00640 1 -- 172.21.15.131:0/3598181388 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd04404a030 con 0x7fd05c160350 2024-04-25T19:22:12.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.201+0000 7fd061400640 1 -- 172.21.15.131:0/3598181388 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd05c0b7920 con 0x7fd05c160350 2024-04-25T19:22:12.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.202+0000 7fd058c00640 1 -- 172.21.15.131:0/3598181388 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7fd0440b5070 con 0x7fd05c160350 2024-04-25T19:22:12.203 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-25T19:22:12.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.205+0000 7fd061400640 1 -- 172.21.15.131:0/3598181388 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd0380744b0 msgr2=0x7fd0380769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:12.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.205+0000 7fd061400640 1 --2- 172.21.15.131:0/3598181388 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd0380744b0 0x7fd0380769c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd04c001050 tx=0x7fd04c009040 comp rx=0 tx=0).stop 2024-04-25T19:22:12.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.205+0000 7fd061400640 1 -- 172.21.15.131:0/3598181388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd05c160350 msgr2=0x7fd05c15fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:12.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.205+0000 7fd061400640 1 --2- 172.21.15.131:0/3598181388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd05c160350 0x7fd05c15fa20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd044034040 tx=0x7fd044004730 comp rx=0 tx=0).stop 2024-04-25T19:22:12.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.206+0000 7fd061400640 1 -- 172.21.15.131:0/3598181388 shutdown_connections 2024-04-25T19:22:12.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.206+0000 7fd061400640 1 --2- 172.21.15.131:0/3598181388 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd0380744b0 0x7fd0380769c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:12.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.206+0000 7fd061400640 1 --2- 172.21.15.131:0/3598181388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd05c0b57d0 0x7fd05c1337e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:12.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.206+0000 7fd061400640 1 --2- 172.21.15.131:0/3598181388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd05c160350 0x7fd05c15fa20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:12.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.206+0000 7fd061400640 1 --2- 172.21.15.131:0/3598181388 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd040004800 0x7fd05c1582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:12.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.206+0000 7fd061400640 1 -- 172.21.15.131:0/3598181388 >> 172.21.15.131:0/3598181388 conn(0x7fd05c072f40 msgr2=0x7fd05c073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:12.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.206+0000 7fd061400640 1 -- 172.21.15.131:0/3598181388 shutdown_connections 2024-04-25T19:22:12.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.206+0000 7fd061400640 1 -- 172.21.15.131:0/3598181388 wait complete. 2024-04-25T19:22:12.232 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:22:12.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.489+0000 7f5e47e00640 1 Processor -- start 2024-04-25T19:22:12.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.489+0000 7f5e47e00640 1 -- start start 2024-04-25T19:22:12.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.491+0000 7f5e47e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e480d50e0 0x7f5e480d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:12.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.491+0000 7f5e47e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5e480d2ae0 0x7f5e48160650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:12.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.491+0000 7f5e47e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5e48160b90 0x7f5e48161810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:12.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.491+0000 7f5e47e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f5e480b7940 con 0x7f5e480d2ae0 2024-04-25T19:22:12.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.491+0000 7f5e47e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f5e480d2ef0 con 0x7f5e48160b90 2024-04-25T19:22:12.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.491+0000 7f5e47e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5e48161280 con 0x7f5e480d50e0 2024-04-25T19:22:12.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.491+0000 7f5e3fe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5e480d2ae0 0x7f5e48160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:12.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.491+0000 7f5e3fe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5e480d2ae0 0x7f5e48160650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33820/0 (socket says 172.21.15.131:33820) 2024-04-25T19:22:12.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.491+0000 7f5e3fe00640 1 -- 172.21.15.131:0/2005019692 learned_addr learned my addr 172.21.15.131:0/2005019692 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:12.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.491+0000 7f5e46a00640 1 --2- 172.21.15.131:0/2005019692 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e480d50e0 0x7f5e480d25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:12.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.491+0000 7f5e3fe00640 1 -- 172.21.15.131:0/2005019692 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e480d50e0 msgr2=0x7f5e480d25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:12.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.491+0000 7f5e47400640 1 --2- 172.21.15.131:0/2005019692 >> v2:172.21.15.195:3300/0 conn(0x7f5e48160b90 0x7f5e48161810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:12.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.491+0000 7f5e3fe00640 1 --2- 172.21.15.131:0/2005019692 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e480d50e0 0x7f5e480d25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:12.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.491+0000 7f5e3fe00640 1 -- 172.21.15.131:0/2005019692 >> v2:172.21.15.195:3300/0 conn(0x7f5e48160b90 msgr2=0x7f5e48161810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:12.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.491+0000 7f5e3fe00640 1 --2- 172.21.15.131:0/2005019692 >> v2:172.21.15.195:3300/0 conn(0x7f5e48160b90 0x7f5e48161810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:12.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.491+0000 7f5e3fe00640 1 -- 172.21.15.131:0/2005019692 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e480d4600 con 0x7f5e480d2ae0 2024-04-25T19:22:12.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.492+0000 7f5e3fe00640 1 --2- 172.21.15.131:0/2005019692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e480d2ae0 0x7f5e48160650 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5e480b55d0 tx=0x7f5e3002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f37419c2c94512 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:12.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.493+0000 7f5e46000640 1 -- 172.21.15.131:0/2005019692 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e30037070 con 0x7f5e480d2ae0 2024-04-25T19:22:12.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.493+0000 7f5e46000640 1 -- 172.21.15.131:0/2005019692 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e30032440 con 0x7f5e480d2ae0 2024-04-25T19:22:12.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.493+0000 7f5e46000640 1 -- 172.21.15.131:0/2005019692 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e30032810 con 0x7f5e480d2ae0 2024-04-25T19:22:12.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.493+0000 7f5e47e00640 1 -- 172.21.15.131:0/2005019692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e480d2ae0 msgr2=0x7f5e48160650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:12.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.493+0000 7f5e47e00640 1 --2- 172.21.15.131:0/2005019692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e480d2ae0 0x7f5e48160650 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5e480b55d0 tx=0x7f5e3002a1e0 comp rx=0 tx=0).stop 2024-04-25T19:22:12.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.493+0000 7f5e47e00640 1 -- 172.21.15.131:0/2005019692 shutdown_connections 2024-04-25T19:22:12.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.493+0000 7f5e47e00640 1 --2- 172.21.15.131:0/2005019692 >> v2:172.21.15.195:3300/0 conn(0x7f5e48160b90 0x7f5e48161810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:12.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.493+0000 7f5e47e00640 1 --2- 172.21.15.131:0/2005019692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e480d2ae0 0x7f5e48160650 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:12.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.493+0000 7f5e47e00640 1 --2- 172.21.15.131:0/2005019692 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e480d50e0 0x7f5e480d25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:12.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.494+0000 7f5e47e00640 1 -- 172.21.15.131:0/2005019692 >> 172.21.15.131:0/2005019692 conn(0x7f5e4806c5c0 msgr2=0x7f5e4806c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:12.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.494+0000 7f5e47e00640 1 -- 172.21.15.131:0/2005019692 shutdown_connections 2024-04-25T19:22:12.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.494+0000 7f5e47e00640 1 -- 172.21.15.131:0/2005019692 wait complete. 2024-04-25T19:22:12.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.496+0000 7f5e47e00640 1 Processor -- start 2024-04-25T19:22:12.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.496+0000 7f5e47e00640 1 -- start start 2024-04-25T19:22:12.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.497+0000 7f5e47e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e480d2ae0 0x7f5e480d0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:12.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.497+0000 7f5e47e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e480d50e0 0x7f5e48159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:12.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.497+0000 7f5e47e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e48160b90 0x7f5e481eb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:12.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.497+0000 7f5e47e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5e48160fa0 con 0x7f5e48160b90 2024-04-25T19:22:12.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.497+0000 7f5e47e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5e480d4bc0 con 0x7f5e480d2ae0 2024-04-25T19:22:12.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.498+0000 7f5e47e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5e48161560 con 0x7f5e480d50e0 2024-04-25T19:22:12.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.498+0000 7f5e47400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e48160b90 0x7f5e481eb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:12.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.498+0000 7f5e47400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e48160b90 0x7f5e481eb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33836/0 (socket says 172.21.15.131:33836) 2024-04-25T19:22:12.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.498+0000 7f5e47400640 1 -- 172.21.15.131:0/949576510 learned_addr learned my addr 172.21.15.131:0/949576510 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:12.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.498+0000 7f5e47400640 1 -- 172.21.15.131:0/949576510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e480d50e0 msgr2=0x7f5e48159990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:12.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.498+0000 7f5e47400640 1 --2- 172.21.15.131:0/949576510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e480d50e0 0x7f5e48159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:12.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.498+0000 7f5e46a00640 1 --2- 172.21.15.131:0/949576510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e480d2ae0 0x7f5e480d0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:12.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.498+0000 7f5e47400640 1 -- 172.21.15.131:0/949576510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e480d2ae0 msgr2=0x7f5e480d0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:12.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.498+0000 7f5e47400640 1 --2- 172.21.15.131:0/949576510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e480d2ae0 0x7f5e480d0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:12.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.498+0000 7f5e47400640 1 -- 172.21.15.131:0/949576510 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e48159ed0 con 0x7f5e48160b90 2024-04-25T19:22:12.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.498+0000 7f5e47400640 1 --2- 172.21.15.131:0/949576510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e48160b90 0x7f5e481eb4b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000cc60 tx=0x7f5e4000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:12.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.499+0000 7f5e3ea00640 1 -- 172.21.15.131:0/949576510 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40003990 con 0x7f5e48160b90 2024-04-25T19:22:12.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.499+0000 7f5e3ea00640 1 -- 172.21.15.131:0/949576510 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e40003b30 con 0x7f5e48160b90 2024-04-25T19:22:12.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.499+0000 7f5e47e00640 1 -- 172.21.15.131:0/949576510 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e480cd7f0 con 0x7f5e48160b90 2024-04-25T19:22:12.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.499+0000 7f5e3ea00640 1 -- 172.21.15.131:0/949576510 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40004020 con 0x7f5e48160b90 2024-04-25T19:22:12.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.499+0000 7f5e47e00640 1 -- 172.21.15.131:0/949576510 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e480cddb0 con 0x7f5e48160b90 2024-04-25T19:22:12.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.500+0000 7f5e47e00640 1 -- 172.21.15.131:0/949576510 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e480d0dd0 con 0x7f5e48160b90 2024-04-25T19:22:12.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.501+0000 7f5e3ea00640 1 -- 172.21.15.131:0/949576510 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5e400041c0 con 0x7f5e48160b90 2024-04-25T19:22:12.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.502+0000 7f5e3ea00640 1 --2- 172.21.15.131:0/949576510 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f5e240744b0 0x7f5e240769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:12.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.502+0000 7f5e3ea00640 1 -- 172.21.15.131:0/949576510 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f5e40095460 con 0x7f5e48160b90 2024-04-25T19:22:12.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.502+0000 7f5e46a00640 1 --2- 172.21.15.131:0/949576510 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f5e240744b0 0x7f5e240769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:12.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.503+0000 7f5e46a00640 1 --2- 172.21.15.131:0/949576510 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f5e240744b0 0x7f5e240769c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800b740 tx=0x7f5e38008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:12.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.507+0000 7f5e3ea00640 1 -- 172.21.15.131:0/949576510 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5e480d0dd0 con 0x7f5e48160b90 2024-04-25T19:22:12.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.726+0000 7f5e47e00640 1 -- 172.21.15.131:0/949576510 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e48050740 con 0x7f5e48160b90 2024-04-25T19:22:12.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.727+0000 7f5e3ea00640 1 -- 172.21.15.131:0/949576510 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3876 (secure 0 0 0) 0x7f5e40014030 con 0x7f5e48160b90 2024-04-25T19:22:12.728 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:12.728 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/1570319410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":1570319410},{"type":"v1","addr":"172.21.15.195:6837","nonce":1570319410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/4072860882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4072860882},{"type":"v1","addr":"172.21.15.131:6834","nonce":4072860882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2207155444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2207155444},{"type":"v1","addr":"172.21.15.131:6835","nonce":2207155444}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/1898121552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1898121552},{"type":"v1","addr":"172.21.15.195:6836","nonce":1898121552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T19:22:12.728 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 3 2024-04-25T19:22:12.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.730+0000 7f5e47e00640 1 -- 172.21.15.131:0/949576510 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f5e240744b0 msgr2=0x7f5e240769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:12.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.730+0000 7f5e47e00640 1 --2- 172.21.15.131:0/949576510 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f5e240744b0 0x7f5e240769c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800b740 tx=0x7f5e38008040 comp rx=0 tx=0).stop 2024-04-25T19:22:12.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.730+0000 7f5e47e00640 1 -- 172.21.15.131:0/949576510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e48160b90 msgr2=0x7f5e481eb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:12.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.730+0000 7f5e47e00640 1 --2- 172.21.15.131:0/949576510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e48160b90 0x7f5e481eb4b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000cc60 tx=0x7f5e4000a5c0 comp rx=0 tx=0).stop 2024-04-25T19:22:12.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.730+0000 7f5e47e00640 1 -- 172.21.15.131:0/949576510 shutdown_connections 2024-04-25T19:22:12.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.730+0000 7f5e47e00640 1 --2- 172.21.15.131:0/949576510 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f5e240744b0 0x7f5e240769c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:12.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.730+0000 7f5e47e00640 1 --2- 172.21.15.131:0/949576510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e480d50e0 0x7f5e48159990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:12.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.730+0000 7f5e47e00640 1 --2- 172.21.15.131:0/949576510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e48160b90 0x7f5e481eb4b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:12.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.730+0000 7f5e47e00640 1 --2- 172.21.15.131:0/949576510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e480d2ae0 0x7f5e480d0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:12.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.730+0000 7f5e47e00640 1 -- 172.21.15.131:0/949576510 >> 172.21.15.131:0/949576510 conn(0x7f5e4806c5c0 msgr2=0x7f5e480b7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:12.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.730+0000 7f5e47e00640 1 -- 172.21.15.131:0/949576510 shutdown_connections 2024-04-25T19:22:12.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:12.730+0000 7f5e47e00640 1 -- 172.21.15.131:0/949576510 wait complete. 2024-04-25T19:22:12.756 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:22:13.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.016+0000 7fd80e000640 1 Processor -- start 2024-04-25T19:22:13.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.016+0000 7fd80e000640 1 -- start start 2024-04-25T19:22:13.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.018+0000 7fd80e000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd8081612f0 0x7fd8080d12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:13.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.018+0000 7fd80e000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd80806f3e0 con 0x7fd8081434d0 2024-04-25T19:22:13.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.018+0000 7fd80e000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd80806f6c0 con 0x7fd8080d0ed0 2024-04-25T19:22:13.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.018+0000 7fd80e000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd8081438e0 con 0x7fd8081612f0 2024-04-25T19:22:13.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.018+0000 7fd807400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fd8081434d0 0x7fd808070480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:56524/0 (socket says 172.21.15.131:56524) 2024-04-25T19:22:13.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.018+0000 7fd807400640 1 -- 172.21.15.131:0/3279667770 learned_addr learned my addr 172.21.15.131:0/3279667770 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:13.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.019+0000 7fd806a00640 1 -- 172.21.15.131:0/3279667770 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 500691228 0 0) 0x7fd80806f3e0 con 0x7fd8081434d0 2024-04-25T19:22:13.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.019+0000 7fd806a00640 1 -- 172.21.15.131:0/3279667770 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7ec005730 con 0x7fd8081434d0 2024-04-25T19:22:13.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.019+0000 7fd807e00640 1 --2- 172.21.15.131:0/3279667770 >> v2:172.21.15.195:3300/0 conn(0x7fd8081612f0 0x7fd8080d12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:13.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.019+0000 7fd806a00640 1 -- 172.21.15.131:0/3279667770 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2365880801 0 0) 0x7fd7ec005730 con 0x7fd8081434d0 2024-04-25T19:22:13.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.019+0000 7fd806a00640 1 -- 172.21.15.131:0/3279667770 >> v2:172.21.15.195:3300/0 conn(0x7fd8081612f0 msgr2=0x7fd8080d12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:13.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.019+0000 7fd806a00640 1 --2- 172.21.15.131:0/3279667770 >> v2:172.21.15.195:3300/0 conn(0x7fd8081612f0 0x7fd8080d12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:13.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.019+0000 7fd806a00640 1 -- 172.21.15.131:0/3279667770 >> v1:172.21.15.195:6789/0 conn(0x7fd8080d0ed0 legacy=0x7fd808160be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:13.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.019+0000 7fd806a00640 1 -- 172.21.15.131:0/3279667770 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd80806f9a0 con 0x7fd8081434d0 2024-04-25T19:22:13.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.019+0000 7fd806a00640 1 -- 172.21.15.131:0/3279667770 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7fd7f8001670 con 0x7fd8081434d0 2024-04-25T19:22:13.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.019+0000 7fd806a00640 1 -- 172.21.15.131:0/3279667770 >> v1:172.21.15.131:6789/0 conn(0x7fd8081434d0 legacy=0x7fd808070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:13.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.019+0000 7fd806a00640 1 --2- 172.21.15.131:0/3279667770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7ec005bf0 0x7fd7ec006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:13.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.019+0000 7fd806a00640 1 --2- 172.21.15.131:0/3279667770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7ec006a10 0x7fd7ec006e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:13.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.019+0000 7fd806a00640 1 --2- 172.21.15.131:0/3279667770 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7ec007430 0x7fd7ec00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:13.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.019+0000 7fd806a00640 1 -- 172.21.15.131:0/3279667770 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd8081438e0 con 0x7fd7ec005bf0 2024-04-25T19:22:13.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.019+0000 7fd806a00640 1 -- 172.21.15.131:0/3279667770 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ec00e3c0 con 0x7fd7ec006a10 2024-04-25T19:22:13.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.019+0000 7fd806a00640 1 -- 172.21.15.131:0/3279667770 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd7ec00e5c0 con 0x7fd7ec007430 2024-04-25T19:22:13.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.020+0000 7fd807400640 1 --2- 172.21.15.131:0/3279667770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7ec005bf0 0x7fd7ec006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:13.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.020+0000 7fd807400640 1 -- 172.21.15.131:0/3279667770 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7ec007430 msgr2=0x7fd7ec00dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:13.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.020+0000 7fd7fea00640 1 --2- 172.21.15.131:0/3279667770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7ec006a10 0x7fd7ec006e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:13.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.020+0000 7fd807400640 1 --2- 172.21.15.131:0/3279667770 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7ec007430 0x7fd7ec00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:13.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.020+0000 7fd807400640 1 -- 172.21.15.131:0/3279667770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7ec006a10 msgr2=0x7fd7ec006e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:13.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.020+0000 7fd807400640 1 --2- 172.21.15.131:0/3279667770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7ec006a10 0x7fd7ec006e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:13.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.020+0000 7fd807e00640 1 -- 172.21.15.131:0/3279667770 reap_dead start 2024-04-25T19:22:13.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.020+0000 7fd807400640 1 -- 172.21.15.131:0/3279667770 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd80806f9a0 con 0x7fd7ec005bf0 2024-04-25T19:22:13.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.021+0000 7fd807400640 1 --2- 172.21.15.131:0/3279667770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7ec005bf0 0x7fd7ec006040 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800c370 tx=0x7fd7ec007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f32ca9a425c6449 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:13.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.021+0000 7fd806a00640 1 -- 172.21.15.131:0/3279667770 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8007e20 con 0x7fd7ec005bf0 2024-04-25T19:22:13.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.021+0000 7fd806a00640 1 -- 172.21.15.131:0/3279667770 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7f8034070 con 0x7fd7ec005bf0 2024-04-25T19:22:13.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.021+0000 7fd806a00640 1 -- 172.21.15.131:0/3279667770 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8005d10 con 0x7fd7ec005bf0 2024-04-25T19:22:13.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.022+0000 7fd80e000640 1 -- 172.21.15.131:0/3279667770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7ec005bf0 msgr2=0x7fd7ec006040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:13.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.022+0000 7fd80e000640 1 --2- 172.21.15.131:0/3279667770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7ec005bf0 0x7fd7ec006040 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800c370 tx=0x7fd7ec007a40 comp rx=0 tx=0).stop 2024-04-25T19:22:13.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.022+0000 7fd80e000640 1 -- 172.21.15.131:0/3279667770 shutdown_connections 2024-04-25T19:22:13.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.022+0000 7fd80e000640 1 --2- 172.21.15.131:0/3279667770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7ec005bf0 0x7fd7ec006040 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:13.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.022+0000 7fd80e000640 1 -- 172.21.15.131:0/3279667770 >> 172.21.15.131:0/3279667770 conn(0x7fd8080d1ae0 msgr2=0x7fd8080d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:13.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.022+0000 7fd80e000640 1 -- 172.21.15.131:0/3279667770 shutdown_connections 2024-04-25T19:22:13.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.022+0000 7fd80e000640 1 -- 172.21.15.131:0/3279667770 wait complete. 2024-04-25T19:22:13.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.024+0000 7fd80e000640 1 Processor -- start 2024-04-25T19:22:13.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.024+0000 7fd80e000640 1 -- start start 2024-04-25T19:22:13.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.026+0000 7fd80e000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7ec005bf0 0x7fd80815a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:13.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.026+0000 7fd80e000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd8080b2740 0x7fd80813f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:13.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.026+0000 7fd80e000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd80813fcb0 0x7fd8081f5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:13.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.026+0000 7fd80e000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd8080d12e0 con 0x7fd7ec005bf0 2024-04-25T19:22:13.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.026+0000 7fd80e000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd80806f090 con 0x7fd80813fcb0 2024-04-25T19:22:13.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.026+0000 7fd80e000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd8080d1460 con 0x7fd8080b2740 2024-04-25T19:22:13.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.026+0000 7fd807400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7ec005bf0 0x7fd80815a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:13.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.026+0000 7fd807400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7ec005bf0 0x7fd80815a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33858/0 (socket says 172.21.15.131:33858) 2024-04-25T19:22:13.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.026+0000 7fd807400640 1 -- 172.21.15.131:0/2192784475 learned_addr learned my addr 172.21.15.131:0/2192784475 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:13.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.026+0000 7fd807400640 1 -- 172.21.15.131:0/2192784475 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd8080b2740 msgr2=0x7fd80813f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:13.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.026+0000 7fd807400640 1 --2- 172.21.15.131:0/2192784475 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd8080b2740 0x7fd80813f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:13.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.027+0000 7fd807400640 1 -- 172.21.15.131:0/2192784475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd80813fcb0 msgr2=0x7fd8081f5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:13.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.027+0000 7fd807400640 1 --2- 172.21.15.131:0/2192784475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd80813fcb0 0x7fd8081f5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:13.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.027+0000 7fd807400640 1 -- 172.21.15.131:0/2192784475 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8081400c0 con 0x7fd7ec005bf0 2024-04-25T19:22:13.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.027+0000 7fd807400640 1 --2- 172.21.15.131:0/2192784475 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7ec005bf0 0x7fd80815a380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8031040 tx=0x7fd7f8001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:13.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.027+0000 7fd7ffe00640 1 -- 172.21.15.131:0/2192784475 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8004e60 con 0x7fd7ec005bf0 2024-04-25T19:22:13.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.027+0000 7fd7ffe00640 1 -- 172.21.15.131:0/2192784475 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7f803f030 con 0x7fd7ec005bf0 2024-04-25T19:22:13.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.027+0000 7fd7ffe00640 1 -- 172.21.15.131:0/2192784475 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f80076e0 con 0x7fd7ec005bf0 2024-04-25T19:22:13.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.027+0000 7fd80e000640 1 -- 172.21.15.131:0/2192784475 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd80813e4a0 con 0x7fd7ec005bf0 2024-04-25T19:22:13.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.027+0000 7fd80e000640 1 -- 172.21.15.131:0/2192784475 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd80813ea60 con 0x7fd7ec005bf0 2024-04-25T19:22:13.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.028+0000 7fd80e000640 1 -- 172.21.15.131:0/2192784475 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8080af8c0 con 0x7fd7ec005bf0 2024-04-25T19:22:13.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.029+0000 7fd7ffe00640 1 -- 172.21.15.131:0/2192784475 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd7f802e070 con 0x7fd7ec005bf0 2024-04-25T19:22:13.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.031+0000 7fd7ffe00640 1 --2- 172.21.15.131:0/2192784475 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd7e40744e0 0x7fd7e40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:13.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.031+0000 7fd7ffe00640 1 -- 172.21.15.131:0/2192784475 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fd7f80b5870 con 0x7fd7ec005bf0 2024-04-25T19:22:13.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.032+0000 7fd7fea00640 1 --2- 172.21.15.131:0/2192784475 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd7e40744e0 0x7fd7e40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:13.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.033+0000 7fd7fea00640 1 --2- 172.21.15.131:0/2192784475 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd7e40744e0 0x7fd7e40769f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd80813f6d0 tx=0x7fd7f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:13.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.036+0000 7fd7ffe00640 1 -- 172.21.15.131:0/2192784475 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd8080af8c0 con 0x7fd7ec005bf0 2024-04-25T19:22:13.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.232+0000 7fd80e000640 1 -- 172.21.15.131:0/2192784475 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd808050740 con 0x7fd7ec005bf0 2024-04-25T19:22:13.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.234+0000 7fd7ffe00640 1 -- 172.21.15.131:0/2192784475 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12908 (secure 0 0 0) 0x7fd7f8049030 con 0x7fd7ec005bf0 2024-04-25T19:22:13.235 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:13.235 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":16,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:22:06.942529+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:22:13.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.237+0000 7fd80e000640 1 -- 172.21.15.131:0/2192784475 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd7e40744e0 msgr2=0x7fd7e40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:13.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.237+0000 7fd80e000640 1 --2- 172.21.15.131:0/2192784475 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd7e40744e0 0x7fd7e40769f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd80813f6d0 tx=0x7fd7f0009040 comp rx=0 tx=0).stop 2024-04-25T19:22:13.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.237+0000 7fd80e000640 1 -- 172.21.15.131:0/2192784475 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7ec005bf0 msgr2=0x7fd80815a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:13.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.237+0000 7fd80e000640 1 --2- 172.21.15.131:0/2192784475 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7ec005bf0 0x7fd80815a380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8031040 tx=0x7fd7f8001a40 comp rx=0 tx=0).stop 2024-04-25T19:22:13.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.237+0000 7fd80e000640 1 -- 172.21.15.131:0/2192784475 shutdown_connections 2024-04-25T19:22:13.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.237+0000 7fd80e000640 1 --2- 172.21.15.131:0/2192784475 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd7e40744e0 0x7fd7e40769f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:13.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.237+0000 7fd80e000640 1 --2- 172.21.15.131:0/2192784475 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd8080b2740 0x7fd80813f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:13.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.237+0000 7fd80e000640 1 --2- 172.21.15.131:0/2192784475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd80813fcb0 0x7fd8081f5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:13.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.237+0000 7fd80e000640 1 --2- 172.21.15.131:0/2192784475 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7ec005bf0 0x7fd80815a380 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:13.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.237+0000 7fd80e000640 1 -- 172.21.15.131:0/2192784475 >> 172.21.15.131:0/2192784475 conn(0x7fd8080d1ae0 msgr2=0x7fd80815bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:13.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.237+0000 7fd80e000640 1 -- 172.21.15.131:0/2192784475 shutdown_connections 2024-04-25T19:22:13.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.237+0000 7fd80e000640 1 -- 172.21.15.131:0/2192784475 wait complete. 2024-04-25T19:22:13.263 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T19:22:04.178847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T19:22:13.263 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T19:22:13.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.526+0000 7fdc2a800640 1 Processor -- start 2024-04-25T19:22:13.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.526+0000 7fdc2a800640 1 -- start start 2024-04-25T19:22:13.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.528+0000 7fdc2a800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdc240d4250 0x7fdc240bb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:13.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.528+0000 7fdc2a800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdc240b4db0 0x7fdc240b91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:13.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.528+0000 7fdc2a800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc240d4900 con 0x7fdc240b7580 2024-04-25T19:22:13.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.528+0000 7fdc2a800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fdc240b9730 con 0x7fdc240b4db0 2024-04-25T19:22:13.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.528+0000 7fdc2a800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdc240d4be0 con 0x7fdc240d4250 2024-04-25T19:22:13.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.529+0000 7fdc28a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdc240b4db0 0x7fdc240b91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:13.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.529+0000 7fdc28a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdc240b4db0 0x7fdc240b91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33862/0 (socket says 172.21.15.131:33862) 2024-04-25T19:22:13.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.529+0000 7fdc28a00640 1 -- 172.21.15.131:0/2756835200 learned_addr learned my addr 172.21.15.131:0/2756835200 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:13.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.529+0000 7fdc29400640 1 --2- 172.21.15.131:0/2756835200 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdc240d4250 0x7fdc240bb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:13.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.529+0000 7fdc28a00640 1 -- 172.21.15.131:0/2756835200 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdc240d4250 msgr2=0x7fdc240bb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:13.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.529+0000 7fdc28a00640 1 --2- 172.21.15.131:0/2756835200 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdc240d4250 0x7fdc240bb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:13.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.529+0000 7fdc28a00640 1 -- 172.21.15.131:0/2756835200 >> v1:172.21.15.195:6789/0 conn(0x7fdc240b7580 legacy=0x7fdc240b7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:13.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.529+0000 7fdc28a00640 1 -- 172.21.15.131:0/2756835200 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc240d4ec0 con 0x7fdc240b4db0 2024-04-25T19:22:13.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.530+0000 7fdc28a00640 1 --2- 172.21.15.131:0/2756835200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc240b4db0 0x7fdc240b91f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdc240b98b0 tx=0x7fdc1002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2adcaae64f3dc7bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:13.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.530+0000 7fdc23e00640 1 -- 172.21.15.131:0/2756835200 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc10036070 con 0x7fdc240b4db0 2024-04-25T19:22:13.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.530+0000 7fdc23e00640 1 -- 172.21.15.131:0/2756835200 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc10031600 con 0x7fdc240b4db0 2024-04-25T19:22:13.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.530+0000 7fdc23e00640 1 -- 172.21.15.131:0/2756835200 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc100319d0 con 0x7fdc240b4db0 2024-04-25T19:22:13.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.531+0000 7fdc2a800640 1 -- 172.21.15.131:0/2756835200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc240b4db0 msgr2=0x7fdc240b91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:13.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.531+0000 7fdc2a800640 1 --2- 172.21.15.131:0/2756835200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc240b4db0 0x7fdc240b91f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdc240b98b0 tx=0x7fdc1002a6c0 comp rx=0 tx=0).stop 2024-04-25T19:22:13.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.531+0000 7fdc2a800640 1 -- 172.21.15.131:0/2756835200 shutdown_connections 2024-04-25T19:22:13.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.531+0000 7fdc2a800640 1 --2- 172.21.15.131:0/2756835200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc240b4db0 0x7fdc240b91f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:13.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.531+0000 7fdc2a800640 1 --2- 172.21.15.131:0/2756835200 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdc240d4250 0x7fdc240bb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:13.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.531+0000 7fdc2a800640 1 -- 172.21.15.131:0/2756835200 >> 172.21.15.131:0/2756835200 conn(0x7fdc240d2760 msgr2=0x7fdc240d2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:13.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.531+0000 7fdc2a800640 1 -- 172.21.15.131:0/2756835200 shutdown_connections 2024-04-25T19:22:13.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.531+0000 7fdc2a800640 1 -- 172.21.15.131:0/2756835200 wait complete. 2024-04-25T19:22:13.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.533+0000 7fdc2a800640 1 Processor -- start 2024-04-25T19:22:13.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.534+0000 7fdc2a800640 1 -- start start 2024-04-25T19:22:13.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.535+0000 7fdc2a800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdc240b4db0 0x7fdc24159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:13.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.535+0000 7fdc2a800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc240b7580 0x7fdc24162a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:13.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.535+0000 7fdc2a800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc240d4250 0x7fdc24162fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:13.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.535+0000 7fdc2a800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdc240d1700 con 0x7fdc240d4250 2024-04-25T19:22:13.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.535+0000 7fdc2a800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdc240d5480 con 0x7fdc240b7580 2024-04-25T19:22:13.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.535+0000 7fdc2a800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdc24163ff0 con 0x7fdc240b4db0 2024-04-25T19:22:13.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.535+0000 7fdc29e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc240d4250 0x7fdc24162fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:13.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.535+0000 7fdc29e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc240d4250 0x7fdc24162fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33864/0 (socket says 172.21.15.131:33864) 2024-04-25T19:22:13.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.535+0000 7fdc29e00640 1 -- 172.21.15.131:0/478782176 learned_addr learned my addr 172.21.15.131:0/478782176 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:13.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.536+0000 7fdc29400640 1 --2- 172.21.15.131:0/478782176 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdc240b4db0 0x7fdc24159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:13.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.536+0000 7fdc28a00640 1 --2- 172.21.15.131:0/478782176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc240b7580 0x7fdc24162a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:13.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.536+0000 7fdc29e00640 1 -- 172.21.15.131:0/478782176 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdc240b4db0 msgr2=0x7fdc24159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:13.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.536+0000 7fdc29e00640 1 --2- 172.21.15.131:0/478782176 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdc240b4db0 0x7fdc24159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:13.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.536+0000 7fdc29e00640 1 -- 172.21.15.131:0/478782176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc240b7580 msgr2=0x7fdc24162a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:13.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.536+0000 7fdc29e00640 1 --2- 172.21.15.131:0/478782176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc240b7580 0x7fdc24162a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:13.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.536+0000 7fdc29e00640 1 -- 172.21.15.131:0/478782176 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc2415c2a0 con 0x7fdc240d4250 2024-04-25T19:22:13.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.536+0000 7fdc28a00640 1 --2- 172.21.15.131:0/478782176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc240b7580 0x7fdc24162a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:13.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.536+0000 7fdc29400640 1 --2- 172.21.15.131:0/478782176 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdc240b4db0 0x7fdc24159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:13.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.536+0000 7fdc29e00640 1 --2- 172.21.15.131:0/478782176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc240d4250 0x7fdc24162fc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400b410 tx=0x7fdc1400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:13.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.536+0000 7fdc21600640 1 -- 172.21.15.131:0/478782176 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc14015030 con 0x7fdc240d4250 2024-04-25T19:22:13.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.536+0000 7fdc21600640 1 -- 172.21.15.131:0/478782176 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc14004020 con 0x7fdc240d4250 2024-04-25T19:22:13.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.536+0000 7fdc2a800640 1 -- 172.21.15.131:0/478782176 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc2415c580 con 0x7fdc240d4250 2024-04-25T19:22:13.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.536+0000 7fdc21600640 1 -- 172.21.15.131:0/478782176 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc14004450 con 0x7fdc240d4250 2024-04-25T19:22:13.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.536+0000 7fdc2a800640 1 -- 172.21.15.131:0/478782176 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc2415cb40 con 0x7fdc240d4250 2024-04-25T19:22:13.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.537+0000 7fdc2a800640 1 -- 172.21.15.131:0/478782176 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc24076c60 con 0x7fdc240d4250 2024-04-25T19:22:13.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.539+0000 7fdc21600640 1 -- 172.21.15.131:0/478782176 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fdc14018070 con 0x7fdc240d4250 2024-04-25T19:22:13.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.540+0000 7fdc21600640 1 --2- 172.21.15.131:0/478782176 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdc040744b0 0x7fdc040769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:13.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.540+0000 7fdc21600640 1 -- 172.21.15.131:0/478782176 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fdc140949f0 con 0x7fdc240d4250 2024-04-25T19:22:13.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.540+0000 7fdc29400640 1 --2- 172.21.15.131:0/478782176 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdc040744b0 0x7fdc040769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:13.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.541+0000 7fdc29400640 1 --2- 172.21.15.131:0/478782176 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdc040744b0 0x7fdc040769c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c006fd0 tx=0x7fdc1c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:13.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.544+0000 7fdc21600640 1 -- 172.21.15.131:0/478782176 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdc1405f4d0 con 0x7fdc240d4250 2024-04-25T19:22:13.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.733+0000 7fdc2a800640 1 -- 172.21.15.131:0/478782176 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdc240d4030 con 0x7fdc240d4250 2024-04-25T19:22:13.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.734+0000 7fdc21600640 1 -- 172.21.15.131:0/478782176 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7fdc1405edd0 con 0x7fdc240d4250 2024-04-25T19:22:13.735 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-25T19:22:13.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.736+0000 7fdc2a800640 1 -- 172.21.15.131:0/478782176 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdc040744b0 msgr2=0x7fdc040769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:13.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.736+0000 7fdc2a800640 1 --2- 172.21.15.131:0/478782176 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdc040744b0 0x7fdc040769c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c006fd0 tx=0x7fdc1c008040 comp rx=0 tx=0).stop 2024-04-25T19:22:13.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.736+0000 7fdc2a800640 1 -- 172.21.15.131:0/478782176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc240d4250 msgr2=0x7fdc24162fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:13.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.736+0000 7fdc2a800640 1 --2- 172.21.15.131:0/478782176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc240d4250 0x7fdc24162fc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400b410 tx=0x7fdc1400b8d0 comp rx=0 tx=0).stop 2024-04-25T19:22:13.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.737+0000 7fdc2a800640 1 -- 172.21.15.131:0/478782176 shutdown_connections 2024-04-25T19:22:13.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.737+0000 7fdc2a800640 1 --2- 172.21.15.131:0/478782176 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdc040744b0 0x7fdc040769c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:13.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.737+0000 7fdc2a800640 1 --2- 172.21.15.131:0/478782176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc240d4250 0x7fdc24162fc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:13.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.737+0000 7fdc2a800640 1 --2- 172.21.15.131:0/478782176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc240b7580 0x7fdc24162a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:13.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.737+0000 7fdc2a800640 1 --2- 172.21.15.131:0/478782176 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdc240b4db0 0x7fdc24159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:13.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.737+0000 7fdc2a800640 1 -- 172.21.15.131:0/478782176 >> 172.21.15.131:0/478782176 conn(0x7fdc240d2760 msgr2=0x7fdc240b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:13.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.737+0000 7fdc2a800640 1 -- 172.21.15.131:0/478782176 shutdown_connections 2024-04-25T19:22:13.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:13.737+0000 7fdc2a800640 1 -- 172.21.15.131:0/478782176 wait complete. 2024-04-25T19:22:13.761 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T19:22:14.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.020+0000 7fb7ae000640 1 Processor -- start 2024-04-25T19:22:14.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.020+0000 7fb7ae000640 1 -- start start 2024-04-25T19:22:14.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.022+0000 7fb7ae000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7a80b7750 0x7fb7a80d1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:14.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.022+0000 7fb7ae000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb7a80cf610 0x7fb7a8164800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:14.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.022+0000 7fb7ae000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a80b3af0 con 0x7fb7a8164d40 2024-04-25T19:22:14.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.022+0000 7fb7ae000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb7a8164320 con 0x7fb7a80cf610 2024-04-25T19:22:14.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.022+0000 7fb7ae000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb7a80b2f70 con 0x7fb7a80b7750 2024-04-25T19:22:14.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.022+0000 7fb7a7e00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fb7a8164d40 0x7fb7a806d7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:56528/0 (socket says 172.21.15.131:56528) 2024-04-25T19:22:14.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.022+0000 7fb7a7e00640 1 -- 172.21.15.131:0/1878488644 learned_addr learned my addr 172.21.15.131:0/1878488644 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:14.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.023+0000 7fb7a7400640 1 --2- 172.21.15.131:0/1878488644 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7a80b7750 0x7fb7a80d1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:14.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.023+0000 7fb79ea00640 1 --2- 172.21.15.131:0/1878488644 >> v2:172.21.15.195:3300/0 conn(0x7fb7a80cf610 0x7fb7a8164800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:14.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.023+0000 7fb7a6a00640 1 -- 172.21.15.131:0/1878488644 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1460054947 0 0) 0x7fb7a80b3af0 con 0x7fb7a8164d40 2024-04-25T19:22:14.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.023+0000 7fb7a6a00640 1 -- 172.21.15.131:0/1878488644 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb78c003520 con 0x7fb7a8164d40 2024-04-25T19:22:14.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.023+0000 7fb7a6a00640 1 -- 172.21.15.131:0/1878488644 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3102135678 0 0) 0x7fb78c003520 con 0x7fb7a8164d40 2024-04-25T19:22:14.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.023+0000 7fb7a6a00640 1 -- 172.21.15.131:0/1878488644 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7a80b7750 msgr2=0x7fb7a80d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:14.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.023+0000 7fb7a6a00640 1 --2- 172.21.15.131:0/1878488644 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7a80b7750 0x7fb7a80d1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:14.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.023+0000 7fb7a6a00640 1 -- 172.21.15.131:0/1878488644 >> v2:172.21.15.195:3300/0 conn(0x7fb7a80cf610 msgr2=0x7fb7a8164800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:14.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.023+0000 7fb7a6a00640 1 --2- 172.21.15.131:0/1878488644 >> v2:172.21.15.195:3300/0 conn(0x7fb7a80cf610 0x7fb7a8164800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:14.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.023+0000 7fb7a6a00640 1 -- 172.21.15.131:0/1878488644 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a80b3250 con 0x7fb7a8164d40 2024-04-25T19:22:14.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.023+0000 7fb7a6a00640 1 -- 172.21.15.131:0/1878488644 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7fb7a00019f0 con 0x7fb7a8164d40 2024-04-25T19:22:14.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.023+0000 7fb7a6a00640 1 -- 172.21.15.131:0/1878488644 >> v1:172.21.15.131:6789/0 conn(0x7fb7a8164d40 legacy=0x7fb7a806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:14.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.023+0000 7fb7a6a00640 1 --2- 172.21.15.131:0/1878488644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb78c0039b0 0x7fb78c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:14.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.023+0000 7fb7a6a00640 1 --2- 172.21.15.131:0/1878488644 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7a80b7750 0x7fb78c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:14.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.023+0000 7fb7a6a00640 1 --2- 172.21.15.131:0/1878488644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb78c004d40 0x7fb78c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:14.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.023+0000 7fb7a6a00640 1 -- 172.21.15.131:0/1878488644 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a8164320 con 0x7fb78c0039b0 2024-04-25T19:22:14.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.023+0000 7fb7a6a00640 1 -- 172.21.15.131:0/1878488644 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a80b2f70 con 0x7fb78c004d40 2024-04-25T19:22:14.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.023+0000 7fb7a6a00640 1 -- 172.21.15.131:0/1878488644 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb78c00ba40 con 0x7fb7a80b7750 2024-04-25T19:22:14.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.024+0000 7fb7a7400640 1 --2- 172.21.15.131:0/1878488644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb78c0039b0 0x7fb78c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:14.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.024+0000 7fb7a7400640 1 -- 172.21.15.131:0/1878488644 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7a80b7750 msgr2=0x7fb78c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:14.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.024+0000 7fb7a7400640 1 --2- 172.21.15.131:0/1878488644 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7a80b7750 0x7fb78c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:14.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.024+0000 7fb7a7400640 1 -- 172.21.15.131:0/1878488644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb78c004d40 msgr2=0x7fb78c005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:14.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.024+0000 7fb7a7400640 1 --2- 172.21.15.131:0/1878488644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb78c004d40 0x7fb78c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:14.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.024+0000 7fb7a7400640 1 -- 172.21.15.131:0/1878488644 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78c003520 con 0x7fb78c0039b0 2024-04-25T19:22:14.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.025+0000 7fb7a7400640 1 --2- 172.21.15.131:0/1878488644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb78c0039b0 0x7fb78c003e20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8072bc0 tx=0x7fb78c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204b788c748120e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:14.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.025+0000 7fb7a6a00640 1 -- 172.21.15.131:0/1878488644 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb798036070 con 0x7fb78c0039b0 2024-04-25T19:22:14.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.025+0000 7fb7a6a00640 1 -- 172.21.15.131:0/1878488644 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb798031400 con 0x7fb78c0039b0 2024-04-25T19:22:14.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.025+0000 7fb7a6a00640 1 -- 172.21.15.131:0/1878488644 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb798009690 con 0x7fb78c0039b0 2024-04-25T19:22:14.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.026+0000 7fb7ae000640 1 -- 172.21.15.131:0/1878488644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb78c0039b0 msgr2=0x7fb78c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:14.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.026+0000 7fb7ae000640 1 --2- 172.21.15.131:0/1878488644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb78c0039b0 0x7fb78c003e20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8072bc0 tx=0x7fb78c005830 comp rx=0 tx=0).stop 2024-04-25T19:22:14.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.026+0000 7fb7a7e00640 1 -- 172.21.15.131:0/1878488644 reap_dead start 2024-04-25T19:22:14.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.026+0000 7fb7ae000640 1 -- 172.21.15.131:0/1878488644 shutdown_connections 2024-04-25T19:22:14.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.026+0000 7fb7ae000640 1 -- 172.21.15.131:0/1878488644 >> 172.21.15.131:0/1878488644 conn(0x7fb7a809b7d0 msgr2=0x7fb7a80b7040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:14.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.026+0000 7fb7ae000640 1 -- 172.21.15.131:0/1878488644 shutdown_connections 2024-04-25T19:22:14.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.026+0000 7fb7ae000640 1 -- 172.21.15.131:0/1878488644 wait complete. 2024-04-25T19:22:14.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.028+0000 7fb7ae000640 1 Processor -- start 2024-04-25T19:22:14.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.028+0000 7fb7ae000640 1 -- start start 2024-04-25T19:22:14.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.030+0000 7fb7ae000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb78c0039b0 0x7fb7a809c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:14.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.030+0000 7fb7ae000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7a81524d0 0x7fb7a80b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:14.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.030+0000 7fb7ae000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7a80b0550 0x7fb7a81f9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:14.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.030+0000 7fb7ae000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a80cfa20 con 0x7fb7a81524d0 2024-04-25T19:22:14.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.030+0000 7fb7ae000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a80b3810 con 0x7fb78c0039b0 2024-04-25T19:22:14.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.030+0000 7fb7ae000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb7a806def0 con 0x7fb7a80b0550 2024-04-25T19:22:14.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.030+0000 7fb79ea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7a81524d0 0x7fb7a80b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:14.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.030+0000 7fb79ea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7a81524d0 0x7fb7a80b0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33874/0 (socket says 172.21.15.131:33874) 2024-04-25T19:22:14.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.030+0000 7fb79ea00640 1 -- 172.21.15.131:0/1766337744 learned_addr learned my addr 172.21.15.131:0/1766337744 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:14.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.031+0000 7fb7a7400640 1 --2- 172.21.15.131:0/1766337744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb78c0039b0 0x7fb7a809c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:14.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.031+0000 7fb7a7e00640 1 --2- 172.21.15.131:0/1766337744 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7a80b0550 0x7fb7a81f9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:14.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.031+0000 7fb79ea00640 1 -- 172.21.15.131:0/1766337744 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7a80b0550 msgr2=0x7fb7a81f9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:14.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.031+0000 7fb79ea00640 1 --2- 172.21.15.131:0/1766337744 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7a80b0550 0x7fb7a81f9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:14.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.031+0000 7fb79ea00640 1 -- 172.21.15.131:0/1766337744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb78c0039b0 msgr2=0x7fb7a809c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:14.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.031+0000 7fb79ea00640 1 --2- 172.21.15.131:0/1766337744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb78c0039b0 0x7fb7a809c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:14.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.031+0000 7fb79ea00640 1 -- 172.21.15.131:0/1766337744 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a80b0960 con 0x7fb7a81524d0 2024-04-25T19:22:14.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.031+0000 7fb7a7400640 1 --2- 172.21.15.131:0/1766337744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb78c0039b0 0x7fb7a809c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T19:22:14.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.031+0000 7fb79ea00640 1 --2- 172.21.15.131:0/1766337744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7a81524d0 0x7fb7a80b0010 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb79000e890 tx=0x7fb79000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:14.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.031+0000 7fb79fe00640 1 -- 172.21.15.131:0/1766337744 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb790017070 con 0x7fb7a81524d0 2024-04-25T19:22:14.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.031+0000 7fb79fe00640 1 -- 172.21.15.131:0/1766337744 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb79000c940 con 0x7fb7a81524d0 2024-04-25T19:22:14.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.032+0000 7fb7ae000640 1 -- 172.21.15.131:0/1766337744 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a809f0f0 con 0x7fb7a81524d0 2024-04-25T19:22:14.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.032+0000 7fb79fe00640 1 -- 172.21.15.131:0/1766337744 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79000cd10 con 0x7fb7a81524d0 2024-04-25T19:22:14.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.032+0000 7fb7ae000640 1 -- 172.21.15.131:0/1766337744 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a809f6b0 con 0x7fb7a81524d0 2024-04-25T19:22:14.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.033+0000 7fb7ae000640 1 -- 172.21.15.131:0/1766337744 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7a8050740 con 0x7fb7a81524d0 2024-04-25T19:22:14.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.034+0000 7fb79fe00640 1 -- 172.21.15.131:0/1766337744 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb79001a070 con 0x7fb7a81524d0 2024-04-25T19:22:14.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.035+0000 7fb79fe00640 1 --2- 172.21.15.131:0/1766337744 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb7840744b0 0x7fb7840769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:14.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.035+0000 7fb79fe00640 1 -- 172.21.15.131:0/1766337744 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fb7900951b0 con 0x7fb7a81524d0 2024-04-25T19:22:14.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.035+0000 7fb7a7400640 1 --2- 172.21.15.131:0/1766337744 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb7840744b0 0x7fb7840769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:14.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.036+0000 7fb7a7400640 1 --2- 172.21.15.131:0/1766337744 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb7840744b0 0x7fb7840769c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb798033000 tx=0x7fb798008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:14.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.039+0000 7fb79fe00640 1 -- 172.21.15.131:0/1766337744 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb7a80b0960 con 0x7fb7a81524d0 2024-04-25T19:22:14.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.241+0000 7fb7ae000640 1 -- 172.21.15.131:0/1766337744 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb7a80d2f00 con 0x7fb7a81524d0 2024-04-25T19:22:14.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.242+0000 7fb79fe00640 1 -- 172.21.15.131:0/1766337744 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7fb79005fbf0 con 0x7fb7a81524d0 2024-04-25T19:22:14.243 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:14.243 INFO:teuthology.orchestra.run.smithi131.stdout:[ 2024-04-25T19:22:14.243 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:22:14.243 INFO:teuthology.orchestra.run.smithi131.stdout: "poolnum": 1, 2024-04-25T19:22:14.243 INFO:teuthology.orchestra.run.smithi131.stdout: "poolname": ".mgr" 2024-04-25T19:22:14.243 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:22:14.243 INFO:teuthology.orchestra.run.smithi131.stdout:] 2024-04-25T19:22:14.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.244+0000 7fb7ae000640 1 -- 172.21.15.131:0/1766337744 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb7840744b0 msgr2=0x7fb7840769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:14.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.245+0000 7fb7ae000640 1 --2- 172.21.15.131:0/1766337744 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb7840744b0 0x7fb7840769c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb798033000 tx=0x7fb798008030 comp rx=0 tx=0).stop 2024-04-25T19:22:14.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.245+0000 7fb7ae000640 1 -- 172.21.15.131:0/1766337744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7a81524d0 msgr2=0x7fb7a80b0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:14.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.245+0000 7fb7ae000640 1 --2- 172.21.15.131:0/1766337744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7a81524d0 0x7fb7a80b0010 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb79000e890 tx=0x7fb79000ed50 comp rx=0 tx=0).stop 2024-04-25T19:22:14.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.245+0000 7fb7ae000640 1 -- 172.21.15.131:0/1766337744 shutdown_connections 2024-04-25T19:22:14.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.245+0000 7fb7ae000640 1 --2- 172.21.15.131:0/1766337744 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb7840744b0 0x7fb7840769c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:14.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.245+0000 7fb7ae000640 1 --2- 172.21.15.131:0/1766337744 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7a80b0550 0x7fb7a81f9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:14.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.245+0000 7fb7ae000640 1 --2- 172.21.15.131:0/1766337744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7a81524d0 0x7fb7a80b0010 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:14.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.245+0000 7fb7ae000640 1 --2- 172.21.15.131:0/1766337744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb78c0039b0 0x7fb7a809c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:14.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.245+0000 7fb7ae000640 1 -- 172.21.15.131:0/1766337744 >> 172.21.15.131:0/1766337744 conn(0x7fb7a809b7d0 msgr2=0x7fb7a80684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:14.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.245+0000 7fb7ae000640 1 -- 172.21.15.131:0/1766337744 shutdown_connections 2024-04-25T19:22:14.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.245+0000 7fb7ae000640 1 -- 172.21.15.131:0/1766337744 wait complete. 2024-04-25T19:22:14.269 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T19:22:14.269 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T19:22:14.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.543+0000 7ff843600640 1 Processor -- start 2024-04-25T19:22:14.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.543+0000 7ff843600640 1 -- start start 2024-04-25T19:22:14.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.545+0000 7ff843600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff83c0b77d0 0x7ff83c164bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:14.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.545+0000 7ff843600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff83c0d1170 0x7ff83c0b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:14.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.545+0000 7ff843600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff83c0cffa0 con 0x7ff83c0d0d60 2024-04-25T19:22:14.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.545+0000 7ff843600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ff83c0b7be0 con 0x7ff83c0d1170 2024-04-25T19:22:14.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.545+0000 7ff843600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7ff83c165110 con 0x7ff83c0b77d0 2024-04-25T19:22:14.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.545+0000 7ff841600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff83c0d1170 0x7ff83c0b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:14.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.545+0000 7ff841600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff83c0d1170 0x7ff83c0b2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33878/0 (socket says 172.21.15.131:33878) 2024-04-25T19:22:14.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.545+0000 7ff841600640 1 -- 172.21.15.131:0/3739424737 learned_addr learned my addr 172.21.15.131:0/3739424737 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:14.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.545+0000 7ff840c00640 1 --2- 172.21.15.131:0/3739424737 >> v2:172.21.15.195:3300/0 conn(0x7ff83c0b77d0 0x7ff83c164bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:14.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.546+0000 7ff841600640 1 -- 172.21.15.131:0/3739424737 >> v2:172.21.15.195:3300/0 conn(0x7ff83c0b77d0 msgr2=0x7ff83c164bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:14.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.546+0000 7ff841600640 1 --2- 172.21.15.131:0/3739424737 >> v2:172.21.15.195:3300/0 conn(0x7ff83c0b77d0 0x7ff83c164bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:14.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.546+0000 7ff841600640 1 -- 172.21.15.131:0/3739424737 >> v1:172.21.15.195:6789/0 conn(0x7ff83c0d0d60 legacy=0x7ff83c160360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:14.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.546+0000 7ff841600640 1 -- 172.21.15.131:0/3739424737 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff83c0d0280 con 0x7ff83c0d1170 2024-04-25T19:22:14.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.546+0000 7ff840c00640 1 --2- 172.21.15.131:0/3739424737 >> v2:172.21.15.195:3300/0 conn(0x7ff83c0b77d0 0x7ff83c164bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:14.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.547+0000 7ff841600640 1 --2- 172.21.15.131:0/3739424737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff83c0d1170 0x7ff83c0b2f40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff83c0b83a0 tx=0x7ff83402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f44d9b8857c73a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:14.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.547+0000 7ff83b400640 1 -- 172.21.15.131:0/3739424737 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff834037070 con 0x7ff83c0d1170 2024-04-25T19:22:14.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.547+0000 7ff83b400640 1 -- 172.21.15.131:0/3739424737 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff834032440 con 0x7ff83c0d1170 2024-04-25T19:22:14.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.547+0000 7ff83b400640 1 -- 172.21.15.131:0/3739424737 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff834032810 con 0x7ff83c0d1170 2024-04-25T19:22:14.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.548+0000 7ff843600640 1 -- 172.21.15.131:0/3739424737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff83c0d1170 msgr2=0x7ff83c0b2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:14.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.548+0000 7ff843600640 1 --2- 172.21.15.131:0/3739424737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff83c0d1170 0x7ff83c0b2f40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff83c0b83a0 tx=0x7ff83402a2c0 comp rx=0 tx=0).stop 2024-04-25T19:22:14.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.548+0000 7ff843600640 1 -- 172.21.15.131:0/3739424737 shutdown_connections 2024-04-25T19:22:14.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.548+0000 7ff843600640 1 --2- 172.21.15.131:0/3739424737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff83c0d1170 0x7ff83c0b2f40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:14.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.548+0000 7ff843600640 1 --2- 172.21.15.131:0/3739424737 >> v2:172.21.15.195:3300/0 conn(0x7ff83c0b77d0 0x7ff83c164bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:14.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.548+0000 7ff843600640 1 -- 172.21.15.131:0/3739424737 >> 172.21.15.131:0/3739424737 conn(0x7ff83c09b7d0 msgr2=0x7ff83c0b70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:14.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.548+0000 7ff843600640 1 -- 172.21.15.131:0/3739424737 shutdown_connections 2024-04-25T19:22:14.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.548+0000 7ff843600640 1 -- 172.21.15.131:0/3739424737 wait complete. 2024-04-25T19:22:14.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.550+0000 7ff843600640 1 Processor -- start 2024-04-25T19:22:14.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.551+0000 7ff843600640 1 -- start start 2024-04-25T19:22:14.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.552+0000 7ff843600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff83c0b77d0 0x7ff83c15a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:14.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.552+0000 7ff843600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff83c0d0d60 0x7ff83c09f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:14.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.552+0000 7ff843600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff83c0d1170 0x7ff83c163980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:14.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.552+0000 7ff843600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff83c160a70 con 0x7ff83c0d1170 2024-04-25T19:22:14.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.552+0000 7ff843600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff83c0d08d0 con 0x7ff83c0d0d60 2024-04-25T19:22:14.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.552+0000 7ff843600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff83c0b3480 con 0x7ff83c0b77d0 2024-04-25T19:22:14.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.552+0000 7ff841600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff83c0d1170 0x7ff83c163980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:14.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.552+0000 7ff841600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff83c0d1170 0x7ff83c163980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33880/0 (socket says 172.21.15.131:33880) 2024-04-25T19:22:14.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.552+0000 7ff841600640 1 -- 172.21.15.131:0/4100515819 learned_addr learned my addr 172.21.15.131:0/4100515819 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:14.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.553+0000 7ff840c00640 1 --2- 172.21.15.131:0/4100515819 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff83c0b77d0 0x7ff83c15a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:14.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.553+0000 7ff83be00640 1 --2- 172.21.15.131:0/4100515819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff83c0d0d60 0x7ff83c09f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:14.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.553+0000 7ff841600640 1 -- 172.21.15.131:0/4100515819 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff83c0b77d0 msgr2=0x7ff83c15a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:14.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.553+0000 7ff841600640 1 --2- 172.21.15.131:0/4100515819 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff83c0b77d0 0x7ff83c15a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:14.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.553+0000 7ff841600640 1 -- 172.21.15.131:0/4100515819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff83c0d0d60 msgr2=0x7ff83c09f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:14.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.553+0000 7ff841600640 1 --2- 172.21.15.131:0/4100515819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff83c0d0d60 0x7ff83c09f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:14.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.553+0000 7ff841600640 1 -- 172.21.15.131:0/4100515819 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff83c09ff30 con 0x7ff83c0d1170 2024-04-25T19:22:14.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.553+0000 7ff841600640 1 --2- 172.21.15.131:0/4100515819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff83c0d1170 0x7ff83c163980 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff83402a300 tx=0x7ff8340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:14.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.553+0000 7ff838c00640 1 -- 172.21.15.131:0/4100515819 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff834037040 con 0x7ff83c0d1170 2024-04-25T19:22:14.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.554+0000 7ff838c00640 1 -- 172.21.15.131:0/4100515819 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff834042070 con 0x7ff83c0d1170 2024-04-25T19:22:14.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.554+0000 7ff838c00640 1 -- 172.21.15.131:0/4100515819 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff834030c90 con 0x7ff83c0d1170 2024-04-25T19:22:14.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.554+0000 7ff843600640 1 -- 172.21.15.131:0/4100515819 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff83c160c90 con 0x7ff83c0d1170 2024-04-25T19:22:14.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.554+0000 7ff843600640 1 -- 172.21.15.131:0/4100515819 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff83c161250 con 0x7ff83c0d1170 2024-04-25T19:22:14.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.555+0000 7ff843600640 1 -- 172.21.15.131:0/4100515819 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff83c06e2b0 con 0x7ff83c0d1170 2024-04-25T19:22:14.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.556+0000 7ff838c00640 1 -- 172.21.15.131:0/4100515819 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff834047460 con 0x7ff83c0d1170 2024-04-25T19:22:14.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.558+0000 7ff838c00640 1 --2- 172.21.15.131:0/4100515819 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff8180744b0 0x7ff8180769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:14.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.558+0000 7ff838c00640 1 -- 172.21.15.131:0/4100515819 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff8340b5b40 con 0x7ff83c0d1170 2024-04-25T19:22:14.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.558+0000 7ff840c00640 1 --2- 172.21.15.131:0/4100515819 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff8180744b0 0x7ff8180769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:14.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.559+0000 7ff840c00640 1 --2- 172.21.15.131:0/4100515819 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff8180744b0 0x7ff8180769c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff82400a950 tx=0x7ff824008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:14.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.562+0000 7ff838c00640 1 -- 172.21.15.131:0/4100515819 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff83407ffc0 con 0x7ff83c0d1170 2024-04-25T19:22:14.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:14.760+0000 7ff843600640 1 -- 172.21.15.131:0/4100515819 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff83c068ec0 con 0x7ff83c0d1170 2024-04-25T19:22:15.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.014+0000 7ff838c00640 1 -- 172.21.15.131:0/4100515819 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7ff83c068ec0 con 0x7ff83c0d1170 2024-04-25T19:22:15.015 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'cephfs_metadata' created 2024-04-25T19:22:15.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.018+0000 7ff843600640 1 -- 172.21.15.131:0/4100515819 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff8180744b0 msgr2=0x7ff8180769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:15.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.018+0000 7ff843600640 1 --2- 172.21.15.131:0/4100515819 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff8180744b0 0x7ff8180769c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff82400a950 tx=0x7ff824008040 comp rx=0 tx=0).stop 2024-04-25T19:22:15.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.018+0000 7ff843600640 1 -- 172.21.15.131:0/4100515819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff83c0d1170 msgr2=0x7ff83c163980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:15.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.018+0000 7ff843600640 1 --2- 172.21.15.131:0/4100515819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff83c0d1170 0x7ff83c163980 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff83402a300 tx=0x7ff8340046c0 comp rx=0 tx=0).stop 2024-04-25T19:22:15.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.018+0000 7ff843600640 1 -- 172.21.15.131:0/4100515819 shutdown_connections 2024-04-25T19:22:15.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.018+0000 7ff843600640 1 --2- 172.21.15.131:0/4100515819 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff8180744b0 0x7ff8180769c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:15.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.018+0000 7ff843600640 1 --2- 172.21.15.131:0/4100515819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff83c0d1170 0x7ff83c163980 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:15.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.018+0000 7ff843600640 1 --2- 172.21.15.131:0/4100515819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff83c0d0d60 0x7ff83c09f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:15.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.018+0000 7ff843600640 1 --2- 172.21.15.131:0/4100515819 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff83c0b77d0 0x7ff83c15a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:15.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.018+0000 7ff843600640 1 -- 172.21.15.131:0/4100515819 >> 172.21.15.131:0/4100515819 conn(0x7ff83c09b7d0 msgr2=0x7ff83c0711c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:15.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.019+0000 7ff843600640 1 -- 172.21.15.131:0/4100515819 shutdown_connections 2024-04-25T19:22:15.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.019+0000 7ff843600640 1 -- 172.21.15.131:0/4100515819 wait complete. 2024-04-25T19:22:15.053 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T19:22:15.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.311+0000 7f9b7a000640 1 Processor -- start 2024-04-25T19:22:15.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.312+0000 7f9b7a000640 1 -- start start 2024-04-25T19:22:15.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.314+0000 7f9b7a000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b7415bb20 0x7f9b7406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:15.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.314+0000 7f9b7a000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9b7406db10 0x7f9b74165100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:15.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.314+0000 7f9b7a000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b7406df20 con 0x7f9b7415b710 2024-04-25T19:22:15.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.314+0000 7f9b7a000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f9b74169280 con 0x7f9b7406db10 2024-04-25T19:22:15.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.314+0000 7f9b7a000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9b740d1630 con 0x7f9b7415bb20 2024-04-25T19:22:15.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.314+0000 7f9b73e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9b7406db10 0x7f9b74165100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:15.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.314+0000 7f9b73400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f9b7415b710 0x7f9b740d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:56532/0 (socket says 172.21.15.131:56532) 2024-04-25T19:22:15.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.314+0000 7f9b73400640 1 -- 172.21.15.131:0/723960244 learned_addr learned my addr 172.21.15.131:0/723960244 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:15.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.314+0000 7f9b73e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9b7406db10 0x7f9b74165100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33886/0 (socket says 172.21.15.131:33886) 2024-04-25T19:22:15.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.314+0000 7f9b6be00640 1 --2- 172.21.15.131:0/723960244 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b7415bb20 0x7f9b7406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:15.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.314+0000 7f9b73e00640 1 -- 172.21.15.131:0/723960244 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b7415bb20 msgr2=0x7f9b7406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:15.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.314+0000 7f9b73e00640 1 --2- 172.21.15.131:0/723960244 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b7415bb20 0x7f9b7406d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:15.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.314+0000 7f9b73e00640 1 -- 172.21.15.131:0/723960244 >> v1:172.21.15.131:6789/0 conn(0x7f9b7415b710 legacy=0x7f9b740d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:15.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.315+0000 7f9b73e00640 1 -- 172.21.15.131:0/723960244 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b74168670 con 0x7f9b7406db10 2024-04-25T19:22:15.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.314+0000 7f9b72a00640 1 -- 172.21.15.131:0/723960244 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 206744178 0 0) 0x7f9b64001110 con 0x7f9b7415b710 2024-04-25T19:22:15.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.316+0000 7f9b73e00640 1 --2- 172.21.15.131:0/723960244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b7406db10 0x7f9b74165100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c009d90 tx=0x7f9b6c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c407121c48588df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:15.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.316+0000 7f9b72a00640 1 -- 172.21.15.131:0/723960244 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c007740 con 0x7f9b7406db10 2024-04-25T19:22:15.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.316+0000 7f9b72a00640 1 -- 172.21.15.131:0/723960244 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b6c0078e0 con 0x7f9b7406db10 2024-04-25T19:22:15.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.316+0000 7f9b72a00640 1 -- 172.21.15.131:0/723960244 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c007cb0 con 0x7f9b7406db10 2024-04-25T19:22:15.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.317+0000 7f9b7a000640 1 -- 172.21.15.131:0/723960244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b7406db10 msgr2=0x7f9b74165100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:15.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.317+0000 7f9b7a000640 1 --2- 172.21.15.131:0/723960244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b7406db10 0x7f9b74165100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c009d90 tx=0x7f9b6c02a660 comp rx=0 tx=0).stop 2024-04-25T19:22:15.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.317+0000 7f9b7a000640 1 -- 172.21.15.131:0/723960244 shutdown_connections 2024-04-25T19:22:15.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.317+0000 7f9b7a000640 1 --2- 172.21.15.131:0/723960244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b7406db10 0x7f9b74165100 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:15.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.317+0000 7f9b7a000640 1 --2- 172.21.15.131:0/723960244 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b7415bb20 0x7f9b7406d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:15.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.317+0000 7f9b7a000640 1 -- 172.21.15.131:0/723960244 >> 172.21.15.131:0/723960244 conn(0x7f9b74073090 msgr2=0x7f9b740734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:15.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.317+0000 7f9b7a000640 1 -- 172.21.15.131:0/723960244 shutdown_connections 2024-04-25T19:22:15.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.317+0000 7f9b7a000640 1 -- 172.21.15.131:0/723960244 wait complete. 2024-04-25T19:22:15.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.319+0000 7f9b7a000640 1 Processor -- start 2024-04-25T19:22:15.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.319+0000 7f9b7a000640 1 -- start start 2024-04-25T19:22:15.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.321+0000 7f9b7a000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b7406db10 0x7f9b7415c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:15.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.321+0000 7f9b7a000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b7415b710 0x7f9b7414d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:15.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.321+0000 7f9b7a000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b7415bb20 0x7f9b7406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:15.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.321+0000 7f9b7a000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9b74168f10 con 0x7f9b7406db10 2024-04-25T19:22:15.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.321+0000 7f9b7a000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9b74168c30 con 0x7f9b7415b710 2024-04-25T19:22:15.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.321+0000 7f9b7a000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9b740b6180 con 0x7f9b7415bb20 2024-04-25T19:22:15.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.321+0000 7f9b73400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b7406db10 0x7f9b7415c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:15.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.321+0000 7f9b73400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b7406db10 0x7f9b7415c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33892/0 (socket says 172.21.15.131:33892) 2024-04-25T19:22:15.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.321+0000 7f9b73400640 1 -- 172.21.15.131:0/2419323916 learned_addr learned my addr 172.21.15.131:0/2419323916 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:15.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.321+0000 7f9b6be00640 1 --2- 172.21.15.131:0/2419323916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b7415b710 0x7f9b7414d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:15.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.321+0000 7f9b73400640 1 -- 172.21.15.131:0/2419323916 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b7415bb20 msgr2=0x7f9b7406f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:15.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.321+0000 7f9b73400640 1 --2- 172.21.15.131:0/2419323916 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b7415bb20 0x7f9b7406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:15.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.322+0000 7f9b73400640 1 -- 172.21.15.131:0/2419323916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b7415b710 msgr2=0x7f9b7414d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:15.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.322+0000 7f9b73400640 1 --2- 172.21.15.131:0/2419323916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b7415b710 0x7f9b7414d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:15.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.322+0000 7f9b73400640 1 -- 172.21.15.131:0/2419323916 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b7414df30 con 0x7f9b7406db10 2024-04-25T19:22:15.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.322+0000 7f9b73400640 1 --2- 172.21.15.131:0/2419323916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b7406db10 0x7f9b7415c940 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9b6400c460 tx=0x7f9b6400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:15.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.322+0000 7f9b6b400640 1 -- 172.21.15.131:0/2419323916 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b64018070 con 0x7f9b7406db10 2024-04-25T19:22:15.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.322+0000 7f9b6b400640 1 -- 172.21.15.131:0/2419323916 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b64007500 con 0x7f9b7406db10 2024-04-25T19:22:15.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.322+0000 7f9b6b400640 1 -- 172.21.15.131:0/2419323916 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b64004a20 con 0x7f9b7406db10 2024-04-25T19:22:15.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.322+0000 7f9b7a000640 1 -- 172.21.15.131:0/2419323916 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b7415fad0 con 0x7f9b7406db10 2024-04-25T19:22:15.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.322+0000 7f9b7a000640 1 -- 172.21.15.131:0/2419323916 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b74160090 con 0x7f9b7406db10 2024-04-25T19:22:15.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.323+0000 7f9b7a000640 1 -- 172.21.15.131:0/2419323916 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b74050740 con 0x7f9b7406db10 2024-04-25T19:22:15.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.325+0000 7f9b6b400640 1 -- 172.21.15.131:0/2419323916 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9b6401b360 con 0x7f9b7406db10 2024-04-25T19:22:15.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.326+0000 7f9b6b400640 1 --2- 172.21.15.131:0/2419323916 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9b500744e0 0x7f9b500769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:15.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.326+0000 7f9b6b400640 1 -- 172.21.15.131:0/2419323916 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f9b64094660 con 0x7f9b7406db10 2024-04-25T19:22:15.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.327+0000 7f9b6be00640 1 --2- 172.21.15.131:0/2419323916 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9b500744e0 0x7f9b500769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:15.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.328+0000 7f9b6be00640 1 --2- 172.21.15.131:0/2419323916 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9b500744e0 0x7f9b500769f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c006fd0 tx=0x7f9b5c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:15.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.330+0000 7f9b6b400640 1 -- 172.21.15.131:0/2419323916 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9b64021020 con 0x7f9b7406db10 2024-04-25T19:22:15.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:15.531+0000 7f9b7a000640 1 -- 172.21.15.131:0/2419323916 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f9b740b5d40 con 0x7f9b7406db10 2024-04-25T19:22:16.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.031+0000 7f9b6b400640 1 -- 172.21.15.131:0/2419323916 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7f9b7406df20 con 0x7f9b7406db10 2024-04-25T19:22:16.032 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'cephfs_data' created 2024-04-25T19:22:16.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.035+0000 7f9b7a000640 1 -- 172.21.15.131:0/2419323916 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9b500744e0 msgr2=0x7f9b500769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:16.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.035+0000 7f9b7a000640 1 --2- 172.21.15.131:0/2419323916 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9b500744e0 0x7f9b500769f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c006fd0 tx=0x7f9b5c008040 comp rx=0 tx=0).stop 2024-04-25T19:22:16.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.035+0000 7f9b7a000640 1 -- 172.21.15.131:0/2419323916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b7406db10 msgr2=0x7f9b7415c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:16.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.035+0000 7f9b7a000640 1 --2- 172.21.15.131:0/2419323916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b7406db10 0x7f9b7415c940 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9b6400c460 tx=0x7f9b6400c920 comp rx=0 tx=0).stop 2024-04-25T19:22:16.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.035+0000 7f9b7a000640 1 -- 172.21.15.131:0/2419323916 shutdown_connections 2024-04-25T19:22:16.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.035+0000 7f9b7a000640 1 --2- 172.21.15.131:0/2419323916 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9b500744e0 0x7f9b500769f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:16.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.035+0000 7f9b7a000640 1 --2- 172.21.15.131:0/2419323916 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b7415bb20 0x7f9b7406f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:16.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.035+0000 7f9b7a000640 1 --2- 172.21.15.131:0/2419323916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b7415b710 0x7f9b7414d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:16.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.035+0000 7f9b7a000640 1 --2- 172.21.15.131:0/2419323916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b7406db10 0x7f9b7415c940 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:16.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.035+0000 7f9b7a000640 1 -- 172.21.15.131:0/2419323916 >> 172.21.15.131:0/2419323916 conn(0x7f9b74073090 msgr2=0x7f9b740734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:16.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.035+0000 7f9b7a000640 1 -- 172.21.15.131:0/2419323916 shutdown_connections 2024-04-25T19:22:16.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.036+0000 7f9b7a000640 1 -- 172.21.15.131:0/2419323916 wait complete. 2024-04-25T19:22:16.082 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T19:22:16.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.330+0000 7f62cbe00640 1 Processor -- start 2024-04-25T19:22:16.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.330+0000 7f62cbe00640 1 -- start start 2024-04-25T19:22:16.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.333+0000 7f62cbe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f62c406dce0 0x7f62c415f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:16.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.333+0000 7f62cbe00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f62c40b0af0 0x7f62c415faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:16.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.333+0000 7f62cbe00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62c40cdea0 con 0x7f62c40cd9a0 2024-04-25T19:22:16.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.333+0000 7f62cbe00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f62c40ceab0 con 0x7f62c406dce0 2024-04-25T19:22:16.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.333+0000 7f62cbe00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f62c40ce180 con 0x7f62c40b0af0 2024-04-25T19:22:16.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.333+0000 7f62c8a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f62c406dce0 0x7f62c415f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:16.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.333+0000 7f62c8a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f62c406dce0 0x7f62c415f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33908/0 (socket says 172.21.15.131:33908) 2024-04-25T19:22:16.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.333+0000 7f62c8a00640 1 -- 172.21.15.131:0/3413931792 learned_addr learned my addr 172.21.15.131:0/3413931792 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:16.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.334+0000 7f62c9e00640 1 --2- 172.21.15.131:0/3413931792 >> v2:172.21.15.195:3300/0 conn(0x7f62c40b0af0 0x7f62c415faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:16.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.334+0000 7f62c8a00640 1 -- 172.21.15.131:0/3413931792 >> v2:172.21.15.195:3300/0 conn(0x7f62c40b0af0 msgr2=0x7f62c415faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:16.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.334+0000 7f62c8a00640 1 --2- 172.21.15.131:0/3413931792 >> v2:172.21.15.195:3300/0 conn(0x7f62c40b0af0 0x7f62c415faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:16.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.334+0000 7f62c8a00640 1 -- 172.21.15.131:0/3413931792 >> v1:172.21.15.195:6789/0 conn(0x7f62c40cd9a0 legacy=0x7f62c406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:16.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.334+0000 7f62c8a00640 1 -- 172.21.15.131:0/3413931792 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c40ce460 con 0x7f62c406dce0 2024-04-25T19:22:16.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.335+0000 7f62c8a00640 1 --2- 172.21.15.131:0/3413931792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62c406dce0 0x7f62c415f360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f62c4148020 tx=0x7f62b002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4e7a0781227290 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:16.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.335+0000 7f62c3e00640 1 -- 172.21.15.131:0/3413931792 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b0037070 con 0x7f62c406dce0 2024-04-25T19:22:16.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.335+0000 7f62c3e00640 1 -- 172.21.15.131:0/3413931792 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62b0032440 con 0x7f62c406dce0 2024-04-25T19:22:16.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.335+0000 7f62c3e00640 1 -- 172.21.15.131:0/3413931792 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b0032810 con 0x7f62c406dce0 2024-04-25T19:22:16.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.336+0000 7f62cbe00640 1 -- 172.21.15.131:0/3413931792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62c406dce0 msgr2=0x7f62c415f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:16.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.336+0000 7f62cbe00640 1 --2- 172.21.15.131:0/3413931792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62c406dce0 0x7f62c415f360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f62c4148020 tx=0x7f62b002a230 comp rx=0 tx=0).stop 2024-04-25T19:22:16.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.336+0000 7f62cbe00640 1 -- 172.21.15.131:0/3413931792 shutdown_connections 2024-04-25T19:22:16.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.336+0000 7f62cbe00640 1 --2- 172.21.15.131:0/3413931792 >> v2:172.21.15.195:3300/0 conn(0x7f62c40b0af0 0x7f62c415faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:16.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.336+0000 7f62cbe00640 1 --2- 172.21.15.131:0/3413931792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62c406dce0 0x7f62c415f360 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:16.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.336+0000 7f62cbe00640 1 -- 172.21.15.131:0/3413931792 >> 172.21.15.131:0/3413931792 conn(0x7f62c4073090 msgr2=0x7f62c40734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:16.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.337+0000 7f62cbe00640 1 -- 172.21.15.131:0/3413931792 shutdown_connections 2024-04-25T19:22:16.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.337+0000 7f62cbe00640 1 -- 172.21.15.131:0/3413931792 wait complete. 2024-04-25T19:22:16.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.339+0000 7f62cbe00640 1 Processor -- start 2024-04-25T19:22:16.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.339+0000 7f62cbe00640 1 -- start start 2024-04-25T19:22:16.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.340+0000 7f62cbe00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62c40b0af0 0x7f62c4142880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:16.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.341+0000 7f62cbe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62c40cd9a0 0x7f62c41422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:16.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.341+0000 7f62cbe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62c40b2b00 0x7f62c41446f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:16.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.341+0000 7f62cbe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f62c40cef40 con 0x7f62c40b2b00 2024-04-25T19:22:16.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.341+0000 7f62cbe00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f62c40b0f00 con 0x7f62c40b0af0 2024-04-25T19:22:16.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.341+0000 7f62cbe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f62c40cf0c0 con 0x7f62c40cd9a0 2024-04-25T19:22:16.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.341+0000 7f62c9e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62c40b2b00 0x7f62c41446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:16.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.341+0000 7f62c9e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62c40b2b00 0x7f62c41446f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33920/0 (socket says 172.21.15.131:33920) 2024-04-25T19:22:16.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.341+0000 7f62c9e00640 1 -- 172.21.15.131:0/193217565 learned_addr learned my addr 172.21.15.131:0/193217565 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:16.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.341+0000 7f62c9400640 1 --2- 172.21.15.131:0/193217565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62c40b0af0 0x7f62c4142880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:16.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.341+0000 7f62c8a00640 1 --2- 172.21.15.131:0/193217565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62c40cd9a0 0x7f62c41422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:16.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.341+0000 7f62c9e00640 1 -- 172.21.15.131:0/193217565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62c40cd9a0 msgr2=0x7f62c41422b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:16.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.341+0000 7f62c9e00640 1 --2- 172.21.15.131:0/193217565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62c40cd9a0 0x7f62c41422b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:16.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.341+0000 7f62c9e00640 1 -- 172.21.15.131:0/193217565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62c40b0af0 msgr2=0x7f62c4142880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:16.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.341+0000 7f62c9e00640 1 --2- 172.21.15.131:0/193217565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62c40b0af0 0x7f62c4142880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:16.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.341+0000 7f62c9e00640 1 -- 172.21.15.131:0/193217565 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c41430d0 con 0x7f62c40b2b00 2024-04-25T19:22:16.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.341+0000 7f62c8a00640 1 --2- 172.21.15.131:0/193217565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62c40cd9a0 0x7f62c41422b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:16.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.342+0000 7f62c9e00640 1 --2- 172.21.15.131:0/193217565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62c40b2b00 0x7f62c41446f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00c550 tx=0x7f62bc00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:16.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.342+0000 7f62c1600640 1 -- 172.21.15.131:0/193217565 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62bc015070 con 0x7f62c40b2b00 2024-04-25T19:22:16.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.342+0000 7f62c1600640 1 -- 172.21.15.131:0/193217565 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62bc004220 con 0x7f62c40b2b00 2024-04-25T19:22:16.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.342+0000 7f62c1600640 1 -- 172.21.15.131:0/193217565 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62bc003610 con 0x7f62c40b2b00 2024-04-25T19:22:16.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.342+0000 7f62cbe00640 1 -- 172.21.15.131:0/193217565 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62c41433b0 con 0x7f62c40b2b00 2024-04-25T19:22:16.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.342+0000 7f62cbe00640 1 -- 172.21.15.131:0/193217565 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62c4143970 con 0x7f62c40b2b00 2024-04-25T19:22:16.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.343+0000 7f62cbe00640 1 -- 172.21.15.131:0/193217565 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62c4142e20 con 0x7f62c40b2b00 2024-04-25T19:22:16.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.345+0000 7f62c1600640 1 -- 172.21.15.131:0/193217565 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f62bc0037b0 con 0x7f62c40b2b00 2024-04-25T19:22:16.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.345+0000 7f62c1600640 1 --2- 172.21.15.131:0/193217565 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f62a40744b0 0x7f62a40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:16.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.346+0000 7f62c1600640 1 -- 172.21.15.131:0/193217565 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f62bc094f60 con 0x7f62c40b2b00 2024-04-25T19:22:16.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.346+0000 7f62c9400640 1 --2- 172.21.15.131:0/193217565 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f62a40744b0 0x7f62a40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:16.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.347+0000 7f62c9400640 1 --2- 172.21.15.131:0/193217565 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f62a40744b0 0x7f62a40769c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f62b8009f20 tx=0x7f62b80094d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:16.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.351+0000 7f62c1600640 1 -- 172.21.15.131:0/193217565 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f62bc05f7d0 con 0x7f62c40b2b00 2024-04-25T19:22:16.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:16.577+0000 7f62cbe00640 1 -- 172.21.15.131:0/193217565 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f62c4050740 con 0x7f62c40b2b00 2024-04-25T19:22:17.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.059+0000 7f62c1600640 1 -- 172.21.15.131:0/193217565 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f62bc05f0d0 con 0x7f62c40b2b00 2024-04-25T19:22:17.067 INFO:teuthology.orchestra.run.smithi131.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T19:22:17.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.071+0000 7f62cbe00640 1 -- 172.21.15.131:0/193217565 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f62a40744b0 msgr2=0x7f62a40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:17.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.071+0000 7f62cbe00640 1 --2- 172.21.15.131:0/193217565 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f62a40744b0 0x7f62a40769c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f62b8009f20 tx=0x7f62b80094d0 comp rx=0 tx=0).stop 2024-04-25T19:22:17.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.071+0000 7f62cbe00640 1 -- 172.21.15.131:0/193217565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62c40b2b00 msgr2=0x7f62c41446f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:17.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.071+0000 7f62cbe00640 1 --2- 172.21.15.131:0/193217565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62c40b2b00 0x7f62c41446f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00c550 tx=0x7f62bc00ca10 comp rx=0 tx=0).stop 2024-04-25T19:22:17.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.072+0000 7f62cbe00640 1 -- 172.21.15.131:0/193217565 shutdown_connections 2024-04-25T19:22:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.072+0000 7f62cbe00640 1 --2- 172.21.15.131:0/193217565 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f62a40744b0 0x7f62a40769c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.072+0000 7f62cbe00640 1 --2- 172.21.15.131:0/193217565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62c40cd9a0 0x7f62c41422b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.072+0000 7f62cbe00640 1 --2- 172.21.15.131:0/193217565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62c40b2b00 0x7f62c41446f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.072+0000 7f62cbe00640 1 --2- 172.21.15.131:0/193217565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62c40b0af0 0x7f62c4142880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.072+0000 7f62cbe00640 1 -- 172.21.15.131:0/193217565 >> 172.21.15.131:0/193217565 conn(0x7f62c4073090 msgr2=0x7f62c415d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.072+0000 7f62cbe00640 1 -- 172.21.15.131:0/193217565 shutdown_connections 2024-04-25T19:22:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.072+0000 7f62cbe00640 1 -- 172.21.15.131:0/193217565 wait complete. 2024-04-25T19:22:17.111 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:22:17.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.352+0000 7fbe9de00640 1 Processor -- start 2024-04-25T19:22:17.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.352+0000 7fbe9de00640 1 -- start start 2024-04-25T19:22:17.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.355+0000 7fbe9de00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbe980b6430 0x7fbe9806d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:17.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.355+0000 7fbe9de00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe98160aa0 0x7fbe98160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:17.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.355+0000 7fbe9de00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbe980d0bd0 0x7fbe980d0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:17.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.355+0000 7fbe9de00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fbe981613f0 con 0x7fbe980b6430 2024-04-25T19:22:17.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.355+0000 7fbe9de00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fbe980d1520 con 0x7fbe980d0bd0 2024-04-25T19:22:17.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.355+0000 7fbe9de00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbe9806c7d0 con 0x7fbe98160aa0 2024-04-25T19:22:17.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.355+0000 7fbe9ca00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbe980b6430 0x7fbe9806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:17.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.355+0000 7fbe9ca00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbe980b6430 0x7fbe9806d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33936/0 (socket says 172.21.15.131:33936) 2024-04-25T19:22:17.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.355+0000 7fbe9ca00640 1 -- 172.21.15.131:0/3808385986 learned_addr learned my addr 172.21.15.131:0/3808385986 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:17.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.355+0000 7fbe8fe00640 1 --2- 172.21.15.131:0/3808385986 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe98160aa0 0x7fbe98160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:17.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.355+0000 7fbe9ca00640 1 -- 172.21.15.131:0/3808385986 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe98160aa0 msgr2=0x7fbe98160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:17.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.355+0000 7fbe9ca00640 1 --2- 172.21.15.131:0/3808385986 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe98160aa0 0x7fbe98160eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:17.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.355+0000 7fbe9d400640 1 --2- 172.21.15.131:0/3808385986 >> v2:172.21.15.195:3300/0 conn(0x7fbe980d0bd0 0x7fbe980d0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:17.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.355+0000 7fbe9ca00640 1 -- 172.21.15.131:0/3808385986 >> v2:172.21.15.195:3300/0 conn(0x7fbe980d0bd0 msgr2=0x7fbe980d0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:17.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.356+0000 7fbe9ca00640 1 --2- 172.21.15.131:0/3808385986 >> v2:172.21.15.195:3300/0 conn(0x7fbe980d0bd0 0x7fbe980d0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:17.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.356+0000 7fbe9ca00640 1 -- 172.21.15.131:0/3808385986 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9806cab0 con 0x7fbe980b6430 2024-04-25T19:22:17.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.356+0000 7fbe8fe00640 1 --2- 172.21.15.131:0/3808385986 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe98160aa0 0x7fbe98160eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:17.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.356+0000 7fbe9d400640 1 --2- 172.21.15.131:0/3808385986 >> v2:172.21.15.195:3300/0 conn(0x7fbe980d0bd0 0x7fbe980d0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:17.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.357+0000 7fbe9ca00640 1 --2- 172.21.15.131:0/3808385986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe980b6430 0x7fbe9806d870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbe980b4980 tx=0x7fbe8802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7364be05e85dbe58 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:17.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.357+0000 7fbe97e00640 1 -- 172.21.15.131:0/3808385986 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88037070 con 0x7fbe980b6430 2024-04-25T19:22:17.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.357+0000 7fbe97e00640 1 -- 172.21.15.131:0/3808385986 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe8802ae00 con 0x7fbe980b6430 2024-04-25T19:22:17.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.357+0000 7fbe97e00640 1 -- 172.21.15.131:0/3808385986 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88032660 con 0x7fbe980b6430 2024-04-25T19:22:17.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.358+0000 7fbe9de00640 1 -- 172.21.15.131:0/3808385986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe980b6430 msgr2=0x7fbe9806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:17.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.358+0000 7fbe9de00640 1 --2- 172.21.15.131:0/3808385986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe980b6430 0x7fbe9806d870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbe980b4980 tx=0x7fbe8802a0b0 comp rx=0 tx=0).stop 2024-04-25T19:22:17.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.358+0000 7fbe9de00640 1 -- 172.21.15.131:0/3808385986 shutdown_connections 2024-04-25T19:22:17.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.358+0000 7fbe9de00640 1 --2- 172.21.15.131:0/3808385986 >> v2:172.21.15.195:3300/0 conn(0x7fbe980d0bd0 0x7fbe980d0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:17.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.358+0000 7fbe9de00640 1 --2- 172.21.15.131:0/3808385986 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe98160aa0 0x7fbe98160eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:17.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.358+0000 7fbe9de00640 1 --2- 172.21.15.131:0/3808385986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe980b6430 0x7fbe9806d870 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:17.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.358+0000 7fbe9de00640 1 -- 172.21.15.131:0/3808385986 >> 172.21.15.131:0/3808385986 conn(0x7fbe980d1720 msgr2=0x7fbe980d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:17.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.358+0000 7fbe9de00640 1 -- 172.21.15.131:0/3808385986 shutdown_connections 2024-04-25T19:22:17.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.358+0000 7fbe9de00640 1 -- 172.21.15.131:0/3808385986 wait complete. 2024-04-25T19:22:17.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.360+0000 7fbe9de00640 1 Processor -- start 2024-04-25T19:22:17.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.360+0000 7fbe9de00640 1 -- start start 2024-04-25T19:22:17.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.362+0000 7fbe9de00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe980b6430 0x7fbe980cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:17.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.362+0000 7fbe9de00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe980d0bd0 0x7fbe981f96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:17.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.362+0000 7fbe9de00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe98160aa0 0x7fbe981f9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:17.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.362+0000 7fbe9de00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbe980b6840 con 0x7fbe98160aa0 2024-04-25T19:22:17.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.362+0000 7fbe9de00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9806d070 con 0x7fbe980b6430 2024-04-25T19:22:17.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.362+0000 7fbe9de00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbe9806ddb0 con 0x7fbe980d0bd0 2024-04-25T19:22:17.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.362+0000 7fbe9d400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe98160aa0 0x7fbe981f9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:17.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.362+0000 7fbe9d400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe98160aa0 0x7fbe981f9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33952/0 (socket says 172.21.15.131:33952) 2024-04-25T19:22:17.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.362+0000 7fbe9d400640 1 -- 172.21.15.131:0/3565895465 learned_addr learned my addr 172.21.15.131:0/3565895465 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:17.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.362+0000 7fbe8fe00640 1 --2- 172.21.15.131:0/3565895465 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe980d0bd0 0x7fbe981f96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:17.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.362+0000 7fbe9ca00640 1 --2- 172.21.15.131:0/3565895465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe980b6430 0x7fbe980cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:17.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.363+0000 7fbe9d400640 1 -- 172.21.15.131:0/3565895465 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe980d0bd0 msgr2=0x7fbe981f96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:17.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.363+0000 7fbe9d400640 1 --2- 172.21.15.131:0/3565895465 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe980d0bd0 0x7fbe981f96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:17.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.363+0000 7fbe9d400640 1 -- 172.21.15.131:0/3565895465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe980b6430 msgr2=0x7fbe980cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:17.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.363+0000 7fbe9d400640 1 --2- 172.21.15.131:0/3565895465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe980b6430 0x7fbe980cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:17.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.363+0000 7fbe9d400640 1 -- 172.21.15.131:0/3565895465 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe98157fd0 con 0x7fbe98160aa0 2024-04-25T19:22:17.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.363+0000 7fbe9d400640 1 --2- 172.21.15.131:0/3565895465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe98160aa0 0x7fbe981f9bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000cca0 tx=0x7fbe9000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:17.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.363+0000 7fbe95600640 1 -- 172.21.15.131:0/3565895465 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9000f680 con 0x7fbe98160aa0 2024-04-25T19:22:17.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.363+0000 7fbe95600640 1 -- 172.21.15.131:0/3565895465 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe9000f840 con 0x7fbe98160aa0 2024-04-25T19:22:17.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.363+0000 7fbe95600640 1 -- 172.21.15.131:0/3565895465 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9000fc30 con 0x7fbe98160aa0 2024-04-25T19:22:17.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.363+0000 7fbe9de00640 1 -- 172.21.15.131:0/3565895465 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe981582b0 con 0x7fbe98160aa0 2024-04-25T19:22:17.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.364+0000 7fbe9de00640 1 -- 172.21.15.131:0/3565895465 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe98158870 con 0x7fbe98160aa0 2024-04-25T19:22:17.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.365+0000 7fbe9de00640 1 -- 172.21.15.131:0/3565895465 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe98050740 con 0x7fbe98160aa0 2024-04-25T19:22:17.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.366+0000 7fbe95600640 1 -- 172.21.15.131:0/3565895465 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbe9000e3e0 con 0x7fbe98160aa0 2024-04-25T19:22:17.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.367+0000 7fbe95600640 1 --2- 172.21.15.131:0/3565895465 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbe740744b0 0x7fbe740769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:17.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.367+0000 7fbe95600640 1 -- 172.21.15.131:0/3565895465 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fbe90095ff0 con 0x7fbe98160aa0 2024-04-25T19:22:17.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.367+0000 7fbe9ca00640 1 --2- 172.21.15.131:0/3565895465 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbe740744b0 0x7fbe740769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:17.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.369+0000 7fbe9ca00640 1 --2- 172.21.15.131:0/3565895465 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbe740744b0 0x7fbe740769c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbe88034000 tx=0x7fbe8802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:17.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.372+0000 7fbe95600640 1 -- 172.21.15.131:0/3565895465 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbe90014030 con 0x7fbe98160aa0 2024-04-25T19:22:17.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.561+0000 7fbe9de00640 1 -- 172.21.15.131:0/3565895465 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe98157d60 con 0x7fbe98160aa0 2024-04-25T19:22:17.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.564+0000 7fbe95600640 1 -- 172.21.15.131:0/3565895465 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16642 (secure 0 0 0) 0x7fbe90060720 con 0x7fbe98160aa0 2024-04-25T19:22:17.565 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:17.565 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":19,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:22:16.578476+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:22:14.779716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T19:22:15.552027+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:22:17.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.567+0000 7fbe9de00640 1 -- 172.21.15.131:0/3565895465 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbe740744b0 msgr2=0x7fbe740769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:17.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.567+0000 7fbe9de00640 1 --2- 172.21.15.131:0/3565895465 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbe740744b0 0x7fbe740769c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbe88034000 tx=0x7fbe8802e000 comp rx=0 tx=0).stop 2024-04-25T19:22:17.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.567+0000 7fbe9de00640 1 -- 172.21.15.131:0/3565895465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe98160aa0 msgr2=0x7fbe981f9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:17.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.567+0000 7fbe9de00640 1 --2- 172.21.15.131:0/3565895465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe98160aa0 0x7fbe981f9bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000cca0 tx=0x7fbe9000a650 comp rx=0 tx=0).stop 2024-04-25T19:22:17.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.567+0000 7fbe9de00640 1 -- 172.21.15.131:0/3565895465 shutdown_connections 2024-04-25T19:22:17.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.567+0000 7fbe9de00640 1 --2- 172.21.15.131:0/3565895465 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbe740744b0 0x7fbe740769c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:17.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.567+0000 7fbe9de00640 1 --2- 172.21.15.131:0/3565895465 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe980d0bd0 0x7fbe981f96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:17.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.567+0000 7fbe9de00640 1 --2- 172.21.15.131:0/3565895465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe98160aa0 0x7fbe981f9bf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:17.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.567+0000 7fbe9de00640 1 --2- 172.21.15.131:0/3565895465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe980b6430 0x7fbe980cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:17.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.567+0000 7fbe9de00640 1 -- 172.21.15.131:0/3565895465 >> 172.21.15.131:0/3565895465 conn(0x7fbe980d1720 msgr2=0x7fbe9806f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:17.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.567+0000 7fbe9de00640 1 -- 172.21.15.131:0/3565895465 shutdown_connections 2024-04-25T19:22:17.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.567+0000 7fbe9de00640 1 -- 172.21.15.131:0/3565895465 wait complete. 2024-04-25T19:22:17.591 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:22:17.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.845+0000 7f2a5da00640 1 Processor -- start 2024-04-25T19:22:17.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.846+0000 7f2a5da00640 1 -- start start 2024-04-25T19:22:17.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.848+0000 7f2a5da00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2a580b6430 0x7f2a5806d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:17.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.848+0000 7f2a5da00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2a58160aa0 0x7f2a58160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:17.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.848+0000 7f2a5da00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a581613f0 con 0x7f2a580d0bd0 2024-04-25T19:22:17.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.848+0000 7f2a5da00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f2a5806c7d0 con 0x7f2a580b6430 2024-04-25T19:22:17.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.848+0000 7f2a5da00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f2a5806cab0 con 0x7f2a58160aa0 2024-04-25T19:22:17.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.848+0000 7f2a57e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2a580b6430 0x7f2a5806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:17.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.848+0000 7f2a5d000640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f2a580d0bd0 0x7f2a580d0fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:39712/0 (socket says 172.21.15.131:39712) 2024-04-25T19:22:17.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.848+0000 7f2a5d000640 1 -- 172.21.15.131:0/1660522190 learned_addr learned my addr 172.21.15.131:0/1660522190 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:17.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.848+0000 7f2a57400640 1 --2- 172.21.15.131:0/1660522190 >> v2:172.21.15.195:3300/0 conn(0x7f2a58160aa0 0x7f2a58160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:17.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.849+0000 7f2a57e00640 1 -- 172.21.15.131:0/1660522190 >> v2:172.21.15.195:3300/0 conn(0x7f2a58160aa0 msgr2=0x7f2a58160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:17.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.849+0000 7f2a57e00640 1 --2- 172.21.15.131:0/1660522190 >> v2:172.21.15.195:3300/0 conn(0x7f2a58160aa0 0x7f2a58160eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:17.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.849+0000 7f2a57e00640 1 -- 172.21.15.131:0/1660522190 >> v1:172.21.15.131:6789/0 conn(0x7f2a580d0bd0 legacy=0x7f2a580d0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:17.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.849+0000 7f2a57e00640 1 -- 172.21.15.131:0/1660522190 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5806cd90 con 0x7f2a580b6430 2024-04-25T19:22:17.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.849+0000 7f2a57e00640 1 --2- 172.21.15.131:0/1660522190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a580b6430 0x7f2a5806d870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2a58071020 tx=0x7f2a4802a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6bf59f9be5db8e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:17.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.850+0000 7f2a56a00640 1 -- 172.21.15.131:0/1660522190 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a48037070 con 0x7f2a580b6430 2024-04-25T19:22:17.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.850+0000 7f2a56a00640 1 -- 172.21.15.131:0/1660522190 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a4802add0 con 0x7f2a580b6430 2024-04-25T19:22:17.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.850+0000 7f2a56a00640 1 -- 172.21.15.131:0/1660522190 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a48032660 con 0x7f2a580b6430 2024-04-25T19:22:17.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.851+0000 7f2a5da00640 1 -- 172.21.15.131:0/1660522190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a580b6430 msgr2=0x7f2a5806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:17.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.851+0000 7f2a5da00640 1 --2- 172.21.15.131:0/1660522190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a580b6430 0x7f2a5806d870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2a58071020 tx=0x7f2a4802a080 comp rx=0 tx=0).stop 2024-04-25T19:22:17.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.851+0000 7f2a5da00640 1 -- 172.21.15.131:0/1660522190 shutdown_connections 2024-04-25T19:22:17.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.851+0000 7f2a5da00640 1 --2- 172.21.15.131:0/1660522190 >> v2:172.21.15.195:3300/0 conn(0x7f2a58160aa0 0x7f2a58160eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:17.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.851+0000 7f2a5da00640 1 --2- 172.21.15.131:0/1660522190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a580b6430 0x7f2a5806d870 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:17.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.851+0000 7f2a5da00640 1 -- 172.21.15.131:0/1660522190 >> 172.21.15.131:0/1660522190 conn(0x7f2a580d1720 msgr2=0x7f2a580d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:17.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.851+0000 7f2a5da00640 1 -- 172.21.15.131:0/1660522190 shutdown_connections 2024-04-25T19:22:17.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.851+0000 7f2a5da00640 1 -- 172.21.15.131:0/1660522190 wait complete. 2024-04-25T19:22:17.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.853+0000 7f2a5da00640 1 Processor -- start 2024-04-25T19:22:17.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.854+0000 7f2a5da00640 1 -- start start 2024-04-25T19:22:17.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.855+0000 7f2a5da00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a580b6430 0x7f2a5815c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:17.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.855+0000 7f2a5da00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a580d0bd0 0x7f2a580cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:17.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.855+0000 7f2a5da00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a58160aa0 0x7f2a5815d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:17.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.855+0000 7f2a5da00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5806ddb0 con 0x7f2a58160aa0 2024-04-25T19:22:17.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.855+0000 7f2a5da00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2a580b6840 con 0x7f2a580d0bd0 2024-04-25T19:22:17.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.855+0000 7f2a5da00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2a5806df30 con 0x7f2a580b6430 2024-04-25T19:22:17.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.855+0000 7f2a5d000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a58160aa0 0x7f2a5815d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:17.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.855+0000 7f2a5d000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a58160aa0 0x7f2a5815d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54004/0 (socket says 172.21.15.131:54004) 2024-04-25T19:22:17.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.855+0000 7f2a5d000640 1 -- 172.21.15.131:0/211601240 learned_addr learned my addr 172.21.15.131:0/211601240 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:17.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.856+0000 7f2a57e00640 1 --2- 172.21.15.131:0/211601240 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a580b6430 0x7f2a5815c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:17.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.856+0000 7f2a57400640 1 --2- 172.21.15.131:0/211601240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a580d0bd0 0x7f2a580cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:17.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.856+0000 7f2a5d000640 1 -- 172.21.15.131:0/211601240 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a580b6430 msgr2=0x7f2a5815c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:17.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.856+0000 7f2a5d000640 1 --2- 172.21.15.131:0/211601240 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a580b6430 0x7f2a5815c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:17.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.856+0000 7f2a5d000640 1 -- 172.21.15.131:0/211601240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a580d0bd0 msgr2=0x7f2a580cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:17.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.856+0000 7f2a5d000640 1 --2- 172.21.15.131:0/211601240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a580d0bd0 0x7f2a580cb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:17.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.856+0000 7f2a5d000640 1 -- 172.21.15.131:0/211601240 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5815cf10 con 0x7f2a58160aa0 2024-04-25T19:22:17.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.856+0000 7f2a5d000640 1 --2- 172.21.15.131:0/211601240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a58160aa0 0x7f2a5815d320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000caa0 tx=0x7f2a5000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:17.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.856+0000 7f2a4fe00640 1 -- 172.21.15.131:0/211601240 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a50017070 con 0x7f2a58160aa0 2024-04-25T19:22:17.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.856+0000 7f2a4fe00640 1 -- 172.21.15.131:0/211601240 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a5000aba0 con 0x7f2a58160aa0 2024-04-25T19:22:17.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.856+0000 7f2a5da00640 1 -- 172.21.15.131:0/211601240 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a580cda60 con 0x7f2a58160aa0 2024-04-25T19:22:17.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.856+0000 7f2a4fe00640 1 -- 172.21.15.131:0/211601240 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a50012400 con 0x7f2a58160aa0 2024-04-25T19:22:17.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.856+0000 7f2a5da00640 1 -- 172.21.15.131:0/211601240 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a580ce020 con 0x7f2a58160aa0 2024-04-25T19:22:17.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.857+0000 7f2a5da00640 1 -- 172.21.15.131:0/211601240 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a58050740 con 0x7f2a58160aa0 2024-04-25T19:22:17.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.859+0000 7f2a4fe00640 1 -- 172.21.15.131:0/211601240 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2a5001a070 con 0x7f2a58160aa0 2024-04-25T19:22:17.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.860+0000 7f2a4fe00640 1 --2- 172.21.15.131:0/211601240 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2a380744e0 0x7f2a380769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:17.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.860+0000 7f2a4fe00640 1 -- 172.21.15.131:0/211601240 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f2a50094e60 con 0x7f2a58160aa0 2024-04-25T19:22:17.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.860+0000 7f2a57e00640 1 --2- 172.21.15.131:0/211601240 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2a380744e0 0x7f2a380769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:17.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.861+0000 7f2a57e00640 1 --2- 172.21.15.131:0/211601240 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2a380744e0 0x7f2a380769f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2a48034000 tx=0x7f2a4802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:17.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:17.864+0000 7f2a4fe00640 1 -- 172.21.15.131:0/211601240 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2a581613f0 con 0x7f2a58160aa0 2024-04-25T19:22:18.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.048+0000 7f2a5da00640 1 -- 172.21.15.131:0/211601240 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2a580cb8f0 con 0x7f2a58160aa0 2024-04-25T19:22:18.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.051+0000 7f2a4fe00640 1 -- 172.21.15.131:0/211601240 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16642 (secure 0 0 0) 0x7f2a5005ef00 con 0x7f2a58160aa0 2024-04-25T19:22:18.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:18.052 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":19,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:22:16.578476+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:22:14.779716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T19:22:15.552027+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:22:18.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.053+0000 7f2a5da00640 1 -- 172.21.15.131:0/211601240 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2a380744e0 msgr2=0x7f2a380769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:18.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.053+0000 7f2a5da00640 1 --2- 172.21.15.131:0/211601240 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2a380744e0 0x7f2a380769f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2a48034000 tx=0x7f2a4802e000 comp rx=0 tx=0).stop 2024-04-25T19:22:18.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.053+0000 7f2a5da00640 1 -- 172.21.15.131:0/211601240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a58160aa0 msgr2=0x7f2a5815d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:18.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.053+0000 7f2a5da00640 1 --2- 172.21.15.131:0/211601240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a58160aa0 0x7f2a5815d320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000caa0 tx=0x7f2a5000cf60 comp rx=0 tx=0).stop 2024-04-25T19:22:18.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.053+0000 7f2a5da00640 1 -- 172.21.15.131:0/211601240 shutdown_connections 2024-04-25T19:22:18.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.054+0000 7f2a5da00640 1 --2- 172.21.15.131:0/211601240 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2a380744e0 0x7f2a380769f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:18.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.054+0000 7f2a5da00640 1 --2- 172.21.15.131:0/211601240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a58160aa0 0x7f2a5815d320 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:18.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.054+0000 7f2a5da00640 1 --2- 172.21.15.131:0/211601240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a580d0bd0 0x7f2a580cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:18.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.054+0000 7f2a5da00640 1 --2- 172.21.15.131:0/211601240 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a580b6430 0x7f2a5815c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:18.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.054+0000 7f2a5da00640 1 -- 172.21.15.131:0/211601240 >> 172.21.15.131:0/211601240 conn(0x7f2a580d1720 msgr2=0x7f2a580d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:18.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.054+0000 7f2a5da00640 1 -- 172.21.15.131:0/211601240 shutdown_connections 2024-04-25T19:22:18.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.054+0000 7f2a5da00640 1 -- 172.21.15.131:0/211601240 wait complete. 2024-04-25T19:22:18.082 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T19:22:18.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.347+0000 7f6245c00640 1 Processor -- start 2024-04-25T19:22:18.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.347+0000 7f6245c00640 1 -- start start 2024-04-25T19:22:18.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.350+0000 7f6245c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f624006dce0 0x7f624015f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:18.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.350+0000 7f6245c00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62400cdea0 con 0x7f62400b0af0 2024-04-25T19:22:18.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.350+0000 7f6245c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62400ce180 con 0x7f62400cd9a0 2024-04-25T19:22:18.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.350+0000 7f6245c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f62400ceab0 con 0x7f624006dce0 2024-04-25T19:22:18.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.350+0000 7f623f400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f62400b0af0 0x7f624015faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:39724/0 (socket says 172.21.15.131:39724) 2024-04-25T19:22:18.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.350+0000 7f623f400640 1 -- 172.21.15.131:0/4057537838 learned_addr learned my addr 172.21.15.131:0/4057537838 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:18.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.350+0000 7f623e000640 1 -- 172.21.15.131:0/4057537838 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3842616970 0 0) 0x7f62400cdea0 con 0x7f62400b0af0 2024-04-25T19:22:18.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.351+0000 7f6236000640 1 --2- 172.21.15.131:0/4057537838 >> v2:172.21.15.195:3300/0 conn(0x7f624006dce0 0x7f624015f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:18.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.351+0000 7f623e000640 1 -- 172.21.15.131:0/4057537838 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6224003520 con 0x7f62400b0af0 2024-04-25T19:22:18.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.351+0000 7f623e000640 1 -- 172.21.15.131:0/4057537838 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3130572666 0 0) 0x7f6224003520 con 0x7f62400b0af0 2024-04-25T19:22:18.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.351+0000 7f623e000640 1 -- 172.21.15.131:0/4057537838 >> v2:172.21.15.195:3300/0 conn(0x7f624006dce0 msgr2=0x7f624015f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:18.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.351+0000 7f623e000640 1 --2- 172.21.15.131:0/4057537838 >> v2:172.21.15.195:3300/0 conn(0x7f624006dce0 0x7f624015f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:18.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.351+0000 7f623e000640 1 -- 172.21.15.131:0/4057537838 >> v1:172.21.15.195:6789/0 conn(0x7f62400cd9a0 legacy=0x7f624006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:18.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.351+0000 7f623e000640 1 -- 172.21.15.131:0/4057537838 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62400ce460 con 0x7f62400b0af0 2024-04-25T19:22:18.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.351+0000 7f623e000640 1 -- 172.21.15.131:0/4057537838 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f6238001670 con 0x7f62400b0af0 2024-04-25T19:22:18.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.351+0000 7f623e000640 1 -- 172.21.15.131:0/4057537838 >> v1:172.21.15.131:6789/0 conn(0x7f62400b0af0 legacy=0x7f624015faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:18.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.351+0000 7f623e000640 1 --2- 172.21.15.131:0/4057537838 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62240039b0 0x7f6224003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:18.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.351+0000 7f623e000640 1 --2- 172.21.15.131:0/4057537838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6224004800 0x7f6224004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:18.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.351+0000 7f623e000640 1 --2- 172.21.15.131:0/4057537838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6224005270 0x7f622400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:18.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.351+0000 7f623e000640 1 -- 172.21.15.131:0/4057537838 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f62400ceab0 con 0x7f6224005270 2024-04-25T19:22:18.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.351+0000 7f623e000640 1 -- 172.21.15.131:0/4057537838 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f622400c200 con 0x7f6224004800 2024-04-25T19:22:18.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.351+0000 7f623e000640 1 -- 172.21.15.131:0/4057537838 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f622400c400 con 0x7f62240039b0 2024-04-25T19:22:18.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.352+0000 7f623f400640 1 --2- 172.21.15.131:0/4057537838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6224005270 0x7f622400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:18.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.352+0000 7f623ea00640 1 --2- 172.21.15.131:0/4057537838 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62240039b0 0x7f6224003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:18.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.352+0000 7f6236000640 1 --2- 172.21.15.131:0/4057537838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6224004800 0x7f6224004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:18.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.352+0000 7f623f400640 1 -- 172.21.15.131:0/4057537838 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62240039b0 msgr2=0x7f6224003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:18.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.352+0000 7f623f400640 1 --2- 172.21.15.131:0/4057537838 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62240039b0 0x7f6224003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:18.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.352+0000 7f623f400640 1 -- 172.21.15.131:0/4057537838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6224004800 msgr2=0x7f6224004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:18.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.352+0000 7f623f400640 1 --2- 172.21.15.131:0/4057537838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6224004800 0x7f6224004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:18.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.352+0000 7f623f400640 1 -- 172.21.15.131:0/4057537838 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6224003520 con 0x7f6224005270 2024-04-25T19:22:18.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.352+0000 7f623ea00640 1 --2- 172.21.15.131:0/4057537838 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62240039b0 0x7f6224003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T19:22:18.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.352+0000 7f6236000640 1 --2- 172.21.15.131:0/4057537838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6224004800 0x7f6224004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T19:22:18.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.353+0000 7f623f400640 1 -- 172.21.15.131:0/4057537838 reap_dead start 2024-04-25T19:22:18.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.353+0000 7f623f400640 1 --2- 172.21.15.131:0/4057537838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6224005270 0x7f622400b9c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f623800c240 tx=0x7f6224005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe87cdaf119f3c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:18.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.354+0000 7f623e000640 1 -- 172.21.15.131:0/4057537838 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6238007d10 con 0x7f6224005270 2024-04-25T19:22:18.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.354+0000 7f623e000640 1 -- 172.21.15.131:0/4057537838 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6238005ad0 con 0x7f6224005270 2024-04-25T19:22:18.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.354+0000 7f623e000640 1 -- 172.21.15.131:0/4057537838 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6238007070 con 0x7f6224005270 2024-04-25T19:22:18.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.354+0000 7f6245c00640 1 -- 172.21.15.131:0/4057537838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6224005270 msgr2=0x7f622400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:18.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.354+0000 7f6245c00640 1 --2- 172.21.15.131:0/4057537838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6224005270 0x7f622400b9c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f623800c240 tx=0x7f6224005830 comp rx=0 tx=0).stop 2024-04-25T19:22:18.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.355+0000 7f6245c00640 1 -- 172.21.15.131:0/4057537838 shutdown_connections 2024-04-25T19:22:18.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.355+0000 7f6245c00640 1 --2- 172.21.15.131:0/4057537838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6224005270 0x7f622400b9c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:18.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.355+0000 7f6245c00640 1 -- 172.21.15.131:0/4057537838 >> 172.21.15.131:0/4057537838 conn(0x7f6240073090 msgr2=0x7f62400734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:18.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.355+0000 7f6245c00640 1 -- 172.21.15.131:0/4057537838 shutdown_connections 2024-04-25T19:22:18.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.355+0000 7f6245c00640 1 -- 172.21.15.131:0/4057537838 wait complete. 2024-04-25T19:22:18.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.357+0000 7f6245c00640 1 Processor -- start 2024-04-25T19:22:18.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.357+0000 7f6245c00640 1 -- start start 2024-04-25T19:22:18.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.359+0000 7f6245c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6224005270 0x7f6240156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:18.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.359+0000 7f6245c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f624013ca90 0x7f62400b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:18.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.359+0000 7f6245c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62400b27f0 0x7f6240146f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:18.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.359+0000 7f6245c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f62400cef40 con 0x7f624013ca90 2024-04-25T19:22:18.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.359+0000 7f6245c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f62400b0f00 con 0x7f6224005270 2024-04-25T19:22:18.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.359+0000 7f6245c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f62400cf0c0 con 0x7f62400b27f0 2024-04-25T19:22:18.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.359+0000 7f6236000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f624013ca90 0x7f62400b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:18.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.359+0000 7f6236000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f624013ca90 0x7f62400b22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54014/0 (socket says 172.21.15.131:54014) 2024-04-25T19:22:18.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.359+0000 7f6236000640 1 -- 172.21.15.131:0/2434629211 learned_addr learned my addr 172.21.15.131:0/2434629211 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:18.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.359+0000 7f623f400640 1 --2- 172.21.15.131:0/2434629211 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62400b27f0 0x7f6240146f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:18.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.359+0000 7f6236000640 1 -- 172.21.15.131:0/2434629211 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62400b27f0 msgr2=0x7f6240146f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:18.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.359+0000 7f6236000640 1 --2- 172.21.15.131:0/2434629211 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62400b27f0 0x7f6240146f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:18.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.360+0000 7f6236000640 1 -- 172.21.15.131:0/2434629211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6224005270 msgr2=0x7f6240156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:18.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.360+0000 7f623ea00640 1 --2- 172.21.15.131:0/2434629211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6224005270 0x7f6240156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:18.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.360+0000 7f6236000640 1 --2- 172.21.15.131:0/2434629211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6224005270 0x7f6240156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:18.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.360+0000 7f6236000640 1 -- 172.21.15.131:0/2434629211 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6240145ec0 con 0x7f624013ca90 2024-04-25T19:22:18.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.360+0000 7f623f400640 1 --2- 172.21.15.131:0/2434629211 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62400b27f0 0x7f6240146f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:18.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.360+0000 7f6236000640 1 --2- 172.21.15.131:0/2434629211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f624013ca90 0x7f62400b22b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6228009ce0 tx=0x7f6228007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:18.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.360+0000 7f6237400640 1 -- 172.21.15.131:0/2434629211 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6228014610 con 0x7f624013ca90 2024-04-25T19:22:18.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.360+0000 7f6237400640 1 -- 172.21.15.131:0/2434629211 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6228019070 con 0x7f624013ca90 2024-04-25T19:22:18.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.360+0000 7f6245c00640 1 -- 172.21.15.131:0/2434629211 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62401461a0 con 0x7f624013ca90 2024-04-25T19:22:18.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.360+0000 7f6237400640 1 -- 172.21.15.131:0/2434629211 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62280149d0 con 0x7f624013ca90 2024-04-25T19:22:18.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.360+0000 7f6245c00640 1 -- 172.21.15.131:0/2434629211 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6240146760 con 0x7f624013ca90 2024-04-25T19:22:18.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.361+0000 7f6245c00640 1 -- 172.21.15.131:0/2434629211 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6240050740 con 0x7f624013ca90 2024-04-25T19:22:18.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.363+0000 7f6237400640 1 -- 172.21.15.131:0/2434629211 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6228014b70 con 0x7f624013ca90 2024-04-25T19:22:18.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.363+0000 7f6237400640 1 --2- 172.21.15.131:0/2434629211 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f621c0744b0 0x7f621c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:18.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.364+0000 7f6237400640 1 -- 172.21.15.131:0/2434629211 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6228095c20 con 0x7f624013ca90 2024-04-25T19:22:18.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.364+0000 7f623ea00640 1 --2- 172.21.15.131:0/2434629211 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f621c0744b0 0x7f621c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:18.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.365+0000 7f623ea00640 1 --2- 172.21.15.131:0/2434629211 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f621c0744b0 0x7f621c0769c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6230001530 tx=0x7f6230009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:18.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.368+0000 7f6237400640 1 -- 172.21.15.131:0/2434629211 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6228060310 con 0x7f624013ca90 2024-04-25T19:22:18.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:18.609+0000 7f6245c00640 1 -- 172.21.15.131:0/2434629211 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6240145c50 con 0x7f624013ca90 2024-04-25T19:22:19.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.080+0000 7f6237400640 1 -- 172.21.15.131:0/2434629211 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f622805fc10 con 0x7f624013ca90 2024-04-25T19:22:19.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.083+0000 7f6245c00640 1 -- 172.21.15.131:0/2434629211 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f621c0744b0 msgr2=0x7f621c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:19.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.083+0000 7f6245c00640 1 --2- 172.21.15.131:0/2434629211 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f621c0744b0 0x7f621c0769c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6230001530 tx=0x7f6230009040 comp rx=0 tx=0).stop 2024-04-25T19:22:19.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.083+0000 7f6245c00640 1 -- 172.21.15.131:0/2434629211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f624013ca90 msgr2=0x7f62400b22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:19.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.083+0000 7f6245c00640 1 --2- 172.21.15.131:0/2434629211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f624013ca90 0x7f62400b22b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6228009ce0 tx=0x7f6228007700 comp rx=0 tx=0).stop 2024-04-25T19:22:19.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.083+0000 7f6245c00640 1 -- 172.21.15.131:0/2434629211 shutdown_connections 2024-04-25T19:22:19.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.083+0000 7f6245c00640 1 --2- 172.21.15.131:0/2434629211 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f621c0744b0 0x7f621c0769c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:19.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.083+0000 7f6245c00640 1 --2- 172.21.15.131:0/2434629211 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62400b27f0 0x7f6240146f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:19.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.083+0000 7f6245c00640 1 --2- 172.21.15.131:0/2434629211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f624013ca90 0x7f62400b22b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:19.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.083+0000 7f6245c00640 1 --2- 172.21.15.131:0/2434629211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6224005270 0x7f6240156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:19.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.083+0000 7f6245c00640 1 -- 172.21.15.131:0/2434629211 >> 172.21.15.131:0/2434629211 conn(0x7f6240073090 msgr2=0x7f62400cf540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:19.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.084+0000 7f6245c00640 1 -- 172.21.15.131:0/2434629211 shutdown_connections 2024-04-25T19:22:19.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.084+0000 7f6245c00640 1 -- 172.21.15.131:0/2434629211 wait complete. 2024-04-25T19:22:19.111 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T19:22:19.111 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T19:22:19.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.387+0000 7f2d25000640 1 Processor -- start 2024-04-25T19:22:19.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.387+0000 7f2d25000640 1 -- start start 2024-04-25T19:22:19.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.390+0000 7f2d25000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d2006d5d0 0x7f2d2006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:19.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.390+0000 7f2d25000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2d200b50b0 0x7f2d200b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:19.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.390+0000 7f2d25000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d2006df20 con 0x7f2d2014aac0 2024-04-25T19:22:19.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.390+0000 7f2d25000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f2d2014aed0 con 0x7f2d200b50b0 2024-04-25T19:22:19.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.390+0000 7f2d25000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2d2006f460 con 0x7f2d2006d5d0 2024-04-25T19:22:19.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.390+0000 7f2d1f400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f2d2014aac0 0x7f2d201655a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:39738/0 (socket says 172.21.15.131:39738) 2024-04-25T19:22:19.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.390+0000 7f2d1f400640 1 -- 172.21.15.131:0/391913146 learned_addr learned my addr 172.21.15.131:0/391913146 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:19.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.390+0000 7f2d17e00640 1 --2- 172.21.15.131:0/391913146 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d2006d5d0 0x7f2d2006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:19.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.390+0000 7f2d1fe00640 1 --2- 172.21.15.131:0/391913146 >> v2:172.21.15.195:3300/0 conn(0x7f2d200b50b0 0x7f2d200b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:19.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.390+0000 7f2d1ea00640 1 -- 172.21.15.131:0/391913146 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4242626756 0 0) 0x7f2d10001110 con 0x7f2d2014aac0 2024-04-25T19:22:19.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.391+0000 7f2d1ea00640 1 -- 172.21.15.131:0/391913146 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d04003520 con 0x7f2d2014aac0 2024-04-25T19:22:19.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.391+0000 7f2d1ea00640 1 -- 172.21.15.131:0/391913146 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2854072448 0 0) 0x7f2d04003520 con 0x7f2d2014aac0 2024-04-25T19:22:19.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.391+0000 7f2d1ea00640 1 -- 172.21.15.131:0/391913146 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d2006d5d0 msgr2=0x7f2d2006d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:19.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.391+0000 7f2d1ea00640 1 --2- 172.21.15.131:0/391913146 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d2006d5d0 0x7f2d2006d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:19.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.391+0000 7f2d1ea00640 1 -- 172.21.15.131:0/391913146 >> v2:172.21.15.195:3300/0 conn(0x7f2d200b50b0 msgr2=0x7f2d200b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:19.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.391+0000 7f2d1ea00640 1 --2- 172.21.15.131:0/391913146 >> v2:172.21.15.195:3300/0 conn(0x7f2d200b50b0 0x7f2d200b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:19.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.391+0000 7f2d1ea00640 1 -- 172.21.15.131:0/391913146 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d2006f740 con 0x7f2d2014aac0 2024-04-25T19:22:19.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.391+0000 7f2d1ea00640 1 -- 172.21.15.131:0/391913146 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f2d10001840 con 0x7f2d2014aac0 2024-04-25T19:22:19.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.391+0000 7f2d1ea00640 1 -- 172.21.15.131:0/391913146 >> v1:172.21.15.131:6789/0 conn(0x7f2d2014aac0 legacy=0x7f2d201655a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:19.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.391+0000 7f2d1ea00640 1 --2- 172.21.15.131:0/391913146 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d040039b0 0x7f2d04003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:19.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.391+0000 7f2d1ea00640 1 --2- 172.21.15.131:0/391913146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d04004800 0x7f2d04004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:19.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.391+0000 7f2d1ea00640 1 --2- 172.21.15.131:0/391913146 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d2006d5d0 0x7f2d04005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:19.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.391+0000 7f2d1ea00640 1 -- 172.21.15.131:0/391913146 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2014aed0 con 0x7f2d04004800 2024-04-25T19:22:19.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.391+0000 7f2d1ea00640 1 -- 172.21.15.131:0/391913146 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2006f460 con 0x7f2d040039b0 2024-04-25T19:22:19.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.391+0000 7f2d1ea00640 1 -- 172.21.15.131:0/391913146 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2d0400baf0 con 0x7f2d2006d5d0 2024-04-25T19:22:19.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.391+0000 7f2d1fe00640 1 --2- 172.21.15.131:0/391913146 >> v2:172.21.15.195:3300/0 conn(0x7f2d200b50b0 0x7f2d200b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T19:22:19.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.391+0000 7f2d17e00640 1 --2- 172.21.15.131:0/391913146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d04004800 0x7f2d04004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:19.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.392+0000 7f2d17e00640 1 -- 172.21.15.131:0/391913146 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d2006d5d0 msgr2=0x7f2d04005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:19.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.392+0000 7f2d1f400640 1 --2- 172.21.15.131:0/391913146 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d040039b0 0x7f2d04003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:19.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.392+0000 7f2d17e00640 1 --2- 172.21.15.131:0/391913146 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d2006d5d0 0x7f2d04005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:19.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.392+0000 7f2d17e00640 1 -- 172.21.15.131:0/391913146 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d040039b0 msgr2=0x7f2d04003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:19.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.392+0000 7f2d17e00640 1 --2- 172.21.15.131:0/391913146 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d040039b0 0x7f2d04003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:19.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.392+0000 7f2d17e00640 1 -- 172.21.15.131:0/391913146 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d04003520 con 0x7f2d04004800 2024-04-25T19:22:19.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.392+0000 7f2d1f400640 1 --2- 172.21.15.131:0/391913146 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d040039b0 0x7f2d04003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:19.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.393+0000 7f2d17e00640 1 --2- 172.21.15.131:0/391913146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d04004800 0x7f2d04004c10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2d20072db0 tx=0x7f2d04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8d5c2d17095330 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:19.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.393+0000 7f2d1ea00640 1 -- 172.21.15.131:0/391913146 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d08036070 con 0x7f2d04004800 2024-04-25T19:22:19.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.393+0000 7f2d1ea00640 1 -- 172.21.15.131:0/391913146 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d08031400 con 0x7f2d04004800 2024-04-25T19:22:19.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.393+0000 7f2d1ea00640 1 -- 172.21.15.131:0/391913146 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d08009670 con 0x7f2d04004800 2024-04-25T19:22:19.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.394+0000 7f2d25000640 1 -- 172.21.15.131:0/391913146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d04004800 msgr2=0x7f2d04004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:19.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.394+0000 7f2d25000640 1 --2- 172.21.15.131:0/391913146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d04004800 0x7f2d04004c10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2d20072db0 tx=0x7f2d04005830 comp rx=0 tx=0).stop 2024-04-25T19:22:19.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.394+0000 7f2d1fe00640 1 -- 172.21.15.131:0/391913146 reap_dead start 2024-04-25T19:22:19.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.394+0000 7f2d25000640 1 -- 172.21.15.131:0/391913146 shutdown_connections 2024-04-25T19:22:19.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.394+0000 7f2d25000640 1 -- 172.21.15.131:0/391913146 >> 172.21.15.131:0/391913146 conn(0x7f2d20072f40 msgr2=0x7f2d20073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:19.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.394+0000 7f2d25000640 1 -- 172.21.15.131:0/391913146 shutdown_connections 2024-04-25T19:22:19.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.394+0000 7f2d25000640 1 -- 172.21.15.131:0/391913146 wait complete. 2024-04-25T19:22:19.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.396+0000 7f2d25000640 1 Processor -- start 2024-04-25T19:22:19.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.397+0000 7f2d25000640 1 -- start start 2024-04-25T19:22:19.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.398+0000 7f2d25000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d04004800 0x7f2d20167250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:19.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.398+0000 7f2d25000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d20164cd0 0x7f2d2014c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:19.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.398+0000 7f2d25000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d201edf50 0x7f2d201ee360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:19.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.398+0000 7f2d25000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2006ffe0 con 0x7f2d04004800 2024-04-25T19:22:19.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.398+0000 7f2d25000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2006fd00 con 0x7f2d201edf50 2024-04-25T19:22:19.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.398+0000 7f2d25000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2d200b4a90 con 0x7f2d20164cd0 2024-04-25T19:22:19.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.398+0000 7f2d1f400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d04004800 0x7f2d20167250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:19.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.398+0000 7f2d1f400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d04004800 0x7f2d20167250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54036/0 (socket says 172.21.15.131:54036) 2024-04-25T19:22:19.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.398+0000 7f2d1f400640 1 -- 172.21.15.131:0/3102230088 learned_addr learned my addr 172.21.15.131:0/3102230088 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:19.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.399+0000 7f2d17e00640 1 --2- 172.21.15.131:0/3102230088 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d20164cd0 0x7f2d2014c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:19.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.399+0000 7f2d1f400640 1 -- 172.21.15.131:0/3102230088 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d20164cd0 msgr2=0x7f2d2014c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:19.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.399+0000 7f2d1fe00640 1 --2- 172.21.15.131:0/3102230088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d201edf50 0x7f2d201ee360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:19.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.399+0000 7f2d1f400640 1 --2- 172.21.15.131:0/3102230088 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d20164cd0 0x7f2d2014c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:19.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.399+0000 7f2d1f400640 1 -- 172.21.15.131:0/3102230088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d201edf50 msgr2=0x7f2d201ee360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:19.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.399+0000 7f2d1f400640 1 --2- 172.21.15.131:0/3102230088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d201edf50 0x7f2d201ee360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:19.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.399+0000 7f2d1f400640 1 -- 172.21.15.131:0/3102230088 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d2014b700 con 0x7f2d04004800 2024-04-25T19:22:19.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.399+0000 7f2d17e00640 1 --2- 172.21.15.131:0/3102230088 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d20164cd0 0x7f2d2014c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:19.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.399+0000 7f2d1f400640 1 --2- 172.21.15.131:0/3102230088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d04004800 0x7f2d20167250 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2d1000d700 tx=0x7f2d1000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:19.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.399+0000 7f2d17400640 1 -- 172.21.15.131:0/3102230088 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d10019070 con 0x7f2d04004800 2024-04-25T19:22:19.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.399+0000 7f2d17400640 1 -- 172.21.15.131:0/3102230088 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d100074e0 con 0x7f2d04004800 2024-04-25T19:22:19.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.399+0000 7f2d25000640 1 -- 172.21.15.131:0/3102230088 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d2014b9e0 con 0x7f2d04004800 2024-04-25T19:22:19.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.399+0000 7f2d17400640 1 -- 172.21.15.131:0/3102230088 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d100049e0 con 0x7f2d04004800 2024-04-25T19:22:19.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.400+0000 7f2d25000640 1 -- 172.21.15.131:0/3102230088 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d2014bfa0 con 0x7f2d04004800 2024-04-25T19:22:19.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.401+0000 7f2d25000640 1 -- 172.21.15.131:0/3102230088 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d20076c60 con 0x7f2d04004800 2024-04-25T19:22:19.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.402+0000 7f2d17400640 1 -- 172.21.15.131:0/3102230088 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2d1001c070 con 0x7f2d04004800 2024-04-25T19:22:19.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.403+0000 7f2d17400640 1 --2- 172.21.15.131:0/3102230088 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2cfc0744b0 0x7f2cfc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:19.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.403+0000 7f2d17400640 1 -- 172.21.15.131:0/3102230088 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2d10094bf0 con 0x7f2d04004800 2024-04-25T19:22:19.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.404+0000 7f2d17e00640 1 --2- 172.21.15.131:0/3102230088 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2cfc0744b0 0x7f2cfc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:19.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.405+0000 7f2d17e00640 1 --2- 172.21.15.131:0/3102230088 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2cfc0744b0 0x7f2cfc0769c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2d08033000 tx=0x7f2d08008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:19.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.408+0000 7f2d17400640 1 -- 172.21.15.131:0/3102230088 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2d2006df20 con 0x7f2d04004800 2024-04-25T19:22:19.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:19.646+0000 7f2d25000640 1 -- 172.21.15.131:0/3102230088 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f2d20070e70 con 0x7f2d04004800 2024-04-25T19:22:20.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.094+0000 7f2d17400640 1 -- 172.21.15.131:0/3102230088 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f2d1005f410 con 0x7f2d04004800 2024-04-25T19:22:20.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.098+0000 7f2d25000640 1 -- 172.21.15.131:0/3102230088 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2cfc0744b0 msgr2=0x7f2cfc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:20.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.098+0000 7f2d25000640 1 --2- 172.21.15.131:0/3102230088 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2cfc0744b0 0x7f2cfc0769c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2d08033000 tx=0x7f2d08008030 comp rx=0 tx=0).stop 2024-04-25T19:22:20.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.098+0000 7f2d25000640 1 -- 172.21.15.131:0/3102230088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d04004800 msgr2=0x7f2d20167250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:20.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.098+0000 7f2d25000640 1 --2- 172.21.15.131:0/3102230088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d04004800 0x7f2d20167250 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2d1000d700 tx=0x7f2d1000dbc0 comp rx=0 tx=0).stop 2024-04-25T19:22:20.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.098+0000 7f2d25000640 1 -- 172.21.15.131:0/3102230088 shutdown_connections 2024-04-25T19:22:20.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.098+0000 7f2d25000640 1 --2- 172.21.15.131:0/3102230088 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2cfc0744b0 0x7f2cfc0769c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:20.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.098+0000 7f2d25000640 1 --2- 172.21.15.131:0/3102230088 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d20164cd0 0x7f2d2014c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:20.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.098+0000 7f2d25000640 1 --2- 172.21.15.131:0/3102230088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d201edf50 0x7f2d201ee360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:20.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.098+0000 7f2d25000640 1 --2- 172.21.15.131:0/3102230088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d04004800 0x7f2d20167250 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:20.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.098+0000 7f2d25000640 1 -- 172.21.15.131:0/3102230088 >> 172.21.15.131:0/3102230088 conn(0x7f2d20072f40 msgr2=0x7f2d2006cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:20.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.098+0000 7f2d25000640 1 -- 172.21.15.131:0/3102230088 shutdown_connections 2024-04-25T19:22:20.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.098+0000 7f2d25000640 1 -- 172.21.15.131:0/3102230088 wait complete. 2024-04-25T19:22:20.129 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T19:22:20.129 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:22:20.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.393+0000 7f99a6e00640 1 Processor -- start 2024-04-25T19:22:20.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.393+0000 7f99a6e00640 1 -- start start 2024-04-25T19:22:20.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.395+0000 7f99a6e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f99a006c5c0 0x7f99a00cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:20.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.395+0000 7f99a6e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99a0144370 0x7f99a00b4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:20.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.395+0000 7f99a6e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99a00b50e0 con 0x7f99a00b4cd0 2024-04-25T19:22:20.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.395+0000 7f99a6e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f99a00d1230 con 0x7f99a006c5c0 2024-04-25T19:22:20.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.395+0000 7f99a6e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f99a00d06b0 con 0x7f99a0144370 2024-04-25T19:22:20.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.396+0000 7f99a5000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99a0144370 0x7f99a00b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:20.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.396+0000 7f99a5000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99a0144370 0x7f99a00b4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.131:37928/0 (socket says 172.21.15.131:37928) 2024-04-25T19:22:20.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.396+0000 7f99a5000640 1 -- 172.21.15.131:0/1805990373 learned_addr learned my addr 172.21.15.131:0/1805990373 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:20.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.396+0000 7f99a5a00640 1 --2- 172.21.15.131:0/1805990373 >> v2:172.21.15.195:3300/0 conn(0x7f99a006c5c0 0x7f99a00cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:20.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.397+0000 7f99a5000640 1 -- 172.21.15.131:0/1805990373 >> v2:172.21.15.195:3300/0 conn(0x7f99a006c5c0 msgr2=0x7f99a00cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:20.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.397+0000 7f99a5000640 1 --2- 172.21.15.131:0/1805990373 >> v2:172.21.15.195:3300/0 conn(0x7f99a006c5c0 0x7f99a00cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:20.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.397+0000 7f99a5000640 1 -- 172.21.15.131:0/1805990373 >> v1:172.21.15.195:6789/0 conn(0x7f99a00b4cd0 legacy=0x7f99a0161a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:20.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.397+0000 7f99a5000640 1 -- 172.21.15.131:0/1805990373 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a00d0990 con 0x7f99a0144370 2024-04-25T19:22:20.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.398+0000 7f99a5000640 1 --2- 172.21.15.131:0/1805990373 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99a0144370 0x7f99a00b4790 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f998c009870 tx=0x7f998c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecf9fff56e4262ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:20.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.399+0000 7f999fe00640 1 -- 172.21.15.131:0/1805990373 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998c037070 con 0x7f99a0144370 2024-04-25T19:22:20.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.399+0000 7f999fe00640 1 -- 172.21.15.131:0/1805990373 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f998c032440 con 0x7f99a0144370 2024-04-25T19:22:20.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.399+0000 7f999fe00640 1 -- 172.21.15.131:0/1805990373 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998c032810 con 0x7f99a0144370 2024-04-25T19:22:20.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.400+0000 7f99a6e00640 1 -- 172.21.15.131:0/1805990373 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99a0144370 msgr2=0x7f99a00b4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:20.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.400+0000 7f99a6e00640 1 --2- 172.21.15.131:0/1805990373 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99a0144370 0x7f99a00b4790 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f998c009870 tx=0x7f998c02a270 comp rx=0 tx=0).stop 2024-04-25T19:22:20.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.400+0000 7f99a6e00640 1 -- 172.21.15.131:0/1805990373 shutdown_connections 2024-04-25T19:22:20.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.400+0000 7f99a6e00640 1 --2- 172.21.15.131:0/1805990373 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99a0144370 0x7f99a00b4790 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:20.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.400+0000 7f99a6e00640 1 --2- 172.21.15.131:0/1805990373 >> v2:172.21.15.195:3300/0 conn(0x7f99a006c5c0 0x7f99a00cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:20.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.400+0000 7f99a6e00640 1 -- 172.21.15.131:0/1805990373 >> 172.21.15.131:0/1805990373 conn(0x7f99a00d1720 msgr2=0x7f99a00d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:20.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.400+0000 7f99a6e00640 1 -- 172.21.15.131:0/1805990373 shutdown_connections 2024-04-25T19:22:20.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.400+0000 7f99a6e00640 1 -- 172.21.15.131:0/1805990373 wait complete. 2024-04-25T19:22:20.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.403+0000 7f99a6e00640 1 Processor -- start 2024-04-25T19:22:20.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.403+0000 7f99a6e00640 1 -- start start 2024-04-25T19:22:20.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.405+0000 7f99a6e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99a006c5c0 0x7f99a0162190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:20.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.405+0000 7f99a6e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99a00b4cd0 0x7f99a01456a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:20.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.405+0000 7f99a6e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99a0144370 0x7f99a0145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:20.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.405+0000 7f99a6e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f99a00d02d0 con 0x7f99a0144370 2024-04-25T19:22:20.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.405+0000 7f99a6e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f99a00d0f50 con 0x7f99a00b4cd0 2024-04-25T19:22:20.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.405+0000 7f99a6e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f99a00d0450 con 0x7f99a006c5c0 2024-04-25T19:22:20.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.405+0000 7f99a6400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99a0144370 0x7f99a0145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:20.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.405+0000 7f99a6400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99a0144370 0x7f99a0145be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54042/0 (socket says 172.21.15.131:54042) 2024-04-25T19:22:20.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.405+0000 7f99a6400640 1 -- 172.21.15.131:0/2444182793 learned_addr learned my addr 172.21.15.131:0/2444182793 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:20.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.405+0000 7f99a5a00640 1 --2- 172.21.15.131:0/2444182793 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99a006c5c0 0x7f99a0162190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:20.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.405+0000 7f99a5000640 1 --2- 172.21.15.131:0/2444182793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99a00b4cd0 0x7f99a01456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:20.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.406+0000 7f99a6400640 1 -- 172.21.15.131:0/2444182793 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99a006c5c0 msgr2=0x7f99a0162190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:20.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.406+0000 7f99a6400640 1 --2- 172.21.15.131:0/2444182793 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99a006c5c0 0x7f99a0162190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:20.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.406+0000 7f99a6400640 1 -- 172.21.15.131:0/2444182793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99a00b4cd0 msgr2=0x7f99a01456a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:20.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.406+0000 7f99a6400640 1 --2- 172.21.15.131:0/2444182793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99a00b4cd0 0x7f99a01456a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:20.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.406+0000 7f99a6400640 1 -- 172.21.15.131:0/2444182793 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a015baf0 con 0x7f99a0144370 2024-04-25T19:22:20.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.406+0000 7f99a6400640 1 --2- 172.21.15.131:0/2444182793 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99a0144370 0x7f99a0145be0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f999800c760 tx=0x7f999800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:20.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.406+0000 7f999d600640 1 -- 172.21.15.131:0/2444182793 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9998016020 con 0x7f99a0144370 2024-04-25T19:22:20.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.406+0000 7f999d600640 1 -- 172.21.15.131:0/2444182793 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9998006d50 con 0x7f99a0144370 2024-04-25T19:22:20.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.406+0000 7f999d600640 1 -- 172.21.15.131:0/2444182793 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9998003bb0 con 0x7f99a0144370 2024-04-25T19:22:20.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.406+0000 7f99a6e00640 1 -- 172.21.15.131:0/2444182793 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99a015b810 con 0x7f99a0144370 2024-04-25T19:22:20.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.407+0000 7f99a6e00640 1 -- 172.21.15.131:0/2444182793 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99a0146550 con 0x7f99a0144370 2024-04-25T19:22:20.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.408+0000 7f99a6e00640 1 -- 172.21.15.131:0/2444182793 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99a0050740 con 0x7f99a0144370 2024-04-25T19:22:20.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.409+0000 7f999d600640 1 -- 172.21.15.131:0/2444182793 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f99980050d0 con 0x7f99a0144370 2024-04-25T19:22:20.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.410+0000 7f999d600640 1 --2- 172.21.15.131:0/2444182793 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f99800744b0 0x7f99800769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:20.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.410+0000 7f999d600640 1 -- 172.21.15.131:0/2444182793 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9998094e00 con 0x7f99a0144370 2024-04-25T19:22:20.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.410+0000 7f99a5a00640 1 --2- 172.21.15.131:0/2444182793 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f99800744b0 0x7f99800769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:20.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.412+0000 7f99a5a00640 1 --2- 172.21.15.131:0/2444182793 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f99800744b0 0x7f99800769c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9994009a30 tx=0x7f9994008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:20.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.414+0000 7f999d600640 1 -- 172.21.15.131:0/2444182793 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9998020020 con 0x7f99a0144370 2024-04-25T19:22:20.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.634+0000 7f99a6e00640 1 -- 172.21.15.131:0/2444182793 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99a015b5a0 con 0x7f99a0144370 2024-04-25T19:22:20.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.636+0000 7f999d600640 1 -- 172.21.15.131:0/2444182793 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5187 (secure 0 0 0) 0x7f9998062460 con 0x7f99a0144370 2024-04-25T19:22:20.637 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:20.637 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/1570319410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":1570319410},{"type":"v1","addr":"172.21.15.195:6837","nonce":1570319410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/4072860882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4072860882},{"type":"v1","addr":"172.21.15.131:6834","nonce":4072860882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2207155444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2207155444},{"type":"v1","addr":"172.21.15.131:6835","nonce":2207155444}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T19:22:16.578438+0000","modified":"2024-04-25T19:22:19.648009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6836/1898121552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1898121552},{"type":"v1","addr":"172.21.15.195:6836","nonce":1898121552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T19:22:20.637 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 8 2024-04-25T19:22:20.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.638+0000 7f99a6e00640 1 -- 172.21.15.131:0/2444182793 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f99800744b0 msgr2=0x7f99800769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:20.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.638+0000 7f99a6e00640 1 --2- 172.21.15.131:0/2444182793 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f99800744b0 0x7f99800769c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9994009a30 tx=0x7f9994008040 comp rx=0 tx=0).stop 2024-04-25T19:22:20.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.638+0000 7f99a6e00640 1 -- 172.21.15.131:0/2444182793 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99a0144370 msgr2=0x7f99a0145be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:20.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.638+0000 7f99a6e00640 1 --2- 172.21.15.131:0/2444182793 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99a0144370 0x7f99a0145be0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f999800c760 tx=0x7f999800cb60 comp rx=0 tx=0).stop 2024-04-25T19:22:20.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.638+0000 7f99a6e00640 1 -- 172.21.15.131:0/2444182793 shutdown_connections 2024-04-25T19:22:20.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.638+0000 7f99a6e00640 1 --2- 172.21.15.131:0/2444182793 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f99800744b0 0x7f99800769c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:20.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.638+0000 7f99a6e00640 1 --2- 172.21.15.131:0/2444182793 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99a0144370 0x7f99a0145be0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:20.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.638+0000 7f99a6e00640 1 --2- 172.21.15.131:0/2444182793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99a00b4cd0 0x7f99a01456a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:20.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.638+0000 7f99a6e00640 1 --2- 172.21.15.131:0/2444182793 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99a006c5c0 0x7f99a0162190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:20.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.638+0000 7f99a6e00640 1 -- 172.21.15.131:0/2444182793 >> 172.21.15.131:0/2444182793 conn(0x7f99a00d1720 msgr2=0x7f99a006d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:20.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.639+0000 7f99a6e00640 1 -- 172.21.15.131:0/2444182793 shutdown_connections 2024-04-25T19:22:20.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.639+0000 7f99a6e00640 1 -- 172.21.15.131:0/2444182793 wait complete. 2024-04-25T19:22:20.665 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:22:20.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.924+0000 7fb655600640 1 Processor -- start 2024-04-25T19:22:20.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.924+0000 7fb655600640 1 -- start start 2024-04-25T19:22:20.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.926+0000 7fb655600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb6500b6e10 0x7fb65015a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:20.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.926+0000 7fb655600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb6501608d0 0x7fb650160ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:20.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.926+0000 7fb655600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb650161220 con 0x7fb6500cf2f0 2024-04-25T19:22:20.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.926+0000 7fb655600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fb65006f870 con 0x7fb6500b6e10 2024-04-25T19:22:20.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.926+0000 7fb655600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb6500b7220 con 0x7fb6501608d0 2024-04-25T19:22:20.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.927+0000 7fb64f400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb6500b6e10 0x7fb65015a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:20.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.927+0000 7fb64f400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb6500b6e10 0x7fb65015a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54058/0 (socket says 172.21.15.131:54058) 2024-04-25T19:22:20.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.927+0000 7fb64f400640 1 -- 172.21.15.131:0/2998422557 learned_addr learned my addr 172.21.15.131:0/2998422557 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:20.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.927+0000 7fb654c00640 1 --2- 172.21.15.131:0/2998422557 >> v2:172.21.15.195:3300/0 conn(0x7fb6501608d0 0x7fb650160ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:20.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.927+0000 7fb64f400640 1 -- 172.21.15.131:0/2998422557 >> v2:172.21.15.195:3300/0 conn(0x7fb6501608d0 msgr2=0x7fb650160ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:20.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.927+0000 7fb64f400640 1 --2- 172.21.15.131:0/2998422557 >> v2:172.21.15.195:3300/0 conn(0x7fb6501608d0 0x7fb650160ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:20.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.927+0000 7fb64f400640 1 -- 172.21.15.131:0/2998422557 >> v1:172.21.15.195:6789/0 conn(0x7fb6500cf2f0 legacy=0x7fb6500b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:20.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.927+0000 7fb64f400640 1 -- 172.21.15.131:0/2998422557 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6500b74d0 con 0x7fb6500b6e10 2024-04-25T19:22:20.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.928+0000 7fb64f400640 1 --2- 172.21.15.131:0/2998422557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6500b6e10 0x7fb65015a810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb6500d27a0 tx=0x7fb63c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a851bc247b0f7c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:20.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.929+0000 7fb64ea00640 1 -- 172.21.15.131:0/2998422557 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c037070 con 0x7fb6500b6e10 2024-04-25T19:22:20.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.929+0000 7fb64ea00640 1 -- 172.21.15.131:0/2998422557 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb63c032440 con 0x7fb6500b6e10 2024-04-25T19:22:20.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.929+0000 7fb64ea00640 1 -- 172.21.15.131:0/2998422557 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c032810 con 0x7fb6500b6e10 2024-04-25T19:22:20.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.929+0000 7fb655600640 1 -- 172.21.15.131:0/2998422557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6500b6e10 msgr2=0x7fb65015a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:20.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.929+0000 7fb655600640 1 --2- 172.21.15.131:0/2998422557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6500b6e10 0x7fb65015a810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb6500d27a0 tx=0x7fb63c02a270 comp rx=0 tx=0).stop 2024-04-25T19:22:20.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.929+0000 7fb655600640 1 -- 172.21.15.131:0/2998422557 shutdown_connections 2024-04-25T19:22:20.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.929+0000 7fb655600640 1 --2- 172.21.15.131:0/2998422557 >> v2:172.21.15.195:3300/0 conn(0x7fb6501608d0 0x7fb650160ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:20.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.930+0000 7fb655600640 1 --2- 172.21.15.131:0/2998422557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6500b6e10 0x7fb65015a810 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:20.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.930+0000 7fb655600640 1 -- 172.21.15.131:0/2998422557 >> 172.21.15.131:0/2998422557 conn(0x7fb6500d1720 msgr2=0x7fb6500d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:20.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.930+0000 7fb655600640 1 -- 172.21.15.131:0/2998422557 shutdown_connections 2024-04-25T19:22:20.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.930+0000 7fb655600640 1 -- 172.21.15.131:0/2998422557 wait complete. 2024-04-25T19:22:20.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.932+0000 7fb655600640 1 Processor -- start 2024-04-25T19:22:20.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.932+0000 7fb655600640 1 -- start start 2024-04-25T19:22:20.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.933+0000 7fb655600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6500b6e10 0x7fb6500cd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:20.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.933+0000 7fb655600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6500cf2f0 0x7fb650142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:20.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.933+0000 7fb655600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6501608d0 0x7fb65006ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:20.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.933+0000 7fb655600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb65006f500 con 0x7fb6500b6e10 2024-04-25T19:22:20.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.933+0000 7fb655600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb65006f220 con 0x7fb6501608d0 2024-04-25T19:22:20.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.933+0000 7fb655600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb65006fd00 con 0x7fb6500cf2f0 2024-04-25T19:22:20.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.934+0000 7fb64fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6500b6e10 0x7fb6500cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:20.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.934+0000 7fb64fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6500b6e10 0x7fb6500cd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54072/0 (socket says 172.21.15.131:54072) 2024-04-25T19:22:20.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.934+0000 7fb64fe00640 1 -- 172.21.15.131:0/4181541170 learned_addr learned my addr 172.21.15.131:0/4181541170 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:20.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.934+0000 7fb654c00640 1 --2- 172.21.15.131:0/4181541170 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6501608d0 0x7fb65006ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:20.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.934+0000 7fb64f400640 1 --2- 172.21.15.131:0/4181541170 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6500cf2f0 0x7fb650142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:20.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.934+0000 7fb64fe00640 1 -- 172.21.15.131:0/4181541170 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6500cf2f0 msgr2=0x7fb650142cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:20.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.934+0000 7fb64fe00640 1 --2- 172.21.15.131:0/4181541170 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6500cf2f0 0x7fb650142cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:20.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.934+0000 7fb64fe00640 1 -- 172.21.15.131:0/4181541170 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6501608d0 msgr2=0x7fb65006ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:20.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.934+0000 7fb64fe00640 1 --2- 172.21.15.131:0/4181541170 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6501608d0 0x7fb65006ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:20.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.934+0000 7fb64fe00640 1 -- 172.21.15.131:0/4181541170 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb650143230 con 0x7fb6500b6e10 2024-04-25T19:22:20.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.934+0000 7fb654c00640 1 --2- 172.21.15.131:0/4181541170 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6501608d0 0x7fb65006ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:20.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.934+0000 7fb64fe00640 1 --2- 172.21.15.131:0/4181541170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6500b6e10 0x7fb6500cd350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb64000c400 tx=0x7fb64000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:20.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.935+0000 7fb647e00640 1 -- 172.21.15.131:0/4181541170 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb640017070 con 0x7fb6500b6e10 2024-04-25T19:22:20.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.935+0000 7fb647e00640 1 -- 172.21.15.131:0/4181541170 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6400052d0 con 0x7fb6500b6e10 2024-04-25T19:22:20.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.935+0000 7fb647e00640 1 -- 172.21.15.131:0/4181541170 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb640003830 con 0x7fb6500b6e10 2024-04-25T19:22:20.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.935+0000 7fb655600640 1 -- 172.21.15.131:0/4181541170 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb65015f590 con 0x7fb6500b6e10 2024-04-25T19:22:20.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.935+0000 7fb655600640 1 -- 172.21.15.131:0/4181541170 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb65015fd70 con 0x7fb6500b6e10 2024-04-25T19:22:20.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.936+0000 7fb655600640 1 -- 172.21.15.131:0/4181541170 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb650050740 con 0x7fb6500b6e10 2024-04-25T19:22:20.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.937+0000 7fb647e00640 1 -- 172.21.15.131:0/4181541170 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb64001a070 con 0x7fb6500b6e10 2024-04-25T19:22:20.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.938+0000 7fb647e00640 1 --2- 172.21.15.131:0/4181541170 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb6300744b0 0x7fb6300769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:20.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.938+0000 7fb647e00640 1 -- 172.21.15.131:0/4181541170 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb640094530 con 0x7fb6500b6e10 2024-04-25T19:22:20.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.939+0000 7fb64f400640 1 --2- 172.21.15.131:0/4181541170 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb6300744b0 0x7fb6300769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:20.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.940+0000 7fb64f400640 1 --2- 172.21.15.131:0/4181541170 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb6300744b0 0x7fb6300769c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb63c034000 tx=0x7fb63c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:20.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:20.943+0000 7fb647e00640 1 -- 172.21.15.131:0/4181541170 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb650143230 con 0x7fb6500b6e10 2024-04-25T19:22:21.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.143+0000 7fb655600640 1 -- 172.21.15.131:0/4181541170 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb65006c770 con 0x7fb6500b6e10 2024-04-25T19:22:21.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.146+0000 7fb647e00640 1 -- 172.21.15.131:0/4181541170 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16629 (secure 0 0 0) 0x7fb650161220 con 0x7fb6500b6e10 2024-04-25T19:22:21.147 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:21.147 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":20,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:22:18.057809+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:22:14.779716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T19:22:15.552027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:22:21.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.149+0000 7fb655600640 1 -- 172.21.15.131:0/4181541170 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb6300744b0 msgr2=0x7fb6300769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:21.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.149+0000 7fb655600640 1 --2- 172.21.15.131:0/4181541170 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb6300744b0 0x7fb6300769c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb63c034000 tx=0x7fb63c02e000 comp rx=0 tx=0).stop 2024-04-25T19:22:21.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.149+0000 7fb655600640 1 -- 172.21.15.131:0/4181541170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6500b6e10 msgr2=0x7fb6500cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:21.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.149+0000 7fb655600640 1 --2- 172.21.15.131:0/4181541170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6500b6e10 0x7fb6500cd350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb64000c400 tx=0x7fb64000c8c0 comp rx=0 tx=0).stop 2024-04-25T19:22:21.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.149+0000 7fb655600640 1 -- 172.21.15.131:0/4181541170 shutdown_connections 2024-04-25T19:22:21.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.149+0000 7fb655600640 1 --2- 172.21.15.131:0/4181541170 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb6300744b0 0x7fb6300769c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:21.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.149+0000 7fb655600640 1 --2- 172.21.15.131:0/4181541170 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6500cf2f0 0x7fb650142cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:21.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.149+0000 7fb655600640 1 --2- 172.21.15.131:0/4181541170 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6501608d0 0x7fb65006ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:21.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.149+0000 7fb655600640 1 --2- 172.21.15.131:0/4181541170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6500b6e10 0x7fb6500cd350 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:21.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.149+0000 7fb655600640 1 -- 172.21.15.131:0/4181541170 >> 172.21.15.131:0/4181541170 conn(0x7fb6500d1720 msgr2=0x7fb6500d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:21.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.149+0000 7fb655600640 1 -- 172.21.15.131:0/4181541170 shutdown_connections 2024-04-25T19:22:21.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.149+0000 7fb655600640 1 -- 172.21.15.131:0/4181541170 wait complete. 2024-04-25T19:22:21.178 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T19:22:21.178 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T19:22:21.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.441+0000 7f94d4400640 1 Processor -- start 2024-04-25T19:22:21.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.442+0000 7f94d4400640 1 -- start start 2024-04-25T19:22:21.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.444+0000 7f94d4400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94cc0b7750 0x7f94cc0d1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:21.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.444+0000 7f94d4400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94cc0b3af0 con 0x7f94cc06d7e0 2024-04-25T19:22:21.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.444+0000 7f94d4400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94cc164320 con 0x7f94cc0cf610 2024-04-25T19:22:21.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.444+0000 7f94d4400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f94cc0b2f70 con 0x7f94cc0b7750 2024-04-25T19:22:21.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.444+0000 7f94d2400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f94cc06d7e0 0x7f94cc06dbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:39752/0 (socket says 172.21.15.131:39752) 2024-04-25T19:22:21.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.444+0000 7f94d2400640 1 -- 172.21.15.131:0/816055053 learned_addr learned my addr 172.21.15.131:0/816055053 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:21.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.444+0000 7f94d1a00640 1 --2- 172.21.15.131:0/816055053 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94cc0b7750 0x7f94cc0d1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:21.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.445+0000 7f94cbe00640 1 -- 172.21.15.131:0/816055053 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2726501734 0 0) 0x7f94cc0b3af0 con 0x7f94cc06d7e0 2024-04-25T19:22:21.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.445+0000 7f94cbe00640 1 -- 172.21.15.131:0/816055053 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94b4003520 con 0x7f94cc06d7e0 2024-04-25T19:22:21.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.445+0000 7f94cbe00640 1 -- 172.21.15.131:0/816055053 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2439183733 0 0) 0x7f94b4003520 con 0x7f94cc06d7e0 2024-04-25T19:22:21.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.445+0000 7f94cbe00640 1 -- 172.21.15.131:0/816055053 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94cc0b7750 msgr2=0x7f94cc0d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:21.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.445+0000 7f94cbe00640 1 --2- 172.21.15.131:0/816055053 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94cc0b7750 0x7f94cc0d1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:21.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.445+0000 7f94cbe00640 1 -- 172.21.15.131:0/816055053 >> v1:172.21.15.195:6789/0 conn(0x7f94cc0cf610 legacy=0x7f94cc164800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:21.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.445+0000 7f94cbe00640 1 -- 172.21.15.131:0/816055053 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94cc0b3250 con 0x7f94cc06d7e0 2024-04-25T19:22:21.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.445+0000 7f94cbe00640 1 -- 172.21.15.131:0/816055053 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f94c4001670 con 0x7f94cc06d7e0 2024-04-25T19:22:21.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.445+0000 7f94cbe00640 1 -- 172.21.15.131:0/816055053 >> v1:172.21.15.131:6789/0 conn(0x7f94cc06d7e0 legacy=0x7f94cc06dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:21.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.445+0000 7f94cbe00640 1 --2- 172.21.15.131:0/816055053 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94cc0b7750 0x7f94b40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:21.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.445+0000 7f94cbe00640 1 --2- 172.21.15.131:0/816055053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94b4003f60 0x7f94b4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:21.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.445+0000 7f94cbe00640 1 --2- 172.21.15.131:0/816055053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94b4004d40 0x7f94b4005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:21.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.446+0000 7f94cbe00640 1 -- 172.21.15.131:0/816055053 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc0b2f70 con 0x7f94b4003f60 2024-04-25T19:22:21.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.446+0000 7f94cbe00640 1 -- 172.21.15.131:0/816055053 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f94b400bc00 con 0x7f94b4004d40 2024-04-25T19:22:21.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.446+0000 7f94cbe00640 1 -- 172.21.15.131:0/816055053 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f94b400be00 con 0x7f94cc0b7750 2024-04-25T19:22:21.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.446+0000 7f94d1000640 1 --2- 172.21.15.131:0/816055053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94b4003f60 0x7f94b4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:21.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.446+0000 7f94d1a00640 1 --2- 172.21.15.131:0/816055053 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94cc0b7750 0x7f94b40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:21.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.446+0000 7f94d2400640 1 --2- 172.21.15.131:0/816055053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94b4004d40 0x7f94b4005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:21.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.446+0000 7f94d1000640 1 -- 172.21.15.131:0/816055053 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94cc0b7750 msgr2=0x7f94b40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:21.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.446+0000 7f94d1000640 1 --2- 172.21.15.131:0/816055053 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94cc0b7750 0x7f94b40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:21.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.446+0000 7f94d1000640 1 -- 172.21.15.131:0/816055053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94b4004d40 msgr2=0x7f94b4005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:21.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.446+0000 7f94d1000640 1 --2- 172.21.15.131:0/816055053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94b4004d40 0x7f94b4005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:21.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.446+0000 7f94d1000640 1 -- 172.21.15.131:0/816055053 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b4003520 con 0x7f94b4003f60 2024-04-25T19:22:21.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.447+0000 7f94d1000640 1 --2- 172.21.15.131:0/816055053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94b4003f60 0x7f94b4004800 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f94bc001e50 tx=0x7f94b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2d96e3ef6509e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:21.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.447+0000 7f94cbe00640 1 -- 172.21.15.131:0/816055053 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94bc001a70 con 0x7f94b4003f60 2024-04-25T19:22:21.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.447+0000 7f94cbe00640 1 -- 172.21.15.131:0/816055053 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94bc003970 con 0x7f94b4003f60 2024-04-25T19:22:21.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.447+0000 7f94cbe00640 1 -- 172.21.15.131:0/816055053 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94bc003d60 con 0x7f94b4003f60 2024-04-25T19:22:21.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.448+0000 7f94d4400640 1 -- 172.21.15.131:0/816055053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94b4003f60 msgr2=0x7f94b4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:21.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.448+0000 7f94d4400640 1 --2- 172.21.15.131:0/816055053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94b4003f60 0x7f94b4004800 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f94bc001e50 tx=0x7f94b4005830 comp rx=0 tx=0).stop 2024-04-25T19:22:21.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.448+0000 7f94d2400640 1 -- 172.21.15.131:0/816055053 reap_dead start 2024-04-25T19:22:21.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.448+0000 7f94d4400640 1 -- 172.21.15.131:0/816055053 shutdown_connections 2024-04-25T19:22:21.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.448+0000 7f94d4400640 1 -- 172.21.15.131:0/816055053 >> 172.21.15.131:0/816055053 conn(0x7f94cc09b7d0 msgr2=0x7f94cc0b7040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:21.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.448+0000 7f94d4400640 1 -- 172.21.15.131:0/816055053 shutdown_connections 2024-04-25T19:22:21.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.448+0000 7f94d4400640 1 -- 172.21.15.131:0/816055053 wait complete. 2024-04-25T19:22:21.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.450+0000 7f94d4400640 1 Processor -- start 2024-04-25T19:22:21.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.451+0000 7f94d4400640 1 -- start start 2024-04-25T19:22:21.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.452+0000 7f94d4400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94b4003f60 0x7f94cc14d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:21.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.452+0000 7f94d4400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94cc150450 0x7f94cc150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:21.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.452+0000 7f94d4400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94cc160190 0x7f94cc1605a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:21.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.452+0000 7f94d4400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc0cfa20 con 0x7f94cc150450 2024-04-25T19:22:21.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.452+0000 7f94d4400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc0b3810 con 0x7f94cc160190 2024-04-25T19:22:21.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.452+0000 7f94d4400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f94cc164f10 con 0x7f94b4003f60 2024-04-25T19:22:21.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.452+0000 7f94d1000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94cc150450 0x7f94cc150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:21.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.452+0000 7f94d1000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94cc150450 0x7f94cc150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54092/0 (socket says 172.21.15.131:54092) 2024-04-25T19:22:21.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.452+0000 7f94d1000640 1 -- 172.21.15.131:0/1588577993 learned_addr learned my addr 172.21.15.131:0/1588577993 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:21.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.453+0000 7f94d1a00640 1 --2- 172.21.15.131:0/1588577993 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94b4003f60 0x7f94cc14d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:21.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.453+0000 7f94d2400640 1 --2- 172.21.15.131:0/1588577993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94cc160190 0x7f94cc1605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:21.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.453+0000 7f94d1000640 1 -- 172.21.15.131:0/1588577993 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94b4003f60 msgr2=0x7f94cc14d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:21.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.453+0000 7f94d1000640 1 --2- 172.21.15.131:0/1588577993 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94b4003f60 0x7f94cc14d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:21.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.453+0000 7f94d1000640 1 -- 172.21.15.131:0/1588577993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94cc160190 msgr2=0x7f94cc1605a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:21.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.453+0000 7f94d1000640 1 --2- 172.21.15.131:0/1588577993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94cc160190 0x7f94cc1605a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:21.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.453+0000 7f94d1000640 1 -- 172.21.15.131:0/1588577993 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94cc160ae0 con 0x7f94cc150450 2024-04-25T19:22:21.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.453+0000 7f94d1000640 1 --2- 172.21.15.131:0/1588577993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94cc150450 0x7f94cc150860 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f94bc001be0 tx=0x7f94bc0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:21.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.453+0000 7f94c9600640 1 -- 172.21.15.131:0/1588577993 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94bc03f030 con 0x7f94cc150450 2024-04-25T19:22:21.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.453+0000 7f94c9600640 1 -- 172.21.15.131:0/1588577993 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94bc001250 con 0x7f94cc150450 2024-04-25T19:22:21.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.453+0000 7f94c9600640 1 -- 172.21.15.131:0/1588577993 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94bc037040 con 0x7f94cc150450 2024-04-25T19:22:21.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.453+0000 7f94d4400640 1 -- 172.21.15.131:0/1588577993 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94cc14df10 con 0x7f94cc150450 2024-04-25T19:22:21.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.454+0000 7f94d4400640 1 -- 172.21.15.131:0/1588577993 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94cc09e280 con 0x7f94cc150450 2024-04-25T19:22:21.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.455+0000 7f94d4400640 1 -- 172.21.15.131:0/1588577993 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94cc150f30 con 0x7f94cc150450 2024-04-25T19:22:21.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.456+0000 7f94c9600640 1 -- 172.21.15.131:0/1588577993 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f94bc042070 con 0x7f94cc150450 2024-04-25T19:22:21.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.456+0000 7f94c9600640 1 --2- 172.21.15.131:0/1588577993 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f94b00744b0 0x7f94b00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:21.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.457+0000 7f94c9600640 1 -- 172.21.15.131:0/1588577993 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f94bc0b4f60 con 0x7f94cc150450 2024-04-25T19:22:21.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.457+0000 7f94d1a00640 1 --2- 172.21.15.131:0/1588577993 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f94b00744b0 0x7f94b00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:21.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.458+0000 7f94d1a00640 1 --2- 172.21.15.131:0/1588577993 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f94b00744b0 0x7f94b00769c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f94cc0b4dc0 tx=0x7f94c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:21.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.462+0000 7f94c9600640 1 -- 172.21.15.131:0/1588577993 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f94cc160ae0 con 0x7f94cc150450 2024-04-25T19:22:21.465 INFO:tasks.ceph.mds.d.smithi195.stderr:2024-04-25T19:22:21.464+0000 7ff1dd000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T19:22:21.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.655+0000 7f94d4400640 1 -- 172.21.15.131:0/1588577993 --> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f94cc050740 con 0x7f94b00744b0 2024-04-25T19:22:21.680 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.679+0000 7f94c9600640 1 -- 172.21.15.131:0/1588577993 <== mgr.4105 v2:172.21.15.195:6832/2541913764 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251937 (secure 0 0 0) 0x7f94cc050740 con 0x7f94b00744b0 2024-04-25T19:22:21.684 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:21.685 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-04-25T19:22:21.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.685+0000 7f94d4400640 1 -- 172.21.15.131:0/1588577993 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f94b00744b0 msgr2=0x7f94b00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:21.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.686+0000 7f94d4400640 1 --2- 172.21.15.131:0/1588577993 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f94b00744b0 0x7f94b00769c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f94cc0b4dc0 tx=0x7f94c0008040 comp rx=0 tx=0).stop 2024-04-25T19:22:21.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.686+0000 7f94d4400640 1 -- 172.21.15.131:0/1588577993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94cc150450 msgr2=0x7f94cc150860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:21.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.686+0000 7f94d4400640 1 --2- 172.21.15.131:0/1588577993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94cc150450 0x7f94cc150860 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f94bc001be0 tx=0x7f94bc0014a0 comp rx=0 tx=0).stop 2024-04-25T19:22:21.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.686+0000 7f94d4400640 1 -- 172.21.15.131:0/1588577993 shutdown_connections 2024-04-25T19:22:21.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.686+0000 7f94d4400640 1 --2- 172.21.15.131:0/1588577993 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f94b00744b0 0x7f94b00769c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:21.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.686+0000 7f94d4400640 1 --2- 172.21.15.131:0/1588577993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94cc160190 0x7f94cc1605a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:21.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.686+0000 7f94d4400640 1 --2- 172.21.15.131:0/1588577993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94cc150450 0x7f94cc150860 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:21.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.686+0000 7f94d4400640 1 --2- 172.21.15.131:0/1588577993 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94b4003f60 0x7f94cc14d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:21.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.686+0000 7f94d4400640 1 -- 172.21.15.131:0/1588577993 >> 172.21.15.131:0/1588577993 conn(0x7f94cc09b7d0 msgr2=0x7f94cc0cfdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:21.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.686+0000 7f94d4400640 1 -- 172.21.15.131:0/1588577993 shutdown_connections 2024-04-25T19:22:21.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:21.686+0000 7f94d4400640 1 -- 172.21.15.131:0/1588577993 wait complete. 2024-04-25T19:22:21.711 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-25T19:22:20.136766+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235636,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739084,"statfs":{"total":773094113280,"available":772852822016,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.119458"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138347+0000","last_change":"2024-04-25T19:22:17.084552+0000","last_active":"2024-04-25T19:22:18.138347+0000","last_peered":"2024-04-25T19:22:18.138347+0000","last_clean":"2024-04-25T19:22:18.138347+0000","last_became_active":"2024-04-25T19:22:17.083645+0000","last_became_peered":"2024-04-25T19:22:17.083645+0000","last_unstale":"2024-04-25T19:22:18.138347+0000","last_undegraded":"2024-04-25T19:22:18.138347+0000","last_fullsized":"2024-04-25T19:22:18.138347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:49:42.415156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073420+0000","last_change":"2024-04-25T19:22:17.069431+0000","last_active":"2024-04-25T19:22:18.073420+0000","last_peered":"2024-04-25T19:22:18.073420+0000","last_clean":"2024-04-25T19:22:18.073420+0000","last_became_active":"2024-04-25T19:22:17.069036+0000","last_became_peered":"2024-04-25T19:22:17.069036+0000","last_unstale":"2024-04-25T19:22:18.073420+0000","last_undegraded":"2024-04-25T19:22:18.073420+0000","last_fullsized":"2024-04-25T19:22:18.073420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:52.165740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135315+0000","last_change":"2024-04-25T19:22:17.063030+0000","last_active":"2024-04-25T19:22:18.135315+0000","last_peered":"2024-04-25T19:22:18.135315+0000","last_clean":"2024-04-25T19:22:18.135315+0000","last_became_active":"2024-04-25T19:22:17.059484+0000","last_became_peered":"2024-04-25T19:22:17.059484+0000","last_unstale":"2024-04-25T19:22:18.135315+0000","last_undegraded":"2024-04-25T19:22:18.135315+0000","last_fullsized":"2024-04-25T19:22:18.135315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:59.050894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076254+0000","last_change":"2024-04-25T19:22:17.081742+0000","last_active":"2024-04-25T19:22:18.076254+0000","last_peered":"2024-04-25T19:22:18.076254+0000","last_clean":"2024-04-25T19:22:18.076254+0000","last_became_active":"2024-04-25T19:22:17.080753+0000","last_became_peered":"2024-04-25T19:22:17.080753+0000","last_unstale":"2024-04-25T19:22:18.076254+0000","last_undegraded":"2024-04-25T19:22:18.076254+0000","last_fullsized":"2024-04-25T19:22:18.076254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:58:50.378291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.137965+0000","last_change":"2024-04-25T19:22:17.074651+0000","last_active":"2024-04-25T19:22:18.137965+0000","last_peered":"2024-04-25T19:22:18.137965+0000","last_clean":"2024-04-25T19:22:18.137965+0000","last_became_active":"2024-04-25T19:22:17.073983+0000","last_became_peered":"2024-04-25T19:22:17.073983+0000","last_unstale":"2024-04-25T19:22:18.137965+0000","last_undegraded":"2024-04-25T19:22:18.137965+0000","last_fullsized":"2024-04-25T19:22:18.137965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:11.217132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.075816+0000","last_change":"2024-04-25T19:22:17.073457+0000","last_active":"2024-04-25T19:22:18.075816+0000","last_peered":"2024-04-25T19:22:18.075816+0000","last_clean":"2024-04-25T19:22:18.075816+0000","last_became_active":"2024-04-25T19:22:17.071400+0000","last_became_peered":"2024-04-25T19:22:17.071400+0000","last_unstale":"2024-04-25T19:22:18.075816+0000","last_undegraded":"2024-04-25T19:22:18.075816+0000","last_fullsized":"2024-04-25T19:22:18.075816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:36:53.730051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.136942+0000","last_change":"2024-04-25T19:22:17.082930+0000","last_active":"2024-04-25T19:22:18.136942+0000","last_peered":"2024-04-25T19:22:18.136942+0000","last_clean":"2024-04-25T19:22:18.136942+0000","last_became_active":"2024-04-25T19:22:17.082555+0000","last_became_peered":"2024-04-25T19:22:17.082555+0000","last_unstale":"2024-04-25T19:22:18.136942+0000","last_undegraded":"2024-04-25T19:22:18.136942+0000","last_fullsized":"2024-04-25T19:22:18.136942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:15:59.386088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134476+0000","last_change":"2024-04-25T19:22:17.081565+0000","last_active":"2024-04-25T19:22:18.134476+0000","last_peered":"2024-04-25T19:22:18.134476+0000","last_clean":"2024-04-25T19:22:18.134476+0000","last_became_active":"2024-04-25T19:22:17.080933+0000","last_became_peered":"2024-04-25T19:22:17.080933+0000","last_unstale":"2024-04-25T19:22:18.134476+0000","last_undegraded":"2024-04-25T19:22:18.134476+0000","last_fullsized":"2024-04-25T19:22:18.134476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:05.392241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138545+0000","last_change":"2024-04-25T19:22:17.096675+0000","last_active":"2024-04-25T19:22:18.138545+0000","last_peered":"2024-04-25T19:22:18.138545+0000","last_clean":"2024-04-25T19:22:18.138545+0000","last_became_active":"2024-04-25T19:22:17.096054+0000","last_became_peered":"2024-04-25T19:22:17.096054+0000","last_unstale":"2024-04-25T19:22:18.138545+0000","last_undegraded":"2024-04-25T19:22:18.138545+0000","last_fullsized":"2024-04-25T19:22:18.138545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:34.594467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.082280+0000","last_change":"2024-04-25T19:22:17.092042+0000","last_active":"2024-04-25T19:22:18.082280+0000","last_peered":"2024-04-25T19:22:18.082280+0000","last_clean":"2024-04-25T19:22:18.082280+0000","last_became_active":"2024-04-25T19:22:17.091661+0000","last_became_peered":"2024-04-25T19:22:17.091661+0000","last_unstale":"2024-04-25T19:22:18.082280+0000","last_undegraded":"2024-04-25T19:22:18.082280+0000","last_fullsized":"2024-04-25T19:22:18.082280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.514449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081825+0000","last_change":"2024-04-25T19:22:17.089728+0000","last_active":"2024-04-25T19:22:18.081825+0000","last_peered":"2024-04-25T19:22:18.081825+0000","last_clean":"2024-04-25T19:22:18.081825+0000","last_became_active":"2024-04-25T19:22:17.089366+0000","last_became_peered":"2024-04-25T19:22:17.089366+0000","last_unstale":"2024-04-25T19:22:18.081825+0000","last_undegraded":"2024-04-25T19:22:18.081825+0000","last_fullsized":"2024-04-25T19:22:18.081825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:59.050894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073574+0000","last_change":"2024-04-25T19:22:17.076934+0000","last_active":"2024-04-25T19:22:18.073574+0000","last_peered":"2024-04-25T19:22:18.073574+0000","last_clean":"2024-04-25T19:22:18.073574+0000","last_became_active":"2024-04-25T19:22:17.074228+0000","last_became_peered":"2024-04-25T19:22:17.074228+0000","last_unstale":"2024-04-25T19:22:18.073574+0000","last_undegraded":"2024-04-25T19:22:18.073574+0000","last_fullsized":"2024-04-25T19:22:18.073574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:45.772456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134905+0000","last_change":"2024-04-25T19:22:17.074643+0000","last_active":"2024-04-25T19:22:18.134905+0000","last_peered":"2024-04-25T19:22:18.134905+0000","last_clean":"2024-04-25T19:22:18.134905+0000","last_became_active":"2024-04-25T19:22:17.074222+0000","last_became_peered":"2024-04-25T19:22:17.074222+0000","last_unstale":"2024-04-25T19:22:18.134905+0000","last_undegraded":"2024-04-25T19:22:18.134905+0000","last_fullsized":"2024-04-25T19:22:18.134905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:42.370408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134334+0000","last_change":"2024-04-25T19:22:17.080879+0000","last_active":"2024-04-25T19:22:18.134334+0000","last_peered":"2024-04-25T19:22:18.134334+0000","last_clean":"2024-04-25T19:22:18.134334+0000","last_became_active":"2024-04-25T19:22:17.080532+0000","last_became_peered":"2024-04-25T19:22:17.080532+0000","last_unstale":"2024-04-25T19:22:18.134334+0000","last_undegraded":"2024-04-25T19:22:18.134334+0000","last_fullsized":"2024-04-25T19:22:18.134334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:02.635176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072556+0000","last_change":"2024-04-25T19:22:17.073160+0000","last_active":"2024-04-25T19:22:18.072556+0000","last_peered":"2024-04-25T19:22:18.072556+0000","last_clean":"2024-04-25T19:22:18.072556+0000","last_became_active":"2024-04-25T19:22:17.072815+0000","last_became_peered":"2024-04-25T19:22:17.072815+0000","last_unstale":"2024-04-25T19:22:18.072556+0000","last_undegraded":"2024-04-25T19:22:18.072556+0000","last_fullsized":"2024-04-25T19:22:18.072556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:59.050894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.075591+0000","last_change":"2024-04-25T19:22:17.071757+0000","last_active":"2024-04-25T19:22:18.075591+0000","last_peered":"2024-04-25T19:22:18.075591+0000","last_clean":"2024-04-25T19:22:18.075591+0000","last_became_active":"2024-04-25T19:22:17.071385+0000","last_became_peered":"2024-04-25T19:22:17.071385+0000","last_unstale":"2024-04-25T19:22:18.075591+0000","last_undegraded":"2024-04-25T19:22:18.075591+0000","last_fullsized":"2024-04-25T19:22:18.075591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:52.165740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.077244+0000","last_change":"2024-04-25T19:22:17.082098+0000","last_active":"2024-04-25T19:22:18.077244+0000","last_peered":"2024-04-25T19:22:18.077244+0000","last_clean":"2024-04-25T19:22:18.077244+0000","last_became_active":"2024-04-25T19:22:17.080035+0000","last_became_peered":"2024-04-25T19:22:17.080035+0000","last_unstale":"2024-04-25T19:22:18.077244+0000","last_undegraded":"2024-04-25T19:22:18.077244+0000","last_fullsized":"2024-04-25T19:22:18.077244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:49:42.415156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.133867+0000","last_change":"2024-04-25T19:22:17.071266+0000","last_active":"2024-04-25T19:22:18.133867+0000","last_peered":"2024-04-25T19:22:18.133867+0000","last_clean":"2024-04-25T19:22:18.133867+0000","last_became_active":"2024-04-25T19:22:17.070270+0000","last_became_peered":"2024-04-25T19:22:17.070270+0000","last_unstale":"2024-04-25T19:22:18.133867+0000","last_undegraded":"2024-04-25T19:22:18.133867+0000","last_fullsized":"2024-04-25T19:22:18.133867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:49:46.991384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138169+0000","last_change":"2024-04-25T19:22:17.089998+0000","last_active":"2024-04-25T19:22:18.138169+0000","last_peered":"2024-04-25T19:22:18.138169+0000","last_clean":"2024-04-25T19:22:18.138169+0000","last_became_active":"2024-04-25T19:22:17.087637+0000","last_became_peered":"2024-04-25T19:22:17.087637+0000","last_unstale":"2024-04-25T19:22:18.138169+0000","last_undegraded":"2024-04-25T19:22:18.138169+0000","last_fullsized":"2024-04-25T19:22:18.138169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:31.122370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081737+0000","last_change":"2024-04-25T19:22:17.085745+0000","last_active":"2024-04-25T19:22:18.081737+0000","last_peered":"2024-04-25T19:22:18.081737+0000","last_clean":"2024-04-25T19:22:18.081737+0000","last_became_active":"2024-04-25T19:22:17.084164+0000","last_became_peered":"2024-04-25T19:22:17.084164+0000","last_unstale":"2024-04-25T19:22:18.081737+0000","last_undegraded":"2024-04-25T19:22:18.081737+0000","last_fullsized":"2024-04-25T19:22:18.081737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:23.797191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134984+0000","last_change":"2024-04-25T19:22:17.071037+0000","last_active":"2024-04-25T19:22:18.134984+0000","last_peered":"2024-04-25T19:22:18.134984+0000","last_clean":"2024-04-25T19:22:18.134984+0000","last_became_active":"2024-04-25T19:22:17.070692+0000","last_became_peered":"2024-04-25T19:22:17.070692+0000","last_unstale":"2024-04-25T19:22:18.134984+0000","last_undegraded":"2024-04-25T19:22:18.134984+0000","last_fullsized":"2024-04-25T19:22:18.134984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:06.030063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.075876+0000","last_change":"2024-04-25T19:22:17.082746+0000","last_active":"2024-04-25T19:22:18.075876+0000","last_peered":"2024-04-25T19:22:18.075876+0000","last_clean":"2024-04-25T19:22:18.075876+0000","last_became_active":"2024-04-25T19:22:17.081725+0000","last_became_peered":"2024-04-25T19:22:17.081725+0000","last_unstale":"2024-04-25T19:22:18.075876+0000","last_undegraded":"2024-04-25T19:22:18.075876+0000","last_fullsized":"2024-04-25T19:22:18.075876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:42.285229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134792+0000","last_change":"2024-04-25T19:22:17.085784+0000","last_active":"2024-04-25T19:22:18.134792+0000","last_peered":"2024-04-25T19:22:18.134792+0000","last_clean":"2024-04-25T19:22:18.134792+0000","last_became_active":"2024-04-25T19:22:17.085388+0000","last_became_peered":"2024-04-25T19:22:17.085388+0000","last_unstale":"2024-04-25T19:22:18.134792+0000","last_undegraded":"2024-04-25T19:22:18.134792+0000","last_fullsized":"2024-04-25T19:22:18.134792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:59.050894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.075802+0000","last_change":"2024-04-25T19:22:17.083578+0000","last_active":"2024-04-25T19:22:18.075802+0000","last_peered":"2024-04-25T19:22:18.075802+0000","last_clean":"2024-04-25T19:22:18.075802+0000","last_became_active":"2024-04-25T19:22:17.082843+0000","last_became_peered":"2024-04-25T19:22:17.082843+0000","last_unstale":"2024-04-25T19:22:18.075802+0000","last_undegraded":"2024-04-25T19:22:18.075802+0000","last_fullsized":"2024-04-25T19:22:18.075802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.514449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135247+0000","last_change":"2024-04-25T19:22:17.086133+0000","last_active":"2024-04-25T19:22:18.135247+0000","last_peered":"2024-04-25T19:22:18.135247+0000","last_clean":"2024-04-25T19:22:18.135247+0000","last_became_active":"2024-04-25T19:22:17.084935+0000","last_became_peered":"2024-04-25T19:22:17.084935+0000","last_unstale":"2024-04-25T19:22:18.135247+0000","last_undegraded":"2024-04-25T19:22:18.135247+0000","last_fullsized":"2024-04-25T19:22:18.135247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.514449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.082077+0000","last_change":"2024-04-25T19:22:17.072128+0000","last_active":"2024-04-25T19:22:18.082077+0000","last_peered":"2024-04-25T19:22:18.082077+0000","last_clean":"2024-04-25T19:22:18.082077+0000","last_became_active":"2024-04-25T19:22:17.071637+0000","last_became_peered":"2024-04-25T19:22:17.071637+0000","last_unstale":"2024-04-25T19:22:18.082077+0000","last_undegraded":"2024-04-25T19:22:18.082077+0000","last_fullsized":"2024-04-25T19:22:18.082077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:52.165740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072909+0000","last_change":"2024-04-25T19:22:17.077813+0000","last_active":"2024-04-25T19:22:18.072909+0000","last_peered":"2024-04-25T19:22:18.072909+0000","last_clean":"2024-04-25T19:22:18.072909+0000","last_became_active":"2024-04-25T19:22:17.076972+0000","last_became_peered":"2024-04-25T19:22:17.076972+0000","last_unstale":"2024-04-25T19:22:18.072909+0000","last_undegraded":"2024-04-25T19:22:18.072909+0000","last_fullsized":"2024-04-25T19:22:18.072909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:27.385683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135131+0000","last_change":"2024-04-25T19:22:17.085634+0000","last_active":"2024-04-25T19:22:18.135131+0000","last_peered":"2024-04-25T19:22:18.135131+0000","last_clean":"2024-04-25T19:22:18.135131+0000","last_became_active":"2024-04-25T19:22:17.085069+0000","last_became_peered":"2024-04-25T19:22:17.085069+0000","last_unstale":"2024-04-25T19:22:18.135131+0000","last_undegraded":"2024-04-25T19:22:18.135131+0000","last_fullsized":"2024-04-25T19:22:18.135131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:27.385683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135179+0000","last_change":"2024-04-25T19:22:17.081785+0000","last_active":"2024-04-25T19:22:18.135179+0000","last_peered":"2024-04-25T19:22:18.135179+0000","last_clean":"2024-04-25T19:22:18.135179+0000","last_became_active":"2024-04-25T19:22:17.081478+0000","last_became_peered":"2024-04-25T19:22:17.081478+0000","last_unstale":"2024-04-25T19:22:18.135179+0000","last_undegraded":"2024-04-25T19:22:18.135179+0000","last_fullsized":"2024-04-25T19:22:18.135179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:23.797191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076049+0000","last_change":"2024-04-25T19:22:17.084665+0000","last_active":"2024-04-25T19:22:18.076049+0000","last_peered":"2024-04-25T19:22:18.076049+0000","last_clean":"2024-04-25T19:22:18.076049+0000","last_became_active":"2024-04-25T19:22:17.082107+0000","last_became_peered":"2024-04-25T19:22:17.082107+0000","last_unstale":"2024-04-25T19:22:18.076049+0000","last_undegraded":"2024-04-25T19:22:18.076049+0000","last_fullsized":"2024-04-25T19:22:18.076049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:15:59.386088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.133567+0000","last_change":"2024-04-25T19:22:17.082056+0000","last_active":"2024-04-25T19:22:18.133567+0000","last_peered":"2024-04-25T19:22:18.133567+0000","last_clean":"2024-04-25T19:22:18.133567+0000","last_became_active":"2024-04-25T19:22:17.079951+0000","last_became_peered":"2024-04-25T19:22:17.079951+0000","last_unstale":"2024-04-25T19:22:18.133567+0000","last_undegraded":"2024-04-25T19:22:18.133567+0000","last_fullsized":"2024-04-25T19:22:18.133567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:19.060353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081500+0000","last_change":"2024-04-25T19:22:17.082235+0000","last_active":"2024-04-25T19:22:18.081500+0000","last_peered":"2024-04-25T19:22:18.081500+0000","last_clean":"2024-04-25T19:22:18.081500+0000","last_became_active":"2024-04-25T19:22:17.081806+0000","last_became_peered":"2024-04-25T19:22:17.081806+0000","last_unstale":"2024-04-25T19:22:18.081500+0000","last_undegraded":"2024-04-25T19:22:18.081500+0000","last_fullsized":"2024-04-25T19:22:18.081500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:06.030063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073096+0000","last_change":"2024-04-25T19:22:17.080063+0000","last_active":"2024-04-25T19:22:18.073096+0000","last_peered":"2024-04-25T19:22:18.073096+0000","last_clean":"2024-04-25T19:22:18.073096+0000","last_became_active":"2024-04-25T19:22:17.079696+0000","last_became_peered":"2024-04-25T19:22:17.079696+0000","last_unstale":"2024-04-25T19:22:18.073096+0000","last_undegraded":"2024-04-25T19:22:18.073096+0000","last_fullsized":"2024-04-25T19:22:18.073096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:26.080591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135311+0000","last_change":"2024-04-25T19:22:16.067625+0000","last_active":"2024-04-25T19:22:18.135311+0000","last_peered":"2024-04-25T19:22:18.135311+0000","last_clean":"2024-04-25T19:22:18.135311+0000","last_became_active":"2024-04-25T19:22:16.067277+0000","last_became_peered":"2024-04-25T19:22:16.067277+0000","last_unstale":"2024-04-25T19:22:18.135311+0000","last_undegraded":"2024-04-25T19:22:18.135311+0000","last_fullsized":"2024-04-25T19:22:18.135311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:38.378131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135442+0000","last_change":"2024-04-25T19:22:17.067796+0000","last_active":"2024-04-25T19:22:18.135442+0000","last_peered":"2024-04-25T19:22:18.135442+0000","last_clean":"2024-04-25T19:22:18.135442+0000","last_became_active":"2024-04-25T19:22:17.067488+0000","last_became_peered":"2024-04-25T19:22:17.067488+0000","last_unstale":"2024-04-25T19:22:18.135442+0000","last_undegraded":"2024-04-25T19:22:18.135442+0000","last_fullsized":"2024-04-25T19:22:18.135442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:42.370408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.082142+0000","last_change":"2024-04-25T19:22:16.073203+0000","last_active":"2024-04-25T19:22:18.082142+0000","last_peered":"2024-04-25T19:22:18.082142+0000","last_clean":"2024-04-25T19:22:18.082142+0000","last_became_active":"2024-04-25T19:22:16.072711+0000","last_became_peered":"2024-04-25T19:22:16.072711+0000","last_unstale":"2024-04-25T19:22:18.082142+0000","last_undegraded":"2024-04-25T19:22:18.082142+0000","last_fullsized":"2024-04-25T19:22:18.082142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:39:11.697383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134798+0000","last_change":"2024-04-25T19:22:16.066248+0000","last_active":"2024-04-25T19:22:18.134798+0000","last_peered":"2024-04-25T19:22:18.134798+0000","last_clean":"2024-04-25T19:22:18.134798+0000","last_became_active":"2024-04-25T19:22:16.065906+0000","last_became_peered":"2024-04-25T19:22:16.065906+0000","last_unstale":"2024-04-25T19:22:18.134798+0000","last_undegraded":"2024-04-25T19:22:18.134798+0000","last_fullsized":"2024-04-25T19:22:18.134798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:32:14.300239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134508+0000","last_change":"2024-04-25T19:22:17.076260+0000","last_active":"2024-04-25T19:22:18.134508+0000","last_peered":"2024-04-25T19:22:18.134508+0000","last_clean":"2024-04-25T19:22:18.134508+0000","last_became_active":"2024-04-25T19:22:17.075601+0000","last_became_peered":"2024-04-25T19:22:17.075601+0000","last_unstale":"2024-04-25T19:22:18.134508+0000","last_undegraded":"2024-04-25T19:22:18.134508+0000","last_fullsized":"2024-04-25T19:22:18.134508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:06.030063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.075730+0000","last_change":"2024-04-25T19:22:16.071937+0000","last_active":"2024-04-25T19:22:18.075730+0000","last_peered":"2024-04-25T19:22:18.075730+0000","last_clean":"2024-04-25T19:22:18.075730+0000","last_became_active":"2024-04-25T19:22:16.071520+0000","last_became_peered":"2024-04-25T19:22:16.071520+0000","last_unstale":"2024-04-25T19:22:18.075730+0000","last_undegraded":"2024-04-25T19:22:18.075730+0000","last_fullsized":"2024-04-25T19:22:18.075730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:44.758262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072358+0000","last_change":"2024-04-25T19:22:17.077394+0000","last_active":"2024-04-25T19:22:18.072358+0000","last_peered":"2024-04-25T19:22:18.072358+0000","last_clean":"2024-04-25T19:22:18.072358+0000","last_became_active":"2024-04-25T19:22:17.077051+0000","last_became_peered":"2024-04-25T19:22:17.077051+0000","last_unstale":"2024-04-25T19:22:18.072358+0000","last_undegraded":"2024-04-25T19:22:18.072358+0000","last_fullsized":"2024-04-25T19:22:18.072358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:06.030063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081976+0000","last_change":"2024-04-25T19:22:16.072385+0000","last_active":"2024-04-25T19:22:18.081976+0000","last_peered":"2024-04-25T19:22:18.081976+0000","last_clean":"2024-04-25T19:22:18.081976+0000","last_became_active":"2024-04-25T19:22:16.070426+0000","last_became_peered":"2024-04-25T19:22:16.070426+0000","last_unstale":"2024-04-25T19:22:18.081976+0000","last_undegraded":"2024-04-25T19:22:18.081976+0000","last_fullsized":"2024-04-25T19:22:18.081976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:44.758262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076712+0000","last_change":"2024-04-25T19:22:17.082646+0000","last_active":"2024-04-25T19:22:18.076712+0000","last_peered":"2024-04-25T19:22:18.076712+0000","last_clean":"2024-04-25T19:22:18.076712+0000","last_became_active":"2024-04-25T19:22:17.080730+0000","last_became_peered":"2024-04-25T19:22:17.080730+0000","last_unstale":"2024-04-25T19:22:18.076712+0000","last_undegraded":"2024-04-25T19:22:18.076712+0000","last_fullsized":"2024-04-25T19:22:18.076712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:31.122370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.077020+0000","last_change":"2024-04-25T19:22:16.074350+0000","last_active":"2024-04-25T19:22:18.077020+0000","last_peered":"2024-04-25T19:22:18.077020+0000","last_clean":"2024-04-25T19:22:18.077020+0000","last_became_active":"2024-04-25T19:22:16.074011+0000","last_became_peered":"2024-04-25T19:22:16.074011+0000","last_unstale":"2024-04-25T19:22:18.077020+0000","last_undegraded":"2024-04-25T19:22:18.077020+0000","last_fullsized":"2024-04-25T19:22:18.077020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:26.277490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135604+0000","last_change":"2024-04-25T19:22:17.064011+0000","last_active":"2024-04-25T19:22:18.135604+0000","last_peered":"2024-04-25T19:22:18.135604+0000","last_clean":"2024-04-25T19:22:18.135604+0000","last_became_active":"2024-04-25T19:22:17.062182+0000","last_became_peered":"2024-04-25T19:22:17.062182+0000","last_unstale":"2024-04-25T19:22:18.135604+0000","last_undegraded":"2024-04-25T19:22:18.135604+0000","last_fullsized":"2024-04-25T19:22:18.135604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:52.165740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073457+0000","last_change":"2024-04-25T19:22:16.071057+0000","last_active":"2024-04-25T19:22:18.073457+0000","last_peered":"2024-04-25T19:22:18.073457+0000","last_clean":"2024-04-25T19:22:18.073457+0000","last_became_active":"2024-04-25T19:22:16.070791+0000","last_became_peered":"2024-04-25T19:22:16.070791+0000","last_unstale":"2024-04-25T19:22:18.073457+0000","last_undegraded":"2024-04-25T19:22:18.073457+0000","last_fullsized":"2024-04-25T19:22:18.073457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:52.491459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073601+0000","last_change":"2024-04-25T19:22:17.077831+0000","last_active":"2024-04-25T19:22:18.073601+0000","last_peered":"2024-04-25T19:22:18.073601+0000","last_clean":"2024-04-25T19:22:18.073601+0000","last_became_active":"2024-04-25T19:22:17.077469+0000","last_became_peered":"2024-04-25T19:22:17.077469+0000","last_unstale":"2024-04-25T19:22:18.073601+0000","last_undegraded":"2024-04-25T19:22:18.073601+0000","last_fullsized":"2024-04-25T19:22:18.073601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:52:35.971335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081891+0000","last_change":"2024-04-25T19:22:16.071427+0000","last_active":"2024-04-25T19:22:18.081891+0000","last_peered":"2024-04-25T19:22:18.081891+0000","last_clean":"2024-04-25T19:22:18.081891+0000","last_became_active":"2024-04-25T19:22:16.070575+0000","last_became_peered":"2024-04-25T19:22:16.070575+0000","last_unstale":"2024-04-25T19:22:18.081891+0000","last_undegraded":"2024-04-25T19:22:18.081891+0000","last_fullsized":"2024-04-25T19:22:18.081891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:25.066396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.137428+0000","last_change":"2024-04-25T19:22:17.084347+0000","last_active":"2024-04-25T19:22:18.137428+0000","last_peered":"2024-04-25T19:22:18.137428+0000","last_clean":"2024-04-25T19:22:18.137428+0000","last_became_active":"2024-04-25T19:22:17.084024+0000","last_became_peered":"2024-04-25T19:22:17.084024+0000","last_unstale":"2024-04-25T19:22:18.137428+0000","last_undegraded":"2024-04-25T19:22:18.137428+0000","last_fullsized":"2024-04-25T19:22:18.137428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:58:50.378291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135604+0000","last_change":"2024-04-25T19:22:16.070227+0000","last_active":"2024-04-25T19:22:18.135604+0000","last_peered":"2024-04-25T19:22:18.135604+0000","last_clean":"2024-04-25T19:22:18.135604+0000","last_became_active":"2024-04-25T19:22:16.069762+0000","last_became_peered":"2024-04-25T19:22:16.069762+0000","last_unstale":"2024-04-25T19:22:18.135604+0000","last_undegraded":"2024-04-25T19:22:18.135604+0000","last_fullsized":"2024-04-25T19:22:18.135604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:32:14.300239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134514+0000","last_change":"2024-04-25T19:22:17.072239+0000","last_active":"2024-04-25T19:22:18.134514+0000","last_peered":"2024-04-25T19:22:18.134514+0000","last_clean":"2024-04-25T19:22:18.134514+0000","last_became_active":"2024-04-25T19:22:17.070501+0000","last_became_peered":"2024-04-25T19:22:17.070501+0000","last_unstale":"2024-04-25T19:22:18.134514+0000","last_undegraded":"2024-04-25T19:22:18.134514+0000","last_fullsized":"2024-04-25T19:22:18.134514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:02.462274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076023+0000","last_change":"2024-04-25T19:22:16.065013+0000","last_active":"2024-04-25T19:22:18.076023+0000","last_peered":"2024-04-25T19:22:18.076023+0000","last_clean":"2024-04-25T19:22:18.076023+0000","last_became_active":"2024-04-25T19:22:16.063969+0000","last_became_peered":"2024-04-25T19:22:16.063969+0000","last_unstale":"2024-04-25T19:22:18.076023+0000","last_undegraded":"2024-04-25T19:22:18.076023+0000","last_fullsized":"2024-04-25T19:22:18.076023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:39:11.697383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.137925+0000","last_change":"2024-04-25T19:22:17.100962+0000","last_active":"2024-04-25T19:22:18.137925+0000","last_peered":"2024-04-25T19:22:18.137925+0000","last_clean":"2024-04-25T19:22:18.137925+0000","last_became_active":"2024-04-25T19:22:17.099677+0000","last_became_peered":"2024-04-25T19:22:17.099677+0000","last_unstale":"2024-04-25T19:22:18.137925+0000","last_undegraded":"2024-04-25T19:22:18.137925+0000","last_fullsized":"2024-04-25T19:22:18.137925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:43.115713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081451+0000","last_change":"2024-04-25T19:22:16.073130+0000","last_active":"2024-04-25T19:22:18.081451+0000","last_peered":"2024-04-25T19:22:18.081451+0000","last_clean":"2024-04-25T19:22:18.081451+0000","last_became_active":"2024-04-25T19:22:16.070679+0000","last_became_peered":"2024-04-25T19:22:16.070679+0000","last_unstale":"2024-04-25T19:22:18.081451+0000","last_undegraded":"2024-04-25T19:22:18.081451+0000","last_fullsized":"2024-04-25T19:22:18.081451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:51.334418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081928+0000","last_change":"2024-04-25T19:22:17.081998+0000","last_active":"2024-04-25T19:22:18.081928+0000","last_peered":"2024-04-25T19:22:18.081928+0000","last_clean":"2024-04-25T19:22:18.081928+0000","last_became_active":"2024-04-25T19:22:17.081424+0000","last_became_peered":"2024-04-25T19:22:17.081424+0000","last_unstale":"2024-04-25T19:22:18.081928+0000","last_undegraded":"2024-04-25T19:22:18.081928+0000","last_fullsized":"2024-04-25T19:22:18.081928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:42.370408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.133344+0000","last_change":"2024-04-25T19:22:16.055538+0000","last_active":"2024-04-25T19:22:18.133344+0000","last_peered":"2024-04-25T19:22:18.133344+0000","last_clean":"2024-04-25T19:22:18.133344+0000","last_became_active":"2024-04-25T19:22:16.055142+0000","last_became_peered":"2024-04-25T19:22:16.055142+0000","last_unstale":"2024-04-25T19:22:18.133344+0000","last_undegraded":"2024-04-25T19:22:18.133344+0000","last_fullsized":"2024-04-25T19:22:18.133344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:51.334418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.136896+0000","last_change":"2024-04-25T19:22:17.085913+0000","last_active":"2024-04-25T19:22:18.136896+0000","last_peered":"2024-04-25T19:22:18.136896+0000","last_clean":"2024-04-25T19:22:18.136896+0000","last_became_active":"2024-04-25T19:22:17.081882+0000","last_became_peered":"2024-04-25T19:22:17.081882+0000","last_unstale":"2024-04-25T19:22:18.136896+0000","last_undegraded":"2024-04-25T19:22:18.136896+0000","last_fullsized":"2024-04-25T19:22:18.136896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:42.285229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.074059+0000","last_change":"2024-04-25T19:22:16.063433+0000","last_active":"2024-04-25T19:22:18.074059+0000","last_peered":"2024-04-25T19:22:18.074059+0000","last_clean":"2024-04-25T19:22:18.074059+0000","last_became_active":"2024-04-25T19:22:16.062287+0000","last_became_peered":"2024-04-25T19:22:16.062287+0000","last_unstale":"2024-04-25T19:22:18.074059+0000","last_undegraded":"2024-04-25T19:22:18.074059+0000","last_fullsized":"2024-04-25T19:22:18.074059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:03:07.738217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.137576+0000","last_change":"2024-04-25T19:22:17.075699+0000","last_active":"2024-04-25T19:22:18.137576+0000","last_peered":"2024-04-25T19:22:18.137576+0000","last_clean":"2024-04-25T19:22:18.137576+0000","last_became_active":"2024-04-25T19:22:17.075238+0000","last_became_peered":"2024-04-25T19:22:17.075238+0000","last_unstale":"2024-04-25T19:22:18.137576+0000","last_undegraded":"2024-04-25T19:22:18.137576+0000","last_fullsized":"2024-04-25T19:22:18.137576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:37.277654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.133800+0000","last_change":"2024-04-25T19:22:16.056199+0000","last_active":"2024-04-25T19:22:18.133800+0000","last_peered":"2024-04-25T19:22:18.133800+0000","last_clean":"2024-04-25T19:22:18.133800+0000","last_became_active":"2024-04-25T19:22:16.055898+0000","last_became_peered":"2024-04-25T19:22:16.055898+0000","last_unstale":"2024-04-25T19:22:18.133800+0000","last_undegraded":"2024-04-25T19:22:18.133800+0000","last_fullsized":"2024-04-25T19:22:18.133800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:25.066396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138688+0000","last_change":"2024-04-25T19:22:17.075542+0000","last_active":"2024-04-25T19:22:18.138688+0000","last_peered":"2024-04-25T19:22:18.138688+0000","last_clean":"2024-04-25T19:22:18.138688+0000","last_became_active":"2024-04-25T19:22:17.075208+0000","last_became_peered":"2024-04-25T19:22:17.075208+0000","last_unstale":"2024-04-25T19:22:18.138688+0000","last_undegraded":"2024-04-25T19:22:18.138688+0000","last_fullsized":"2024-04-25T19:22:18.138688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:07.456013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073013+0000","last_change":"2024-04-25T19:22:16.057412+0000","last_active":"2024-04-25T19:22:18.073013+0000","last_peered":"2024-04-25T19:22:18.073013+0000","last_clean":"2024-04-25T19:22:18.073013+0000","last_became_active":"2024-04-25T19:22:16.056998+0000","last_became_peered":"2024-04-25T19:22:16.056998+0000","last_unstale":"2024-04-25T19:22:18.073013+0000","last_undegraded":"2024-04-25T19:22:18.073013+0000","last_fullsized":"2024-04-25T19:22:18.073013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:49:45.977189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076474+0000","last_change":"2024-04-25T19:22:17.083087+0000","last_active":"2024-04-25T19:22:18.076474+0000","last_peered":"2024-04-25T19:22:18.076474+0000","last_clean":"2024-04-25T19:22:18.076474+0000","last_became_active":"2024-04-25T19:22:17.080584+0000","last_became_peered":"2024-04-25T19:22:17.080584+0000","last_unstale":"2024-04-25T19:22:18.076474+0000","last_undegraded":"2024-04-25T19:22:18.076474+0000","last_fullsized":"2024-04-25T19:22:18.076474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:43.115713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.133601+0000","last_change":"2024-04-25T19:22:16.064556+0000","last_active":"2024-04-25T19:22:18.133601+0000","last_peered":"2024-04-25T19:22:18.133601+0000","last_clean":"2024-04-25T19:22:18.133601+0000","last_became_active":"2024-04-25T19:22:16.063605+0000","last_became_peered":"2024-04-25T19:22:16.063605+0000","last_unstale":"2024-04-25T19:22:18.133601+0000","last_undegraded":"2024-04-25T19:22:18.133601+0000","last_fullsized":"2024-04-25T19:22:18.133601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:39:11.697383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.137672+0000","last_change":"2024-04-25T19:22:17.091739+0000","last_active":"2024-04-25T19:22:18.137672+0000","last_peered":"2024-04-25T19:22:18.137672+0000","last_clean":"2024-04-25T19:22:18.137672+0000","last_became_active":"2024-04-25T19:22:17.091329+0000","last_became_peered":"2024-04-25T19:22:17.091329+0000","last_unstale":"2024-04-25T19:22:18.137672+0000","last_undegraded":"2024-04-25T19:22:18.137672+0000","last_fullsized":"2024-04-25T19:22:18.137672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:25.008654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.136813+0000","last_change":"2024-04-25T19:22:06.081655+0000","last_active":"2024-04-25T19:22:18.136813+0000","last_peered":"2024-04-25T19:22:18.136813+0000","last_clean":"2024-04-25T19:22:18.136813+0000","last_became_active":"2024-04-25T19:22:06.078999+0000","last_became_peered":"2024-04-25T19:22:06.078999+0000","last_unstale":"2024-04-25T19:22:18.136813+0000","last_undegraded":"2024-04-25T19:22:18.136813+0000","last_fullsized":"2024-04-25T19:22:18.136813+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_clean_scrub_stamp":"2024-04-25T19:22:04.921147+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:30.543734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.075905+0000","last_change":"2024-04-25T19:22:16.058023+0000","last_active":"2024-04-25T19:22:18.075905+0000","last_peered":"2024-04-25T19:22:18.075905+0000","last_clean":"2024-04-25T19:22:18.075905+0000","last_became_active":"2024-04-25T19:22:16.057585+0000","last_became_peered":"2024-04-25T19:22:16.057585+0000","last_unstale":"2024-04-25T19:22:18.075905+0000","last_undegraded":"2024-04-25T19:22:18.075905+0000","last_fullsized":"2024-04-25T19:22:18.075905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:51.334418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135269+0000","last_change":"2024-04-25T19:22:17.080786+0000","last_active":"2024-04-25T19:22:18.135269+0000","last_peered":"2024-04-25T19:22:18.135269+0000","last_clean":"2024-04-25T19:22:18.135269+0000","last_became_active":"2024-04-25T19:22:17.080103+0000","last_became_peered":"2024-04-25T19:22:17.080103+0000","last_unstale":"2024-04-25T19:22:18.135269+0000","last_undegraded":"2024-04-25T19:22:18.135269+0000","last_fullsized":"2024-04-25T19:22:18.135269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:36:53.730051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.136579+0000","last_change":"2024-04-25T19:22:16.079452+0000","last_active":"2024-04-25T19:22:18.136579+0000","last_peered":"2024-04-25T19:22:18.136579+0000","last_clean":"2024-04-25T19:22:18.136579+0000","last_became_active":"2024-04-25T19:22:16.078988+0000","last_became_peered":"2024-04-25T19:22:16.078988+0000","last_unstale":"2024-04-25T19:22:18.136579+0000","last_undegraded":"2024-04-25T19:22:18.136579+0000","last_fullsized":"2024-04-25T19:22:18.136579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:52:34.957140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134617+0000","last_change":"2024-04-25T19:22:17.063481+0000","last_active":"2024-04-25T19:22:18.134617+0000","last_peered":"2024-04-25T19:22:18.134617+0000","last_clean":"2024-04-25T19:22:18.134617+0000","last_became_active":"2024-04-25T19:22:17.061000+0000","last_became_peered":"2024-04-25T19:22:17.061000+0000","last_unstale":"2024-04-25T19:22:18.134617+0000","last_undegraded":"2024-04-25T19:22:18.134617+0000","last_fullsized":"2024-04-25T19:22:18.134617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:05.392241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.133582+0000","last_change":"2024-04-25T19:22:16.060594+0000","last_active":"2024-04-25T19:22:18.133582+0000","last_peered":"2024-04-25T19:22:18.133582+0000","last_clean":"2024-04-25T19:22:18.133582+0000","last_became_active":"2024-04-25T19:22:16.060250+0000","last_became_peered":"2024-04-25T19:22:16.060250+0000","last_unstale":"2024-04-25T19:22:18.133582+0000","last_undegraded":"2024-04-25T19:22:18.133582+0000","last_fullsized":"2024-04-25T19:22:18.133582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:38.378131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072506+0000","last_change":"2024-04-25T19:22:17.068935+0000","last_active":"2024-04-25T19:22:18.072506+0000","last_peered":"2024-04-25T19:22:18.072506+0000","last_clean":"2024-04-25T19:22:18.072506+0000","last_became_active":"2024-04-25T19:22:17.068017+0000","last_became_peered":"2024-04-25T19:22:17.068017+0000","last_unstale":"2024-04-25T19:22:18.072506+0000","last_undegraded":"2024-04-25T19:22:18.072506+0000","last_fullsized":"2024-04-25T19:22:18.072506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:23.797191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076158+0000","last_change":"2024-04-25T19:22:16.064341+0000","last_active":"2024-04-25T19:22:18.076158+0000","last_peered":"2024-04-25T19:22:18.076158+0000","last_clean":"2024-04-25T19:22:18.076158+0000","last_became_active":"2024-04-25T19:22:16.063393+0000","last_became_peered":"2024-04-25T19:22:16.063393+0000","last_unstale":"2024-04-25T19:22:18.076158+0000","last_undegraded":"2024-04-25T19:22:18.076158+0000","last_fullsized":"2024-04-25T19:22:18.076158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:25.066396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073702+0000","last_change":"2024-04-25T19:22:17.085013+0000","last_active":"2024-04-25T19:22:18.073702+0000","last_peered":"2024-04-25T19:22:18.073702+0000","last_clean":"2024-04-25T19:22:18.073702+0000","last_became_active":"2024-04-25T19:22:17.084714+0000","last_became_peered":"2024-04-25T19:22:17.084714+0000","last_unstale":"2024-04-25T19:22:18.073702+0000","last_undegraded":"2024-04-25T19:22:18.073702+0000","last_fullsized":"2024-04-25T19:22:18.073702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:19.060353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072843+0000","last_change":"2024-04-25T19:22:16.055692+0000","last_active":"2024-04-25T19:22:18.072843+0000","last_peered":"2024-04-25T19:22:18.072843+0000","last_clean":"2024-04-25T19:22:18.072843+0000","last_became_active":"2024-04-25T19:22:16.054860+0000","last_became_peered":"2024-04-25T19:22:16.054860+0000","last_unstale":"2024-04-25T19:22:18.072843+0000","last_undegraded":"2024-04-25T19:22:18.072843+0000","last_fullsized":"2024-04-25T19:22:18.072843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:26.277490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076489+0000","last_change":"2024-04-25T19:22:17.085772+0000","last_active":"2024-04-25T19:22:18.076489+0000","last_peered":"2024-04-25T19:22:18.076489+0000","last_clean":"2024-04-25T19:22:18.076489+0000","last_became_active":"2024-04-25T19:22:17.085385+0000","last_became_peered":"2024-04-25T19:22:17.085385+0000","last_unstale":"2024-04-25T19:22:18.076489+0000","last_undegraded":"2024-04-25T19:22:18.076489+0000","last_fullsized":"2024-04-25T19:22:18.076489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:11.217132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138639+0000","last_change":"2024-04-25T19:22:16.081834+0000","last_active":"2024-04-25T19:22:18.138639+0000","last_peered":"2024-04-25T19:22:18.138639+0000","last_clean":"2024-04-25T19:22:18.138639+0000","last_became_active":"2024-04-25T19:22:16.081457+0000","last_became_peered":"2024-04-25T19:22:16.081457+0000","last_unstale":"2024-04-25T19:22:18.138639+0000","last_undegraded":"2024-04-25T19:22:18.138639+0000","last_fullsized":"2024-04-25T19:22:18.138639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:30.978869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072883+0000","last_change":"2024-04-25T19:22:17.077342+0000","last_active":"2024-04-25T19:22:18.072883+0000","last_peered":"2024-04-25T19:22:18.072883+0000","last_clean":"2024-04-25T19:22:18.072883+0000","last_became_active":"2024-04-25T19:22:17.076548+0000","last_became_peered":"2024-04-25T19:22:17.076548+0000","last_unstale":"2024-04-25T19:22:18.072883+0000","last_undegraded":"2024-04-25T19:22:18.072883+0000","last_fullsized":"2024-04-25T19:22:18.072883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:42.370408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.080648+0000","last_change":"2024-04-25T19:22:16.068620+0000","last_active":"2024-04-25T19:22:18.080648+0000","last_peered":"2024-04-25T19:22:18.080648+0000","last_clean":"2024-04-25T19:22:18.080648+0000","last_became_active":"2024-04-25T19:22:16.068220+0000","last_became_peered":"2024-04-25T19:22:16.068220+0000","last_unstale":"2024-04-25T19:22:18.080648+0000","last_undegraded":"2024-04-25T19:22:18.080648+0000","last_fullsized":"2024-04-25T19:22:18.080648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:30.978869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135459+0000","last_change":"2024-04-25T19:22:17.075136+0000","last_active":"2024-04-25T19:22:18.135459+0000","last_peered":"2024-04-25T19:22:18.135459+0000","last_clean":"2024-04-25T19:22:18.135459+0000","last_became_active":"2024-04-25T19:22:17.074780+0000","last_became_peered":"2024-04-25T19:22:17.074780+0000","last_unstale":"2024-04-25T19:22:18.135459+0000","last_undegraded":"2024-04-25T19:22:18.135459+0000","last_fullsized":"2024-04-25T19:22:18.135459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:42.285229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.082026+0000","last_change":"2024-04-25T19:22:16.073857+0000","last_active":"2024-04-25T19:22:18.082026+0000","last_peered":"2024-04-25T19:22:18.082026+0000","last_clean":"2024-04-25T19:22:18.082026+0000","last_became_active":"2024-04-25T19:22:16.073078+0000","last_became_peered":"2024-04-25T19:22:16.073078+0000","last_unstale":"2024-04-25T19:22:18.082026+0000","last_undegraded":"2024-04-25T19:22:18.082026+0000","last_fullsized":"2024-04-25T19:22:18.082026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:26.277490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135943+0000","last_change":"2024-04-25T19:22:17.070172+0000","last_active":"2024-04-25T19:22:18.135943+0000","last_peered":"2024-04-25T19:22:18.135943+0000","last_clean":"2024-04-25T19:22:18.135943+0000","last_became_active":"2024-04-25T19:22:17.069803+0000","last_became_peered":"2024-04-25T19:22:17.069803+0000","last_unstale":"2024-04-25T19:22:18.135943+0000","last_undegraded":"2024-04-25T19:22:18.135943+0000","last_fullsized":"2024-04-25T19:22:18.135943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.514449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.136579+0000","last_change":"2024-04-25T19:22:16.078887+0000","last_active":"2024-04-25T19:22:18.136579+0000","last_peered":"2024-04-25T19:22:18.136579+0000","last_clean":"2024-04-25T19:22:18.136579+0000","last_became_active":"2024-04-25T19:22:16.078375+0000","last_became_peered":"2024-04-25T19:22:16.078375+0000","last_unstale":"2024-04-25T19:22:18.136579+0000","last_undegraded":"2024-04-25T19:22:18.136579+0000","last_fullsized":"2024-04-25T19:22:18.136579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:44.758262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073176+0000","last_change":"2024-04-25T19:22:17.076840+0000","last_active":"2024-04-25T19:22:18.073176+0000","last_peered":"2024-04-25T19:22:18.073176+0000","last_clean":"2024-04-25T19:22:18.073176+0000","last_became_active":"2024-04-25T19:22:17.071951+0000","last_became_peered":"2024-04-25T19:22:17.071951+0000","last_unstale":"2024-04-25T19:22:18.073176+0000","last_undegraded":"2024-04-25T19:22:18.073176+0000","last_fullsized":"2024-04-25T19:22:18.073176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:27.291685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072526+0000","last_change":"2024-04-25T19:22:16.068098+0000","last_active":"2024-04-25T19:22:18.072526+0000","last_peered":"2024-04-25T19:22:18.072526+0000","last_clean":"2024-04-25T19:22:18.072526+0000","last_became_active":"2024-04-25T19:22:16.067726+0000","last_became_peered":"2024-04-25T19:22:16.067726+0000","last_unstale":"2024-04-25T19:22:18.072526+0000","last_undegraded":"2024-04-25T19:22:18.072526+0000","last_fullsized":"2024-04-25T19:22:18.072526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:44.758262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134620+0000","last_change":"2024-04-25T19:22:17.075489+0000","last_active":"2024-04-25T19:22:18.134620+0000","last_peered":"2024-04-25T19:22:18.134620+0000","last_clean":"2024-04-25T19:22:18.134620+0000","last_became_active":"2024-04-25T19:22:17.075103+0000","last_became_peered":"2024-04-25T19:22:17.075103+0000","last_unstale":"2024-04-25T19:22:18.134620+0000","last_undegraded":"2024-04-25T19:22:18.134620+0000","last_fullsized":"2024-04-25T19:22:18.134620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:23.797191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072600+0000","last_change":"2024-04-25T19:22:16.062470+0000","last_active":"2024-04-25T19:22:18.072600+0000","last_peered":"2024-04-25T19:22:18.072600+0000","last_clean":"2024-04-25T19:22:18.072600+0000","last_became_active":"2024-04-25T19:22:16.062069+0000","last_became_peered":"2024-04-25T19:22:16.062069+0000","last_unstale":"2024-04-25T19:22:18.072600+0000","last_undegraded":"2024-04-25T19:22:18.072600+0000","last_fullsized":"2024-04-25T19:22:18.072600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:52:34.957140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135155+0000","last_change":"2024-04-25T19:22:17.074489+0000","last_active":"2024-04-25T19:22:18.135155+0000","last_peered":"2024-04-25T19:22:18.135155+0000","last_clean":"2024-04-25T19:22:18.135155+0000","last_became_active":"2024-04-25T19:22:17.073799+0000","last_became_peered":"2024-04-25T19:22:17.073799+0000","last_unstale":"2024-04-25T19:22:18.135155+0000","last_undegraded":"2024-04-25T19:22:18.135155+0000","last_fullsized":"2024-04-25T19:22:18.135155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:52.165740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138381+0000","last_change":"2024-04-25T19:22:16.080827+0000","last_active":"2024-04-25T19:22:18.138381+0000","last_peered":"2024-04-25T19:22:18.138381+0000","last_clean":"2024-04-25T19:22:18.138381+0000","last_became_active":"2024-04-25T19:22:16.080356+0000","last_became_peered":"2024-04-25T19:22:16.080356+0000","last_unstale":"2024-04-25T19:22:18.138381+0000","last_undegraded":"2024-04-25T19:22:18.138381+0000","last_fullsized":"2024-04-25T19:22:18.138381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:18.046159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081947+0000","last_change":"2024-04-25T19:22:17.077563+0000","last_active":"2024-04-25T19:22:18.081947+0000","last_peered":"2024-04-25T19:22:18.081947+0000","last_clean":"2024-04-25T19:22:18.081947+0000","last_became_active":"2024-04-25T19:22:17.073123+0000","last_became_peered":"2024-04-25T19:22:17.073123+0000","last_unstale":"2024-04-25T19:22:18.081947+0000","last_undegraded":"2024-04-25T19:22:18.081947+0000","last_fullsized":"2024-04-25T19:22:18.081947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:27.385683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076484+0000","last_change":"2024-04-25T19:22:17.079364+0000","last_active":"2024-04-25T19:22:18.076484+0000","last_peered":"2024-04-25T19:22:18.076484+0000","last_clean":"2024-04-25T19:22:18.076484+0000","last_became_active":"2024-04-25T19:22:17.079025+0000","last_became_peered":"2024-04-25T19:22:17.079025+0000","last_unstale":"2024-04-25T19:22:18.076484+0000","last_undegraded":"2024-04-25T19:22:18.076484+0000","last_fullsized":"2024-04-25T19:22:18.076484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:25.008654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.137489+0000","last_change":"2024-04-25T19:22:16.081730+0000","last_active":"2024-04-25T19:22:18.137489+0000","last_peered":"2024-04-25T19:22:18.137489+0000","last_clean":"2024-04-25T19:22:18.137489+0000","last_became_active":"2024-04-25T19:22:16.081421+0000","last_became_peered":"2024-04-25T19:22:16.081421+0000","last_unstale":"2024-04-25T19:22:18.137489+0000","last_undegraded":"2024-04-25T19:22:18.137489+0000","last_fullsized":"2024-04-25T19:22:18.137489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:49:45.977189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076421+0000","last_change":"2024-04-25T19:22:17.080305+0000","last_active":"2024-04-25T19:22:18.076421+0000","last_peered":"2024-04-25T19:22:18.076421+0000","last_clean":"2024-04-25T19:22:18.076421+0000","last_became_active":"2024-04-25T19:22:17.079799+0000","last_became_peered":"2024-04-25T19:22:17.079799+0000","last_unstale":"2024-04-25T19:22:18.076421+0000","last_undegraded":"2024-04-25T19:22:18.076421+0000","last_fullsized":"2024-04-25T19:22:18.076421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:37.277654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138286+0000","last_change":"2024-04-25T19:22:16.081114+0000","last_active":"2024-04-25T19:22:18.138286+0000","last_peered":"2024-04-25T19:22:18.138286+0000","last_clean":"2024-04-25T19:22:18.138286+0000","last_became_active":"2024-04-25T19:22:16.080449+0000","last_became_peered":"2024-04-25T19:22:16.080449+0000","last_unstale":"2024-04-25T19:22:18.138286+0000","last_undegraded":"2024-04-25T19:22:18.138286+0000","last_fullsized":"2024-04-25T19:22:18.138286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:52.491459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135509+0000","last_change":"2024-04-25T19:22:17.065056+0000","last_active":"2024-04-25T19:22:18.135509+0000","last_peered":"2024-04-25T19:22:18.135509+0000","last_clean":"2024-04-25T19:22:18.135509+0000","last_became_active":"2024-04-25T19:22:17.062680+0000","last_became_peered":"2024-04-25T19:22:17.062680+0000","last_unstale":"2024-04-25T19:22:18.135509+0000","last_undegraded":"2024-04-25T19:22:18.135509+0000","last_fullsized":"2024-04-25T19:22:18.135509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:27.385683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135590+0000","last_change":"2024-04-25T19:22:16.056898+0000","last_active":"2024-04-25T19:22:18.135590+0000","last_peered":"2024-04-25T19:22:18.135590+0000","last_clean":"2024-04-25T19:22:18.135590+0000","last_became_active":"2024-04-25T19:22:16.056528+0000","last_became_peered":"2024-04-25T19:22:16.056528+0000","last_unstale":"2024-04-25T19:22:18.135590+0000","last_undegraded":"2024-04-25T19:22:18.135590+0000","last_fullsized":"2024-04-25T19:22:18.135590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:51.334418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135596+0000","last_change":"2024-04-25T19:22:17.075549+0000","last_active":"2024-04-25T19:22:18.135596+0000","last_peered":"2024-04-25T19:22:18.135596+0000","last_clean":"2024-04-25T19:22:18.135596+0000","last_became_active":"2024-04-25T19:22:17.075224+0000","last_became_peered":"2024-04-25T19:22:17.075224+0000","last_unstale":"2024-04-25T19:22:18.135596+0000","last_undegraded":"2024-04-25T19:22:18.135596+0000","last_fullsized":"2024-04-25T19:22:18.135596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:15:59.386088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135671+0000","last_change":"2024-04-25T19:22:16.073541+0000","last_active":"2024-04-25T19:22:18.135671+0000","last_peered":"2024-04-25T19:22:18.135671+0000","last_clean":"2024-04-25T19:22:18.135671+0000","last_became_active":"2024-04-25T19:22:16.073195+0000","last_became_peered":"2024-04-25T19:22:16.073195+0000","last_unstale":"2024-04-25T19:22:18.135671+0000","last_undegraded":"2024-04-25T19:22:18.135671+0000","last_fullsized":"2024-04-25T19:22:18.135671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:21.114512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T19:22:21.716 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T19:22:22.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.015+0000 7efdce400640 1 Processor -- start 2024-04-25T19:22:22.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.015+0000 7efdce400640 1 -- start start 2024-04-25T19:22:22.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.017+0000 7efdce400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efdc80cf5e0 0x7efdc80cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:22.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.017+0000 7efdce400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdc80cff30 con 0x7efdc81443c0 2024-04-25T19:22:22.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.017+0000 7efdce400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdc815f5f0 con 0x7efdc806c5c0 2024-04-25T19:22:22.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.017+0000 7efdce400640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7efdc80708d0 con 0x7efdc80cf5e0 2024-04-25T19:22:22.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.017+0000 7efdbea00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efdc80cf5e0 0x7efdc80cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:22.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.017+0000 7efdbea00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efdc80cf5e0 0x7efdc80cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54102/0 (socket says 172.21.15.131:54102) 2024-04-25T19:22:22.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.017+0000 7efdbea00640 1 -- 172.21.15.131:0/1784731961 learned_addr learned my addr 172.21.15.131:0/1784731961 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:22.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.017+0000 7efdc7400640 1 --1- 172.21.15.131:0/1784731961 >> v1:172.21.15.131:6789/0 conn(0x7efdc81443c0 0x7efdc806fe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:39766/0 (socket says 172.21.15.131:39766) 2024-04-25T19:22:22.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.018+0000 7efdbea00640 1 -- 172.21.15.131:0/1784731961 >> v1:172.21.15.195:6789/0 conn(0x7efdc806c5c0 legacy=0x7efdc806c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:22.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.018+0000 7efdbea00640 1 -- 172.21.15.131:0/1784731961 >> v1:172.21.15.131:6789/0 conn(0x7efdc81443c0 legacy=0x7efdc806fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:22.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.018+0000 7efdbea00640 1 -- 172.21.15.131:0/1784731961 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc815e830 con 0x7efdc80cf5e0 2024-04-25T19:22:22.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.019+0000 7efdbea00640 1 --2- 172.21.15.131:0/1784731961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc80cf5e0 0x7efdc80cf9f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009870 tx=0x7efdb002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16adfd5916f01fa4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:22.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.019+0000 7efdc6a00640 1 -- 172.21.15.131:0/1784731961 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0037070 con 0x7efdc80cf5e0 2024-04-25T19:22:22.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.019+0000 7efdc6a00640 1 -- 172.21.15.131:0/1784731961 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb0032440 con 0x7efdc80cf5e0 2024-04-25T19:22:22.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.019+0000 7efdc6a00640 1 -- 172.21.15.131:0/1784731961 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0032810 con 0x7efdc80cf5e0 2024-04-25T19:22:22.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.020+0000 7efdce400640 1 -- 172.21.15.131:0/1784731961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc80cf5e0 msgr2=0x7efdc80cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:22.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.020+0000 7efdce400640 1 --2- 172.21.15.131:0/1784731961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc80cf5e0 0x7efdc80cf9f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009870 tx=0x7efdb002a2a0 comp rx=0 tx=0).stop 2024-04-25T19:22:22.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.020+0000 7efdce400640 1 -- 172.21.15.131:0/1784731961 shutdown_connections 2024-04-25T19:22:22.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.020+0000 7efdce400640 1 --2- 172.21.15.131:0/1784731961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc80cf5e0 0x7efdc80cf9f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:22.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.020+0000 7efdce400640 1 -- 172.21.15.131:0/1784731961 >> 172.21.15.131:0/1784731961 conn(0x7efdc80d1ae0 msgr2=0x7efdc80d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:22.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.020+0000 7efdce400640 1 -- 172.21.15.131:0/1784731961 shutdown_connections 2024-04-25T19:22:22.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.020+0000 7efdce400640 1 -- 172.21.15.131:0/1784731961 wait complete. 2024-04-25T19:22:22.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.022+0000 7efdce400640 1 Processor -- start 2024-04-25T19:22:22.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.023+0000 7efdce400640 1 -- start start 2024-04-25T19:22:22.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.024+0000 7efdce400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdc806c5c0 0x7efdc81f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:22.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.024+0000 7efdce400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efdc80cf5e0 0x7efdc81f73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:22.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.024+0000 7efdce400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc81443c0 0x7efdc81f35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:22.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.024+0000 7efdce400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7efdc815edf0 con 0x7efdc81443c0 2024-04-25T19:22:22.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.024+0000 7efdce400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7efdc815f160 con 0x7efdc806c5c0 2024-04-25T19:22:22.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.024+0000 7efdce400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7efdc81447d0 con 0x7efdc80cf5e0 2024-04-25T19:22:22.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.024+0000 7efdc7e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc81443c0 0x7efdc81f35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:22.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.024+0000 7efdc7e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc81443c0 0x7efdc81f35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54112/0 (socket says 172.21.15.131:54112) 2024-04-25T19:22:22.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.024+0000 7efdc7e00640 1 -- 172.21.15.131:0/287636591 learned_addr learned my addr 172.21.15.131:0/287636591 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:22.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.025+0000 7efdbea00640 1 --2- 172.21.15.131:0/287636591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efdc80cf5e0 0x7efdc81f73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:22.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.025+0000 7efdc7400640 1 --2- 172.21.15.131:0/287636591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdc806c5c0 0x7efdc81f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:22.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.025+0000 7efdc7e00640 1 -- 172.21.15.131:0/287636591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efdc80cf5e0 msgr2=0x7efdc81f73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:22.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.025+0000 7efdc7e00640 1 --2- 172.21.15.131:0/287636591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efdc80cf5e0 0x7efdc81f73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:22.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.025+0000 7efdc7e00640 1 -- 172.21.15.131:0/287636591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdc806c5c0 msgr2=0x7efdc81f6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:22.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.025+0000 7efdc7e00640 1 --2- 172.21.15.131:0/287636591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdc806c5c0 0x7efdc81f6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:22.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.025+0000 7efdc7e00640 1 -- 172.21.15.131:0/287636591 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc80b4cc0 con 0x7efdc81443c0 2024-04-25T19:22:22.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.025+0000 7efdc7e00640 1 --2- 172.21.15.131:0/287636591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc81443c0 0x7efdc81f35f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efdc000ba10 tx=0x7efdc000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:22.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.025+0000 7efdbfe00640 1 -- 172.21.15.131:0/287636591 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc0019070 con 0x7efdc81443c0 2024-04-25T19:22:22.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.025+0000 7efdbfe00640 1 -- 172.21.15.131:0/287636591 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc000cb40 con 0x7efdc81443c0 2024-04-25T19:22:22.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.025+0000 7efdce400640 1 -- 172.21.15.131:0/287636591 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdc80b4fa0 con 0x7efdc81443c0 2024-04-25T19:22:22.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.026+0000 7efdbfe00640 1 -- 172.21.15.131:0/287636591 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc0014440 con 0x7efdc81443c0 2024-04-25T19:22:22.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.026+0000 7efdce400640 1 -- 172.21.15.131:0/287636591 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdc80b5560 con 0x7efdc81443c0 2024-04-25T19:22:22.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.027+0000 7efdce400640 1 -- 172.21.15.131:0/287636591 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdc8050740 con 0x7efdc81443c0 2024-04-25T19:22:22.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.028+0000 7efdbfe00640 1 -- 172.21.15.131:0/287636591 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7efdc001c070 con 0x7efdc81443c0 2024-04-25T19:22:22.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.029+0000 7efdbfe00640 1 --2- 172.21.15.131:0/287636591 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7efda40744b0 0x7efda40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:22.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.029+0000 7efdbfe00640 1 -- 172.21.15.131:0/287636591 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efdc0094ef0 con 0x7efdc81443c0 2024-04-25T19:22:22.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.029+0000 7efdc7400640 1 --2- 172.21.15.131:0/287636591 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7efda40744b0 0x7efda40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:22.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.030+0000 7efdc7400640 1 --2- 172.21.15.131:0/287636591 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7efda40744b0 0x7efda40769c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efdb8000f60 tx=0x7efdb8007ce0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:22.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.033+0000 7efdbfe00640 1 -- 172.21.15.131:0/287636591 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efdc005f5e0 con 0x7efdc81443c0 2024-04-25T19:22:22.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.231+0000 7efdce400640 1 -- 172.21.15.131:0/287636591 --> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efdc806f950 con 0x7efda40744b0 2024-04-25T19:22:22.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.251+0000 7efdbfe00640 1 -- 172.21.15.131:0/287636591 <== mgr.4105 v2:172.21.15.195:6832/2541913764 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251937 (secure 0 0 0) 0x7efdc806f950 con 0x7efda40744b0 2024-04-25T19:22:22.255 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:22.256 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-04-25T19:22:22.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.257+0000 7efdce400640 1 -- 172.21.15.131:0/287636591 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7efda40744b0 msgr2=0x7efda40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:22.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.257+0000 7efdce400640 1 --2- 172.21.15.131:0/287636591 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7efda40744b0 0x7efda40769c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efdb8000f60 tx=0x7efdb8007ce0 comp rx=0 tx=0).stop 2024-04-25T19:22:22.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.257+0000 7efdce400640 1 -- 172.21.15.131:0/287636591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc81443c0 msgr2=0x7efdc81f35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:22.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.257+0000 7efdce400640 1 --2- 172.21.15.131:0/287636591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc81443c0 0x7efdc81f35f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efdc000ba10 tx=0x7efdc000bed0 comp rx=0 tx=0).stop 2024-04-25T19:22:22.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.257+0000 7efdce400640 1 -- 172.21.15.131:0/287636591 shutdown_connections 2024-04-25T19:22:22.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.257+0000 7efdce400640 1 --2- 172.21.15.131:0/287636591 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7efda40744b0 0x7efda40769c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:22.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.257+0000 7efdce400640 1 --2- 172.21.15.131:0/287636591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efdc80cf5e0 0x7efdc81f73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:22.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.257+0000 7efdce400640 1 --2- 172.21.15.131:0/287636591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc81443c0 0x7efdc81f35f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:22.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.257+0000 7efdce400640 1 --2- 172.21.15.131:0/287636591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdc806c5c0 0x7efdc81f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:22.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.257+0000 7efdce400640 1 -- 172.21.15.131:0/287636591 >> 172.21.15.131:0/287636591 conn(0x7efdc80d1ae0 msgr2=0x7efdc80b1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:22.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.257+0000 7efdce400640 1 -- 172.21.15.131:0/287636591 shutdown_connections 2024-04-25T19:22:22.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.257+0000 7efdce400640 1 -- 172.21.15.131:0/287636591 wait complete. 2024-04-25T19:22:22.283 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-25T19:22:22.137677+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235636,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739084,"statfs":{"total":773094113280,"available":772852822016,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.103822"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138347+0000","last_change":"2024-04-25T19:22:17.084552+0000","last_active":"2024-04-25T19:22:18.138347+0000","last_peered":"2024-04-25T19:22:18.138347+0000","last_clean":"2024-04-25T19:22:18.138347+0000","last_became_active":"2024-04-25T19:22:17.083645+0000","last_became_peered":"2024-04-25T19:22:17.083645+0000","last_unstale":"2024-04-25T19:22:18.138347+0000","last_undegraded":"2024-04-25T19:22:18.138347+0000","last_fullsized":"2024-04-25T19:22:18.138347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:49:42.415156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073420+0000","last_change":"2024-04-25T19:22:17.069431+0000","last_active":"2024-04-25T19:22:18.073420+0000","last_peered":"2024-04-25T19:22:18.073420+0000","last_clean":"2024-04-25T19:22:18.073420+0000","last_became_active":"2024-04-25T19:22:17.069036+0000","last_became_peered":"2024-04-25T19:22:17.069036+0000","last_unstale":"2024-04-25T19:22:18.073420+0000","last_undegraded":"2024-04-25T19:22:18.073420+0000","last_fullsized":"2024-04-25T19:22:18.073420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:52.165740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135315+0000","last_change":"2024-04-25T19:22:17.063030+0000","last_active":"2024-04-25T19:22:18.135315+0000","last_peered":"2024-04-25T19:22:18.135315+0000","last_clean":"2024-04-25T19:22:18.135315+0000","last_became_active":"2024-04-25T19:22:17.059484+0000","last_became_peered":"2024-04-25T19:22:17.059484+0000","last_unstale":"2024-04-25T19:22:18.135315+0000","last_undegraded":"2024-04-25T19:22:18.135315+0000","last_fullsized":"2024-04-25T19:22:18.135315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:59.050894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076254+0000","last_change":"2024-04-25T19:22:17.081742+0000","last_active":"2024-04-25T19:22:18.076254+0000","last_peered":"2024-04-25T19:22:18.076254+0000","last_clean":"2024-04-25T19:22:18.076254+0000","last_became_active":"2024-04-25T19:22:17.080753+0000","last_became_peered":"2024-04-25T19:22:17.080753+0000","last_unstale":"2024-04-25T19:22:18.076254+0000","last_undegraded":"2024-04-25T19:22:18.076254+0000","last_fullsized":"2024-04-25T19:22:18.076254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:58:50.378291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.137965+0000","last_change":"2024-04-25T19:22:17.074651+0000","last_active":"2024-04-25T19:22:18.137965+0000","last_peered":"2024-04-25T19:22:18.137965+0000","last_clean":"2024-04-25T19:22:18.137965+0000","last_became_active":"2024-04-25T19:22:17.073983+0000","last_became_peered":"2024-04-25T19:22:17.073983+0000","last_unstale":"2024-04-25T19:22:18.137965+0000","last_undegraded":"2024-04-25T19:22:18.137965+0000","last_fullsized":"2024-04-25T19:22:18.137965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:11.217132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.075816+0000","last_change":"2024-04-25T19:22:17.073457+0000","last_active":"2024-04-25T19:22:18.075816+0000","last_peered":"2024-04-25T19:22:18.075816+0000","last_clean":"2024-04-25T19:22:18.075816+0000","last_became_active":"2024-04-25T19:22:17.071400+0000","last_became_peered":"2024-04-25T19:22:17.071400+0000","last_unstale":"2024-04-25T19:22:18.075816+0000","last_undegraded":"2024-04-25T19:22:18.075816+0000","last_fullsized":"2024-04-25T19:22:18.075816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:36:53.730051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.136942+0000","last_change":"2024-04-25T19:22:17.082930+0000","last_active":"2024-04-25T19:22:18.136942+0000","last_peered":"2024-04-25T19:22:18.136942+0000","last_clean":"2024-04-25T19:22:18.136942+0000","last_became_active":"2024-04-25T19:22:17.082555+0000","last_became_peered":"2024-04-25T19:22:17.082555+0000","last_unstale":"2024-04-25T19:22:18.136942+0000","last_undegraded":"2024-04-25T19:22:18.136942+0000","last_fullsized":"2024-04-25T19:22:18.136942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:15:59.386088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134476+0000","last_change":"2024-04-25T19:22:17.081565+0000","last_active":"2024-04-25T19:22:18.134476+0000","last_peered":"2024-04-25T19:22:18.134476+0000","last_clean":"2024-04-25T19:22:18.134476+0000","last_became_active":"2024-04-25T19:22:17.080933+0000","last_became_peered":"2024-04-25T19:22:17.080933+0000","last_unstale":"2024-04-25T19:22:18.134476+0000","last_undegraded":"2024-04-25T19:22:18.134476+0000","last_fullsized":"2024-04-25T19:22:18.134476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:05.392241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138545+0000","last_change":"2024-04-25T19:22:17.096675+0000","last_active":"2024-04-25T19:22:18.138545+0000","last_peered":"2024-04-25T19:22:18.138545+0000","last_clean":"2024-04-25T19:22:18.138545+0000","last_became_active":"2024-04-25T19:22:17.096054+0000","last_became_peered":"2024-04-25T19:22:17.096054+0000","last_unstale":"2024-04-25T19:22:18.138545+0000","last_undegraded":"2024-04-25T19:22:18.138545+0000","last_fullsized":"2024-04-25T19:22:18.138545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:34.594467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.082280+0000","last_change":"2024-04-25T19:22:17.092042+0000","last_active":"2024-04-25T19:22:18.082280+0000","last_peered":"2024-04-25T19:22:18.082280+0000","last_clean":"2024-04-25T19:22:18.082280+0000","last_became_active":"2024-04-25T19:22:17.091661+0000","last_became_peered":"2024-04-25T19:22:17.091661+0000","last_unstale":"2024-04-25T19:22:18.082280+0000","last_undegraded":"2024-04-25T19:22:18.082280+0000","last_fullsized":"2024-04-25T19:22:18.082280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.514449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081825+0000","last_change":"2024-04-25T19:22:17.089728+0000","last_active":"2024-04-25T19:22:18.081825+0000","last_peered":"2024-04-25T19:22:18.081825+0000","last_clean":"2024-04-25T19:22:18.081825+0000","last_became_active":"2024-04-25T19:22:17.089366+0000","last_became_peered":"2024-04-25T19:22:17.089366+0000","last_unstale":"2024-04-25T19:22:18.081825+0000","last_undegraded":"2024-04-25T19:22:18.081825+0000","last_fullsized":"2024-04-25T19:22:18.081825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:59.050894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073574+0000","last_change":"2024-04-25T19:22:17.076934+0000","last_active":"2024-04-25T19:22:18.073574+0000","last_peered":"2024-04-25T19:22:18.073574+0000","last_clean":"2024-04-25T19:22:18.073574+0000","last_became_active":"2024-04-25T19:22:17.074228+0000","last_became_peered":"2024-04-25T19:22:17.074228+0000","last_unstale":"2024-04-25T19:22:18.073574+0000","last_undegraded":"2024-04-25T19:22:18.073574+0000","last_fullsized":"2024-04-25T19:22:18.073574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:45.772456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134905+0000","last_change":"2024-04-25T19:22:17.074643+0000","last_active":"2024-04-25T19:22:18.134905+0000","last_peered":"2024-04-25T19:22:18.134905+0000","last_clean":"2024-04-25T19:22:18.134905+0000","last_became_active":"2024-04-25T19:22:17.074222+0000","last_became_peered":"2024-04-25T19:22:17.074222+0000","last_unstale":"2024-04-25T19:22:18.134905+0000","last_undegraded":"2024-04-25T19:22:18.134905+0000","last_fullsized":"2024-04-25T19:22:18.134905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:42.370408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134334+0000","last_change":"2024-04-25T19:22:17.080879+0000","last_active":"2024-04-25T19:22:18.134334+0000","last_peered":"2024-04-25T19:22:18.134334+0000","last_clean":"2024-04-25T19:22:18.134334+0000","last_became_active":"2024-04-25T19:22:17.080532+0000","last_became_peered":"2024-04-25T19:22:17.080532+0000","last_unstale":"2024-04-25T19:22:18.134334+0000","last_undegraded":"2024-04-25T19:22:18.134334+0000","last_fullsized":"2024-04-25T19:22:18.134334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:02.635176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072556+0000","last_change":"2024-04-25T19:22:17.073160+0000","last_active":"2024-04-25T19:22:18.072556+0000","last_peered":"2024-04-25T19:22:18.072556+0000","last_clean":"2024-04-25T19:22:18.072556+0000","last_became_active":"2024-04-25T19:22:17.072815+0000","last_became_peered":"2024-04-25T19:22:17.072815+0000","last_unstale":"2024-04-25T19:22:18.072556+0000","last_undegraded":"2024-04-25T19:22:18.072556+0000","last_fullsized":"2024-04-25T19:22:18.072556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:59.050894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.075591+0000","last_change":"2024-04-25T19:22:17.071757+0000","last_active":"2024-04-25T19:22:18.075591+0000","last_peered":"2024-04-25T19:22:18.075591+0000","last_clean":"2024-04-25T19:22:18.075591+0000","last_became_active":"2024-04-25T19:22:17.071385+0000","last_became_peered":"2024-04-25T19:22:17.071385+0000","last_unstale":"2024-04-25T19:22:18.075591+0000","last_undegraded":"2024-04-25T19:22:18.075591+0000","last_fullsized":"2024-04-25T19:22:18.075591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:52.165740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.077244+0000","last_change":"2024-04-25T19:22:17.082098+0000","last_active":"2024-04-25T19:22:18.077244+0000","last_peered":"2024-04-25T19:22:18.077244+0000","last_clean":"2024-04-25T19:22:18.077244+0000","last_became_active":"2024-04-25T19:22:17.080035+0000","last_became_peered":"2024-04-25T19:22:17.080035+0000","last_unstale":"2024-04-25T19:22:18.077244+0000","last_undegraded":"2024-04-25T19:22:18.077244+0000","last_fullsized":"2024-04-25T19:22:18.077244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:49:42.415156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.133867+0000","last_change":"2024-04-25T19:22:17.071266+0000","last_active":"2024-04-25T19:22:18.133867+0000","last_peered":"2024-04-25T19:22:18.133867+0000","last_clean":"2024-04-25T19:22:18.133867+0000","last_became_active":"2024-04-25T19:22:17.070270+0000","last_became_peered":"2024-04-25T19:22:17.070270+0000","last_unstale":"2024-04-25T19:22:18.133867+0000","last_undegraded":"2024-04-25T19:22:18.133867+0000","last_fullsized":"2024-04-25T19:22:18.133867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:49:46.991384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138169+0000","last_change":"2024-04-25T19:22:17.089998+0000","last_active":"2024-04-25T19:22:18.138169+0000","last_peered":"2024-04-25T19:22:18.138169+0000","last_clean":"2024-04-25T19:22:18.138169+0000","last_became_active":"2024-04-25T19:22:17.087637+0000","last_became_peered":"2024-04-25T19:22:17.087637+0000","last_unstale":"2024-04-25T19:22:18.138169+0000","last_undegraded":"2024-04-25T19:22:18.138169+0000","last_fullsized":"2024-04-25T19:22:18.138169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:31.122370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081737+0000","last_change":"2024-04-25T19:22:17.085745+0000","last_active":"2024-04-25T19:22:18.081737+0000","last_peered":"2024-04-25T19:22:18.081737+0000","last_clean":"2024-04-25T19:22:18.081737+0000","last_became_active":"2024-04-25T19:22:17.084164+0000","last_became_peered":"2024-04-25T19:22:17.084164+0000","last_unstale":"2024-04-25T19:22:18.081737+0000","last_undegraded":"2024-04-25T19:22:18.081737+0000","last_fullsized":"2024-04-25T19:22:18.081737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:23.797191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134984+0000","last_change":"2024-04-25T19:22:17.071037+0000","last_active":"2024-04-25T19:22:18.134984+0000","last_peered":"2024-04-25T19:22:18.134984+0000","last_clean":"2024-04-25T19:22:18.134984+0000","last_became_active":"2024-04-25T19:22:17.070692+0000","last_became_peered":"2024-04-25T19:22:17.070692+0000","last_unstale":"2024-04-25T19:22:18.134984+0000","last_undegraded":"2024-04-25T19:22:18.134984+0000","last_fullsized":"2024-04-25T19:22:18.134984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:06.030063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.075876+0000","last_change":"2024-04-25T19:22:17.082746+0000","last_active":"2024-04-25T19:22:18.075876+0000","last_peered":"2024-04-25T19:22:18.075876+0000","last_clean":"2024-04-25T19:22:18.075876+0000","last_became_active":"2024-04-25T19:22:17.081725+0000","last_became_peered":"2024-04-25T19:22:17.081725+0000","last_unstale":"2024-04-25T19:22:18.075876+0000","last_undegraded":"2024-04-25T19:22:18.075876+0000","last_fullsized":"2024-04-25T19:22:18.075876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:42.285229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134792+0000","last_change":"2024-04-25T19:22:17.085784+0000","last_active":"2024-04-25T19:22:18.134792+0000","last_peered":"2024-04-25T19:22:18.134792+0000","last_clean":"2024-04-25T19:22:18.134792+0000","last_became_active":"2024-04-25T19:22:17.085388+0000","last_became_peered":"2024-04-25T19:22:17.085388+0000","last_unstale":"2024-04-25T19:22:18.134792+0000","last_undegraded":"2024-04-25T19:22:18.134792+0000","last_fullsized":"2024-04-25T19:22:18.134792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:59.050894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.075802+0000","last_change":"2024-04-25T19:22:17.083578+0000","last_active":"2024-04-25T19:22:18.075802+0000","last_peered":"2024-04-25T19:22:18.075802+0000","last_clean":"2024-04-25T19:22:18.075802+0000","last_became_active":"2024-04-25T19:22:17.082843+0000","last_became_peered":"2024-04-25T19:22:17.082843+0000","last_unstale":"2024-04-25T19:22:18.075802+0000","last_undegraded":"2024-04-25T19:22:18.075802+0000","last_fullsized":"2024-04-25T19:22:18.075802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.514449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135247+0000","last_change":"2024-04-25T19:22:17.086133+0000","last_active":"2024-04-25T19:22:18.135247+0000","last_peered":"2024-04-25T19:22:18.135247+0000","last_clean":"2024-04-25T19:22:18.135247+0000","last_became_active":"2024-04-25T19:22:17.084935+0000","last_became_peered":"2024-04-25T19:22:17.084935+0000","last_unstale":"2024-04-25T19:22:18.135247+0000","last_undegraded":"2024-04-25T19:22:18.135247+0000","last_fullsized":"2024-04-25T19:22:18.135247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.514449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.082077+0000","last_change":"2024-04-25T19:22:17.072128+0000","last_active":"2024-04-25T19:22:18.082077+0000","last_peered":"2024-04-25T19:22:18.082077+0000","last_clean":"2024-04-25T19:22:18.082077+0000","last_became_active":"2024-04-25T19:22:17.071637+0000","last_became_peered":"2024-04-25T19:22:17.071637+0000","last_unstale":"2024-04-25T19:22:18.082077+0000","last_undegraded":"2024-04-25T19:22:18.082077+0000","last_fullsized":"2024-04-25T19:22:18.082077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:52.165740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072909+0000","last_change":"2024-04-25T19:22:17.077813+0000","last_active":"2024-04-25T19:22:18.072909+0000","last_peered":"2024-04-25T19:22:18.072909+0000","last_clean":"2024-04-25T19:22:18.072909+0000","last_became_active":"2024-04-25T19:22:17.076972+0000","last_became_peered":"2024-04-25T19:22:17.076972+0000","last_unstale":"2024-04-25T19:22:18.072909+0000","last_undegraded":"2024-04-25T19:22:18.072909+0000","last_fullsized":"2024-04-25T19:22:18.072909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:27.385683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135131+0000","last_change":"2024-04-25T19:22:17.085634+0000","last_active":"2024-04-25T19:22:18.135131+0000","last_peered":"2024-04-25T19:22:18.135131+0000","last_clean":"2024-04-25T19:22:18.135131+0000","last_became_active":"2024-04-25T19:22:17.085069+0000","last_became_peered":"2024-04-25T19:22:17.085069+0000","last_unstale":"2024-04-25T19:22:18.135131+0000","last_undegraded":"2024-04-25T19:22:18.135131+0000","last_fullsized":"2024-04-25T19:22:18.135131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:27.385683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135179+0000","last_change":"2024-04-25T19:22:17.081785+0000","last_active":"2024-04-25T19:22:18.135179+0000","last_peered":"2024-04-25T19:22:18.135179+0000","last_clean":"2024-04-25T19:22:18.135179+0000","last_became_active":"2024-04-25T19:22:17.081478+0000","last_became_peered":"2024-04-25T19:22:17.081478+0000","last_unstale":"2024-04-25T19:22:18.135179+0000","last_undegraded":"2024-04-25T19:22:18.135179+0000","last_fullsized":"2024-04-25T19:22:18.135179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:23.797191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076049+0000","last_change":"2024-04-25T19:22:17.084665+0000","last_active":"2024-04-25T19:22:18.076049+0000","last_peered":"2024-04-25T19:22:18.076049+0000","last_clean":"2024-04-25T19:22:18.076049+0000","last_became_active":"2024-04-25T19:22:17.082107+0000","last_became_peered":"2024-04-25T19:22:17.082107+0000","last_unstale":"2024-04-25T19:22:18.076049+0000","last_undegraded":"2024-04-25T19:22:18.076049+0000","last_fullsized":"2024-04-25T19:22:18.076049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:15:59.386088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.133567+0000","last_change":"2024-04-25T19:22:17.082056+0000","last_active":"2024-04-25T19:22:18.133567+0000","last_peered":"2024-04-25T19:22:18.133567+0000","last_clean":"2024-04-25T19:22:18.133567+0000","last_became_active":"2024-04-25T19:22:17.079951+0000","last_became_peered":"2024-04-25T19:22:17.079951+0000","last_unstale":"2024-04-25T19:22:18.133567+0000","last_undegraded":"2024-04-25T19:22:18.133567+0000","last_fullsized":"2024-04-25T19:22:18.133567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:19.060353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081500+0000","last_change":"2024-04-25T19:22:17.082235+0000","last_active":"2024-04-25T19:22:18.081500+0000","last_peered":"2024-04-25T19:22:18.081500+0000","last_clean":"2024-04-25T19:22:18.081500+0000","last_became_active":"2024-04-25T19:22:17.081806+0000","last_became_peered":"2024-04-25T19:22:17.081806+0000","last_unstale":"2024-04-25T19:22:18.081500+0000","last_undegraded":"2024-04-25T19:22:18.081500+0000","last_fullsized":"2024-04-25T19:22:18.081500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:06.030063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073096+0000","last_change":"2024-04-25T19:22:17.080063+0000","last_active":"2024-04-25T19:22:18.073096+0000","last_peered":"2024-04-25T19:22:18.073096+0000","last_clean":"2024-04-25T19:22:18.073096+0000","last_became_active":"2024-04-25T19:22:17.079696+0000","last_became_peered":"2024-04-25T19:22:17.079696+0000","last_unstale":"2024-04-25T19:22:18.073096+0000","last_undegraded":"2024-04-25T19:22:18.073096+0000","last_fullsized":"2024-04-25T19:22:18.073096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:26.080591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135311+0000","last_change":"2024-04-25T19:22:16.067625+0000","last_active":"2024-04-25T19:22:18.135311+0000","last_peered":"2024-04-25T19:22:18.135311+0000","last_clean":"2024-04-25T19:22:18.135311+0000","last_became_active":"2024-04-25T19:22:16.067277+0000","last_became_peered":"2024-04-25T19:22:16.067277+0000","last_unstale":"2024-04-25T19:22:18.135311+0000","last_undegraded":"2024-04-25T19:22:18.135311+0000","last_fullsized":"2024-04-25T19:22:18.135311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:38.378131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135442+0000","last_change":"2024-04-25T19:22:17.067796+0000","last_active":"2024-04-25T19:22:18.135442+0000","last_peered":"2024-04-25T19:22:18.135442+0000","last_clean":"2024-04-25T19:22:18.135442+0000","last_became_active":"2024-04-25T19:22:17.067488+0000","last_became_peered":"2024-04-25T19:22:17.067488+0000","last_unstale":"2024-04-25T19:22:18.135442+0000","last_undegraded":"2024-04-25T19:22:18.135442+0000","last_fullsized":"2024-04-25T19:22:18.135442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:42.370408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.082142+0000","last_change":"2024-04-25T19:22:16.073203+0000","last_active":"2024-04-25T19:22:18.082142+0000","last_peered":"2024-04-25T19:22:18.082142+0000","last_clean":"2024-04-25T19:22:18.082142+0000","last_became_active":"2024-04-25T19:22:16.072711+0000","last_became_peered":"2024-04-25T19:22:16.072711+0000","last_unstale":"2024-04-25T19:22:18.082142+0000","last_undegraded":"2024-04-25T19:22:18.082142+0000","last_fullsized":"2024-04-25T19:22:18.082142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:39:11.697383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134798+0000","last_change":"2024-04-25T19:22:16.066248+0000","last_active":"2024-04-25T19:22:18.134798+0000","last_peered":"2024-04-25T19:22:18.134798+0000","last_clean":"2024-04-25T19:22:18.134798+0000","last_became_active":"2024-04-25T19:22:16.065906+0000","last_became_peered":"2024-04-25T19:22:16.065906+0000","last_unstale":"2024-04-25T19:22:18.134798+0000","last_undegraded":"2024-04-25T19:22:18.134798+0000","last_fullsized":"2024-04-25T19:22:18.134798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:32:14.300239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134508+0000","last_change":"2024-04-25T19:22:17.076260+0000","last_active":"2024-04-25T19:22:18.134508+0000","last_peered":"2024-04-25T19:22:18.134508+0000","last_clean":"2024-04-25T19:22:18.134508+0000","last_became_active":"2024-04-25T19:22:17.075601+0000","last_became_peered":"2024-04-25T19:22:17.075601+0000","last_unstale":"2024-04-25T19:22:18.134508+0000","last_undegraded":"2024-04-25T19:22:18.134508+0000","last_fullsized":"2024-04-25T19:22:18.134508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:06.030063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.075730+0000","last_change":"2024-04-25T19:22:16.071937+0000","last_active":"2024-04-25T19:22:18.075730+0000","last_peered":"2024-04-25T19:22:18.075730+0000","last_clean":"2024-04-25T19:22:18.075730+0000","last_became_active":"2024-04-25T19:22:16.071520+0000","last_became_peered":"2024-04-25T19:22:16.071520+0000","last_unstale":"2024-04-25T19:22:18.075730+0000","last_undegraded":"2024-04-25T19:22:18.075730+0000","last_fullsized":"2024-04-25T19:22:18.075730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:44.758262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072358+0000","last_change":"2024-04-25T19:22:17.077394+0000","last_active":"2024-04-25T19:22:18.072358+0000","last_peered":"2024-04-25T19:22:18.072358+0000","last_clean":"2024-04-25T19:22:18.072358+0000","last_became_active":"2024-04-25T19:22:17.077051+0000","last_became_peered":"2024-04-25T19:22:17.077051+0000","last_unstale":"2024-04-25T19:22:18.072358+0000","last_undegraded":"2024-04-25T19:22:18.072358+0000","last_fullsized":"2024-04-25T19:22:18.072358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:06.030063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081976+0000","last_change":"2024-04-25T19:22:16.072385+0000","last_active":"2024-04-25T19:22:18.081976+0000","last_peered":"2024-04-25T19:22:18.081976+0000","last_clean":"2024-04-25T19:22:18.081976+0000","last_became_active":"2024-04-25T19:22:16.070426+0000","last_became_peered":"2024-04-25T19:22:16.070426+0000","last_unstale":"2024-04-25T19:22:18.081976+0000","last_undegraded":"2024-04-25T19:22:18.081976+0000","last_fullsized":"2024-04-25T19:22:18.081976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:44.758262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076712+0000","last_change":"2024-04-25T19:22:17.082646+0000","last_active":"2024-04-25T19:22:18.076712+0000","last_peered":"2024-04-25T19:22:18.076712+0000","last_clean":"2024-04-25T19:22:18.076712+0000","last_became_active":"2024-04-25T19:22:17.080730+0000","last_became_peered":"2024-04-25T19:22:17.080730+0000","last_unstale":"2024-04-25T19:22:18.076712+0000","last_undegraded":"2024-04-25T19:22:18.076712+0000","last_fullsized":"2024-04-25T19:22:18.076712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:31.122370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.077020+0000","last_change":"2024-04-25T19:22:16.074350+0000","last_active":"2024-04-25T19:22:18.077020+0000","last_peered":"2024-04-25T19:22:18.077020+0000","last_clean":"2024-04-25T19:22:18.077020+0000","last_became_active":"2024-04-25T19:22:16.074011+0000","last_became_peered":"2024-04-25T19:22:16.074011+0000","last_unstale":"2024-04-25T19:22:18.077020+0000","last_undegraded":"2024-04-25T19:22:18.077020+0000","last_fullsized":"2024-04-25T19:22:18.077020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:26.277490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135604+0000","last_change":"2024-04-25T19:22:17.064011+0000","last_active":"2024-04-25T19:22:18.135604+0000","last_peered":"2024-04-25T19:22:18.135604+0000","last_clean":"2024-04-25T19:22:18.135604+0000","last_became_active":"2024-04-25T19:22:17.062182+0000","last_became_peered":"2024-04-25T19:22:17.062182+0000","last_unstale":"2024-04-25T19:22:18.135604+0000","last_undegraded":"2024-04-25T19:22:18.135604+0000","last_fullsized":"2024-04-25T19:22:18.135604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:52.165740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073457+0000","last_change":"2024-04-25T19:22:16.071057+0000","last_active":"2024-04-25T19:22:18.073457+0000","last_peered":"2024-04-25T19:22:18.073457+0000","last_clean":"2024-04-25T19:22:18.073457+0000","last_became_active":"2024-04-25T19:22:16.070791+0000","last_became_peered":"2024-04-25T19:22:16.070791+0000","last_unstale":"2024-04-25T19:22:18.073457+0000","last_undegraded":"2024-04-25T19:22:18.073457+0000","last_fullsized":"2024-04-25T19:22:18.073457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:52.491459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073601+0000","last_change":"2024-04-25T19:22:17.077831+0000","last_active":"2024-04-25T19:22:18.073601+0000","last_peered":"2024-04-25T19:22:18.073601+0000","last_clean":"2024-04-25T19:22:18.073601+0000","last_became_active":"2024-04-25T19:22:17.077469+0000","last_became_peered":"2024-04-25T19:22:17.077469+0000","last_unstale":"2024-04-25T19:22:18.073601+0000","last_undegraded":"2024-04-25T19:22:18.073601+0000","last_fullsized":"2024-04-25T19:22:18.073601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:52:35.971335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081891+0000","last_change":"2024-04-25T19:22:16.071427+0000","last_active":"2024-04-25T19:22:18.081891+0000","last_peered":"2024-04-25T19:22:18.081891+0000","last_clean":"2024-04-25T19:22:18.081891+0000","last_became_active":"2024-04-25T19:22:16.070575+0000","last_became_peered":"2024-04-25T19:22:16.070575+0000","last_unstale":"2024-04-25T19:22:18.081891+0000","last_undegraded":"2024-04-25T19:22:18.081891+0000","last_fullsized":"2024-04-25T19:22:18.081891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:25.066396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.137428+0000","last_change":"2024-04-25T19:22:17.084347+0000","last_active":"2024-04-25T19:22:18.137428+0000","last_peered":"2024-04-25T19:22:18.137428+0000","last_clean":"2024-04-25T19:22:18.137428+0000","last_became_active":"2024-04-25T19:22:17.084024+0000","last_became_peered":"2024-04-25T19:22:17.084024+0000","last_unstale":"2024-04-25T19:22:18.137428+0000","last_undegraded":"2024-04-25T19:22:18.137428+0000","last_fullsized":"2024-04-25T19:22:18.137428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:58:50.378291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135604+0000","last_change":"2024-04-25T19:22:16.070227+0000","last_active":"2024-04-25T19:22:18.135604+0000","last_peered":"2024-04-25T19:22:18.135604+0000","last_clean":"2024-04-25T19:22:18.135604+0000","last_became_active":"2024-04-25T19:22:16.069762+0000","last_became_peered":"2024-04-25T19:22:16.069762+0000","last_unstale":"2024-04-25T19:22:18.135604+0000","last_undegraded":"2024-04-25T19:22:18.135604+0000","last_fullsized":"2024-04-25T19:22:18.135604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:32:14.300239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134514+0000","last_change":"2024-04-25T19:22:17.072239+0000","last_active":"2024-04-25T19:22:18.134514+0000","last_peered":"2024-04-25T19:22:18.134514+0000","last_clean":"2024-04-25T19:22:18.134514+0000","last_became_active":"2024-04-25T19:22:17.070501+0000","last_became_peered":"2024-04-25T19:22:17.070501+0000","last_unstale":"2024-04-25T19:22:18.134514+0000","last_undegraded":"2024-04-25T19:22:18.134514+0000","last_fullsized":"2024-04-25T19:22:18.134514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:02.462274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076023+0000","last_change":"2024-04-25T19:22:16.065013+0000","last_active":"2024-04-25T19:22:18.076023+0000","last_peered":"2024-04-25T19:22:18.076023+0000","last_clean":"2024-04-25T19:22:18.076023+0000","last_became_active":"2024-04-25T19:22:16.063969+0000","last_became_peered":"2024-04-25T19:22:16.063969+0000","last_unstale":"2024-04-25T19:22:18.076023+0000","last_undegraded":"2024-04-25T19:22:18.076023+0000","last_fullsized":"2024-04-25T19:22:18.076023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:39:11.697383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.137925+0000","last_change":"2024-04-25T19:22:17.100962+0000","last_active":"2024-04-25T19:22:18.137925+0000","last_peered":"2024-04-25T19:22:18.137925+0000","last_clean":"2024-04-25T19:22:18.137925+0000","last_became_active":"2024-04-25T19:22:17.099677+0000","last_became_peered":"2024-04-25T19:22:17.099677+0000","last_unstale":"2024-04-25T19:22:18.137925+0000","last_undegraded":"2024-04-25T19:22:18.137925+0000","last_fullsized":"2024-04-25T19:22:18.137925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:43.115713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081451+0000","last_change":"2024-04-25T19:22:16.073130+0000","last_active":"2024-04-25T19:22:18.081451+0000","last_peered":"2024-04-25T19:22:18.081451+0000","last_clean":"2024-04-25T19:22:18.081451+0000","last_became_active":"2024-04-25T19:22:16.070679+0000","last_became_peered":"2024-04-25T19:22:16.070679+0000","last_unstale":"2024-04-25T19:22:18.081451+0000","last_undegraded":"2024-04-25T19:22:18.081451+0000","last_fullsized":"2024-04-25T19:22:18.081451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:51.334418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081928+0000","last_change":"2024-04-25T19:22:17.081998+0000","last_active":"2024-04-25T19:22:18.081928+0000","last_peered":"2024-04-25T19:22:18.081928+0000","last_clean":"2024-04-25T19:22:18.081928+0000","last_became_active":"2024-04-25T19:22:17.081424+0000","last_became_peered":"2024-04-25T19:22:17.081424+0000","last_unstale":"2024-04-25T19:22:18.081928+0000","last_undegraded":"2024-04-25T19:22:18.081928+0000","last_fullsized":"2024-04-25T19:22:18.081928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:42.370408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.133344+0000","last_change":"2024-04-25T19:22:16.055538+0000","last_active":"2024-04-25T19:22:18.133344+0000","last_peered":"2024-04-25T19:22:18.133344+0000","last_clean":"2024-04-25T19:22:18.133344+0000","last_became_active":"2024-04-25T19:22:16.055142+0000","last_became_peered":"2024-04-25T19:22:16.055142+0000","last_unstale":"2024-04-25T19:22:18.133344+0000","last_undegraded":"2024-04-25T19:22:18.133344+0000","last_fullsized":"2024-04-25T19:22:18.133344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:51.334418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.136896+0000","last_change":"2024-04-25T19:22:17.085913+0000","last_active":"2024-04-25T19:22:18.136896+0000","last_peered":"2024-04-25T19:22:18.136896+0000","last_clean":"2024-04-25T19:22:18.136896+0000","last_became_active":"2024-04-25T19:22:17.081882+0000","last_became_peered":"2024-04-25T19:22:17.081882+0000","last_unstale":"2024-04-25T19:22:18.136896+0000","last_undegraded":"2024-04-25T19:22:18.136896+0000","last_fullsized":"2024-04-25T19:22:18.136896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:42.285229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.074059+0000","last_change":"2024-04-25T19:22:16.063433+0000","last_active":"2024-04-25T19:22:18.074059+0000","last_peered":"2024-04-25T19:22:18.074059+0000","last_clean":"2024-04-25T19:22:18.074059+0000","last_became_active":"2024-04-25T19:22:16.062287+0000","last_became_peered":"2024-04-25T19:22:16.062287+0000","last_unstale":"2024-04-25T19:22:18.074059+0000","last_undegraded":"2024-04-25T19:22:18.074059+0000","last_fullsized":"2024-04-25T19:22:18.074059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:03:07.738217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.137576+0000","last_change":"2024-04-25T19:22:17.075699+0000","last_active":"2024-04-25T19:22:18.137576+0000","last_peered":"2024-04-25T19:22:18.137576+0000","last_clean":"2024-04-25T19:22:18.137576+0000","last_became_active":"2024-04-25T19:22:17.075238+0000","last_became_peered":"2024-04-25T19:22:17.075238+0000","last_unstale":"2024-04-25T19:22:18.137576+0000","last_undegraded":"2024-04-25T19:22:18.137576+0000","last_fullsized":"2024-04-25T19:22:18.137576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:37.277654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.133800+0000","last_change":"2024-04-25T19:22:16.056199+0000","last_active":"2024-04-25T19:22:18.133800+0000","last_peered":"2024-04-25T19:22:18.133800+0000","last_clean":"2024-04-25T19:22:18.133800+0000","last_became_active":"2024-04-25T19:22:16.055898+0000","last_became_peered":"2024-04-25T19:22:16.055898+0000","last_unstale":"2024-04-25T19:22:18.133800+0000","last_undegraded":"2024-04-25T19:22:18.133800+0000","last_fullsized":"2024-04-25T19:22:18.133800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:25.066396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138688+0000","last_change":"2024-04-25T19:22:17.075542+0000","last_active":"2024-04-25T19:22:18.138688+0000","last_peered":"2024-04-25T19:22:18.138688+0000","last_clean":"2024-04-25T19:22:18.138688+0000","last_became_active":"2024-04-25T19:22:17.075208+0000","last_became_peered":"2024-04-25T19:22:17.075208+0000","last_unstale":"2024-04-25T19:22:18.138688+0000","last_undegraded":"2024-04-25T19:22:18.138688+0000","last_fullsized":"2024-04-25T19:22:18.138688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:07.456013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073013+0000","last_change":"2024-04-25T19:22:16.057412+0000","last_active":"2024-04-25T19:22:18.073013+0000","last_peered":"2024-04-25T19:22:18.073013+0000","last_clean":"2024-04-25T19:22:18.073013+0000","last_became_active":"2024-04-25T19:22:16.056998+0000","last_became_peered":"2024-04-25T19:22:16.056998+0000","last_unstale":"2024-04-25T19:22:18.073013+0000","last_undegraded":"2024-04-25T19:22:18.073013+0000","last_fullsized":"2024-04-25T19:22:18.073013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:49:45.977189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076474+0000","last_change":"2024-04-25T19:22:17.083087+0000","last_active":"2024-04-25T19:22:18.076474+0000","last_peered":"2024-04-25T19:22:18.076474+0000","last_clean":"2024-04-25T19:22:18.076474+0000","last_became_active":"2024-04-25T19:22:17.080584+0000","last_became_peered":"2024-04-25T19:22:17.080584+0000","last_unstale":"2024-04-25T19:22:18.076474+0000","last_undegraded":"2024-04-25T19:22:18.076474+0000","last_fullsized":"2024-04-25T19:22:18.076474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:43.115713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.133601+0000","last_change":"2024-04-25T19:22:16.064556+0000","last_active":"2024-04-25T19:22:18.133601+0000","last_peered":"2024-04-25T19:22:18.133601+0000","last_clean":"2024-04-25T19:22:18.133601+0000","last_became_active":"2024-04-25T19:22:16.063605+0000","last_became_peered":"2024-04-25T19:22:16.063605+0000","last_unstale":"2024-04-25T19:22:18.133601+0000","last_undegraded":"2024-04-25T19:22:18.133601+0000","last_fullsized":"2024-04-25T19:22:18.133601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:39:11.697383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.137672+0000","last_change":"2024-04-25T19:22:17.091739+0000","last_active":"2024-04-25T19:22:18.137672+0000","last_peered":"2024-04-25T19:22:18.137672+0000","last_clean":"2024-04-25T19:22:18.137672+0000","last_became_active":"2024-04-25T19:22:17.091329+0000","last_became_peered":"2024-04-25T19:22:17.091329+0000","last_unstale":"2024-04-25T19:22:18.137672+0000","last_undegraded":"2024-04-25T19:22:18.137672+0000","last_fullsized":"2024-04-25T19:22:18.137672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:25.008654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.136813+0000","last_change":"2024-04-25T19:22:06.081655+0000","last_active":"2024-04-25T19:22:18.136813+0000","last_peered":"2024-04-25T19:22:18.136813+0000","last_clean":"2024-04-25T19:22:18.136813+0000","last_became_active":"2024-04-25T19:22:06.078999+0000","last_became_peered":"2024-04-25T19:22:06.078999+0000","last_unstale":"2024-04-25T19:22:18.136813+0000","last_undegraded":"2024-04-25T19:22:18.136813+0000","last_fullsized":"2024-04-25T19:22:18.136813+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_clean_scrub_stamp":"2024-04-25T19:22:04.921147+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:30.543734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.075905+0000","last_change":"2024-04-25T19:22:16.058023+0000","last_active":"2024-04-25T19:22:18.075905+0000","last_peered":"2024-04-25T19:22:18.075905+0000","last_clean":"2024-04-25T19:22:18.075905+0000","last_became_active":"2024-04-25T19:22:16.057585+0000","last_became_peered":"2024-04-25T19:22:16.057585+0000","last_unstale":"2024-04-25T19:22:18.075905+0000","last_undegraded":"2024-04-25T19:22:18.075905+0000","last_fullsized":"2024-04-25T19:22:18.075905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:51.334418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135269+0000","last_change":"2024-04-25T19:22:17.080786+0000","last_active":"2024-04-25T19:22:18.135269+0000","last_peered":"2024-04-25T19:22:18.135269+0000","last_clean":"2024-04-25T19:22:18.135269+0000","last_became_active":"2024-04-25T19:22:17.080103+0000","last_became_peered":"2024-04-25T19:22:17.080103+0000","last_unstale":"2024-04-25T19:22:18.135269+0000","last_undegraded":"2024-04-25T19:22:18.135269+0000","last_fullsized":"2024-04-25T19:22:18.135269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:36:53.730051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.136579+0000","last_change":"2024-04-25T19:22:16.079452+0000","last_active":"2024-04-25T19:22:18.136579+0000","last_peered":"2024-04-25T19:22:18.136579+0000","last_clean":"2024-04-25T19:22:18.136579+0000","last_became_active":"2024-04-25T19:22:16.078988+0000","last_became_peered":"2024-04-25T19:22:16.078988+0000","last_unstale":"2024-04-25T19:22:18.136579+0000","last_undegraded":"2024-04-25T19:22:18.136579+0000","last_fullsized":"2024-04-25T19:22:18.136579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:52:34.957140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134617+0000","last_change":"2024-04-25T19:22:17.063481+0000","last_active":"2024-04-25T19:22:18.134617+0000","last_peered":"2024-04-25T19:22:18.134617+0000","last_clean":"2024-04-25T19:22:18.134617+0000","last_became_active":"2024-04-25T19:22:17.061000+0000","last_became_peered":"2024-04-25T19:22:17.061000+0000","last_unstale":"2024-04-25T19:22:18.134617+0000","last_undegraded":"2024-04-25T19:22:18.134617+0000","last_fullsized":"2024-04-25T19:22:18.134617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:05.392241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.133582+0000","last_change":"2024-04-25T19:22:16.060594+0000","last_active":"2024-04-25T19:22:18.133582+0000","last_peered":"2024-04-25T19:22:18.133582+0000","last_clean":"2024-04-25T19:22:18.133582+0000","last_became_active":"2024-04-25T19:22:16.060250+0000","last_became_peered":"2024-04-25T19:22:16.060250+0000","last_unstale":"2024-04-25T19:22:18.133582+0000","last_undegraded":"2024-04-25T19:22:18.133582+0000","last_fullsized":"2024-04-25T19:22:18.133582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:38.378131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072506+0000","last_change":"2024-04-25T19:22:17.068935+0000","last_active":"2024-04-25T19:22:18.072506+0000","last_peered":"2024-04-25T19:22:18.072506+0000","last_clean":"2024-04-25T19:22:18.072506+0000","last_became_active":"2024-04-25T19:22:17.068017+0000","last_became_peered":"2024-04-25T19:22:17.068017+0000","last_unstale":"2024-04-25T19:22:18.072506+0000","last_undegraded":"2024-04-25T19:22:18.072506+0000","last_fullsized":"2024-04-25T19:22:18.072506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:23.797191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076158+0000","last_change":"2024-04-25T19:22:16.064341+0000","last_active":"2024-04-25T19:22:18.076158+0000","last_peered":"2024-04-25T19:22:18.076158+0000","last_clean":"2024-04-25T19:22:18.076158+0000","last_became_active":"2024-04-25T19:22:16.063393+0000","last_became_peered":"2024-04-25T19:22:16.063393+0000","last_unstale":"2024-04-25T19:22:18.076158+0000","last_undegraded":"2024-04-25T19:22:18.076158+0000","last_fullsized":"2024-04-25T19:22:18.076158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:25.066396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073702+0000","last_change":"2024-04-25T19:22:17.085013+0000","last_active":"2024-04-25T19:22:18.073702+0000","last_peered":"2024-04-25T19:22:18.073702+0000","last_clean":"2024-04-25T19:22:18.073702+0000","last_became_active":"2024-04-25T19:22:17.084714+0000","last_became_peered":"2024-04-25T19:22:17.084714+0000","last_unstale":"2024-04-25T19:22:18.073702+0000","last_undegraded":"2024-04-25T19:22:18.073702+0000","last_fullsized":"2024-04-25T19:22:18.073702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:19.060353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072843+0000","last_change":"2024-04-25T19:22:16.055692+0000","last_active":"2024-04-25T19:22:18.072843+0000","last_peered":"2024-04-25T19:22:18.072843+0000","last_clean":"2024-04-25T19:22:18.072843+0000","last_became_active":"2024-04-25T19:22:16.054860+0000","last_became_peered":"2024-04-25T19:22:16.054860+0000","last_unstale":"2024-04-25T19:22:18.072843+0000","last_undegraded":"2024-04-25T19:22:18.072843+0000","last_fullsized":"2024-04-25T19:22:18.072843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:26.277490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076489+0000","last_change":"2024-04-25T19:22:17.085772+0000","last_active":"2024-04-25T19:22:18.076489+0000","last_peered":"2024-04-25T19:22:18.076489+0000","last_clean":"2024-04-25T19:22:18.076489+0000","last_became_active":"2024-04-25T19:22:17.085385+0000","last_became_peered":"2024-04-25T19:22:17.085385+0000","last_unstale":"2024-04-25T19:22:18.076489+0000","last_undegraded":"2024-04-25T19:22:18.076489+0000","last_fullsized":"2024-04-25T19:22:18.076489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:11.217132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138639+0000","last_change":"2024-04-25T19:22:16.081834+0000","last_active":"2024-04-25T19:22:18.138639+0000","last_peered":"2024-04-25T19:22:18.138639+0000","last_clean":"2024-04-25T19:22:18.138639+0000","last_became_active":"2024-04-25T19:22:16.081457+0000","last_became_peered":"2024-04-25T19:22:16.081457+0000","last_unstale":"2024-04-25T19:22:18.138639+0000","last_undegraded":"2024-04-25T19:22:18.138639+0000","last_fullsized":"2024-04-25T19:22:18.138639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:30.978869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072883+0000","last_change":"2024-04-25T19:22:17.077342+0000","last_active":"2024-04-25T19:22:18.072883+0000","last_peered":"2024-04-25T19:22:18.072883+0000","last_clean":"2024-04-25T19:22:18.072883+0000","last_became_active":"2024-04-25T19:22:17.076548+0000","last_became_peered":"2024-04-25T19:22:17.076548+0000","last_unstale":"2024-04-25T19:22:18.072883+0000","last_undegraded":"2024-04-25T19:22:18.072883+0000","last_fullsized":"2024-04-25T19:22:18.072883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:42.370408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.080648+0000","last_change":"2024-04-25T19:22:16.068620+0000","last_active":"2024-04-25T19:22:18.080648+0000","last_peered":"2024-04-25T19:22:18.080648+0000","last_clean":"2024-04-25T19:22:18.080648+0000","last_became_active":"2024-04-25T19:22:16.068220+0000","last_became_peered":"2024-04-25T19:22:16.068220+0000","last_unstale":"2024-04-25T19:22:18.080648+0000","last_undegraded":"2024-04-25T19:22:18.080648+0000","last_fullsized":"2024-04-25T19:22:18.080648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:30.978869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135459+0000","last_change":"2024-04-25T19:22:17.075136+0000","last_active":"2024-04-25T19:22:18.135459+0000","last_peered":"2024-04-25T19:22:18.135459+0000","last_clean":"2024-04-25T19:22:18.135459+0000","last_became_active":"2024-04-25T19:22:17.074780+0000","last_became_peered":"2024-04-25T19:22:17.074780+0000","last_unstale":"2024-04-25T19:22:18.135459+0000","last_undegraded":"2024-04-25T19:22:18.135459+0000","last_fullsized":"2024-04-25T19:22:18.135459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:42.285229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.082026+0000","last_change":"2024-04-25T19:22:16.073857+0000","last_active":"2024-04-25T19:22:18.082026+0000","last_peered":"2024-04-25T19:22:18.082026+0000","last_clean":"2024-04-25T19:22:18.082026+0000","last_became_active":"2024-04-25T19:22:16.073078+0000","last_became_peered":"2024-04-25T19:22:16.073078+0000","last_unstale":"2024-04-25T19:22:18.082026+0000","last_undegraded":"2024-04-25T19:22:18.082026+0000","last_fullsized":"2024-04-25T19:22:18.082026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:26.277490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135943+0000","last_change":"2024-04-25T19:22:17.070172+0000","last_active":"2024-04-25T19:22:18.135943+0000","last_peered":"2024-04-25T19:22:18.135943+0000","last_clean":"2024-04-25T19:22:18.135943+0000","last_became_active":"2024-04-25T19:22:17.069803+0000","last_became_peered":"2024-04-25T19:22:17.069803+0000","last_unstale":"2024-04-25T19:22:18.135943+0000","last_undegraded":"2024-04-25T19:22:18.135943+0000","last_fullsized":"2024-04-25T19:22:18.135943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.514449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.136579+0000","last_change":"2024-04-25T19:22:16.078887+0000","last_active":"2024-04-25T19:22:18.136579+0000","last_peered":"2024-04-25T19:22:18.136579+0000","last_clean":"2024-04-25T19:22:18.136579+0000","last_became_active":"2024-04-25T19:22:16.078375+0000","last_became_peered":"2024-04-25T19:22:16.078375+0000","last_unstale":"2024-04-25T19:22:18.136579+0000","last_undegraded":"2024-04-25T19:22:18.136579+0000","last_fullsized":"2024-04-25T19:22:18.136579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:44.758262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073176+0000","last_change":"2024-04-25T19:22:17.076840+0000","last_active":"2024-04-25T19:22:18.073176+0000","last_peered":"2024-04-25T19:22:18.073176+0000","last_clean":"2024-04-25T19:22:18.073176+0000","last_became_active":"2024-04-25T19:22:17.071951+0000","last_became_peered":"2024-04-25T19:22:17.071951+0000","last_unstale":"2024-04-25T19:22:18.073176+0000","last_undegraded":"2024-04-25T19:22:18.073176+0000","last_fullsized":"2024-04-25T19:22:18.073176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:27.291685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072526+0000","last_change":"2024-04-25T19:22:16.068098+0000","last_active":"2024-04-25T19:22:18.072526+0000","last_peered":"2024-04-25T19:22:18.072526+0000","last_clean":"2024-04-25T19:22:18.072526+0000","last_became_active":"2024-04-25T19:22:16.067726+0000","last_became_peered":"2024-04-25T19:22:16.067726+0000","last_unstale":"2024-04-25T19:22:18.072526+0000","last_undegraded":"2024-04-25T19:22:18.072526+0000","last_fullsized":"2024-04-25T19:22:18.072526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:44.758262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134620+0000","last_change":"2024-04-25T19:22:17.075489+0000","last_active":"2024-04-25T19:22:18.134620+0000","last_peered":"2024-04-25T19:22:18.134620+0000","last_clean":"2024-04-25T19:22:18.134620+0000","last_became_active":"2024-04-25T19:22:17.075103+0000","last_became_peered":"2024-04-25T19:22:17.075103+0000","last_unstale":"2024-04-25T19:22:18.134620+0000","last_undegraded":"2024-04-25T19:22:18.134620+0000","last_fullsized":"2024-04-25T19:22:18.134620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:23.797191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072600+0000","last_change":"2024-04-25T19:22:16.062470+0000","last_active":"2024-04-25T19:22:18.072600+0000","last_peered":"2024-04-25T19:22:18.072600+0000","last_clean":"2024-04-25T19:22:18.072600+0000","last_became_active":"2024-04-25T19:22:16.062069+0000","last_became_peered":"2024-04-25T19:22:16.062069+0000","last_unstale":"2024-04-25T19:22:18.072600+0000","last_undegraded":"2024-04-25T19:22:18.072600+0000","last_fullsized":"2024-04-25T19:22:18.072600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:52:34.957140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135155+0000","last_change":"2024-04-25T19:22:17.074489+0000","last_active":"2024-04-25T19:22:18.135155+0000","last_peered":"2024-04-25T19:22:18.135155+0000","last_clean":"2024-04-25T19:22:18.135155+0000","last_became_active":"2024-04-25T19:22:17.073799+0000","last_became_peered":"2024-04-25T19:22:17.073799+0000","last_unstale":"2024-04-25T19:22:18.135155+0000","last_undegraded":"2024-04-25T19:22:18.135155+0000","last_fullsized":"2024-04-25T19:22:18.135155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:52.165740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138381+0000","last_change":"2024-04-25T19:22:16.080827+0000","last_active":"2024-04-25T19:22:18.138381+0000","last_peered":"2024-04-25T19:22:18.138381+0000","last_clean":"2024-04-25T19:22:18.138381+0000","last_became_active":"2024-04-25T19:22:16.080356+0000","last_became_peered":"2024-04-25T19:22:16.080356+0000","last_unstale":"2024-04-25T19:22:18.138381+0000","last_undegraded":"2024-04-25T19:22:18.138381+0000","last_fullsized":"2024-04-25T19:22:18.138381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:18.046159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081947+0000","last_change":"2024-04-25T19:22:17.077563+0000","last_active":"2024-04-25T19:22:18.081947+0000","last_peered":"2024-04-25T19:22:18.081947+0000","last_clean":"2024-04-25T19:22:18.081947+0000","last_became_active":"2024-04-25T19:22:17.073123+0000","last_became_peered":"2024-04-25T19:22:17.073123+0000","last_unstale":"2024-04-25T19:22:18.081947+0000","last_undegraded":"2024-04-25T19:22:18.081947+0000","last_fullsized":"2024-04-25T19:22:18.081947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:27.385683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076484+0000","last_change":"2024-04-25T19:22:17.079364+0000","last_active":"2024-04-25T19:22:18.076484+0000","last_peered":"2024-04-25T19:22:18.076484+0000","last_clean":"2024-04-25T19:22:18.076484+0000","last_became_active":"2024-04-25T19:22:17.079025+0000","last_became_peered":"2024-04-25T19:22:17.079025+0000","last_unstale":"2024-04-25T19:22:18.076484+0000","last_undegraded":"2024-04-25T19:22:18.076484+0000","last_fullsized":"2024-04-25T19:22:18.076484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:25.008654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.137489+0000","last_change":"2024-04-25T19:22:16.081730+0000","last_active":"2024-04-25T19:22:18.137489+0000","last_peered":"2024-04-25T19:22:18.137489+0000","last_clean":"2024-04-25T19:22:18.137489+0000","last_became_active":"2024-04-25T19:22:16.081421+0000","last_became_peered":"2024-04-25T19:22:16.081421+0000","last_unstale":"2024-04-25T19:22:18.137489+0000","last_undegraded":"2024-04-25T19:22:18.137489+0000","last_fullsized":"2024-04-25T19:22:18.137489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:49:45.977189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076421+0000","last_change":"2024-04-25T19:22:17.080305+0000","last_active":"2024-04-25T19:22:18.076421+0000","last_peered":"2024-04-25T19:22:18.076421+0000","last_clean":"2024-04-25T19:22:18.076421+0000","last_became_active":"2024-04-25T19:22:17.079799+0000","last_became_peered":"2024-04-25T19:22:17.079799+0000","last_unstale":"2024-04-25T19:22:18.076421+0000","last_undegraded":"2024-04-25T19:22:18.076421+0000","last_fullsized":"2024-04-25T19:22:18.076421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:37.277654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138286+0000","last_change":"2024-04-25T19:22:16.081114+0000","last_active":"2024-04-25T19:22:18.138286+0000","last_peered":"2024-04-25T19:22:18.138286+0000","last_clean":"2024-04-25T19:22:18.138286+0000","last_became_active":"2024-04-25T19:22:16.080449+0000","last_became_peered":"2024-04-25T19:22:16.080449+0000","last_unstale":"2024-04-25T19:22:18.138286+0000","last_undegraded":"2024-04-25T19:22:18.138286+0000","last_fullsized":"2024-04-25T19:22:18.138286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:52.491459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135509+0000","last_change":"2024-04-25T19:22:17.065056+0000","last_active":"2024-04-25T19:22:18.135509+0000","last_peered":"2024-04-25T19:22:18.135509+0000","last_clean":"2024-04-25T19:22:18.135509+0000","last_became_active":"2024-04-25T19:22:17.062680+0000","last_became_peered":"2024-04-25T19:22:17.062680+0000","last_unstale":"2024-04-25T19:22:18.135509+0000","last_undegraded":"2024-04-25T19:22:18.135509+0000","last_fullsized":"2024-04-25T19:22:18.135509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:27.385683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135590+0000","last_change":"2024-04-25T19:22:16.056898+0000","last_active":"2024-04-25T19:22:18.135590+0000","last_peered":"2024-04-25T19:22:18.135590+0000","last_clean":"2024-04-25T19:22:18.135590+0000","last_became_active":"2024-04-25T19:22:16.056528+0000","last_became_peered":"2024-04-25T19:22:16.056528+0000","last_unstale":"2024-04-25T19:22:18.135590+0000","last_undegraded":"2024-04-25T19:22:18.135590+0000","last_fullsized":"2024-04-25T19:22:18.135590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:51.334418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135596+0000","last_change":"2024-04-25T19:22:17.075549+0000","last_active":"2024-04-25T19:22:18.135596+0000","last_peered":"2024-04-25T19:22:18.135596+0000","last_clean":"2024-04-25T19:22:18.135596+0000","last_became_active":"2024-04-25T19:22:17.075224+0000","last_became_peered":"2024-04-25T19:22:17.075224+0000","last_unstale":"2024-04-25T19:22:18.135596+0000","last_undegraded":"2024-04-25T19:22:18.135596+0000","last_fullsized":"2024-04-25T19:22:18.135596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:15:59.386088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135671+0000","last_change":"2024-04-25T19:22:16.073541+0000","last_active":"2024-04-25T19:22:18.135671+0000","last_peered":"2024-04-25T19:22:18.135671+0000","last_clean":"2024-04-25T19:22:18.135671+0000","last_became_active":"2024-04-25T19:22:16.073195+0000","last_became_peered":"2024-04-25T19:22:16.073195+0000","last_unstale":"2024-04-25T19:22:18.135671+0000","last_undegraded":"2024-04-25T19:22:18.135671+0000","last_fullsized":"2024-04-25T19:22:18.135671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:21.114512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T19:22:22.287 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T19:22:22.287 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T19:22:22.288 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T19:22:22.288 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T19:22:22.288 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T19:22:22.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.596+0000 7f6ac5600640 1 Processor -- start 2024-04-25T19:22:22.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.597+0000 7f6ac5600640 1 -- start start 2024-04-25T19:22:22.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.598+0000 7f6ac5600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6ac006d560 0x7f6ac015d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:22.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.598+0000 7f6ac5600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ac015a2f0 0x7f6ac00b4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:22.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.598+0000 7f6ac5600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ac01611e0 con 0x7f6ac00b6a00 2024-04-25T19:22:22.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.598+0000 7f6ac5600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f6ac0160d50 con 0x7f6ac006d560 2024-04-25T19:22:22.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.598+0000 7f6ac5600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac015a700 con 0x7f6ac015a2f0 2024-04-25T19:22:22.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.599+0000 7f6abea00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f6ac00b6a00 0x7f6ac006ce50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:39782/0 (socket says 172.21.15.131:39782) 2024-04-25T19:22:22.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.599+0000 7f6abea00640 1 -- 172.21.15.131:0/2228417728 learned_addr learned my addr 172.21.15.131:0/2228417728 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:22.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.599+0000 7f6abe000640 1 --2- 172.21.15.131:0/2228417728 >> v2:172.21.15.131:3300/0 conn(0x7f6ac006d560 0x7f6ac015d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:22.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.599+0000 7f6abd600640 1 -- 172.21.15.131:0/2228417728 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1928610220 0 0) 0x7f6ac01611e0 con 0x7f6ac00b6a00 2024-04-25T19:22:22.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.599+0000 7f6abf400640 1 --2- 172.21.15.131:0/2228417728 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ac015a2f0 0x7f6ac00b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:22.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.599+0000 7f6abd600640 1 -- 172.21.15.131:0/2228417728 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6aa4003520 con 0x7f6ac00b6a00 2024-04-25T19:22:22.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.600+0000 7f6abe000640 1 -- 172.21.15.131:0/2228417728 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ac015a2f0 msgr2=0x7f6ac00b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:22.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.600+0000 7f6abe000640 1 --2- 172.21.15.131:0/2228417728 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ac015a2f0 0x7f6ac00b4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:22.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.600+0000 7f6abd600640 1 -- 172.21.15.131:0/2228417728 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3811825069 0 0) 0x7f6aa4003520 con 0x7f6ac00b6a00 2024-04-25T19:22:22.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.600+0000 7f6abe000640 1 -- 172.21.15.131:0/2228417728 >> v1:172.21.15.131:6789/0 conn(0x7f6ac00b6a00 legacy=0x7f6ac006ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:22.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.600+0000 7f6abe000640 1 -- 172.21.15.131:0/2228417728 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac0160420 con 0x7f6ac006d560 2024-04-25T19:22:22.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.601+0000 7f6abe000640 1 --2- 172.21.15.131:0/2228417728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ac006d560 0x7f6ac015d6c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009d90 tx=0x7f6ab002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92db4687287bda34 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:22.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.601+0000 7f6abd600640 1 -- 172.21.15.131:0/2228417728 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8001670 con 0x7f6ac006d560 2024-04-25T19:22:22.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.601+0000 7f6abd600640 1 -- 172.21.15.131:0/2228417728 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab0007540 con 0x7f6ac006d560 2024-04-25T19:22:22.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.601+0000 7f6abd600640 1 -- 172.21.15.131:0/2228417728 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0007910 con 0x7f6ac006d560 2024-04-25T19:22:22.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.602+0000 7f6ac5600640 1 -- 172.21.15.131:0/2228417728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ac006d560 msgr2=0x7f6ac015d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:22.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.602+0000 7f6ac5600640 1 --2- 172.21.15.131:0/2228417728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ac006d560 0x7f6ac015d6c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009d90 tx=0x7f6ab002a5f0 comp rx=0 tx=0).stop 2024-04-25T19:22:22.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.602+0000 7f6ac5600640 1 -- 172.21.15.131:0/2228417728 shutdown_connections 2024-04-25T19:22:22.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.602+0000 7f6ac5600640 1 --2- 172.21.15.131:0/2228417728 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ac015a2f0 0x7f6ac00b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:22.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.602+0000 7f6ac5600640 1 --2- 172.21.15.131:0/2228417728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ac006d560 0x7f6ac015d6c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:22.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.602+0000 7f6ac5600640 1 -- 172.21.15.131:0/2228417728 >> 172.21.15.131:0/2228417728 conn(0x7f6ac00d1ae0 msgr2=0x7f6ac00d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:22.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.602+0000 7f6ac5600640 1 -- 172.21.15.131:0/2228417728 shutdown_connections 2024-04-25T19:22:22.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.602+0000 7f6ac5600640 1 -- 172.21.15.131:0/2228417728 wait complete. 2024-04-25T19:22:22.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.605+0000 7f6ac5600640 1 Processor -- start 2024-04-25T19:22:22.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.605+0000 7f6ac5600640 1 -- start start 2024-04-25T19:22:22.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.606+0000 7f6ac5600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ac006d560 0x7f6ac014d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:22.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.606+0000 7f6ac5600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ac00b6a00 0x7f6ac00cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:22.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.606+0000 7f6ac5600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ac015a2f0 0x7f6ac00cc400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:22.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.606+0000 7f6ac5600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac00ce580 con 0x7f6ac006d560 2024-04-25T19:22:22.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.606+0000 7f6ac5600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac01609e0 con 0x7f6ac00b6a00 2024-04-25T19:22:22.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.606+0000 7f6ac5600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac00ce700 con 0x7f6ac015a2f0 2024-04-25T19:22:22.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.607+0000 7f6abea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ac006d560 0x7f6ac014d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:22.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.607+0000 7f6abea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ac006d560 0x7f6ac014d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54126/0 (socket says 172.21.15.131:54126) 2024-04-25T19:22:22.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.607+0000 7f6abea00640 1 -- 172.21.15.131:0/2810779022 learned_addr learned my addr 172.21.15.131:0/2810779022 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:22.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.607+0000 7f6abe000640 1 --2- 172.21.15.131:0/2810779022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ac00b6a00 0x7f6ac00cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:22.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.607+0000 7f6abea00640 1 -- 172.21.15.131:0/2810779022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ac015a2f0 msgr2=0x7f6ac00cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:22.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.607+0000 7f6abea00640 1 --2- 172.21.15.131:0/2810779022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ac015a2f0 0x7f6ac00cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:22.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.607+0000 7f6abea00640 1 -- 172.21.15.131:0/2810779022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ac00b6a00 msgr2=0x7f6ac00cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:22.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.607+0000 7f6abea00640 1 --2- 172.21.15.131:0/2810779022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ac00b6a00 0x7f6ac00cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:22.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.607+0000 7f6abea00640 1 -- 172.21.15.131:0/2810779022 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac00ce130 con 0x7f6ac006d560 2024-04-25T19:22:22.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.607+0000 7f6abea00640 1 --2- 172.21.15.131:0/2810779022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ac006d560 0x7f6ac014d350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80011e0 tx=0x7f6aa800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:22.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.608+0000 7f6ab6a00640 1 -- 172.21.15.131:0/2810779022 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8017070 con 0x7f6ac006d560 2024-04-25T19:22:22.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.608+0000 7f6ab6a00640 1 -- 172.21.15.131:0/2810779022 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aa8005ad0 con 0x7f6ac006d560 2024-04-25T19:22:22.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.608+0000 7f6ac5600640 1 -- 172.21.15.131:0/2810779022 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac00ca760 con 0x7f6ac006d560 2024-04-25T19:22:22.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.608+0000 7f6ab6a00640 1 -- 172.21.15.131:0/2810779022 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8007070 con 0x7f6ac006d560 2024-04-25T19:22:22.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.608+0000 7f6ac5600640 1 -- 172.21.15.131:0/2810779022 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac00cad20 con 0x7f6ac006d560 2024-04-25T19:22:22.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.609+0000 7f6ac5600640 1 -- 172.21.15.131:0/2810779022 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac00705a0 con 0x7f6ac006d560 2024-04-25T19:22:22.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.610+0000 7f6ab6a00640 1 -- 172.21.15.131:0/2810779022 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6aa801a070 con 0x7f6ac006d560 2024-04-25T19:22:22.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.611+0000 7f6ab6a00640 1 --2- 172.21.15.131:0/2810779022 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6a9c0744b0 0x7f6a9c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:22.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.611+0000 7f6ab6a00640 1 -- 172.21.15.131:0/2810779022 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6aa80945a0 con 0x7f6ac006d560 2024-04-25T19:22:22.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.612+0000 7f6abe000640 1 --2- 172.21.15.131:0/2810779022 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6a9c0744b0 0x7f6a9c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:22.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.613+0000 7f6abe000640 1 --2- 172.21.15.131:0/2810779022 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6a9c0744b0 0x7f6a9c0769c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0034000 tx=0x7f6ab002f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:22.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.616+0000 7f6ab6a00640 1 -- 172.21.15.131:0/2810779022 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6ac00ce130 con 0x7f6ac006d560 2024-04-25T19:22:22.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.867+0000 7f6ac5600640 1 -- 172.21.15.131:0/2810779022 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f6ac0073bb0 con 0x7f6ac006d560 2024-04-25T19:22:22.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.873+0000 7f6ab6a00640 1 -- 172.21.15.131:0/2810779022 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+186750 (secure 0 0 0) 0x7f6aa805e6d0 con 0x7f6ac006d560 2024-04-25T19:22:22.876 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:22.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.879+0000 7f6ac5600640 1 -- 172.21.15.131:0/2810779022 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6a9c0744b0 msgr2=0x7f6a9c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:22.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.879+0000 7f6ac5600640 1 --2- 172.21.15.131:0/2810779022 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6a9c0744b0 0x7f6a9c0769c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0034000 tx=0x7f6ab002f000 comp rx=0 tx=0).stop 2024-04-25T19:22:22.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.879+0000 7f6ac5600640 1 -- 172.21.15.131:0/2810779022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ac006d560 msgr2=0x7f6ac014d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:22.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.879+0000 7f6ac5600640 1 --2- 172.21.15.131:0/2810779022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ac006d560 0x7f6ac014d350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80011e0 tx=0x7f6aa800cb90 comp rx=0 tx=0).stop 2024-04-25T19:22:22.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.879+0000 7f6ac5600640 1 -- 172.21.15.131:0/2810779022 shutdown_connections 2024-04-25T19:22:22.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.879+0000 7f6ac5600640 1 --2- 172.21.15.131:0/2810779022 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6a9c0744b0 0x7f6a9c0769c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:22.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.879+0000 7f6ac5600640 1 --2- 172.21.15.131:0/2810779022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ac015a2f0 0x7f6ac00cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:22.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.879+0000 7f6ac5600640 1 --2- 172.21.15.131:0/2810779022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ac00b6a00 0x7f6ac00cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:22.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.879+0000 7f6ac5600640 1 --2- 172.21.15.131:0/2810779022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ac006d560 0x7f6ac014d350 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:22.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.879+0000 7f6ac5600640 1 -- 172.21.15.131:0/2810779022 >> 172.21.15.131:0/2810779022 conn(0x7f6ac00d1ae0 msgr2=0x7f6ac015a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:22.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.879+0000 7f6ac5600640 1 -- 172.21.15.131:0/2810779022 shutdown_connections 2024-04-25T19:22:22.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:22.879+0000 7f6ac5600640 1 -- 172.21.15.131:0/2810779022 wait complete. 2024-04-25T19:22:22.905 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2541913764},{"type":"v1","addr":"172.21.15.195:6833","nonce":2541913764}]},"active_addr":"172.21.15.195:6833/2541913764","active_change":"2024-04-25T19:21:56.117300+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.195:0","nonce":1215848485}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.195:0","nonce":3496864913}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.195:0","nonce":3096159364}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.195:0","nonce":1919734090}]}]} 2024-04-25T19:22:22.908 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T19:22:22.909 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T19:22:22.909 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:22:23.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.177+0000 7fb299200640 1 Processor -- start 2024-04-25T19:22:23.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.177+0000 7fb299200640 1 -- start start 2024-04-25T19:22:23.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.180+0000 7fb299200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb2940cf5e0 0x7fb2940cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:23.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.180+0000 7fb299200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb29406c5c0 0x7fb29406c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:23.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.180+0000 7fb299200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2940cff30 con 0x7fb2941443c0 2024-04-25T19:22:23.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.180+0000 7fb299200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fb2940708d0 con 0x7fb2940cf5e0 2024-04-25T19:22:23.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.180+0000 7fb299200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb29415f160 con 0x7fb29406c5c0 2024-04-25T19:22:23.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.180+0000 7fb28be00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb2940cf5e0 0x7fb2940cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:23.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.180+0000 7fb28be00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb2940cf5e0 0x7fb2940cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54132/0 (socket says 172.21.15.131:54132) 2024-04-25T19:22:23.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.180+0000 7fb28be00640 1 -- 172.21.15.131:0/3586281543 learned_addr learned my addr 172.21.15.131:0/3586281543 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:23.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.180+0000 7fb291e00640 1 --1- 172.21.15.131:0/3586281543 >> v1:172.21.15.131:6789/0 conn(0x7fb2941443c0 0x7fb29406fe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:39784/0 (socket says 172.21.15.131:39784) 2024-04-25T19:22:23.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.180+0000 7fb292800640 1 --2- 172.21.15.131:0/3586281543 >> v2:172.21.15.195:3300/0 conn(0x7fb29406c5c0 0x7fb29406c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:23.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.181+0000 7fb28be00640 1 -- 172.21.15.131:0/3586281543 >> v2:172.21.15.195:3300/0 conn(0x7fb29406c5c0 msgr2=0x7fb29406c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:23.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.181+0000 7fb28be00640 1 --2- 172.21.15.131:0/3586281543 >> v2:172.21.15.195:3300/0 conn(0x7fb29406c5c0 0x7fb29406c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:23.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.181+0000 7fb28be00640 1 -- 172.21.15.131:0/3586281543 >> v1:172.21.15.131:6789/0 conn(0x7fb2941443c0 legacy=0x7fb29406fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:23.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.181+0000 7fb28be00640 1 -- 172.21.15.131:0/3586281543 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb29415f5f0 con 0x7fb2940cf5e0 2024-04-25T19:22:23.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.182+0000 7fb28be00640 1 --2- 172.21.15.131:0/3586281543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2940cf5e0 0x7fb2940cf9f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb29415c250 tx=0x7fb27c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e716b90b7109d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:23.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.182+0000 7fb291400640 1 -- 172.21.15.131:0/3586281543 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c037070 con 0x7fb2940cf5e0 2024-04-25T19:22:23.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.182+0000 7fb291400640 1 -- 172.21.15.131:0/3586281543 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb27c032440 con 0x7fb2940cf5e0 2024-04-25T19:22:23.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.182+0000 7fb291400640 1 -- 172.21.15.131:0/3586281543 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c032810 con 0x7fb2940cf5e0 2024-04-25T19:22:23.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.183+0000 7fb299200640 1 -- 172.21.15.131:0/3586281543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2940cf5e0 msgr2=0x7fb2940cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:23.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.183+0000 7fb299200640 1 --2- 172.21.15.131:0/3586281543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2940cf5e0 0x7fb2940cf9f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb29415c250 tx=0x7fb27c02a270 comp rx=0 tx=0).stop 2024-04-25T19:22:23.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.183+0000 7fb299200640 1 -- 172.21.15.131:0/3586281543 shutdown_connections 2024-04-25T19:22:23.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.183+0000 7fb299200640 1 --2- 172.21.15.131:0/3586281543 >> v2:172.21.15.195:3300/0 conn(0x7fb29406c5c0 0x7fb29406c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:23.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.183+0000 7fb299200640 1 --2- 172.21.15.131:0/3586281543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2940cf5e0 0x7fb2940cf9f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:23.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.183+0000 7fb299200640 1 -- 172.21.15.131:0/3586281543 >> 172.21.15.131:0/3586281543 conn(0x7fb2940d1ae0 msgr2=0x7fb2940d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:23.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.183+0000 7fb299200640 1 -- 172.21.15.131:0/3586281543 shutdown_connections 2024-04-25T19:22:23.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.183+0000 7fb299200640 1 -- 172.21.15.131:0/3586281543 wait complete. 2024-04-25T19:22:23.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.186+0000 7fb299200640 1 Processor -- start 2024-04-25T19:22:23.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.186+0000 7fb299200640 1 -- start start 2024-04-25T19:22:23.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.188+0000 7fb299200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb29406c5c0 0x7fb2941e90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:23.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.188+0000 7fb299200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2940cf5e0 0x7fb294140c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:23.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.188+0000 7fb299200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2941443c0 0x7fb294159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:23.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.188+0000 7fb299200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb29415edf0 con 0x7fb2941443c0 2024-04-25T19:22:23.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.188+0000 7fb299200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb29415eb10 con 0x7fb29406c5c0 2024-04-25T19:22:23.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.188+0000 7fb299200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb2941447d0 con 0x7fb2940cf5e0 2024-04-25T19:22:23.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.188+0000 7fb292800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2941443c0 0x7fb294159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:23.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.188+0000 7fb292800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2941443c0 0x7fb294159d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54134/0 (socket says 172.21.15.131:54134) 2024-04-25T19:22:23.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.188+0000 7fb292800640 1 -- 172.21.15.131:0/3250860624 learned_addr learned my addr 172.21.15.131:0/3250860624 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:23.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.188+0000 7fb291e00640 1 --2- 172.21.15.131:0/3250860624 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb29406c5c0 0x7fb2941e90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:23.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.188+0000 7fb28be00640 1 --2- 172.21.15.131:0/3250860624 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2940cf5e0 0x7fb294140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:23.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.189+0000 7fb292800640 1 -- 172.21.15.131:0/3250860624 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2940cf5e0 msgr2=0x7fb294140c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:23.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.189+0000 7fb292800640 1 --2- 172.21.15.131:0/3250860624 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2940cf5e0 0x7fb294140c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:23.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.189+0000 7fb292800640 1 -- 172.21.15.131:0/3250860624 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb29406c5c0 msgr2=0x7fb2941e90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:23.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.189+0000 7fb292800640 1 --2- 172.21.15.131:0/3250860624 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb29406c5c0 0x7fb2941e90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:23.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.189+0000 7fb292800640 1 -- 172.21.15.131:0/3250860624 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2941e98f0 con 0x7fb2941443c0 2024-04-25T19:22:23.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.189+0000 7fb291e00640 1 --2- 172.21.15.131:0/3250860624 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb29406c5c0 0x7fb2941e90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:23.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.189+0000 7fb292800640 1 --2- 172.21.15.131:0/3250860624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2941443c0 0x7fb294159d60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb28c007d80 tx=0x7fb28c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:23.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.189+0000 7fb28a000640 1 -- 172.21.15.131:0/3250860624 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28c014420 con 0x7fb2941443c0 2024-04-25T19:22:23.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.189+0000 7fb28a000640 1 -- 172.21.15.131:0/3250860624 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb28c019070 con 0x7fb2941443c0 2024-04-25T19:22:23.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.189+0000 7fb28a000640 1 -- 172.21.15.131:0/3250860624 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28c014800 con 0x7fb2941443c0 2024-04-25T19:22:23.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.189+0000 7fb299200640 1 -- 172.21.15.131:0/3250860624 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2941e9bd0 con 0x7fb2941443c0 2024-04-25T19:22:23.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.189+0000 7fb299200640 1 -- 172.21.15.131:0/3250860624 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2941ea190 con 0x7fb2941443c0 2024-04-25T19:22:23.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.191+0000 7fb299200640 1 -- 172.21.15.131:0/3250860624 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb294050740 con 0x7fb2941443c0 2024-04-25T19:22:23.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.192+0000 7fb28a000640 1 -- 172.21.15.131:0/3250860624 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb28c0149a0 con 0x7fb2941443c0 2024-04-25T19:22:23.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.193+0000 7fb28a000640 1 --2- 172.21.15.131:0/3250860624 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb2700744e0 0x7fb2700769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:23.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.193+0000 7fb28a000640 1 -- 172.21.15.131:0/3250860624 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb28c095a00 con 0x7fb2941443c0 2024-04-25T19:22:23.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.193+0000 7fb291e00640 1 --2- 172.21.15.131:0/3250860624 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb2700744e0 0x7fb2700769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:23.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.195+0000 7fb291e00640 1 --2- 172.21.15.131:0/3250860624 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb2700744e0 0x7fb2700769f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb284000f60 tx=0x7fb284009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:23.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.198+0000 7fb28a000640 1 -- 172.21.15.131:0/3250860624 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb28c060190 con 0x7fb2941443c0 2024-04-25T19:22:23.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.397+0000 7fb299200640 1 -- 172.21.15.131:0/3250860624 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb29406cd10 con 0x7fb2941443c0 2024-04-25T19:22:23.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.400+0000 7fb28a000640 1 -- 172.21.15.131:0/3250860624 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16629 (secure 0 0 0) 0x7fb28c05fa90 con 0x7fb2941443c0 2024-04-25T19:22:23.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:23.401 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":20,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:22:18.057809+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:22:14.779716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T19:22:15.552027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:22:23.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.402+0000 7fb299200640 1 -- 172.21.15.131:0/3250860624 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb2700744e0 msgr2=0x7fb2700769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:23.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.402+0000 7fb299200640 1 --2- 172.21.15.131:0/3250860624 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb2700744e0 0x7fb2700769f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb284000f60 tx=0x7fb284009040 comp rx=0 tx=0).stop 2024-04-25T19:22:23.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.402+0000 7fb299200640 1 -- 172.21.15.131:0/3250860624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2941443c0 msgr2=0x7fb294159d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:23.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.402+0000 7fb299200640 1 --2- 172.21.15.131:0/3250860624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2941443c0 0x7fb294159d60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb28c007d80 tx=0x7fb28c00e4b0 comp rx=0 tx=0).stop 2024-04-25T19:22:23.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.403+0000 7fb299200640 1 -- 172.21.15.131:0/3250860624 shutdown_connections 2024-04-25T19:22:23.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.403+0000 7fb299200640 1 --2- 172.21.15.131:0/3250860624 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb2700744e0 0x7fb2700769f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:23.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.403+0000 7fb299200640 1 --2- 172.21.15.131:0/3250860624 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2940cf5e0 0x7fb294140c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:23.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.403+0000 7fb299200640 1 --2- 172.21.15.131:0/3250860624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2941443c0 0x7fb294159d60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:23.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.403+0000 7fb299200640 1 --2- 172.21.15.131:0/3250860624 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb29406c5c0 0x7fb2941e90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:23.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.403+0000 7fb299200640 1 -- 172.21.15.131:0/3250860624 >> 172.21.15.131:0/3250860624 conn(0x7fb2940d1ae0 msgr2=0x7fb29406d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:23.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.403+0000 7fb299200640 1 -- 172.21.15.131:0/3250860624 shutdown_connections 2024-04-25T19:22:23.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.403+0000 7fb299200640 1 -- 172.21.15.131:0/3250860624 wait complete. 2024-04-25T19:22:23.429 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T19:22:23.429 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:22:23.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.677+0000 7f9e37200640 1 Processor -- start 2024-04-25T19:22:23.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.677+0000 7f9e37200640 1 -- start start 2024-04-25T19:22:23.680 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.679+0000 7f9e37200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9e380d1070 0x7f9e38162200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:23.680 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.679+0000 7f9e37200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e38144e60 0x7f9e38145270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:23.680 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.679+0000 7f9e37200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e3806fc70 con 0x7f9e38144350 2024-04-25T19:22:23.680 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.679+0000 7f9e37200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f9e3806ff50 con 0x7f9e380d1070 2024-04-25T19:22:23.680 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.679+0000 7f9e37200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9e38070230 con 0x7f9e38144e60 2024-04-25T19:22:23.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.680+0000 7f9e36800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e38144e60 0x7f9e38145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:23.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.680+0000 7f9e36800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e38144e60 0x7f9e38145270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.131:38026/0 (socket says 172.21.15.131:38026) 2024-04-25T19:22:23.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.680+0000 7f9e36800640 1 -- 172.21.15.131:0/3626052053 learned_addr learned my addr 172.21.15.131:0/3626052053 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:23.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.680+0000 7f9e35400640 1 --2- 172.21.15.131:0/3626052053 >> v2:172.21.15.195:3300/0 conn(0x7f9e380d1070 0x7f9e38162200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:23.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.681+0000 7f9e35400640 1 -- 172.21.15.131:0/3626052053 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e38144e60 msgr2=0x7f9e38145270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:23.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.681+0000 7f9e35400640 1 --2- 172.21.15.131:0/3626052053 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e38144e60 0x7f9e38145270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:23.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.681+0000 7f9e35400640 1 -- 172.21.15.131:0/3626052053 >> v1:172.21.15.195:6789/0 conn(0x7f9e38144350 legacy=0x7f9e38161af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:23.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.681+0000 7f9e35400640 1 -- 172.21.15.131:0/3626052053 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e38070510 con 0x7f9e380d1070 2024-04-25T19:22:23.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.681+0000 7f9e36800640 1 --2- 172.21.15.131:0/3626052053 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e38144e60 0x7f9e38145270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T19:22:23.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.682+0000 7f9e35400640 1 --2- 172.21.15.131:0/3626052053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e380d1070 0x7f9e38162200 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9e240097a0 tx=0x7f9e2402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c824547071c0c7a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:23.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.683+0000 7f9e34a00640 1 -- 172.21.15.131:0/3626052053 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e24037070 con 0x7f9e380d1070 2024-04-25T19:22:23.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.683+0000 7f9e34a00640 1 -- 172.21.15.131:0/3626052053 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e24032440 con 0x7f9e380d1070 2024-04-25T19:22:23.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.683+0000 7f9e34a00640 1 -- 172.21.15.131:0/3626052053 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e24032810 con 0x7f9e380d1070 2024-04-25T19:22:23.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.683+0000 7f9e37200640 1 -- 172.21.15.131:0/3626052053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e380d1070 msgr2=0x7f9e38162200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:23.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.683+0000 7f9e37200640 1 --2- 172.21.15.131:0/3626052053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e380d1070 0x7f9e38162200 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9e240097a0 tx=0x7f9e2402a180 comp rx=0 tx=0).stop 2024-04-25T19:22:23.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.683+0000 7f9e37200640 1 -- 172.21.15.131:0/3626052053 shutdown_connections 2024-04-25T19:22:23.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.683+0000 7f9e37200640 1 --2- 172.21.15.131:0/3626052053 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e38144e60 0x7f9e38145270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:23.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.683+0000 7f9e37200640 1 --2- 172.21.15.131:0/3626052053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e380d1070 0x7f9e38162200 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:23.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.683+0000 7f9e37200640 1 -- 172.21.15.131:0/3626052053 >> 172.21.15.131:0/3626052053 conn(0x7f9e380d1720 msgr2=0x7f9e380d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:23.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.683+0000 7f9e37200640 1 -- 172.21.15.131:0/3626052053 shutdown_connections 2024-04-25T19:22:23.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.683+0000 7f9e37200640 1 -- 172.21.15.131:0/3626052053 wait complete. 2024-04-25T19:22:23.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.686+0000 7f9e37200640 1 Processor -- start 2024-04-25T19:22:23.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.686+0000 7f9e37200640 1 -- start start 2024-04-25T19:22:23.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.687+0000 7f9e37200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e380d1070 0x7f9e381e7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:23.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.687+0000 7f9e37200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e38144350 0x7f9e3815d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:23.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.687+0000 7f9e37200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e38144e60 0x7f9e380b5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:23.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.687+0000 7f9e37200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9e38162740 con 0x7f9e380d1070 2024-04-25T19:22:23.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.687+0000 7f9e37200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9e38147910 con 0x7f9e38144350 2024-04-25T19:22:23.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.687+0000 7f9e37200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9e381628c0 con 0x7f9e38144e60 2024-04-25T19:22:23.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.688+0000 7f9e35e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e380d1070 0x7f9e381e7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:23.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.688+0000 7f9e35e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e380d1070 0x7f9e381e7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54142/0 (socket says 172.21.15.131:54142) 2024-04-25T19:22:23.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.688+0000 7f9e35e00640 1 -- 172.21.15.131:0/1580038662 learned_addr learned my addr 172.21.15.131:0/1580038662 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:23.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.688+0000 7f9e36800640 1 --2- 172.21.15.131:0/1580038662 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e38144e60 0x7f9e380b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:23.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.688+0000 7f9e35e00640 1 -- 172.21.15.131:0/1580038662 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e38144e60 msgr2=0x7f9e380b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:23.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.688+0000 7f9e35e00640 1 --2- 172.21.15.131:0/1580038662 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e38144e60 0x7f9e380b5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:23.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.688+0000 7f9e35e00640 1 -- 172.21.15.131:0/1580038662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e38144350 msgr2=0x7f9e3815d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:23.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.688+0000 7f9e35e00640 1 --2- 172.21.15.131:0/1580038662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e38144350 0x7f9e3815d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:23.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.688+0000 7f9e35e00640 1 -- 172.21.15.131:0/1580038662 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e381e8260 con 0x7f9e380d1070 2024-04-25T19:22:23.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.688+0000 7f9e35e00640 1 --2- 172.21.15.131:0/1580038662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e380d1070 0x7f9e381e7830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9e2800c3c0 tx=0x7f9e2800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:23.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.688+0000 7f9e2e000640 1 -- 172.21.15.131:0/1580038662 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e28017070 con 0x7f9e380d1070 2024-04-25T19:22:23.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.689+0000 7f9e2e000640 1 -- 172.21.15.131:0/1580038662 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e280052f0 con 0x7f9e380d1070 2024-04-25T19:22:23.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.689+0000 7f9e37200640 1 -- 172.21.15.131:0/1580038662 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e3815fbf0 con 0x7f9e380d1070 2024-04-25T19:22:23.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.689+0000 7f9e2e000640 1 -- 172.21.15.131:0/1580038662 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e28003850 con 0x7f9e380d1070 2024-04-25T19:22:23.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.689+0000 7f9e37200640 1 -- 172.21.15.131:0/1580038662 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e381601b0 con 0x7f9e380d1070 2024-04-25T19:22:23.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.690+0000 7f9e37200640 1 -- 172.21.15.131:0/1580038662 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e38050740 con 0x7f9e380d1070 2024-04-25T19:22:23.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.691+0000 7f9e2e000640 1 -- 172.21.15.131:0/1580038662 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9e2801a070 con 0x7f9e380d1070 2024-04-25T19:22:23.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.692+0000 7f9e2e000640 1 --2- 172.21.15.131:0/1580038662 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9e180744b0 0x7f9e180769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:23.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.692+0000 7f9e2e000640 1 -- 172.21.15.131:0/1580038662 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9e28094430 con 0x7f9e380d1070 2024-04-25T19:22:23.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.692+0000 7f9e35400640 1 --2- 172.21.15.131:0/1580038662 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9e180744b0 0x7f9e180769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:23.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.693+0000 7f9e35400640 1 --2- 172.21.15.131:0/1580038662 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9e180744b0 0x7f9e180769c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9e24034000 tx=0x7f9e2402c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:23.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.696+0000 7f9e2e000640 1 -- 172.21.15.131:0/1580038662 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9e2805ec50 con 0x7f9e380d1070 2024-04-25T19:22:23.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.882+0000 7f9e37200640 1 -- 172.21.15.131:0/1580038662 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e3806d910 con 0x7f9e380d1070 2024-04-25T19:22:23.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.885+0000 7f9e2e000640 1 -- 172.21.15.131:0/1580038662 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16629 (secure 0 0 0) 0x7f9e2805e550 con 0x7f9e380d1070 2024-04-25T19:22:23.886 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:23.886 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":20,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:22:18.057809+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:22:14.779716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T19:22:15.552027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:22:23.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.888+0000 7f9e37200640 1 -- 172.21.15.131:0/1580038662 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9e180744b0 msgr2=0x7f9e180769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:23.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.888+0000 7f9e37200640 1 --2- 172.21.15.131:0/1580038662 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9e180744b0 0x7f9e180769c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9e24034000 tx=0x7f9e2402c000 comp rx=0 tx=0).stop 2024-04-25T19:22:23.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.888+0000 7f9e37200640 1 -- 172.21.15.131:0/1580038662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e380d1070 msgr2=0x7f9e381e7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:23.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.888+0000 7f9e37200640 1 --2- 172.21.15.131:0/1580038662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e380d1070 0x7f9e381e7830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9e2800c3c0 tx=0x7f9e2800c880 comp rx=0 tx=0).stop 2024-04-25T19:22:23.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.889+0000 7f9e37200640 1 -- 172.21.15.131:0/1580038662 shutdown_connections 2024-04-25T19:22:23.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.889+0000 7f9e37200640 1 --2- 172.21.15.131:0/1580038662 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9e180744b0 0x7f9e180769c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:23.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.889+0000 7f9e37200640 1 --2- 172.21.15.131:0/1580038662 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e38144e60 0x7f9e380b5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:23.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.889+0000 7f9e37200640 1 --2- 172.21.15.131:0/1580038662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e38144350 0x7f9e3815d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:23.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.889+0000 7f9e37200640 1 --2- 172.21.15.131:0/1580038662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e380d1070 0x7f9e381e7830 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:23.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.889+0000 7f9e37200640 1 -- 172.21.15.131:0/1580038662 >> 172.21.15.131:0/1580038662 conn(0x7f9e380d1720 msgr2=0x7f9e380b0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:23.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.889+0000 7f9e37200640 1 -- 172.21.15.131:0/1580038662 shutdown_connections 2024-04-25T19:22:23.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:23.889+0000 7f9e37200640 1 -- 172.21.15.131:0/1580038662 wait complete. 2024-04-25T19:22:23.915 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T19:22:23.916 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T19:22:23.916 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T19:22:23.916 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T19:22:23.917 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T19:22:23.917 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T19:22:23.918 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T19:22:23.918 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T19:22:24.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.322+0000 7feddd600640 1 Processor -- start 2024-04-25T19:22:24.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.322+0000 7feddd600640 1 -- start start 2024-04-25T19:22:24.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.325+0000 7feddd600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fedd80d5370 0x7fedd8142e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.325+0000 7feddd600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fedd806e390 0x7fedd80d3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.326+0000 7feddcc00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fedd806e390 0x7fedd80d3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.326+0000 7feddcc00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fedd806e390 0x7fedd80d3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54150/0 (socket says 172.21.15.131:54150) 2024-04-25T19:22:24.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.326+0000 7feddcc00640 1 -- 172.21.15.131:0/3099312194 learned_addr learned my addr 172.21.15.131:0/3099312194 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:24.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.326+0000 7fedd7e00640 1 --2- 172.21.15.131:0/3099312194 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fedd80d5370 0x7fedd8142e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.326+0000 7feddd600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedd8145860 con 0x7fedd80d3580 2024-04-25T19:22:24.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.326+0000 7feddd600640 1 -- 172.21.15.131:0/3099312194 --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fedd81616f0 con 0x7fedd806e390 2024-04-25T19:22:24.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.326+0000 7feddd600640 1 -- 172.21.15.131:0/3099312194 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fedd8145b40 con 0x7fedd80d5370 2024-04-25T19:22:24.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.327+0000 7feddcc00640 1 -- 172.21.15.131:0/3099312194 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fedd80d5370 msgr2=0x7fedd8142e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:24.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.327+0000 7feddcc00640 1 --2- 172.21.15.131:0/3099312194 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fedd80d5370 0x7fedd8142e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.327+0000 7feddcc00640 1 -- 172.21.15.131:0/3099312194 >> v1:172.21.15.195:6789/0 conn(0x7fedd80d3580 legacy=0x7fedd806dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:24.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.327+0000 7feddcc00640 1 -- 172.21.15.131:0/3099312194 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd8145e20 con 0x7fedd806e390 2024-04-25T19:22:24.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.329+0000 7feddcc00640 1 --2- 172.21.15.131:0/3099312194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd806e390 0x7fedd80d3990 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fedd80b8fa0 tx=0x7fedd002a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ccd322673fbea7a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.329+0000 7f38b1e00640 1 Processor -- start 2024-04-25T19:22:24.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.329+0000 7f38b1e00640 1 -- start start 2024-04-25T19:22:24.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.330+0000 7fedd6a00640 1 -- 172.21.15.131:0/3099312194 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd0036070 con 0x7fedd806e390 2024-04-25T19:22:24.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.330+0000 7fedd6a00640 1 -- 172.21.15.131:0/3099312194 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedd0031600 con 0x7fedd806e390 2024-04-25T19:22:24.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.330+0000 7fedd6a00640 1 -- 172.21.15.131:0/3099312194 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd00319b0 con 0x7fedd806e390 2024-04-25T19:22:24.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.331+0000 7feddd600640 1 -- 172.21.15.131:0/3099312194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd806e390 msgr2=0x7fedd80d3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.331+0000 7feddd600640 1 --2- 172.21.15.131:0/3099312194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd806e390 0x7fedd80d3990 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fedd80b8fa0 tx=0x7fedd002a640 comp rx=0 tx=0).stop 2024-04-25T19:22:24.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.332+0000 7feddd600640 1 -- 172.21.15.131:0/3099312194 shutdown_connections 2024-04-25T19:22:24.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.332+0000 7feddd600640 1 --2- 172.21.15.131:0/3099312194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd806e390 0x7fedd80d3990 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.332+0000 7feddd600640 1 --2- 172.21.15.131:0/3099312194 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fedd80d5370 0x7fedd8142e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.332+0000 7feddd600640 1 -- 172.21.15.131:0/3099312194 >> 172.21.15.131:0/3099312194 conn(0x7fedd806c5c0 msgr2=0x7fedd806c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:24.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.332+0000 7feddd600640 1 -- 172.21.15.131:0/3099312194 shutdown_connections 2024-04-25T19:22:24.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.332+0000 7feddd600640 1 -- 172.21.15.131:0/3099312194 wait complete. 2024-04-25T19:22:24.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.333+0000 7f38b1e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f38ac1601d0 0x7f38ac1605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.333+0000 7f38b1e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38ac160f40 con 0x7f38ac0736c0 2024-04-25T19:22:24.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.333+0000 7f38b1e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38ac06f8d0 con 0x7f38ac156d20 2024-04-25T19:22:24.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.333+0000 7f38b1e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f38ac06f680 con 0x7f38ac1601d0 2024-04-25T19:22:24.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.333+0000 7f38b0a00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f38ac156d20 0x7f38ac0703b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.131:43918/0 (socket says 172.21.15.131:43918) 2024-04-25T19:22:24.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.333+0000 7f38b0a00640 1 -- 172.21.15.131:0/3696440281 learned_addr learned my addr 172.21.15.131:0/3696440281 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:24.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.334+0000 7f38ab400640 1 -- 172.21.15.131:0/3696440281 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1396779970 0 0) 0x7f38ac160f40 con 0x7f38ac0736c0 2024-04-25T19:22:24.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.334+0000 7f38ab400640 1 -- 172.21.15.131:0/3696440281 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3894003440 con 0x7f38ac0736c0 2024-04-25T19:22:24.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.335+0000 7f38ab400640 1 -- 172.21.15.131:0/3696440281 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3279942289 0 0) 0x7f3894003440 con 0x7f38ac0736c0 2024-04-25T19:22:24.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.335+0000 7f38ab400640 1 -- 172.21.15.131:0/3696440281 >> v2:172.21.15.195:3300/0 conn(0x7f38ac1601d0 msgr2=0x7f38ac1605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:24.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.335+0000 7f38ab400640 1 --2- 172.21.15.131:0/3696440281 >> v2:172.21.15.195:3300/0 conn(0x7f38ac1601d0 0x7f38ac1605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.335+0000 7f38ab400640 1 -- 172.21.15.131:0/3696440281 >> v1:172.21.15.195:6789/0 conn(0x7f38ac156d20 legacy=0x7f38ac0703b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.335+0000 7f38ab400640 1 -- 172.21.15.131:0/3696440281 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ac06fbb0 con 0x7f38ac0736c0 2024-04-25T19:22:24.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.336+0000 7fc85e200640 1 Processor -- start 2024-04-25T19:22:24.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.336+0000 7fc85e200640 1 -- start start 2024-04-25T19:22:24.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.336+0000 7f38ab400640 1 -- 172.21.15.131:0/3696440281 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f3898001650 con 0x7f38ac0736c0 2024-04-25T19:22:24.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.336+0000 7f38ab400640 1 -- 172.21.15.131:0/3696440281 >> v1:172.21.15.131:6789/0 conn(0x7f38ac0736c0 legacy=0x7f38ac073ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.336+0000 7f38ab400640 1 --2- 172.21.15.131:0/3696440281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3894003ae0 0x7f3894003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.336+0000 7f38ab400640 1 --2- 172.21.15.131:0/3696440281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3894008a30 0x7f389400af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.336+0000 7f38ab400640 1 --2- 172.21.15.131:0/3696440281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f389400b7b0 0x7f389400dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.336+0000 7f38ab400640 1 -- 172.21.15.131:0/3696440281 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac06f680 con 0x7f3894008a30 2024-04-25T19:22:24.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.336+0000 7f38ab400640 1 -- 172.21.15.131:0/3696440281 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3894004660 con 0x7f3894003ae0 2024-04-25T19:22:24.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.336+0000 7f38ab400640 1 -- 172.21.15.131:0/3696440281 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3894004860 con 0x7f389400b7b0 2024-04-25T19:22:24.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.337+0000 7f38b0a00640 1 --2- 172.21.15.131:0/3696440281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3894003ae0 0x7f3894003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.337+0000 7f38b1400640 1 --2- 172.21.15.131:0/3696440281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f389400b7b0 0x7f389400dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.338+0000 7feddd600640 1 Processor -- start 2024-04-25T19:22:24.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.338+0000 7feddd600640 1 -- start start 2024-04-25T19:22:24.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.338+0000 7f38abe00640 1 --2- 172.21.15.131:0/3696440281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3894008a30 0x7f389400af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.338+0000 7f38b0a00640 1 -- 172.21.15.131:0/3696440281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f389400b7b0 msgr2=0x7f389400dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:24.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.338+0000 7f38b0a00640 1 --2- 172.21.15.131:0/3696440281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f389400b7b0 0x7f389400dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.338+0000 7f38b0a00640 1 -- 172.21.15.131:0/3696440281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3894008a30 msgr2=0x7f389400af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:24.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.338+0000 7f38b0a00640 1 --2- 172.21.15.131:0/3696440281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3894008a30 0x7f389400af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.338+0000 7f38b0a00640 1 -- 172.21.15.131:0/3696440281 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ac06fbb0 con 0x7f3894003ae0 2024-04-25T19:22:24.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.339+0000 7f38abe00640 1 --2- 172.21.15.131:0/3696440281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3894008a30 0x7f389400af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T19:22:24.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.339+0000 7fc85e200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8500e3a90 0x7fc850057bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.339+0000 7f38b1400640 1 -- 172.21.15.131:0/3696440281 reap_dead start 2024-04-25T19:22:24.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.339+0000 7fc85e200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc850058b90 0x7fc8500380e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.339+0000 7fc85e200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc8500073d0 0x7fc8500077e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.339+0000 7fc85e200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fc850057730 con 0x7fc8500073d0 2024-04-25T19:22:24.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.339+0000 7fc85e200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fc850038620 con 0x7fc850058b90 2024-04-25T19:22:24.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.339+0000 7fc85e200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc850007d20 con 0x7fc8500e3a90 2024-04-25T19:22:24.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.340+0000 7fa512c00640 1 Processor -- start 2024-04-25T19:22:24.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.340+0000 7fc85d800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc8500073d0 0x7fc8500077e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.340+0000 7fc85d800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc8500073d0 0x7fc8500077e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54166/0 (socket says 172.21.15.131:54166) 2024-04-25T19:22:24.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.340+0000 7fc85d800640 1 -- 172.21.15.131:0/106145482 learned_addr learned my addr 172.21.15.131:0/106145482 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:24.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.340+0000 7fa512c00640 1 -- start start 2024-04-25T19:22:24.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.340+0000 7f38b0a00640 1 --2- 172.21.15.131:0/3696440281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3894003ae0 0x7f3894003f70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f38a0007fd0 tx=0x7f3894003730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec23e99222eafe8f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.341+0000 7fc85ce00640 1 --2- 172.21.15.131:0/106145482 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8500e3a90 0x7fc850057bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.341+0000 7fc85d800640 1 -- 172.21.15.131:0/106145482 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8500e3a90 msgr2=0x7fc850057bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:24.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.341+0000 7fc85d800640 1 --2- 172.21.15.131:0/106145482 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8500e3a90 0x7fc850057bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.341+0000 7fc85d800640 1 -- 172.21.15.131:0/106145482 >> v2:172.21.15.195:3300/0 conn(0x7fc850058b90 msgr2=0x7fc8500380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:24.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.341+0000 7fc85d800640 1 --2- 172.21.15.131:0/106145482 >> v2:172.21.15.195:3300/0 conn(0x7fc850058b90 0x7fc8500380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.341+0000 7fc85d800640 1 -- 172.21.15.131:0/106145482 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc850056e00 con 0x7fc8500073d0 2024-04-25T19:22:24.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.341+0000 7feddd600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd80d3580 0x7fedd8158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.341+0000 7feddd600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedd80d5370 0x7fedd80b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.341+0000 7feddd600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fedd81628d0 0x7fedd8162ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.341+0000 7feddd600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fedd8164ae0 con 0x7fedd80d3580 2024-04-25T19:22:24.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.341+0000 7feddd600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fedd81433c0 con 0x7fedd80d5370 2024-04-25T19:22:24.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.341+0000 7feddd600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fedd8164c60 con 0x7fedd81628d0 2024-04-25T19:22:24.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.341+0000 7f38ab400640 1 -- 172.21.15.131:0/3696440281 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a0001460 con 0x7f3894003ae0 2024-04-25T19:22:24.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.341+0000 7f38ab400640 1 -- 172.21.15.131:0/3696440281 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a002e070 con 0x7f3894003ae0 2024-04-25T19:22:24.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.341+0000 7f38ab400640 1 -- 172.21.15.131:0/3696440281 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a002ad70 con 0x7f3894003ae0 2024-04-25T19:22:24.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.341+0000 7fedd7e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd80d3580 0x7fedd8158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.342+0000 7fedd7e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd80d3580 0x7fedd8158e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54170/0 (socket says 172.21.15.131:54170) 2024-04-25T19:22:24.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.342+0000 7fedd7e00640 1 -- 172.21.15.131:0/4189640248 learned_addr learned my addr 172.21.15.131:0/4189640248 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:24.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.342+0000 7fc85ce00640 1 --2- 172.21.15.131:0/106145482 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8500e3a90 0x7fc850057bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:24.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.342+0000 7feddcc00640 1 --2- 172.21.15.131:0/4189640248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fedd81628d0 0x7fedd8162ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.342+0000 7fedd7400640 1 --2- 172.21.15.131:0/4189640248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedd80d5370 0x7fedd80b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.342+0000 7fc85d800640 1 --2- 172.21.15.131:0/106145482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8500073d0 0x7fc8500077e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc85806b8e0 tx=0x7fc8580695d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b115634124816e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.342+0000 7fedd7e00640 1 -- 172.21.15.131:0/4189640248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fedd81628d0 msgr2=0x7fedd8162ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.342+0000 7fedd7e00640 1 --2- 172.21.15.131:0/4189640248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fedd81628d0 0x7fedd8162ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.342+0000 7fedd7e00640 1 -- 172.21.15.131:0/4189640248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedd80d5370 msgr2=0x7fedd80b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.342+0000 7fedd7e00640 1 --2- 172.21.15.131:0/4189640248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedd80d5370 0x7fedd80b56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.342+0000 7fedd7e00640 1 -- 172.21.15.131:0/4189640248 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd8163220 con 0x7fedd80d3580 2024-04-25T19:22:24.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.343+0000 7f38b1e00640 1 -- 172.21.15.131:0/3696440281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3894003ae0 msgr2=0x7f3894003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.343+0000 7f38b1e00640 1 --2- 172.21.15.131:0/3696440281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3894003ae0 0x7f3894003f70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f38a0007fd0 tx=0x7f3894003730 comp rx=0 tx=0).stop 2024-04-25T19:22:24.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.343+0000 7f38b1e00640 1 -- 172.21.15.131:0/3696440281 shutdown_connections 2024-04-25T19:22:24.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.343+0000 7f38b1e00640 1 --2- 172.21.15.131:0/3696440281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3894003ae0 0x7f3894003f70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.343+0000 7f38b1e00640 1 -- 172.21.15.131:0/3696440281 >> 172.21.15.131:0/3696440281 conn(0x7f38ac0d1f40 msgr2=0x7f38ac0d2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:24.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.343+0000 7fc857400640 1 -- 172.21.15.131:0/106145482 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8580b4070 con 0x7fc8500073d0 2024-04-25T19:22:24.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.343+0000 7fc857400640 1 -- 172.21.15.131:0/106145482 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8580a7d60 con 0x7fc8500073d0 2024-04-25T19:22:24.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.343+0000 7fc857400640 1 -- 172.21.15.131:0/106145482 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8580b4070 con 0x7fc8500073d0 2024-04-25T19:22:24.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.343+0000 7fa512c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa50c15e800 0x7fa50c0b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.343+0000 7fa512c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa50c06c5c0 0x7fa50c06c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.343+0000 7fa512c00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa50c0d2220 con 0x7fa50c15f420 2024-04-25T19:22:24.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.343+0000 7fa512c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa50c0d2df0 con 0x7fa50c15e800 2024-04-25T19:22:24.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.343+0000 7fa512c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fa50c0d24c0 con 0x7fa50c06c5c0 2024-04-25T19:22:24.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.343+0000 7f38b1e00640 1 -- 172.21.15.131:0/3696440281 shutdown_connections 2024-04-25T19:22:24.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.344+0000 7fedd7e00640 1 --2- 172.21.15.131:0/4189640248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd80d3580 0x7fedd8158e50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fedc400d5f0 tx=0x7fedc400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.344+0000 7fa50b400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa50c15e800 0x7fa50c0b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.344+0000 7fa50b400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa50c15e800 0x7fa50c0b3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54182/0 (socket says 172.21.15.131:54182) 2024-04-25T19:22:24.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.344+0000 7fa50b400640 1 -- 172.21.15.131:0/2378929882 learned_addr learned my addr 172.21.15.131:0/2378929882 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:24.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.344+0000 7fc85e200640 1 -- 172.21.15.131:0/106145482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8500073d0 msgr2=0x7fc8500077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.344+0000 7fc85e200640 1 --2- 172.21.15.131:0/106145482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8500073d0 0x7fc8500077e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc85806b8e0 tx=0x7fc8580695d0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.344+0000 7fc85e200640 1 -- 172.21.15.131:0/106145482 shutdown_connections 2024-04-25T19:22:24.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.344+0000 7fc85e200640 1 --2- 172.21.15.131:0/106145482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8500073d0 0x7fc8500077e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.344+0000 7fc85e200640 1 --2- 172.21.15.131:0/106145482 >> v2:172.21.15.195:3300/0 conn(0x7fc850058b90 0x7fc8500380e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.344+0000 7fc85e200640 1 --2- 172.21.15.131:0/106145482 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8500e3a90 0x7fc850057bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.344+0000 7fc85e200640 1 -- 172.21.15.131:0/106145482 >> 172.21.15.131:0/106145482 conn(0x7fc85003abf0 msgr2=0x7fc85003b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:24.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.345+0000 7fedcfe00640 1 -- 172.21.15.131:0/4189640248 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc40125f0 con 0x7fedd80d3580 2024-04-25T19:22:24.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.345+0000 7fedcfe00640 1 -- 172.21.15.131:0/4189640248 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc4019070 con 0x7fedd80d3580 2024-04-25T19:22:24.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.345+0000 7fedcfe00640 1 -- 172.21.15.131:0/4189640248 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc4012990 con 0x7fedd80d3580 2024-04-25T19:22:24.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.345+0000 7fc85e200640 1 -- 172.21.15.131:0/106145482 shutdown_connections 2024-04-25T19:22:24.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.345+0000 7feddd600640 1 -- 172.21.15.131:0/4189640248 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedd8157db0 con 0x7fedd80d3580 2024-04-25T19:22:24.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.345+0000 7feddd600640 1 -- 172.21.15.131:0/4189640248 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedd8158370 con 0x7fedd80d3580 2024-04-25T19:22:24.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.345+0000 7fa50b400640 1 -- 172.21.15.131:0/2378929882 >> v2:172.21.15.195:3300/0 conn(0x7fa50c06c5c0 msgr2=0x7fa50c06c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:24.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.345+0000 7fa50b400640 1 --2- 172.21.15.131:0/2378929882 >> v2:172.21.15.195:3300/0 conn(0x7fa50c06c5c0 0x7fa50c06c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.345+0000 7fa50b400640 1 -- 172.21.15.131:0/2378929882 >> v1:172.21.15.131:6789/0 conn(0x7fa50c15f420 legacy=0x7fa50c0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.345+0000 7fa50b400640 1 -- 172.21.15.131:0/2378929882 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa50c0d27a0 con 0x7fa50c15e800 2024-04-25T19:22:24.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.347+0000 7feddd600640 1 -- 172.21.15.131:0/4189640248 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fedd8069d10 con 0x7fedd80d3580 2024-04-25T19:22:24.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.344+0000 7f38b1e00640 1 -- 172.21.15.131:0/3696440281 wait complete. 2024-04-25T19:22:24.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.346+0000 7fc85e200640 1 -- 172.21.15.131:0/106145482 wait complete. 2024-04-25T19:22:24.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.347+0000 7fa50b400640 1 --2- 172.21.15.131:0/2378929882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa50c15e800 0x7fa50c0b3430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa50c06e350 tx=0x7fa4fc02a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7712f43d1eaf38c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.348+0000 7fa50aa00640 1 -- 172.21.15.131:0/2378929882 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc036070 con 0x7fa50c15e800 2024-04-25T19:22:24.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.348+0000 7fa50aa00640 1 -- 172.21.15.131:0/2378929882 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4fc031600 con 0x7fa50c15e800 2024-04-25T19:22:24.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.348+0000 7fa50aa00640 1 -- 172.21.15.131:0/2378929882 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc0319d0 con 0x7fa50c15e800 2024-04-25T19:22:24.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.348+0000 7f38b1e00640 1 Processor -- start 2024-04-25T19:22:24.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.348+0000 7f3dfc000640 1 Processor -- start 2024-04-25T19:22:24.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.349+0000 7f38b1e00640 1 -- start start 2024-04-25T19:22:24.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.349+0000 7fa512c00640 1 -- 172.21.15.131:0/2378929882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa50c15e800 msgr2=0x7fa50c0b3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.349+0000 7fa512c00640 1 --2- 172.21.15.131:0/2378929882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa50c15e800 0x7fa50c0b3430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa50c06e350 tx=0x7fa4fc02a740 comp rx=0 tx=0).stop 2024-04-25T19:22:24.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.349+0000 7f3dfc000640 1 -- start start 2024-04-25T19:22:24.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.350+0000 7fa512c00640 1 -- 172.21.15.131:0/2378929882 shutdown_connections 2024-04-25T19:22:24.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.350+0000 7fa512c00640 1 --2- 172.21.15.131:0/2378929882 >> v2:172.21.15.195:3300/0 conn(0x7fa50c06c5c0 0x7fa50c06c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.350+0000 7fa512c00640 1 --2- 172.21.15.131:0/2378929882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa50c15e800 0x7fa50c0b3430 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.350+0000 7fa512c00640 1 -- 172.21.15.131:0/2378929882 >> 172.21.15.131:0/2378929882 conn(0x7fa50c09b7d0 msgr2=0x7fa50c0b7040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:24.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.350+0000 7fa512c00640 1 -- 172.21.15.131:0/2378929882 shutdown_connections 2024-04-25T19:22:24.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.350+0000 7f5063e00640 1 Processor -- start 2024-04-25T19:22:24.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.350+0000 7f5063e00640 1 -- start start 2024-04-25T19:22:24.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.350+0000 7fa512c00640 1 -- 172.21.15.131:0/2378929882 wait complete. 2024-04-25T19:22:24.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.351+0000 7fc85e200640 1 Processor -- start 2024-04-25T19:22:24.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.351+0000 7fc85e200640 1 -- start start 2024-04-25T19:22:24.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.351+0000 7fedcfe00640 1 -- 172.21.15.131:0/4189640248 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fedc4012b30 con 0x7fedd80d3580 2024-04-25T19:22:24.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.352+0000 7f38b1e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3894003ae0 0x7f38ac0c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.352+0000 7f38b1e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f38ac0c8080 0x7f38ac0ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.352+0000 7fdf47200640 1 Processor -- start 2024-04-25T19:22:24.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.352+0000 7f38b1e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38ac0ca820 0x7f38ac0cac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.353+0000 7fdf47200640 1 -- start start 2024-04-25T19:22:24.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.353+0000 7f38b1e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac073e60 con 0x7f38ac0ca820 2024-04-25T19:22:24.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.353+0000 7f38b1e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac073ce0 con 0x7f3894003ae0 2024-04-25T19:22:24.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.353+0000 7f3dfc000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3df40b5e40 0x7f3df40b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.353+0000 7f38b1e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f38ac073fe0 con 0x7f38ac0c8080 2024-04-25T19:22:24.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.353+0000 7f38b1400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38ac0ca820 0x7f38ac0cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.353+0000 7f3dfc000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3df406c5c0 0x7f3df406c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.353+0000 7f38abe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f38ac0c8080 0x7f38ac0ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.353+0000 7f3dfc000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3df40b6790 con 0x7f3df414ad60 2024-04-25T19:22:24.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.353+0000 7f38b1400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38ac0ca820 0x7f38ac0cac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54194/0 (socket says 172.21.15.131:54194) 2024-04-25T19:22:24.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.353+0000 7f38b1400640 1 -- 172.21.15.131:0/4222107961 learned_addr learned my addr 172.21.15.131:0/4222107961 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:24.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.354+0000 7f3dfc000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3df40b4af0 con 0x7f3df40b5e40 2024-04-25T19:22:24.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.354+0000 7f3dfc000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3df40b4dd0 con 0x7f3df406c5c0 2024-04-25T19:22:24.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.354+0000 7f38b0a00640 1 --2- 172.21.15.131:0/4222107961 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3894003ae0 0x7f38ac0c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.354+0000 7f5063e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f50640b4da0 0x7f50641600e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.354+0000 7fc85e200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8500073d0 0x7fc850181880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.354+0000 7fc85e200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc850058b90 0x7fc850181dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.354+0000 7fc85e200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8500e3a90 0x7fc8500d8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.354+0000 7fc85e200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc850037d70 con 0x7fc850058b90 2024-04-25T19:22:24.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.354+0000 7fc85e200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc8500573c0 con 0x7fc8500e3a90 2024-04-25T19:22:24.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.354+0000 7fc85e200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc850053f40 con 0x7fc8500073d0 2024-04-25T19:22:24.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.354+0000 7f3df8c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3df40b5e40 0x7f3df40b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.354+0000 7f3df9600640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f3df414ad60 0x7f3df4070010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:39812/0 (socket says 172.21.15.131:39812) 2024-04-25T19:22:24.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.354+0000 7f3df9600640 1 -- 172.21.15.131:0/331976437 learned_addr learned my addr 172.21.15.131:0/331976437 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:24.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.354+0000 7f3dfa000640 1 --2- 172.21.15.131:0/331976437 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3df406c5c0 0x7f3df406c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.354+0000 7f5063e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5064160620 con 0x7f50640b7bc0 2024-04-25T19:22:24.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.354+0000 7f5063e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50640d0b30 con 0x7f50640b5260 2024-04-25T19:22:24.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.354+0000 7f5063e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f50640d4420 con 0x7f50640b4da0 2024-04-25T19:22:24.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.354+0000 7fa512c00640 1 Processor -- start 2024-04-25T19:22:24.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.354+0000 7f5063400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f50640b7bc0 0x7f50640b7fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:39816/0 (socket says 172.21.15.131:39816) 2024-04-25T19:22:24.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.354+0000 7f5062a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f50640b4da0 0x7f50641600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.354+0000 7f5063400640 1 -- 172.21.15.131:0/3107787592 learned_addr learned my addr 172.21.15.131:0/3107787592 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:24.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.354+0000 7fc857e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc850058b90 0x7fc850181dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.354+0000 7fc857e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc850058b90 0x7fc850181dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54206/0 (socket says 172.21.15.131:54206) 2024-04-25T19:22:24.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.354+0000 7fc857e00640 1 -- 172.21.15.131:0/2895088194 learned_addr learned my addr 172.21.15.131:0/2895088194 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:24.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.354+0000 7fc85ce00640 1 --2- 172.21.15.131:0/2895088194 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8500073d0 0x7fc850181880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.355+0000 7fc857e00640 1 -- 172.21.15.131:0/2895088194 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8500073d0 msgr2=0x7fc850181880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.355+0000 7fc857e00640 1 --2- 172.21.15.131:0/2895088194 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8500073d0 0x7fc850181880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.355+0000 7fc857e00640 1 -- 172.21.15.131:0/2895088194 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8500e3a90 msgr2=0x7fc8500d8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.355+0000 7fc857e00640 1 --2- 172.21.15.131:0/2895088194 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8500e3a90 0x7fc8500d8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.355+0000 7fc857e00640 1 -- 172.21.15.131:0/2895088194 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8500d7640 con 0x7fc850058b90 2024-04-25T19:22:24.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.355+0000 7fa512c00640 1 -- start start 2024-04-25T19:22:24.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.355+0000 7f3df3e00640 1 -- 172.21.15.131:0/331976437 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2272193823 0 0) 0x7f3de8001110 con 0x7f3df414ad60 2024-04-25T19:22:24.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.355+0000 7f38b1400640 1 -- 172.21.15.131:0/4222107961 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f38ac0c8080 msgr2=0x7f38ac0ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.355+0000 7f3df3e00640 1 -- 172.21.15.131:0/331976437 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ddc003520 con 0x7f3df414ad60 2024-04-25T19:22:24.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.355+0000 7f38b1400640 1 --2- 172.21.15.131:0/4222107961 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f38ac0c8080 0x7f38ac0ca2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.355+0000 7fedcfe00640 1 --2- 172.21.15.131:0/4189640248 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fedb8074580 0x7fedb8076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.355+0000 7fc857e00640 1 --2- 172.21.15.131:0/2895088194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc850058b90 0x7fc850181dc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc84400b410 tx=0x7fc84400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.355+0000 7f38b1400640 1 -- 172.21.15.131:0/4222107961 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3894003ae0 msgr2=0x7f38ac0c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.355+0000 7f38b1400640 1 --2- 172.21.15.131:0/4222107961 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3894003ae0 0x7f38ac0c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.355+0000 7f3df8c00640 1 -- 172.21.15.131:0/331976437 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3df406c5c0 msgr2=0x7f3df406c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:24.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.356+0000 7f38b1400640 1 -- 172.21.15.131:0/4222107961 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ac15d8d0 con 0x7f38ac0ca820 2024-04-25T19:22:24.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.356+0000 7f38b0a00640 1 --2- 172.21.15.131:0/4222107961 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3894003ae0 0x7f38ac0c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:24.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.355+0000 7f3df8c00640 1 --2- 172.21.15.131:0/331976437 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3df406c5c0 0x7f3df406c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.355+0000 7f3df8c00640 1 -- 172.21.15.131:0/331976437 >> v1:172.21.15.131:6789/0 conn(0x7f3df414ad60 legacy=0x7f3df4070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.356+0000 7f3df8c00640 1 -- 172.21.15.131:0/331976437 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df40b50b0 con 0x7f3df40b5e40 2024-04-25T19:22:24.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.356+0000 7fc854c00640 1 -- 172.21.15.131:0/2895088194 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc844015020 con 0x7fc850058b90 2024-04-25T19:22:24.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.356+0000 7fc854c00640 1 -- 172.21.15.131:0/2895088194 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc844011850 con 0x7fc850058b90 2024-04-25T19:22:24.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.356+0000 7fc854c00640 1 -- 172.21.15.131:0/2895088194 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc844011c40 con 0x7fc850058b90 2024-04-25T19:22:24.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.356+0000 7f38b1400640 1 --2- 172.21.15.131:0/4222107961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38ac0ca820 0x7f38ac0cac30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f38ac0b1950 tx=0x7f38a400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.355+0000 7f5062a00640 1 -- 172.21.15.131:0/3107787592 >> v1:172.21.15.195:6789/0 conn(0x7f50640b5260 legacy=0x7f50640b9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:24.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.355+0000 7f5062a00640 1 -- 172.21.15.131:0/3107787592 >> v1:172.21.15.131:6789/0 conn(0x7f50640b7bc0 legacy=0x7f50640b7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:24.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.356+0000 7f5062a00640 1 -- 172.21.15.131:0/3107787592 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50640d4700 con 0x7f50640b4da0 2024-04-25T19:22:24.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.357+0000 7fdf47200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf48156d20 0x7fdf480703b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.357+0000 7fdf47200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdf480736c0 0x7fdf48073ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.357+0000 7fdf47200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdf481601d0 0x7fdf481605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.357+0000 7fc85e200640 1 -- 172.21.15.131:0/2895088194 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8500d7920 con 0x7fc850058b90 2024-04-25T19:22:24.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.357+0000 7fdf47200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fdf4806f680 con 0x7fdf481601d0 2024-04-25T19:22:24.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.357+0000 7fdf47200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fdf4806ff20 con 0x7fdf480736c0 2024-04-25T19:22:24.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.357+0000 7fdf47200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdf48074010 con 0x7fdf48156d20 2024-04-25T19:22:24.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.356+0000 7fedcfe00640 1 -- 172.21.15.131:0/4189640248 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fedc4096010 con 0x7fedd80d3580 2024-04-25T19:22:24.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.357+0000 7fedcfe00640 1 --2- 172.21.15.131:0/4189640248 >> [v2:172.21.15.131:6822/182543209,v1:172.21.15.131:6824/182543209] conn(0x7fedb807c850 0x7fedb807eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.357+0000 7fedcfe00640 1 -- 172.21.15.131:0/4189640248 --> [v2:172.21.15.131:6822/182543209,v1:172.21.15.131:6824/182543209] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fedc4001d30 con 0x7fedb807c850 2024-04-25T19:22:24.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.357+0000 7fedcfe00640 1 -- 172.21.15.131:0/4189640248 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fedc4096400 con 0x7fedd80d3580 2024-04-25T19:22:24.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.357+0000 7fedd7400640 1 --2- 172.21.15.131:0/4189640248 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fedb8074580 0x7fedb8076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.357+0000 7f38a8c00640 1 -- 172.21.15.131:0/4222107961 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a400d040 con 0x7f38ac0ca820 2024-04-25T19:22:24.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.357+0000 7f38a8c00640 1 -- 172.21.15.131:0/4222107961 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a4018070 con 0x7f38ac0ca820 2024-04-25T19:22:24.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.357+0000 7f38a8c00640 1 -- 172.21.15.131:0/4222107961 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a400aae0 con 0x7f38ac0ca820 2024-04-25T19:22:24.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.358+0000 7fc85e200640 1 -- 172.21.15.131:0/2895088194 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8500d7ee0 con 0x7fc850058b90 2024-04-25T19:22:24.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.357+0000 7f38b1e00640 1 -- 172.21.15.131:0/4222107961 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38ac0c9240 con 0x7f38ac0ca820 2024-04-25T19:22:24.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.358+0000 7f38b1e00640 1 -- 172.21.15.131:0/4222107961 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38ac0c9800 con 0x7f38ac0ca820 2024-04-25T19:22:24.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.357+0000 7fdf45e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf48156d20 0x7fdf480703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.357+0000 7fdf46800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdf481601d0 0x7fdf481605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.358+0000 7fdf45e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf48156d20 0x7fdf480703b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.131:38102/0 (socket says 172.21.15.131:38102) 2024-04-25T19:22:24.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.358+0000 7fdf45e00640 1 -- 172.21.15.131:0/2778769923 learned_addr learned my addr 172.21.15.131:0/2778769923 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:24.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.358+0000 7feddcc00640 1 --2- 172.21.15.131:0/4189640248 >> [v2:172.21.15.131:6822/182543209,v1:172.21.15.131:6824/182543209] conn(0x7fedb807c850 0x7fedb807eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.358+0000 7f3df8c00640 1 --2- 172.21.15.131:0/331976437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3df40b5e40 0x7f3df40b6250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3de00097a0 tx=0x7f3de002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bec4b5f7ce00666 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.358+0000 7f5062a00640 1 --2- 172.21.15.131:0/3107787592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50640b4da0 0x7f50641600e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f50540097a0 tx=0x7f505402a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=237ccd5b1f299501 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.358+0000 7fdf46800640 1 -- 172.21.15.131:0/2778769923 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf48156d20 msgr2=0x7fdf480703b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:24.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.358+0000 7fdf46800640 1 --2- 172.21.15.131:0/2778769923 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf48156d20 0x7fdf480703b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.358+0000 7fdf46800640 1 -- 172.21.15.131:0/2778769923 >> v2:172.21.15.195:3300/0 conn(0x7fdf480736c0 msgr2=0x7fdf48073ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T19:22:24.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.358+0000 7fdf46800640 1 --2- 172.21.15.131:0/2778769923 >> v2:172.21.15.195:3300/0 conn(0x7fdf480736c0 0x7fdf48073ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.358+0000 7fdf46800640 1 -- 172.21.15.131:0/2778769923 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf48160f40 con 0x7fdf481601d0 2024-04-25T19:22:24.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.358+0000 7f5061600640 1 -- 172.21.15.131:0/3107787592 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5054037070 con 0x7f50640b4da0 2024-04-25T19:22:24.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.359+0000 7fedd7400640 1 --2- 172.21.15.131:0/4189640248 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fedb8074580 0x7fedb8076a90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fedc8006fd0 tx=0x7fedc8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.359+0000 7f5061600640 1 -- 172.21.15.131:0/3107787592 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f505402ad90 con 0x7f50640b4da0 2024-04-25T19:22:24.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.359+0000 7f5061600640 1 -- 172.21.15.131:0/3107787592 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5054032660 con 0x7f50640b4da0 2024-04-25T19:22:24.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.359+0000 7fa512c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa50c06c5c0 0x7fa50c0c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.359+0000 7feddcc00640 1 --2- 172.21.15.131:0/4189640248 >> [v2:172.21.15.131:6822/182543209,v1:172.21.15.131:6824/182543209] conn(0x7fedb807c850 0x7fedb807eca0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.359+0000 7fc85e200640 1 -- 172.21.15.131:0/2895088194 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc850005570 con 0x7fc850058b90 2024-04-25T19:22:24.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.360+0000 7fa512c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa50c15e800 0x7fa50c152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.360+0000 7fa512c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa50c15f420 0x7fa50c0ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.360+0000 7fa50be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa50c06c5c0 0x7fa50c0c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.360+0000 7fa512c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa50c0b3af0 con 0x7fa50c06c5c0 2024-04-25T19:22:24.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.360+0000 7fa512c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa50c0b3970 con 0x7fa50c15e800 2024-04-25T19:22:24.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.360+0000 7fa512c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa50c0b7750 con 0x7fa50c15f420 2024-04-25T19:22:24.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.359+0000 7f3df3e00640 1 -- 172.21.15.131:0/331976437 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de0037070 con 0x7f3df40b5e40 2024-04-25T19:22:24.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.359+0000 7f3df3e00640 1 -- 172.21.15.131:0/331976437 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3de0032440 con 0x7f3df40b5e40 2024-04-25T19:22:24.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.359+0000 7f3df3e00640 1 -- 172.21.15.131:0/331976437 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de00327f0 con 0x7f3df40b5e40 2024-04-25T19:22:24.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.359+0000 7f38b1e00640 1 -- 172.21.15.131:0/4222107961 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f38ac0c9ec0 con 0x7f38ac0ca820 2024-04-25T19:22:24.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.360+0000 7fa50be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa50c06c5c0 0x7fa50c0c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54222/0 (socket says 172.21.15.131:54222) 2024-04-25T19:22:24.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.360+0000 7fa50be00640 1 -- 172.21.15.131:0/340867757 learned_addr learned my addr 172.21.15.131:0/340867757 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:24.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.360+0000 7f5063e00640 1 -- 172.21.15.131:0/3107787592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50640b4da0 msgr2=0x7f50641600e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.360+0000 7f5063e00640 1 --2- 172.21.15.131:0/3107787592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50640b4da0 0x7f50641600e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f50540097a0 tx=0x7f505402a080 comp rx=0 tx=0).stop 2024-04-25T19:22:24.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.360+0000 7fa50b400640 1 --2- 172.21.15.131:0/340867757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa50c15e800 0x7fa50c152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.360+0000 7fa510c00640 1 --2- 172.21.15.131:0/340867757 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa50c15f420 0x7fa50c0ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.361+0000 7fa50be00640 1 -- 172.21.15.131:0/340867757 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa50c15f420 msgr2=0x7fa50c0ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.361+0000 7fa50be00640 1 --2- 172.21.15.131:0/340867757 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa50c15f420 0x7fa50c0ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.361+0000 7fa50be00640 1 -- 172.21.15.131:0/340867757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa50c15e800 msgr2=0x7fa50c152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.361+0000 7fa50be00640 1 --2- 172.21.15.131:0/340867757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa50c15e800 0x7fa50c152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.361+0000 7fa50be00640 1 -- 172.21.15.131:0/340867757 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa50c0ca1b0 con 0x7fa50c06c5c0 2024-04-25T19:22:24.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.361+0000 7fedcfe00640 1 -- 172.21.15.131:0/4189640248 <== osd.0 v2:172.21.15.131:6822/182543209 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fedc4001d30 con 0x7fedb807c850 2024-04-25T19:22:24.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.361+0000 7f5063e00640 1 -- 172.21.15.131:0/3107787592 shutdown_connections 2024-04-25T19:22:24.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.361+0000 7f5063e00640 1 --2- 172.21.15.131:0/3107787592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50640b4da0 0x7f50641600e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.361+0000 7fa50be00640 1 --2- 172.21.15.131:0/340867757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa50c06c5c0 0x7fa50c0c8250 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400c3c0 tx=0x7fa4f400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.361+0000 7f5063e00640 1 -- 172.21.15.131:0/3107787592 >> 172.21.15.131:0/3107787592 conn(0x7f50640d2bd0 msgr2=0x7f50640d2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:24.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.361+0000 7f3dfc000640 1 -- 172.21.15.131:0/331976437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3df40b5e40 msgr2=0x7f3df40b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.361+0000 7f3dfc000640 1 --2- 172.21.15.131:0/331976437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3df40b5e40 0x7f3df40b6250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3de00097a0 tx=0x7f3de002a180 comp rx=0 tx=0).stop 2024-04-25T19:22:24.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.361+0000 7fdf46800640 1 --2- 172.21.15.131:0/2778769923 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf481601d0 0x7fdf481605e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdf480d2ed0 tx=0x7fdf3002e390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152d2e3cbdb8ec02 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.362+0000 7fa503e00640 1 -- 172.21.15.131:0/340867757 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4017070 con 0x7fa50c06c5c0 2024-04-25T19:22:24.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.362+0000 7f3dfc000640 1 -- 172.21.15.131:0/331976437 shutdown_connections 2024-04-25T19:22:24.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.362+0000 7f3dfc000640 1 --2- 172.21.15.131:0/331976437 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3df406c5c0 0x7f3df406c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.362+0000 7f3dfc000640 1 --2- 172.21.15.131:0/331976437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3df40b5e40 0x7f3df40b6250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.362+0000 7f3dfc000640 1 -- 172.21.15.131:0/331976437 >> 172.21.15.131:0/331976437 conn(0x7f3df40d1ae0 msgr2=0x7f3df40d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:24.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.362+0000 7fdf44a00640 1 -- 172.21.15.131:0/2778769923 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3000d2d0 con 0x7fdf481601d0 2024-04-25T19:22:24.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.362+0000 7fa503e00640 1 -- 172.21.15.131:0/340867757 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f40052d0 con 0x7fa50c06c5c0 2024-04-25T19:22:24.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.362+0000 7fa503e00640 1 -- 172.21.15.131:0/340867757 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4017070 con 0x7fa50c06c5c0 2024-04-25T19:22:24.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.362+0000 7fa512c00640 1 -- 172.21.15.131:0/340867757 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa50c0ca490 con 0x7fa50c06c5c0 2024-04-25T19:22:24.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.362+0000 7fa512c00640 1 -- 172.21.15.131:0/340867757 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa50c0caa50 con 0x7fa50c06c5c0 2024-04-25T19:22:24.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.363+0000 7f5063e00640 1 -- 172.21.15.131:0/3107787592 shutdown_connections 2024-04-25T19:22:24.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.363+0000 7fc854c00640 1 -- 172.21.15.131:0/2895088194 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc844018020 con 0x7fc850058b90 2024-04-25T19:22:24.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.362+0000 7fdf44a00640 1 -- 172.21.15.131:0/2778769923 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf3000b450 con 0x7fdf481601d0 2024-04-25T19:22:24.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.362+0000 7fdf44a00640 1 -- 172.21.15.131:0/2778769923 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3000b820 con 0x7fdf481601d0 2024-04-25T19:22:24.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.364+0000 7fdf47200640 1 -- 172.21.15.131:0/2778769923 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf481601d0 msgr2=0x7fdf481605e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.364+0000 7fdf47200640 1 --2- 172.21.15.131:0/2778769923 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf481601d0 0x7fdf481605e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdf480d2ed0 tx=0x7fdf3002e390 comp rx=0 tx=0).stop 2024-04-25T19:22:24.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.364+0000 7f3dfc000640 1 -- 172.21.15.131:0/331976437 shutdown_connections 2024-04-25T19:22:24.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.364+0000 7f3dfc000640 1 -- 172.21.15.131:0/331976437 wait complete. 2024-04-25T19:22:24.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.364+0000 7fdf47200640 1 -- 172.21.15.131:0/2778769923 shutdown_connections 2024-04-25T19:22:24.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.364+0000 7fdf47200640 1 --2- 172.21.15.131:0/2778769923 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf481601d0 0x7fdf481605e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.364+0000 7fdf47200640 1 --2- 172.21.15.131:0/2778769923 >> v2:172.21.15.195:3300/0 conn(0x7fdf480736c0 0x7fdf48073ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.364+0000 7fdf47200640 1 --2- 172.21.15.131:0/2778769923 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf48156d20 0x7fdf480703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.364+0000 7fdf47200640 1 -- 172.21.15.131:0/2778769923 >> 172.21.15.131:0/2778769923 conn(0x7fdf480d1f40 msgr2=0x7fdf480d2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:24.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.364+0000 7fa512c00640 1 -- 172.21.15.131:0/340867757 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa50c050740 con 0x7fa50c06c5c0 2024-04-25T19:22:24.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.365+0000 7fdf47200640 1 -- 172.21.15.131:0/2778769923 shutdown_connections 2024-04-25T19:22:24.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.365+0000 7fc854c00640 1 --2- 172.21.15.131:0/2895088194 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc8380744b0 0x7fc8380769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.366+0000 7fc854c00640 1 -- 172.21.15.131:0/2895088194 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc844095210 con 0x7fc850058b90 2024-04-25T19:22:24.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.366+0000 7fc854c00640 1 --2- 172.21.15.131:0/2895088194 >> [v2:172.21.15.131:6800/1135187016,v1:172.21.15.131:6801/1135187016] conn(0x7fc83807c700 0x7fc83807eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.366+0000 7fc854c00640 1 -- 172.21.15.131:0/2895088194 --> [v2:172.21.15.131:6800/1135187016,v1:172.21.15.131:6801/1135187016] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc84400de50 con 0x7fc83807c700 2024-04-25T19:22:24.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.366+0000 7fc854c00640 1 -- 172.21.15.131:0/2895088194 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc84409c050 con 0x7fc850058b90 2024-04-25T19:22:24.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.365+0000 7f38a8c00640 1 -- 172.21.15.131:0/4222107961 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f38a400ac80 con 0x7f38ac0ca820 2024-04-25T19:22:24.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.366+0000 7f38a8c00640 1 --2- 172.21.15.131:0/4222107961 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f388c074580 0x7f388c076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.366+0000 7f38a8c00640 1 -- 172.21.15.131:0/4222107961 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f38a40959b0 con 0x7f38ac0ca820 2024-04-25T19:22:24.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.366+0000 7f38a8c00640 1 --2- 172.21.15.131:0/4222107961 >> [v2:172.21.15.131:6808/2785914367,v1:172.21.15.131:6809/2785914367] conn(0x7f388c07c850 0x7f388c07eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.366+0000 7f38a8c00640 1 -- 172.21.15.131:0/4222107961 --> [v2:172.21.15.131:6808/2785914367,v1:172.21.15.131:6809/2785914367] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f38a4008e50 con 0x7f388c07c850 2024-04-25T19:22:24.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.366+0000 7f38a8c00640 1 -- 172.21.15.131:0/4222107961 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f38a4095da0 con 0x7f38ac0ca820 2024-04-25T19:22:24.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.366+0000 7fdf47200640 1 -- 172.21.15.131:0/2778769923 wait complete. 2024-04-25T19:22:24.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.367+0000 7f38b0a00640 1 --2- 172.21.15.131:0/4222107961 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f388c074580 0x7f388c076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.367+0000 7f38abe00640 1 --2- 172.21.15.131:0/4222107961 >> [v2:172.21.15.131:6808/2785914367,v1:172.21.15.131:6809/2785914367] conn(0x7f388c07c850 0x7f388c07eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.366+0000 7fc85ce00640 1 --2- 172.21.15.131:0/2895088194 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc8380744b0 0x7fc8380769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.367+0000 7fc85d800640 1 --2- 172.21.15.131:0/2895088194 >> [v2:172.21.15.131:6800/1135187016,v1:172.21.15.131:6801/1135187016] conn(0x7fc83807c700 0x7fc83807eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.368+0000 7f3dfc000640 1 Processor -- start 2024-04-25T19:22:24.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.368+0000 7f3dfc000640 1 -- start start 2024-04-25T19:22:24.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.363+0000 7f5063e00640 1 -- 172.21.15.131:0/3107787592 wait complete. 2024-04-25T19:22:24.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.368+0000 7f5063e00640 1 Processor -- start 2024-04-25T19:22:24.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.368+0000 7f5063e00640 1 -- start start 2024-04-25T19:22:24.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.366+0000 7fa503e00640 1 -- 172.21.15.131:0/340867757 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa4f401a070 con 0x7fa50c06c5c0 2024-04-25T19:22:24.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.368+0000 7fa503e00640 1 --2- 172.21.15.131:0/340867757 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa4e80746b0 0x7fa4e8076bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.368+0000 7fa503e00640 1 -- 172.21.15.131:0/340867757 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa4f40947f0 con 0x7fa50c06c5c0 2024-04-25T19:22:24.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.368+0000 7fa503e00640 1 --2- 172.21.15.131:0/340867757 >> [v2:172.21.15.131:6816/2154643557,v1:172.21.15.131:6817/2154643557] conn(0x7fa4e807c8a0 0x7fa4e807ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.368+0000 7fa503e00640 1 -- 172.21.15.131:0/340867757 --> [v2:172.21.15.131:6816/2154643557,v1:172.21.15.131:6817/2154643557] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa4e807f3c0 con 0x7fa4e807c8a0 2024-04-25T19:22:24.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.368+0000 7fa503e00640 1 -- 172.21.15.131:0/340867757 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa4f4094c80 con 0x7fa50c06c5c0 2024-04-25T19:22:24.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.368+0000 7fa50b400640 1 --2- 172.21.15.131:0/340867757 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa4e80746b0 0x7fa4e8076bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.369+0000 7f38abe00640 1 --2- 172.21.15.131:0/4222107961 >> [v2:172.21.15.131:6808/2785914367,v1:172.21.15.131:6809/2785914367] conn(0x7f388c07c850 0x7f388c07eca0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.370+0000 7fa510c00640 1 --2- 172.21.15.131:0/340867757 >> [v2:172.21.15.131:6816/2154643557,v1:172.21.15.131:6817/2154643557] conn(0x7fa4e807c8a0 0x7fa4e807ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.370+0000 7fdf47200640 1 Processor -- start 2024-04-25T19:22:24.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.370+0000 7f2a74800640 1 Processor -- start 2024-04-25T19:22:24.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.370+0000 7f38b0a00640 1 --2- 172.21.15.131:0/4222107961 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f388c074580 0x7f388c076a90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f38a0032000 tx=0x7f38a0007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.370+0000 7fa50b400640 1 --2- 172.21.15.131:0/340867757 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa4e80746b0 0x7fa4e8076bc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc033000 tx=0x7fa4fc009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.370+0000 7f2a74800640 1 -- start start 2024-04-25T19:22:24.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.371+0000 7f5063e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50640b4da0 0x7f5064202760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.371+0000 7fa510c00640 1 --2- 172.21.15.131:0/340867757 >> [v2:172.21.15.131:6816/2154643557,v1:172.21.15.131:6817/2154643557] conn(0x7fa4e807c8a0 0x7fa4e807ecf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.371+0000 7f5063e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50640b5260 0x7f50640730f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.371+0000 7f3dfc000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3df406c5c0 0x7f3df4157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.371+0000 7f5063e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50640b7bc0 0x7f50640cf260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.372+0000 7f3dfc000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3df40b5e40 0x7f3df4164c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.372+0000 7f5063e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f50640d0750 con 0x7f50640b5260 2024-04-25T19:22:24.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.372+0000 7f5063e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f50640d4cc0 con 0x7f50640b4da0 2024-04-25T19:22:24.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.372+0000 7f5063e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f50640d08d0 con 0x7f50640b7bc0 2024-04-25T19:22:24.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.368+0000 7fc85d800640 1 --2- 172.21.15.131:0/2895088194 >> [v2:172.21.15.131:6800/1135187016,v1:172.21.15.131:6801/1135187016] conn(0x7fc83807c700 0x7fc83807eb50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.371+0000 7fc854c00640 1 -- 172.21.15.131:0/2895088194 <== osd.2 v2:172.21.15.131:6800/1135187016 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc84400de50 con 0x7fc83807c700 2024-04-25T19:22:24.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.372+0000 7f3dfc000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3df414ad60 0x7f3df4165170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.372+0000 7f3dfc000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3df406fb80 con 0x7f3df406c5c0 2024-04-25T19:22:24.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.372+0000 7f3dfc000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3df40b5670 con 0x7f3df40b5e40 2024-04-25T19:22:24.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.372+0000 7f5063400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50640b7bc0 0x7f50640cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.372+0000 7f3dfc000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3df406fd00 con 0x7f3df414ad60 2024-04-25T19:22:24.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.372+0000 7f5063400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50640b7bc0 0x7f50640cf260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.131:38126/0 (socket says 172.21.15.131:38126) 2024-04-25T19:22:24.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.370+0000 7fdf47200640 1 -- start start 2024-04-25T19:22:24.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.372+0000 7f5063400640 1 -- 172.21.15.131:0/1073893225 learned_addr learned my addr 172.21.15.131:0/1073893225 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:24.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.373+0000 7fa503e00640 1 -- 172.21.15.131:0/340867757 <== osd.3 v2:172.21.15.131:6816/2154643557 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa4e807f3c0 con 0x7fa4e807c8a0 2024-04-25T19:22:24.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.373+0000 7f5062000640 1 --2- 172.21.15.131:0/1073893225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50640b5260 0x7f50640730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.373+0000 7f5062a00640 1 --2- 172.21.15.131:0/1073893225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50640b4da0 0x7f5064202760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.373+0000 7f3dfa000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3df414ad60 0x7f3df4165170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.373+0000 7fdf47200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf480736c0 0x7fdf48153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.373+0000 7f3df9600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3df406c5c0 0x7f3df4157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.373+0000 7f3dfa000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3df414ad60 0x7f3df4165170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.131:38140/0 (socket says 172.21.15.131:38140) 2024-04-25T19:22:24.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.373+0000 7f3dfa000640 1 -- 172.21.15.131:0/4047875323 learned_addr learned my addr 172.21.15.131:0/4047875323 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:24.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.373+0000 7f3df8c00640 1 --2- 172.21.15.131:0/4047875323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3df40b5e40 0x7f3df4164c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.373+0000 7fdf47200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf48156d20 0x7fdf480c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.373+0000 7fdf47200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf481601d0 0x7fdf481fab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.373+0000 7fdf47200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdf480708f0 con 0x7fdf481601d0 2024-04-25T19:22:24.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.373+0000 7fdf47200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4806fbb0 con 0x7fdf48156d20 2024-04-25T19:22:24.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.373+0000 7fdf47200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdf48160b20 con 0x7fdf480736c0 2024-04-25T19:22:24.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.374+0000 7fc85ce00640 1 --2- 172.21.15.131:0/2895088194 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc8380744b0 0x7fc8380769c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc850055b50 tx=0x7fc84c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.374+0000 7f2a74800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a6c0d4130 0x7f2a6c0d1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.374+0000 7f2a74800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2a6c06dcf0 0x7f2a6c0d22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.371+0000 7f38a8c00640 1 -- 172.21.15.131:0/4222107961 <== osd.1 v2:172.21.15.131:6808/2785914367 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f38a4008e50 con 0x7f388c07c850 2024-04-25T19:22:24.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.374+0000 7f2a74800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a6c0b3c10 con 0x7f2a6c06d8e0 2024-04-25T19:22:24.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.374+0000 7f2a74800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f2a6c0b9520 con 0x7f2a6c06dcf0 2024-04-25T19:22:24.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.374+0000 7f2a74800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2a6c0b4820 con 0x7f2a6c0d4130 2024-04-25T19:22:24.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.374+0000 7f5062000640 1 -- 172.21.15.131:0/1073893225 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50640b7bc0 msgr2=0x7f50640cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.374+0000 7f5062000640 1 --2- 172.21.15.131:0/1073893225 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50640b7bc0 0x7f50640cf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.374+0000 7f5062000640 1 -- 172.21.15.131:0/1073893225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50640b4da0 msgr2=0x7f5064202760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.374+0000 7f5062000640 1 --2- 172.21.15.131:0/1073893225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50640b4da0 0x7f5064202760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.374+0000 7f5062000640 1 -- 172.21.15.131:0/1073893225 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f506415cf90 con 0x7f50640b5260 2024-04-25T19:22:24.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.375+0000 7f3dfa000640 1 -- 172.21.15.131:0/4047875323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3df40b5e40 msgr2=0x7f3df4164c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.375+0000 7fdf45e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf480736c0 0x7fdf48153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.375+0000 7fdf46800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf481601d0 0x7fdf481fab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.375+0000 7fdf46800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf481601d0 0x7fdf481fab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54254/0 (socket says 172.21.15.131:54254) 2024-04-25T19:22:24.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.375+0000 7fdf46800640 1 -- 172.21.15.131:0/3522308790 learned_addr learned my addr 172.21.15.131:0/3522308790 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:24.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.375+0000 7f3dfa000640 1 --2- 172.21.15.131:0/4047875323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3df40b5e40 0x7f3df4164c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.375+0000 7f3dfa000640 1 -- 172.21.15.131:0/4047875323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3df406c5c0 msgr2=0x7f3df4157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.375+0000 7f2a71400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a6c0d4130 0x7f2a6c0d1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.375+0000 7f2a71e00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f2a6c06d8e0 0x7f2a6c0d3a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.131:43950/0 (socket says 172.21.15.131:43950) 2024-04-25T19:22:24.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.375+0000 7f2a71e00640 1 -- 172.21.15.131:0/114182507 learned_addr learned my addr 172.21.15.131:0/114182507 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:24.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.375+0000 7f3dfa000640 1 --2- 172.21.15.131:0/4047875323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3df406c5c0 0x7f3df4157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.375+0000 7f3dfa000640 1 -- 172.21.15.131:0/4047875323 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df4155420 con 0x7f3df414ad60 2024-04-25T19:22:24.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.375+0000 7f3df9600640 1 --2- 172.21.15.131:0/4047875323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3df406c5c0 0x7f3df4157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T19:22:24.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.375+0000 7fdf45400640 1 --2- 172.21.15.131:0/3522308790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf48156d20 0x7fdf480c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.376+0000 7f2a72800640 1 --2- 172.21.15.131:0/114182507 >> v2:172.21.15.195:3300/0 conn(0x7f2a6c06dcf0 0x7f2a6c0d22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.376+0000 7f3dfa000640 1 --2- 172.21.15.131:0/4047875323 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3df414ad60 0x7f3df4165170 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3dec009d30 tx=0x7f3dec00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.376+0000 7f2a71400640 1 -- 172.21.15.131:0/114182507 >> v2:172.21.15.195:3300/0 conn(0x7f2a6c06dcf0 msgr2=0x7f2a6c0d22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:24.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.376+0000 7f2a71400640 1 --2- 172.21.15.131:0/114182507 >> v2:172.21.15.195:3300/0 conn(0x7f2a6c06dcf0 0x7f2a6c0d22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.376+0000 7f2a71400640 1 -- 172.21.15.131:0/114182507 >> v1:172.21.15.195:6789/0 conn(0x7f2a6c06d8e0 legacy=0x7f2a6c0d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.376+0000 7f2a71400640 1 -- 172.21.15.131:0/114182507 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a6c0b3ef0 con 0x7f2a6c0d4130 2024-04-25T19:22:24.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.376+0000 7f3df1600640 1 -- 172.21.15.131:0/4047875323 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec018020 con 0x7f3df414ad60 2024-04-25T19:22:24.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.376+0000 7f3df1600640 1 -- 172.21.15.131:0/4047875323 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dec014480 con 0x7f3df414ad60 2024-04-25T19:22:24.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.376+0000 7f3df1600640 1 -- 172.21.15.131:0/4047875323 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec014870 con 0x7f3df414ad60 2024-04-25T19:22:24.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.376+0000 7fdf46800640 1 -- 172.21.15.131:0/3522308790 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf480736c0 msgr2=0x7fdf48153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.377+0000 7fdf46800640 1 --2- 172.21.15.131:0/3522308790 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf480736c0 0x7fdf48153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.377+0000 7fdf46800640 1 -- 172.21.15.131:0/3522308790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf48156d20 msgr2=0x7fdf480c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.377+0000 7fdf46800640 1 --2- 172.21.15.131:0/3522308790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf48156d20 0x7fdf480c5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.377+0000 7fdf46800640 1 -- 172.21.15.131:0/3522308790 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf480b4b60 con 0x7fdf481601d0 2024-04-25T19:22:24.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.377+0000 7fdf45e00640 1 --2- 172.21.15.131:0/3522308790 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf480736c0 0x7fdf48153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T19:22:24.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.377+0000 7fdf46800640 1 --2- 172.21.15.131:0/3522308790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf481601d0 0x7fdf481fab70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdf3000dcb0 tx=0x7fdf300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.377+0000 7f3dfc000640 1 -- 172.21.15.131:0/4047875323 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3df4155700 con 0x7f3df414ad60 2024-04-25T19:22:24.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.378+0000 7f3dfc000640 1 -- 172.21.15.131:0/4047875323 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3df4155cc0 con 0x7f3df414ad60 2024-04-25T19:22:24.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.376+0000 7f5062000640 1 --2- 172.21.15.131:0/1073893225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50640b5260 0x7f50640730f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f50640b8900 tx=0x7f505000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.377+0000 7f505aa00640 1 -- 172.21.15.131:0/1073893225 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5050015020 con 0x7f50640b5260 2024-04-25T19:22:24.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.377+0000 7f5063e00640 1 -- 172.21.15.131:0/1073893225 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5064202ca0 con 0x7f50640b5260 2024-04-25T19:22:24.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.377+0000 7f5063e00640 1 -- 172.21.15.131:0/1073893225 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f506415d530 con 0x7f50640b5260 2024-04-25T19:22:24.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.377+0000 7f505aa00640 1 -- 172.21.15.131:0/1073893225 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5050011830 con 0x7f50640b5260 2024-04-25T19:22:24.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.377+0000 7f505aa00640 1 -- 172.21.15.131:0/1073893225 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5050011c20 con 0x7f50640b5260 2024-04-25T19:22:24.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.378+0000 7fdf3e000640 1 -- 172.21.15.131:0/3522308790 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3003f630 con 0x7fdf481601d0 2024-04-25T19:22:24.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.378+0000 7fdf3e000640 1 -- 172.21.15.131:0/3522308790 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf3003f7d0 con 0x7fdf481601d0 2024-04-25T19:22:24.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.378+0000 7fdf3e000640 1 -- 172.21.15.131:0/3522308790 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3003fb80 con 0x7fdf481601d0 2024-04-25T19:22:24.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.378+0000 7f5063e00640 1 -- 172.21.15.131:0/1073893225 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5064073630 con 0x7f50640b5260 2024-04-25T19:22:24.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.380+0000 7fdf47200640 1 -- 172.21.15.131:0/3522308790 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf48153b50 con 0x7fdf481601d0 2024-04-25T19:22:24.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.380+0000 7fdf47200640 1 -- 172.21.15.131:0/3522308790 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf481fb980 con 0x7fdf481601d0 2024-04-25T19:22:24.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.381+0000 7fdf47200640 1 -- 172.21.15.131:0/3522308790 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdf480b7e40 con 0x7fdf481601d0 2024-04-25T19:22:24.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.381+0000 7f505aa00640 1 -- 172.21.15.131:0/1073893225 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5050018020 con 0x7f50640b5260 2024-04-25T19:22:24.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.382+0000 7f3dfc000640 1 -- 172.21.15.131:0/4047875323 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3df41582e0 con 0x7f3df414ad60 2024-04-25T19:22:24.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.380+0000 7f2a71400640 1 --2- 172.21.15.131:0/114182507 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a6c0d4130 0x7f2a6c0d1d60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2a68009d90 tx=0x7f2a6802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe57809e4c202058 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.381+0000 7f2a70a00640 1 -- 172.21.15.131:0/114182507 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a68031600 con 0x7f2a6c0d4130 2024-04-25T19:22:24.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.381+0000 7f2a70a00640 1 -- 172.21.15.131:0/114182507 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a680317a0 con 0x7f2a6c0d4130 2024-04-25T19:22:24.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.381+0000 7f2a70a00640 1 -- 172.21.15.131:0/114182507 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a68031b70 con 0x7f2a6c0d4130 2024-04-25T19:22:24.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.382+0000 7f2a74800640 1 -- 172.21.15.131:0/114182507 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a6c0d4130 msgr2=0x7f2a6c0d1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.383+0000 7f505aa00640 1 --2- 172.21.15.131:0/1073893225 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f50440744b0 0x7f50440769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.382+0000 7f2a74800640 1 --2- 172.21.15.131:0/114182507 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a6c0d4130 0x7f2a6c0d1d60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2a68009d90 tx=0x7f2a6802a5d0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.382+0000 7f2a74800640 1 -- 172.21.15.131:0/114182507 shutdown_connections 2024-04-25T19:22:24.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.383+0000 7f505aa00640 1 -- 172.21.15.131:0/1073893225 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f50500956b0 con 0x7f50640b5260 2024-04-25T19:22:24.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.382+0000 7f2a74800640 1 --2- 172.21.15.131:0/114182507 >> v2:172.21.15.195:3300/0 conn(0x7f2a6c06dcf0 0x7f2a6c0d22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.382+0000 7f2a74800640 1 --2- 172.21.15.131:0/114182507 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a6c0d4130 0x7f2a6c0d1d60 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2a68009d90 tx=0x7f2a6802a5d0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.383+0000 7f505aa00640 1 --2- 172.21.15.131:0/1073893225 >> [v2:172.21.15.195:6824/360782693,v1:172.21.15.195:6825/360782693] conn(0x7f504407c720 0x7f504407eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.383+0000 7f505aa00640 1 -- 172.21.15.131:0/1073893225 --> [v2:172.21.15.195:6824/360782693,v1:172.21.15.195:6825/360782693] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f505001ce70 con 0x7f504407c720 2024-04-25T19:22:24.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.383+0000 7f505aa00640 1 -- 172.21.15.131:0/1073893225 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5050095aa0 con 0x7f50640b5260 2024-04-25T19:22:24.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.383+0000 7f2a74800640 1 -- 172.21.15.131:0/114182507 >> 172.21.15.131:0/114182507 conn(0x7f2a6c08d110 msgr2=0x7f2a6c08d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:24.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.383+0000 7f3df1600640 1 -- 172.21.15.131:0/4047875323 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3dec005d10 con 0x7f3df414ad60 2024-04-25T19:22:24.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.384+0000 7f5062a00640 1 --2- 172.21.15.131:0/1073893225 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f50440744b0 0x7f50440769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.384+0000 7f5063400640 1 --2- 172.21.15.131:0/1073893225 >> [v2:172.21.15.195:6824/360782693,v1:172.21.15.195:6825/360782693] conn(0x7f504407c720 0x7f504407eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.384+0000 7f3df1600640 1 --2- 172.21.15.131:0/4047875323 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3dd40744b0 0x7f3dd40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.384+0000 7f3df1600640 1 -- 172.21.15.131:0/4047875323 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3dec095c70 con 0x7f3df414ad60 2024-04-25T19:22:24.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.385+0000 7f3df1600640 1 --2- 172.21.15.131:0/4047875323 >> [v2:172.21.15.195:6800/3394326073,v1:172.21.15.195:6801/3394326073] conn(0x7f3dd407c780 0x7f3dd407ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.385+0000 7f3df1600640 1 -- 172.21.15.131:0/4047875323 --> [v2:172.21.15.195:6800/3394326073,v1:172.21.15.195:6801/3394326073] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3dec00be50 con 0x7f3dd407c780 2024-04-25T19:22:24.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.385+0000 7f3df1600640 1 -- 172.21.15.131:0/4047875323 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3dec098250 con 0x7f3df414ad60 2024-04-25T19:22:24.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.385+0000 7f3df9600640 1 --2- 172.21.15.131:0/4047875323 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3dd40744b0 0x7f3dd40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.385+0000 7f3df8c00640 1 --2- 172.21.15.131:0/4047875323 >> [v2:172.21.15.195:6800/3394326073,v1:172.21.15.195:6801/3394326073] conn(0x7f3dd407c780 0x7f3dd407ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.386+0000 7f5062a00640 1 --2- 172.21.15.131:0/1073893225 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f50440744b0 0x7f50440769c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5054034000 tx=0x7f505402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.386+0000 7fdf3e000640 1 -- 172.21.15.131:0/3522308790 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fdf300363f0 con 0x7fdf481601d0 2024-04-25T19:22:24.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.386+0000 7f5063400640 1 --2- 172.21.15.131:0/1073893225 >> [v2:172.21.15.195:6824/360782693,v1:172.21.15.195:6825/360782693] conn(0x7f504407c720 0x7f504407eb70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.385+0000 7f2a74800640 1 -- 172.21.15.131:0/114182507 shutdown_connections 2024-04-25T19:22:24.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.385+0000 7f2a74800640 1 -- 172.21.15.131:0/114182507 wait complete. 2024-04-25T19:22:24.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.386+0000 7f3df9600640 1 --2- 172.21.15.131:0/4047875323 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3dd40744b0 0x7f3dd40769c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3de8005880 tx=0x7f3de8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.387+0000 7f3df8c00640 1 --2- 172.21.15.131:0/4047875323 >> [v2:172.21.15.195:6800/3394326073,v1:172.21.15.195:6801/3394326073] conn(0x7f3dd407c780 0x7f3dd407ebd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.387+0000 7fdf3e000640 1 --2- 172.21.15.131:0/3522308790 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdf24074580 0x7fdf24076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.387+0000 7fdf3e000640 1 -- 172.21.15.131:0/3522308790 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdf300b5ae0 con 0x7fdf481601d0 2024-04-25T19:22:24.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.388+0000 7fdf3e000640 1 --2- 172.21.15.131:0/3522308790 >> [v2:172.21.15.195:6816/439683850,v1:172.21.15.195:6817/439683850] conn(0x7fdf2407c850 0x7fdf2407eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.388+0000 7fdf3e000640 1 -- 172.21.15.131:0/3522308790 --> [v2:172.21.15.195:6816/439683850,v1:172.21.15.195:6817/439683850] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf2407f370 con 0x7fdf2407c850 2024-04-25T19:22:24.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.388+0000 7fdf3e000640 1 -- 172.21.15.131:0/3522308790 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fdf300b5ed0 con 0x7fdf481601d0 2024-04-25T19:22:24.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.388+0000 7fdf45e00640 1 --2- 172.21.15.131:0/3522308790 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdf24074580 0x7fdf24076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.388+0000 7fdf45400640 1 --2- 172.21.15.131:0/3522308790 >> [v2:172.21.15.195:6816/439683850,v1:172.21.15.195:6817/439683850] conn(0x7fdf2407c850 0x7fdf2407eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.389+0000 7f505aa00640 1 -- 172.21.15.131:0/1073893225 <== osd.5 v2:172.21.15.195:6824/360782693 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f505001ce70 con 0x7f504407c720 2024-04-25T19:22:24.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.389+0000 7f2a74800640 1 Processor -- start 2024-04-25T19:22:24.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.389+0000 7fdf45e00640 1 --2- 172.21.15.131:0/3522308790 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdf24074580 0x7fdf24076a90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdf480728d0 tx=0x7fdf4000e040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.389+0000 7f3df1600640 1 -- 172.21.15.131:0/4047875323 <== osd.4 v2:172.21.15.195:6800/3394326073 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3dec00be50 con 0x7f3dd407c780 2024-04-25T19:22:24.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.389+0000 7f2a74800640 1 -- start start 2024-04-25T19:22:24.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.392+0000 7f2a74800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a6c06d8e0 0x7f2a6c159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.392+0000 7f2a74800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a6c06dcf0 0x7f2a6c09f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.392+0000 7f2a74800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a6c1590d0 0x7f2a6c09f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.392+0000 7f2a74800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c0b38e0 con 0x7f2a6c1590d0 2024-04-25T19:22:24.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.392+0000 7f2a74800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c0b44b0 con 0x7f2a6c06dcf0 2024-04-25T19:22:24.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.392+0000 7f2a74800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2a6c0d27e0 con 0x7f2a6c06d8e0 2024-04-25T19:22:24.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.393+0000 7feddd600640 1 -- 172.21.15.131:0/4189640248 --> [v2:172.21.15.131:6822/182543209,v1:172.21.15.131:6824/182543209] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fedd8050740 con 0x7fedb807c850 2024-04-25T19:22:24.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.393+0000 7f2a71400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a6c06dcf0 0x7f2a6c09f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.393+0000 7f2a72800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a6c1590d0 0x7f2a6c09f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.393+0000 7f2a71e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a6c06d8e0 0x7f2a6c159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.393+0000 7fdf45400640 1 --2- 172.21.15.131:0/3522308790 >> [v2:172.21.15.195:6816/439683850,v1:172.21.15.195:6817/439683850] conn(0x7fdf2407c850 0x7fdf2407eca0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.393+0000 7f2a72800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a6c1590d0 0x7f2a6c09f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54256/0 (socket says 172.21.15.131:54256) 2024-04-25T19:22:24.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.393+0000 7f2a71e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a6c06d8e0 0x7f2a6c159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.131:38174/0 (socket says 172.21.15.131:38174) 2024-04-25T19:22:24.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.393+0000 7f2a72800640 1 -- 172.21.15.131:0/505015820 learned_addr learned my addr 172.21.15.131:0/505015820 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:24.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.393+0000 7f2a71400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a6c06dcf0 0x7f2a6c09f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.131:58732/0 (socket says 172.21.15.131:58732) 2024-04-25T19:22:24.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.394+0000 7fedcfe00640 1 -- 172.21.15.131:0/4189640248 <== osd.0 v2:172.21.15.131:6822/182543209 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fedd8050740 con 0x7fedb807c850 2024-04-25T19:22:24.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.394+0000 7f2a72800640 1 -- 172.21.15.131:0/505015820 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a6c06d8e0 msgr2=0x7f2a6c159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.394+0000 7f2a72800640 1 --2- 172.21.15.131:0/505015820 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a6c06d8e0 0x7f2a6c159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.394+0000 7f2a72800640 1 -- 172.21.15.131:0/505015820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a6c06dcf0 msgr2=0x7f2a6c09f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.394+0000 7f2a72800640 1 --2- 172.21.15.131:0/505015820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a6c06dcf0 0x7f2a6c09f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.394+0000 7f2a72800640 1 -- 172.21.15.131:0/505015820 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a6c15a8a0 con 0x7f2a6c1590d0 2024-04-25T19:22:24.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.395+0000 7feddd600640 1 -- 172.21.15.131:0/4189640248 >> [v2:172.21.15.131:6822/182543209,v1:172.21.15.131:6824/182543209] conn(0x7fedb807c850 msgr2=0x7fedb807eca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.395+0000 7feddd600640 1 --2- 172.21.15.131:0/4189640248 >> [v2:172.21.15.131:6822/182543209,v1:172.21.15.131:6824/182543209] conn(0x7fedb807c850 0x7fedb807eca0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.395+0000 7f2a72800640 1 --2- 172.21.15.131:0/505015820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a6c1590d0 0x7f2a6c09f830 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00e930 tx=0x7f2a5c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.395+0000 7feddd600640 1 -- 172.21.15.131:0/4189640248 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fedb8074580 msgr2=0x7fedb8076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.395+0000 7feddd600640 1 --2- 172.21.15.131:0/4189640248 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fedb8074580 0x7fedb8076a90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fedc8006fd0 tx=0x7fedc8008040 comp rx=0 tx=0).stop 2024-04-25T19:22:24.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.395+0000 7f2a66000640 1 -- 172.21.15.131:0/505015820 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c017070 con 0x7f2a6c1590d0 2024-04-25T19:22:24.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.395+0000 7feddd600640 1 -- 172.21.15.131:0/4189640248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd80d3580 msgr2=0x7fedd8158e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.395+0000 7feddd600640 1 --2- 172.21.15.131:0/4189640248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd80d3580 0x7fedd8158e50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fedc400d5f0 tx=0x7fedc400dab0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.395+0000 7f2a66000640 1 -- 172.21.15.131:0/505015820 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a5c00c7f0 con 0x7f2a6c1590d0 2024-04-25T19:22:24.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.395+0000 7f2a66000640 1 -- 172.21.15.131:0/505015820 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c00cbe0 con 0x7f2a6c1590d0 2024-04-25T19:22:24.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.395+0000 7feddcc00640 1 -- 172.21.15.131:0/4189640248 reap_dead start 2024-04-25T19:22:24.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.397+0000 7feddd600640 1 -- 172.21.15.131:0/4189640248 shutdown_connections 2024-04-25T19:22:24.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.397+0000 7feddd600640 1 -- 172.21.15.131:0/4189640248 >> 172.21.15.131:0/4189640248 conn(0x7fedd806c5c0 msgr2=0x7fedd815fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:24.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.397+0000 7feddd600640 1 -- 172.21.15.131:0/4189640248 shutdown_connections 2024-04-25T19:22:24.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.397+0000 7feddd600640 1 -- 172.21.15.131:0/4189640248 wait complete. 2024-04-25T19:22:24.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.397+0000 7f2a74800640 1 -- 172.21.15.131:0/505015820 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a6c09e810 con 0x7f2a6c1590d0 2024-04-25T19:22:24.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.397+0000 7fdf3e000640 1 -- 172.21.15.131:0/3522308790 <== osd.6 v2:172.21.15.195:6816/439683850 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdf2407f370 con 0x7fdf2407c850 2024-04-25T19:22:24.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.397+0000 7f2a74800640 1 -- 172.21.15.131:0/505015820 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a6c09edd0 con 0x7f2a6c1590d0 2024-04-25T19:22:24.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.399+0000 7f2a74800640 1 -- 172.21.15.131:0/505015820 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2a6c050740 con 0x7f2a6c1590d0 2024-04-25T19:22:24.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.401+0000 7f2a66000640 1 -- 172.21.15.131:0/505015820 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2a5c01a070 con 0x7f2a6c1590d0 2024-04-25T19:22:24.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.403+0000 7fc85e200640 1 -- 172.21.15.131:0/2895088194 --> [v2:172.21.15.131:6800/1135187016,v1:172.21.15.131:6801/1135187016] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc85003b710 con 0x7fc83807c700 2024-04-25T19:22:24.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.403+0000 7f2a66000640 1 --2- 172.21.15.131:0/505015820 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2a50074530 0x7f2a50076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.403+0000 7f2a66000640 1 -- 172.21.15.131:0/505015820 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2a5c094e20 con 0x7f2a6c1590d0 2024-04-25T19:22:24.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.403+0000 7f2a66000640 1 --2- 172.21.15.131:0/505015820 >> [v2:172.21.15.195:6808/3283593923,v1:172.21.15.195:6809/3283593923] conn(0x7f2a5007c780 0x7f2a5007ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.403+0000 7f2a66000640 1 -- 172.21.15.131:0/505015820 --> [v2:172.21.15.195:6808/3283593923,v1:172.21.15.195:6809/3283593923] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2a5c01ee50 con 0x7f2a5007c780 2024-04-25T19:22:24.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.404+0000 7fc854c00640 1 -- 172.21.15.131:0/2895088194 <== osd.2 v2:172.21.15.131:6800/1135187016 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc85003b710 con 0x7fc83807c700 2024-04-25T19:22:24.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.404+0000 7f2a66000640 1 -- 172.21.15.131:0/505015820 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2a5c05b870 con 0x7f2a6c1590d0 2024-04-25T19:22:24.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.404+0000 7f2a71e00640 1 --2- 172.21.15.131:0/505015820 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2a50074530 0x7f2a50076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.404+0000 7fc85e200640 1 -- 172.21.15.131:0/2895088194 >> [v2:172.21.15.131:6800/1135187016,v1:172.21.15.131:6801/1135187016] conn(0x7fc83807c700 msgr2=0x7fc83807eb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.404+0000 7fc85e200640 1 --2- 172.21.15.131:0/2895088194 >> [v2:172.21.15.131:6800/1135187016,v1:172.21.15.131:6801/1135187016] conn(0x7fc83807c700 0x7fc83807eb50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.404+0000 7f2a71400640 1 --2- 172.21.15.131:0/505015820 >> [v2:172.21.15.195:6808/3283593923,v1:172.21.15.195:6809/3283593923] conn(0x7f2a5007c780 0x7f2a5007ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.405+0000 7fc85e200640 1 -- 172.21.15.131:0/2895088194 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc8380744b0 msgr2=0x7fc8380769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.405+0000 7fc85e200640 1 --2- 172.21.15.131:0/2895088194 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc8380744b0 0x7fc8380769c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc850055b50 tx=0x7fc84c008040 comp rx=0 tx=0).stop 2024-04-25T19:22:24.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.405+0000 7fc85e200640 1 -- 172.21.15.131:0/2895088194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc850058b90 msgr2=0x7fc850181dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.405+0000 7fc85e200640 1 --2- 172.21.15.131:0/2895088194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc850058b90 0x7fc850181dc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc84400b410 tx=0x7fc84400b8d0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.405+0000 7fc85d800640 1 -- 172.21.15.131:0/2895088194 reap_dead start 2024-04-25T19:22:24.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.405+0000 7fc85e200640 1 -- 172.21.15.131:0/2895088194 shutdown_connections 2024-04-25T19:22:24.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.405+0000 7fc85e200640 1 -- 172.21.15.131:0/2895088194 >> 172.21.15.131:0/2895088194 conn(0x7fc85003abf0 msgr2=0x7fc85003a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:24.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.405+0000 7f2a71400640 1 --2- 172.21.15.131:0/505015820 >> [v2:172.21.15.195:6808/3283593923,v1:172.21.15.195:6809/3283593923] conn(0x7f2a5007c780 0x7f2a5007ebd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.405+0000 7fa512c00640 1 -- 172.21.15.131:0/340867757 --> [v2:172.21.15.131:6816/2154643557,v1:172.21.15.131:6817/2154643557] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa50c0cff60 con 0x7fa4e807c8a0 2024-04-25T19:22:24.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.406+0000 7f2a71e00640 1 --2- 172.21.15.131:0/505015820 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2a50074530 0x7f2a50076a40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2a60005880 tx=0x7f2a60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.406+0000 7fa503e00640 1 -- 172.21.15.131:0/340867757 <== osd.3 v2:172.21.15.131:6816/2154643557 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa50c0cff60 con 0x7fa4e807c8a0 2024-04-25T19:22:24.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.406+0000 7fc85e200640 1 -- 172.21.15.131:0/2895088194 shutdown_connections 2024-04-25T19:22:24.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.406+0000 7fc85e200640 1 -- 172.21.15.131:0/2895088194 wait complete. 2024-04-25T19:22:24.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.407+0000 7fa501600640 1 -- 172.21.15.131:0/340867757 >> [v2:172.21.15.131:6816/2154643557,v1:172.21.15.131:6817/2154643557] conn(0x7fa4e807c8a0 msgr2=0x7fa4e807ecf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.407+0000 7fa501600640 1 --2- 172.21.15.131:0/340867757 >> [v2:172.21.15.131:6816/2154643557,v1:172.21.15.131:6817/2154643557] conn(0x7fa4e807c8a0 0x7fa4e807ecf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.407+0000 7fa501600640 1 -- 172.21.15.131:0/340867757 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa4e80746b0 msgr2=0x7fa4e8076bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.407+0000 7f38b1e00640 1 -- 172.21.15.131:0/4222107961 --> [v2:172.21.15.131:6808/2785914367,v1:172.21.15.131:6809/2785914367] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f38ac15dd40 con 0x7f388c07c850 2024-04-25T19:22:24.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.407+0000 7fa501600640 1 --2- 172.21.15.131:0/340867757 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa4e80746b0 0x7fa4e8076bc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc033000 tx=0x7fa4fc009000 comp rx=0 tx=0).stop 2024-04-25T19:22:24.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.407+0000 7fa501600640 1 -- 172.21.15.131:0/340867757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa50c06c5c0 msgr2=0x7fa50c0c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.407+0000 7fa501600640 1 --2- 172.21.15.131:0/340867757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa50c06c5c0 0x7fa50c0c8250 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400c3c0 tx=0x7fa4f400c880 comp rx=0 tx=0).stop 2024-04-25T19:22:24.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.407+0000 7fa510c00640 1 -- 172.21.15.131:0/340867757 reap_dead start 2024-04-25T19:22:24.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.407+0000 7fa501600640 1 -- 172.21.15.131:0/340867757 shutdown_connections 2024-04-25T19:22:24.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.407+0000 7fa501600640 1 -- 172.21.15.131:0/340867757 >> 172.21.15.131:0/340867757 conn(0x7fa50c09b7d0 msgr2=0x7fa50c0d1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:24.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.408+0000 7f38a8c00640 1 -- 172.21.15.131:0/4222107961 <== osd.1 v2:172.21.15.131:6808/2785914367 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f38ac15dd40 con 0x7f388c07c850 2024-04-25T19:22:24.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.408+0000 7fa501600640 1 -- 172.21.15.131:0/340867757 shutdown_connections 2024-04-25T19:22:24.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.408+0000 7f2a66000640 1 -- 172.21.15.131:0/505015820 <== osd.7 v2:172.21.15.195:6808/3283593923 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2a5c01ee50 con 0x7f2a5007c780 2024-04-25T19:22:24.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.408+0000 7fa501600640 1 -- 172.21.15.131:0/340867757 wait complete. 2024-04-25T19:22:24.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.408+0000 7f38b1e00640 1 -- 172.21.15.131:0/4222107961 >> [v2:172.21.15.131:6808/2785914367,v1:172.21.15.131:6809/2785914367] conn(0x7f388c07c850 msgr2=0x7f388c07eca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.408+0000 7f38b1e00640 1 --2- 172.21.15.131:0/4222107961 >> [v2:172.21.15.131:6808/2785914367,v1:172.21.15.131:6809/2785914367] conn(0x7f388c07c850 0x7f388c07eca0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.409+0000 7f38b1e00640 1 -- 172.21.15.131:0/4222107961 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f388c074580 msgr2=0x7f388c076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.409+0000 7f38b1e00640 1 --2- 172.21.15.131:0/4222107961 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f388c074580 0x7f388c076a90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f38a0032000 tx=0x7f38a0007000 comp rx=0 tx=0).stop 2024-04-25T19:22:24.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.409+0000 7f38b1e00640 1 -- 172.21.15.131:0/4222107961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38ac0ca820 msgr2=0x7f38ac0cac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.409+0000 7f38b1e00640 1 --2- 172.21.15.131:0/4222107961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38ac0ca820 0x7f38ac0cac30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f38ac0b1950 tx=0x7f38a400cf90 comp rx=0 tx=0).stop 2024-04-25T19:22:24.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.409+0000 7f38b1400640 1 -- 172.21.15.131:0/4222107961 reap_dead start 2024-04-25T19:22:24.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.409+0000 7f38b1e00640 1 -- 172.21.15.131:0/4222107961 shutdown_connections 2024-04-25T19:22:24.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.409+0000 7f38b1e00640 1 -- 172.21.15.131:0/4222107961 >> 172.21.15.131:0/4222107961 conn(0x7f38ac0d1f40 msgr2=0x7f38ac0d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:24.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.413+0000 7f38b1e00640 1 -- 172.21.15.131:0/4222107961 shutdown_connections 2024-04-25T19:22:24.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.413+0000 7f38b1e00640 1 -- 172.21.15.131:0/4222107961 wait complete. 2024-04-25T19:22:24.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.416+0000 7f5063e00640 1 -- 172.21.15.131:0/1073893225 --> [v2:172.21.15.195:6824/360782693,v1:172.21.15.195:6825/360782693] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f50640738d0 con 0x7f504407c720 2024-04-25T19:22:24.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.417+0000 7f505aa00640 1 -- 172.21.15.131:0/1073893225 <== osd.5 v2:172.21.15.195:6824/360782693 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f50640738d0 con 0x7f504407c720 2024-04-25T19:22:24.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.421+0000 7f5063e00640 1 -- 172.21.15.131:0/1073893225 >> [v2:172.21.15.195:6824/360782693,v1:172.21.15.195:6825/360782693] conn(0x7f504407c720 msgr2=0x7f504407eb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.421+0000 7f5063e00640 1 --2- 172.21.15.131:0/1073893225 >> [v2:172.21.15.195:6824/360782693,v1:172.21.15.195:6825/360782693] conn(0x7f504407c720 0x7f504407eb70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.421+0000 7f5063e00640 1 -- 172.21.15.131:0/1073893225 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f50440744b0 msgr2=0x7f50440769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.421+0000 7f5063e00640 1 --2- 172.21.15.131:0/1073893225 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f50440744b0 0x7f50440769c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5054034000 tx=0x7f505402e000 comp rx=0 tx=0).stop 2024-04-25T19:22:24.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.422+0000 7f5063e00640 1 -- 172.21.15.131:0/1073893225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50640b5260 msgr2=0x7f50640730f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.422+0000 7f5063e00640 1 --2- 172.21.15.131:0/1073893225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50640b5260 0x7f50640730f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f50640b8900 tx=0x7f505000b8f0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.422+0000 7f5063400640 1 -- 172.21.15.131:0/1073893225 reap_dead start 2024-04-25T19:22:24.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.422+0000 7f5063e00640 1 -- 172.21.15.131:0/1073893225 shutdown_connections 2024-04-25T19:22:24.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.422+0000 7f5063e00640 1 -- 172.21.15.131:0/1073893225 >> 172.21.15.131:0/1073893225 conn(0x7f50640d2bd0 msgr2=0x7f5064162800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:24.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.423+0000 7f5063e00640 1 -- 172.21.15.131:0/1073893225 shutdown_connections 2024-04-25T19:22:24.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.423+0000 7f5063e00640 1 -- 172.21.15.131:0/1073893225 wait complete. 2024-04-25T19:22:24.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.428+0000 7f3dfc000640 1 -- 172.21.15.131:0/4047875323 --> [v2:172.21.15.195:6800/3394326073,v1:172.21.15.195:6801/3394326073] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3df40b0ec0 con 0x7f3dd407c780 2024-04-25T19:22:24.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.430+0000 7f3df1600640 1 -- 172.21.15.131:0/4047875323 <== osd.4 v2:172.21.15.195:6800/3394326073 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3df40b0ec0 con 0x7f3dd407c780 2024-04-25T19:22:24.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.432+0000 7f3dfc000640 1 -- 172.21.15.131:0/4047875323 >> [v2:172.21.15.195:6800/3394326073,v1:172.21.15.195:6801/3394326073] conn(0x7f3dd407c780 msgr2=0x7f3dd407ebd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.432+0000 7f3dfc000640 1 --2- 172.21.15.131:0/4047875323 >> [v2:172.21.15.195:6800/3394326073,v1:172.21.15.195:6801/3394326073] conn(0x7f3dd407c780 0x7f3dd407ebd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.460 INFO:teuthology.orchestra.run.smithi131.stdout:55834574855 2024-04-25T19:22:24.460 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T19:22:24.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.434+0000 7f3dfc000640 1 -- 172.21.15.131:0/4047875323 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3dd40744b0 msgr2=0x7f3dd40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.434+0000 7f3dfc000640 1 --2- 172.21.15.131:0/4047875323 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3dd40744b0 0x7f3dd40769c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3de8005880 tx=0x7f3de8009040 comp rx=0 tx=0).stop 2024-04-25T19:22:24.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.434+0000 7f3dfc000640 1 -- 172.21.15.131:0/4047875323 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3df414ad60 msgr2=0x7f3df4165170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.434+0000 7f3dfc000640 1 --2- 172.21.15.131:0/4047875323 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3df414ad60 0x7f3df4165170 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3dec009d30 tx=0x7f3dec00c490 comp rx=0 tx=0).stop 2024-04-25T19:22:24.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.434+0000 7f3dfa000640 1 -- 172.21.15.131:0/4047875323 reap_dead start 2024-04-25T19:22:24.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.434+0000 7f3dfc000640 1 -- 172.21.15.131:0/4047875323 shutdown_connections 2024-04-25T19:22:24.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.434+0000 7f3dfc000640 1 -- 172.21.15.131:0/4047875323 >> 172.21.15.131:0/4047875323 conn(0x7f3df40d1ae0 msgr2=0x7f3df40b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:24.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.434+0000 7f3dfc000640 1 -- 172.21.15.131:0/4047875323 shutdown_connections 2024-04-25T19:22:24.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.434+0000 7f3dfc000640 1 -- 172.21.15.131:0/4047875323 wait complete. 2024-04-25T19:22:24.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.435+0000 7fdf47200640 1 -- 172.21.15.131:0/3522308790 --> [v2:172.21.15.195:6816/439683850,v1:172.21.15.195:6817/439683850] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdf481fb410 con 0x7fdf2407c850 2024-04-25T19:22:24.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.436+0000 7fdf3e000640 1 -- 172.21.15.131:0/3522308790 <== osd.6 v2:172.21.15.195:6816/439683850 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdf481fb410 con 0x7fdf2407c850 2024-04-25T19:22:24.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.436+0000 7fdf47200640 1 -- 172.21.15.131:0/3522308790 >> [v2:172.21.15.195:6816/439683850,v1:172.21.15.195:6817/439683850] conn(0x7fdf2407c850 msgr2=0x7fdf2407eca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.436+0000 7fdf47200640 1 --2- 172.21.15.131:0/3522308790 >> [v2:172.21.15.195:6816/439683850,v1:172.21.15.195:6817/439683850] conn(0x7fdf2407c850 0x7fdf2407eca0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.437+0000 7f2a74800640 1 -- 172.21.15.131:0/505015820 --> [v2:172.21.15.195:6808/3283593923,v1:172.21.15.195:6809/3283593923] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2a6c159550 con 0x7f2a5007c780 2024-04-25T19:22:24.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.437+0000 7fdf47200640 1 -- 172.21.15.131:0/3522308790 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdf24074580 msgr2=0x7fdf24076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.437+0000 7fdf47200640 1 --2- 172.21.15.131:0/3522308790 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdf24074580 0x7fdf24076a90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdf480728d0 tx=0x7fdf4000e040 comp rx=0 tx=0).stop 2024-04-25T19:22:24.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.437+0000 7fdf47200640 1 -- 172.21.15.131:0/3522308790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf481601d0 msgr2=0x7fdf481fab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.437+0000 7fdf47200640 1 --2- 172.21.15.131:0/3522308790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf481601d0 0x7fdf481fab70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdf3000dcb0 tx=0x7fdf300046c0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.437+0000 7fdf46800640 1 -- 172.21.15.131:0/3522308790 reap_dead start 2024-04-25T19:22:24.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.437+0000 7fdf47200640 1 -- 172.21.15.131:0/3522308790 shutdown_connections 2024-04-25T19:22:24.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.437+0000 7fdf47200640 1 -- 172.21.15.131:0/3522308790 >> 172.21.15.131:0/3522308790 conn(0x7fdf480d1f40 msgr2=0x7fdf480b2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:24.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.437+0000 7fdf47200640 1 -- 172.21.15.131:0/3522308790 shutdown_connections 2024-04-25T19:22:24.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.438+0000 7fdf47200640 1 -- 172.21.15.131:0/3522308790 wait complete. 2024-04-25T19:22:24.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.438+0000 7f2a66000640 1 -- 172.21.15.131:0/505015820 <== osd.7 v2:172.21.15.195:6808/3283593923 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2a6c159550 con 0x7f2a5007c780 2024-04-25T19:22:24.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.438+0000 7f2a74800640 1 -- 172.21.15.131:0/505015820 >> [v2:172.21.15.195:6808/3283593923,v1:172.21.15.195:6809/3283593923] conn(0x7f2a5007c780 msgr2=0x7f2a5007ebd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.438+0000 7f2a74800640 1 --2- 172.21.15.131:0/505015820 >> [v2:172.21.15.195:6808/3283593923,v1:172.21.15.195:6809/3283593923] conn(0x7f2a5007c780 0x7f2a5007ebd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.466 INFO:teuthology.orchestra.run.smithi131.stdout:55834574856 2024-04-25T19:22:24.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.439+0000 7f2a74800640 1 -- 172.21.15.131:0/505015820 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2a50074530 msgr2=0x7f2a50076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.439+0000 7f2a74800640 1 --2- 172.21.15.131:0/505015820 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2a50074530 0x7f2a50076a40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2a60005880 tx=0x7f2a60009040 comp rx=0 tx=0).stop 2024-04-25T19:22:24.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.439+0000 7f2a74800640 1 -- 172.21.15.131:0/505015820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a6c1590d0 msgr2=0x7f2a6c09f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.439+0000 7f2a74800640 1 --2- 172.21.15.131:0/505015820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a6c1590d0 0x7f2a6c09f830 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00e930 tx=0x7f2a5c00edf0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.467 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T19:22:24.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.439+0000 7f2a72800640 1 -- 172.21.15.131:0/505015820 reap_dead start 2024-04-25T19:22:24.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.439+0000 7f2a74800640 1 -- 172.21.15.131:0/505015820 shutdown_connections 2024-04-25T19:22:24.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.439+0000 7f2a74800640 1 -- 172.21.15.131:0/505015820 >> 172.21.15.131:0/505015820 conn(0x7f2a6c08d110 msgr2=0x7f2a6c0d2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:24.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.439+0000 7f2a74800640 1 -- 172.21.15.131:0/505015820 shutdown_connections 2024-04-25T19:22:24.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.439+0000 7f2a74800640 1 -- 172.21.15.131:0/505015820 wait complete. 2024-04-25T19:22:24.469 INFO:teuthology.orchestra.run.smithi131.stdout:55834574855 2024-04-25T19:22:24.469 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T19:22:24.470 INFO:teuthology.orchestra.run.smithi131.stdout:55834574855 2024-04-25T19:22:24.471 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T19:22:24.472 INFO:teuthology.orchestra.run.smithi131.stdout:55834574855 2024-04-25T19:22:24.472 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T19:22:24.473 INFO:teuthology.orchestra.run.smithi131.stdout:55834574854 2024-04-25T19:22:24.474 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T19:22:24.475 INFO:teuthology.orchestra.run.smithi131.stdout:55834574855 2024-04-25T19:22:24.475 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T19:22:24.476 INFO:teuthology.orchestra.run.smithi131.stdout:55834574856 2024-04-25T19:22:24.476 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T19:22:24.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.900+0000 7fe385a00640 1 Processor -- start 2024-04-25T19:22:24.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.901+0000 7feb41a00640 1 Processor -- start 2024-04-25T19:22:24.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.901+0000 7feb41a00640 1 -- start start 2024-04-25T19:22:24.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.901+0000 7fe385a00640 1 -- start start 2024-04-25T19:22:24.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.904+0000 7fe385a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe38014ad60 0x7fe380070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.904+0000 7fe385a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3800b5e40 0x7fe3800b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.904+0000 7fe385a00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3800b6790 con 0x7fe3801681d0 2024-04-25T19:22:24.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.904+0000 7fe385a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe3800b4af0 con 0x7fe38014ad60 2024-04-25T19:22:24.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.904+0000 7fe385a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe3800b4dd0 con 0x7fe3800b5e40 2024-04-25T19:22:24.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.905+0000 7fe37f400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fe3801681d0 0x7fe3801685e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:39818/0 (socket says 172.21.15.131:39818) 2024-04-25T19:22:24.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.905+0000 7fe37f400640 1 -- 172.21.15.131:0/3123532358 learned_addr learned my addr 172.21.15.131:0/3123532358 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:24.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.905+0000 7fe37e000640 1 --2- 172.21.15.131:0/3123532358 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3800b5e40 0x7fe3800b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.905+0000 7feb3aa00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7feb3c0d0780 0x7feb3c15fe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:39832/0 (socket says 172.21.15.131:39832) 2024-04-25T19:22:24.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.905+0000 7f1d16600640 1 Processor -- start 2024-04-25T19:22:24.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.905+0000 7feb3aa00640 1 -- 172.21.15.131:0/1868630373 learned_addr learned my addr 172.21.15.131:0/1868630373 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:24.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.906+0000 7fe37e000640 1 -- 172.21.15.131:0/3123532358 >> v2:172.21.15.195:3300/0 conn(0x7fe38014ad60 msgr2=0x7fe380070010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T19:22:24.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.906+0000 7fe37e000640 1 --2- 172.21.15.131:0/3123532358 >> v2:172.21.15.195:3300/0 conn(0x7fe38014ad60 0x7fe380070010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.906+0000 7fe37e000640 1 -- 172.21.15.131:0/3123532358 >> v1:172.21.15.131:6789/0 conn(0x7fe3801681d0 legacy=0x7fe3801685e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.906+0000 7f1d16600640 1 -- start start 2024-04-25T19:22:24.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.906+0000 7feb41a00640 1 --2- 172.21.15.131:0/1868630373 >> v2:172.21.15.195:3300/0 conn(0x7feb3c160510 0x7feb3c0707c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.906+0000 7feb41a00640 1 --2- 172.21.15.131:0/1868630373 >> v2:172.21.15.131:3300/0 conn(0x7feb3c0d1120 0x7feb3c15c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.906+0000 7feb3a000640 1 --2- 172.21.15.131:0/1868630373 >> v2:172.21.15.195:3300/0 conn(0x7feb3c160510 0x7feb3c0707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.907+0000 7feb3b400640 1 --2- 172.21.15.131:0/1868630373 >> v2:172.21.15.131:3300/0 conn(0x7feb3c0d1120 0x7feb3c15c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.907+0000 7feb41a00640 1 -- 172.21.15.131:0/1868630373 --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb3c0cf9c0 con 0x7feb3c0d0780 2024-04-25T19:22:24.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.907+0000 7feb41a00640 1 -- 172.21.15.131:0/1868630373 --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7feb3c156d20 con 0x7feb3c0d1120 2024-04-25T19:22:24.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.907+0000 7feb41a00640 1 -- 172.21.15.131:0/1868630373 --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7feb3c0cfca0 con 0x7feb3c160510 2024-04-25T19:22:24.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.906+0000 7fe37e000640 1 -- 172.21.15.131:0/3123532358 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3800b50b0 con 0x7fe3800b5e40 2024-04-25T19:22:24.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.908+0000 7fe37e000640 1 --2- 172.21.15.131:0/3123532358 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3800b5e40 0x7fe3800b6250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe36c0097a0 tx=0x7fe36c02a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32aeb5160d2bd50 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.908+0000 7feb39600640 1 -- 172.21.15.131:0/1868630373 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 123073924 0 0) 0x7feb3c0cf9c0 con 0x7feb3c0d0780 2024-04-25T19:22:24.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.908+0000 7feb39600640 1 -- 172.21.15.131:0/1868630373 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb20003520 con 0x7feb3c0d0780 2024-04-25T19:22:24.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.908+0000 7feb3a000640 1 -- 172.21.15.131:0/1868630373 >> v2:172.21.15.131:3300/0 conn(0x7feb3c0d1120 msgr2=0x7feb3c15c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:24.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.908+0000 7feb3a000640 1 --2- 172.21.15.131:0/1868630373 >> v2:172.21.15.131:3300/0 conn(0x7feb3c0d1120 0x7feb3c15c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.908+0000 7feb3a000640 1 -- 172.21.15.131:0/1868630373 >> v1:172.21.15.131:6789/0 conn(0x7feb3c0d0780 legacy=0x7feb3c15fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.908+0000 7feb3a000640 1 -- 172.21.15.131:0/1868630373 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3c0cff80 con 0x7feb3c160510 2024-04-25T19:22:24.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.909+0000 7feb3b400640 1 --2- 172.21.15.131:0/1868630373 >> v2:172.21.15.131:3300/0 conn(0x7feb3c0d1120 0x7feb3c15c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T19:22:24.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.909+0000 7fe37d600640 1 -- 172.21.15.131:0/3123532358 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c037070 con 0x7fe3800b5e40 2024-04-25T19:22:24.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.909+0000 7fe37d600640 1 -- 172.21.15.131:0/3123532358 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe36c032440 con 0x7fe3800b5e40 2024-04-25T19:22:24.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.909+0000 7fe37d600640 1 -- 172.21.15.131:0/3123532358 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c032850 con 0x7fe3800b5e40 2024-04-25T19:22:24.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.909+0000 7f1d16600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d1015fe00 0x7f1d100b6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.910+0000 7feb3a000640 1 --2- 172.21.15.131:0/1868630373 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb3c160510 0x7feb3c0707c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feb3c072540 tx=0x7feb2800a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edc6b13a6823f072 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.910+0000 7f1d0ea00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f1d100cdd60 0x7f1d100cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:39838/0 (socket says 172.21.15.131:39838) 2024-04-25T19:22:24.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.910+0000 7f1d0f400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d1015fe00 0x7f1d100b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.910+0000 7f1d0f400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d1015fe00 0x7f1d100b6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.131:38188/0 (socket says 172.21.15.131:38188) 2024-04-25T19:22:24.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.910+0000 7f1d16600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1d100ce170 0x7f1d1006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.910+0000 7f1d16600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d10160450 con 0x7f1d100cdd60 2024-04-25T19:22:24.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.910+0000 7f1d16600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f1d10160210 con 0x7f1d100ce170 2024-04-25T19:22:24.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.910+0000 7f1d16600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1d100b6ed0 con 0x7f1d1015fe00 2024-04-25T19:22:24.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.911+0000 7f1d0ea00640 1 -- 172.21.15.131:0/4169580501 learned_addr learned my addr 172.21.15.131:0/4169580501 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:24.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.911+0000 7feb39600640 1 -- 172.21.15.131:0/1868630373 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb28030070 con 0x7feb3c160510 2024-04-25T19:22:24.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.911+0000 7feb39600640 1 -- 172.21.15.131:0/1868630373 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb28034600 con 0x7feb3c160510 2024-04-25T19:22:24.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.911+0000 7feb39600640 1 -- 172.21.15.131:0/1868630373 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb280349d0 con 0x7feb3c160510 2024-04-25T19:22:24.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.911+0000 7f1d0fe00640 1 --2- 172.21.15.131:0/4169580501 >> v2:172.21.15.195:3300/0 conn(0x7f1d100ce170 0x7f1d1006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.912+0000 7f1d0f400640 1 -- 172.21.15.131:0/4169580501 >> v2:172.21.15.195:3300/0 conn(0x7f1d100ce170 msgr2=0x7f1d1006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:24.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.912+0000 7fe385a00640 1 -- 172.21.15.131:0/3123532358 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3800b5e40 msgr2=0x7fe3800b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.912+0000 7fe385a00640 1 --2- 172.21.15.131:0/3123532358 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3800b5e40 0x7fe3800b6250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe36c0097a0 tx=0x7fe36c02a130 comp rx=0 tx=0).stop 2024-04-25T19:22:24.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.912+0000 7f2961800640 1 Processor -- start 2024-04-25T19:22:24.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.912+0000 7fe385a00640 1 -- 172.21.15.131:0/3123532358 shutdown_connections 2024-04-25T19:22:24.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.912+0000 7f1d0f400640 1 --2- 172.21.15.131:0/4169580501 >> v2:172.21.15.195:3300/0 conn(0x7f1d100ce170 0x7f1d1006d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.912+0000 7fe385a00640 1 --2- 172.21.15.131:0/3123532358 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3800b5e40 0x7fe3800b6250 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.913+0000 7fe385a00640 1 --2- 172.21.15.131:0/3123532358 >> v2:172.21.15.195:3300/0 conn(0x7fe38014ad60 0x7fe380070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.913+0000 7fe385a00640 1 -- 172.21.15.131:0/3123532358 >> 172.21.15.131:0/3123532358 conn(0x7fe3800d1ae0 msgr2=0x7fe3800d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:24.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.913+0000 7f2961800640 1 -- start start 2024-04-25T19:22:24.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.913+0000 7f1d0f400640 1 -- 172.21.15.131:0/4169580501 >> v1:172.21.15.131:6789/0 conn(0x7f1d100cdd60 legacy=0x7f1d100cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:24.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.913+0000 7feb41a00640 1 -- 172.21.15.131:0/1868630373 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb3c160510 msgr2=0x7feb3c0707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.913+0000 7feb41a00640 1 --2- 172.21.15.131:0/1868630373 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb3c160510 0x7feb3c0707c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feb3c072540 tx=0x7feb2800a1a0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.913+0000 7fe385a00640 1 -- 172.21.15.131:0/3123532358 shutdown_connections 2024-04-25T19:22:24.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.913+0000 7fe385a00640 1 -- 172.21.15.131:0/3123532358 wait complete. 2024-04-25T19:22:24.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.913+0000 7f1d0f400640 1 -- 172.21.15.131:0/4169580501 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d10160730 con 0x7f1d1015fe00 2024-04-25T19:22:24.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.914+0000 7feb41a00640 1 -- 172.21.15.131:0/1868630373 shutdown_connections 2024-04-25T19:22:24.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.914+0000 7feb41a00640 1 --2- 172.21.15.131:0/1868630373 >> v2:172.21.15.131:3300/0 conn(0x7feb3c0d1120 0x7feb3c15c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.914+0000 7feb41a00640 1 --2- 172.21.15.131:0/1868630373 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb3c160510 0x7feb3c0707c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.914+0000 7feb41a00640 1 -- 172.21.15.131:0/1868630373 >> 172.21.15.131:0/1868630373 conn(0x7feb3c0d1ae0 msgr2=0x7feb3c0d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:24.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.915+0000 7feb41a00640 1 -- 172.21.15.131:0/1868630373 shutdown_connections 2024-04-25T19:22:24.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.915+0000 7feb41a00640 1 -- 172.21.15.131:0/1868630373 wait complete. 2024-04-25T19:22:24.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.915+0000 7f2961800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f295c0cec70 0x7f295c0b2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.915+0000 7f2961800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f295c06eba0 0x7f295c0b7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.915+0000 7f2961800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f295c0b8190 con 0x7f295c0b7d80 2024-04-25T19:22:24.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.915+0000 7f2961800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f295c0b4420 con 0x7f295c06eba0 2024-04-25T19:22:24.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.915+0000 7f2961800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f295c0d33b0 con 0x7f295c0cec70 2024-04-25T19:22:24.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.915+0000 7f1d0f400640 1 --2- 172.21.15.131:0/4169580501 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d1015fe00 0x7f1d100b6990 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1d000097a0 tx=0x7f1d0002a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41ca069f65ca910a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.916+0000 7f1d0e000640 1 -- 172.21.15.131:0/4169580501 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00037070 con 0x7f1d1015fe00 2024-04-25T19:22:24.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.916+0000 7f1d0e000640 1 -- 172.21.15.131:0/4169580501 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d0002ae40 con 0x7f1d1015fe00 2024-04-25T19:22:24.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.916+0000 7f295a000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f295c06eba0 0x7f295c0b7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.916+0000 7f295a000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f295c06eba0 0x7f295c0b7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54276/0 (socket says 172.21.15.131:54276) 2024-04-25T19:22:24.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.916+0000 7f295a000640 1 -- 172.21.15.131:0/3307532910 learned_addr learned my addr 172.21.15.131:0/3307532910 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:24.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.916+0000 7f1d0e000640 1 -- 172.21.15.131:0/4169580501 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00032660 con 0x7f1d1015fe00 2024-04-25T19:22:24.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.917+0000 7fe385a00640 1 Processor -- start 2024-04-25T19:22:24.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.917+0000 7fe385a00640 1 -- start start 2024-04-25T19:22:24.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.917+0000 7f295aa00640 1 --2- 172.21.15.131:0/3307532910 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f295c0cec70 0x7f295c0b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.917+0000 7f2959600640 1 -- 172.21.15.131:0/3307532910 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1645459461 0 0) 0x7f2954001490 con 0x7f295c0b7d80 2024-04-25T19:22:24.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.918+0000 7f2959600640 1 -- 172.21.15.131:0/3307532910 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2940003520 con 0x7f295c0b7d80 2024-04-25T19:22:24.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.918+0000 7f1d16600640 1 -- 172.21.15.131:0/4169580501 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d1015fe00 msgr2=0x7f1d100b6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.918+0000 7f1d16600640 1 --2- 172.21.15.131:0/4169580501 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d1015fe00 0x7f1d100b6990 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1d000097a0 tx=0x7f1d0002a0f0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.918+0000 7feb41a00640 1 Processor -- start 2024-04-25T19:22:24.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.919+0000 7feb41a00640 1 -- start start 2024-04-25T19:22:24.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.919+0000 7f1d16600640 1 -- 172.21.15.131:0/4169580501 shutdown_connections 2024-04-25T19:22:24.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.919+0000 7f1d16600640 1 --2- 172.21.15.131:0/4169580501 >> v2:172.21.15.195:3300/0 conn(0x7f1d100ce170 0x7f1d1006d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.919+0000 7f1d16600640 1 --2- 172.21.15.131:0/4169580501 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d1015fe00 0x7f1d100b6990 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.919+0000 7f1d16600640 1 -- 172.21.15.131:0/4169580501 >> 172.21.15.131:0/4169580501 conn(0x7f1d10073050 msgr2=0x7f1d10073460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:24.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.919+0000 7f1d16600640 1 -- 172.21.15.131:0/4169580501 shutdown_connections 2024-04-25T19:22:24.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.919+0000 7faa2a600640 1 Processor -- start 2024-04-25T19:22:24.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.920+0000 7faa2a600640 1 -- start start 2024-04-25T19:22:24.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.918+0000 7f295a000640 1 -- 172.21.15.131:0/3307532910 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f295c0cec70 msgr2=0x7f295c0b2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:24.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.918+0000 7f295a000640 1 --2- 172.21.15.131:0/3307532910 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f295c0cec70 0x7f295c0b2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.918+0000 7f295a000640 1 -- 172.21.15.131:0/3307532910 >> v1:172.21.15.131:6789/0 conn(0x7f295c0b7d80 legacy=0x7f295c06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.918+0000 7f295a000640 1 -- 172.21.15.131:0/3307532910 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f295c0d2a80 con 0x7f295c06eba0 2024-04-25T19:22:24.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.919+0000 7f831d600640 1 Processor -- start 2024-04-25T19:22:24.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.919+0000 7f831d600640 1 -- start start 2024-04-25T19:22:24.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.920+0000 7fe385a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3800b5e40 0x7fe3801469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.920+0000 7fe385a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe38014ad60 0x7fe380160080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.920+0000 7fe385a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3801681d0 0x7fe380166dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.920+0000 7fe385a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe380070550 con 0x7fe3800b5e40 2024-04-25T19:22:24.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.920+0000 7fe385a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe3800b5670 con 0x7fe38014ad60 2024-04-25T19:22:24.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.920+0000 7fe385a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe3800706d0 con 0x7fe3801681d0 2024-04-25T19:22:24.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.921+0000 7fe37ea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3800b5e40 0x7fe3801469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.920+0000 7f295a000640 1 --2- 172.21.15.131:0/3307532910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f295c06eba0 0x7f295c0b7840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2948009870 tx=0x7f294802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a042272dad2e4d3a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.921+0000 7f831d600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8318149df0 0x7f831814a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.921+0000 7f831d600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f831814a740 con 0x7f831806f160 2024-04-25T19:22:24.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.921+0000 7f831d600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83180d0f20 con 0x7f83180d0360 2024-04-25T19:22:24.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.921+0000 7f831d600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f83180cdb90 con 0x7f8318149df0 2024-04-25T19:22:24.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.921+0000 7f2959600640 1 -- 172.21.15.131:0/3307532910 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2948037070 con 0x7f295c06eba0 2024-04-25T19:22:24.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.921+0000 7feb41a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb3c0d0780 0x7feb3c1525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.921+0000 7feb41a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb3c0d1120 0x7feb3c1f14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.921+0000 7feb41a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb3c141a40 0x7feb3c141e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.921+0000 7feb41a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c0cf620 con 0x7feb3c0d0780 2024-04-25T19:22:24.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.921+0000 7feb41a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c0d1530 con 0x7feb3c0d1120 2024-04-25T19:22:24.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.921+0000 7feb41a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7feb3c0cf7a0 con 0x7feb3c141a40 2024-04-25T19:22:24.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.921+0000 7fe37ea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3800b5e40 0x7fe3801469e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54288/0 (socket says 172.21.15.131:54288) 2024-04-25T19:22:24.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.921+0000 7fe37ea00640 1 -- 172.21.15.131:0/3572374962 learned_addr learned my addr 172.21.15.131:0/3572374962 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:24.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.921+0000 7f2959600640 1 -- 172.21.15.131:0/3307532910 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2948032440 con 0x7f295c06eba0 2024-04-25T19:22:24.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.921+0000 7f2959600640 1 -- 172.21.15.131:0/3307532910 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2948032810 con 0x7f295c06eba0 2024-04-25T19:22:24.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.919+0000 7f451b200640 1 Processor -- start 2024-04-25T19:22:24.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.921+0000 7f451b200640 1 -- start start 2024-04-25T19:22:24.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.919+0000 7f1d16600640 1 -- 172.21.15.131:0/4169580501 wait complete. 2024-04-25T19:22:24.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.922+0000 7feb3b400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb3c141a40 0x7feb3c141e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.922+0000 7f8317400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8318149df0 0x7f831814a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.922+0000 7f8316000640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f83180d0360 0x7f83180d0770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.131:43960/0 (socket says 172.21.15.131:43960) 2024-04-25T19:22:24.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.922+0000 7f8316000640 1 -- 172.21.15.131:0/1897431490 learned_addr learned my addr 172.21.15.131:0/1897431490 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:24.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.922+0000 7feb3a000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb3c0d1120 0x7feb3c1f14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.922+0000 7fe37f400640 1 --2- 172.21.15.131:0/3572374962 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3801681d0 0x7fe380166dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.922+0000 7fe37e000640 1 --2- 172.21.15.131:0/3572374962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe38014ad60 0x7fe380160080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.922+0000 7feb3a000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb3c0d1120 0x7feb3c1f14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.131:58788/0 (socket says 172.21.15.131:58788) 2024-04-25T19:22:24.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.922+0000 7feb3a000640 1 -- 172.21.15.131:0/2644026823 learned_addr learned my addr 172.21.15.131:0/2644026823 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:24.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.922+0000 7feb3aa00640 1 --2- 172.21.15.131:0/2644026823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb3c0d0780 0x7feb3c1525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.923+0000 7f2961800640 1 -- 172.21.15.131:0/3307532910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f295c06eba0 msgr2=0x7f295c0b7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.923+0000 7faa2a600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7faa2406c5c0 0x7faa240cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.923+0000 7fe37ea00640 1 -- 172.21.15.131:0/3572374962 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3801681d0 msgr2=0x7fe380166dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.923+0000 7faa2a600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa24144370 0x7faa240b4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.923+0000 7f2961800640 1 --2- 172.21.15.131:0/3307532910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f295c06eba0 0x7f295c0b7840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2948009870 tx=0x7f294802a1c0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.923+0000 7f2961800640 1 -- 172.21.15.131:0/3307532910 shutdown_connections 2024-04-25T19:22:24.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.923+0000 7f2961800640 1 --2- 172.21.15.131:0/3307532910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f295c06eba0 0x7f295c0b7840 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.923+0000 7f2961800640 1 --2- 172.21.15.131:0/3307532910 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f295c0cec70 0x7f295c0b2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.923+0000 7f2961800640 1 -- 172.21.15.131:0/3307532910 >> 172.21.15.131:0/3307532910 conn(0x7f295c09b7d0 msgr2=0x7f295c09bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:24.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.923+0000 7f8315600640 1 -- 172.21.15.131:0/1897431490 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1349835055 0 0) 0x7f83180d0f20 con 0x7f83180d0360 2024-04-25T19:22:24.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.923+0000 7f8315600640 1 -- 172.21.15.131:0/1897431490 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82fc003520 con 0x7f83180d0360 2024-04-25T19:22:24.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.923+0000 7f2961800640 1 -- 172.21.15.131:0/3307532910 shutdown_connections 2024-04-25T19:22:24.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.923+0000 7faa2a600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa240b50e0 con 0x7faa240b4cd0 2024-04-25T19:22:24.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.924+0000 7f1d16600640 1 Processor -- start 2024-04-25T19:22:24.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.923+0000 7faa2a600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7faa240d1230 con 0x7faa2406c5c0 2024-04-25T19:22:24.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.923+0000 7faa2a600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faa240d06b0 con 0x7faa24144370 2024-04-25T19:22:24.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.923+0000 7feb3a000640 1 -- 172.21.15.131:0/2644026823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb3c141a40 msgr2=0x7feb3c141e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.923+0000 7feb3a000640 1 --2- 172.21.15.131:0/2644026823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb3c141a40 0x7feb3c141e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.923+0000 7feb3a000640 1 -- 172.21.15.131:0/2644026823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb3c0d0780 msgr2=0x7feb3c1525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.923+0000 7feb3a000640 1 --2- 172.21.15.131:0/2644026823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb3c0d0780 0x7feb3c1525f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.924+0000 7feb3a000640 1 -- 172.21.15.131:0/2644026823 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3c152b30 con 0x7feb3c0d1120 2024-04-25T19:22:24.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.924+0000 7f1d16600640 1 -- start start 2024-04-25T19:22:24.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.924+0000 7faa29c00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7faa240b4cd0 0x7faa24161a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.131:43974/0 (socket says 172.21.15.131:43974) 2024-04-25T19:22:24.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.924+0000 7faa23e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa24144370 0x7faa240b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.924+0000 7faa29c00640 1 -- 172.21.15.131:0/3776622931 learned_addr learned my addr 172.21.15.131:0/3776622931 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:24.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.924+0000 7f451b200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f451c0d4f70 0x7f451c0d28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.924+0000 7f451b200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f451c0d2e30 0x7f451c160600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.924+0000 7f451b200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f451c0d3240 con 0x7f451c160b40 2024-04-25T19:22:24.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.924+0000 7f451b200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f451c0d4ae0 con 0x7f451c0d4f70 2024-04-25T19:22:24.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.924+0000 7f451b200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f451c160f50 con 0x7f451c0d2e30 2024-04-25T19:22:24.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.924+0000 7feb3a000640 1 --2- 172.21.15.131:0/2644026823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb3c0d1120 0x7feb3c1f14e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feb28000c00 tx=0x7feb280046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.923+0000 7fe37ea00640 1 --2- 172.21.15.131:0/3572374962 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3801681d0 0x7fe380166dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.923+0000 7fe37ea00640 1 -- 172.21.15.131:0/3572374962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe38014ad60 msgr2=0x7fe380160080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.923+0000 7fe37ea00640 1 --2- 172.21.15.131:0/3572374962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe38014ad60 0x7fe380160080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.924+0000 7fe37ea00640 1 -- 172.21.15.131:0/3572374962 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3801605c0 con 0x7fe3800b5e40 2024-04-25T19:22:24.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.925+0000 7f4519e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f451c0d4f70 0x7f451c0d28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.925+0000 7f4519e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f451c0d4f70 0x7f451c0d28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54314/0 (socket says 172.21.15.131:54314) 2024-04-25T19:22:24.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.925+0000 7f4519e00640 1 -- 172.21.15.131:0/1524356468 learned_addr learned my addr 172.21.15.131:0/1524356468 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:24.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.925+0000 7f4519400640 1 --2- 172.21.15.131:0/1524356468 >> v2:172.21.15.195:3300/0 conn(0x7f451c0d2e30 0x7f451c160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.925+0000 7feb32a00640 1 -- 172.21.15.131:0/2644026823 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb28043070 con 0x7feb3c0d1120 2024-04-25T19:22:24.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.925+0000 7feb32a00640 1 -- 172.21.15.131:0/2644026823 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb280339f0 con 0x7feb3c0d1120 2024-04-25T19:22:24.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.925+0000 7feb32a00640 1 -- 172.21.15.131:0/2644026823 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb28006e10 con 0x7feb3c0d1120 2024-04-25T19:22:24.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.924+0000 7f8317400640 1 -- 172.21.15.131:0/1897431490 >> v1:172.21.15.195:6789/0 conn(0x7f83180d0360 legacy=0x7f83180d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.924+0000 7f8317400640 1 -- 172.21.15.131:0/1897431490 >> v1:172.21.15.131:6789/0 conn(0x7f831806f160 legacy=0x7f8318147430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.924+0000 7f8317400640 1 -- 172.21.15.131:0/1897431490 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83180d1200 con 0x7f8318149df0 2024-04-25T19:22:24.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.926+0000 7f4519400640 1 -- 172.21.15.131:0/1524356468 >> v2:172.21.15.131:3300/0 conn(0x7f451c0d4f70 msgr2=0x7f451c0d28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:24.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.925+0000 7faa23e00640 1 -- 172.21.15.131:0/3776622931 >> v2:172.21.15.131:3300/0 conn(0x7faa2406c5c0 msgr2=0x7faa240cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:24.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.925+0000 7faa23e00640 1 --2- 172.21.15.131:0/3776622931 >> v2:172.21.15.131:3300/0 conn(0x7faa2406c5c0 0x7faa240cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.925+0000 7faa23e00640 1 -- 172.21.15.131:0/3776622931 >> v1:172.21.15.195:6789/0 conn(0x7faa240b4cd0 legacy=0x7faa24161a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.925+0000 7faa23e00640 1 -- 172.21.15.131:0/3776622931 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa240d0990 con 0x7faa24144370 2024-04-25T19:22:24.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.925+0000 7fe37e000640 1 --2- 172.21.15.131:0/3572374962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe38014ad60 0x7fe380160080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T19:22:24.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.925+0000 7fe37ea00640 1 --2- 172.21.15.131:0/3572374962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3800b5e40 0x7fe3801469e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe37000b3f0 tx=0x7fe37000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.925+0000 7fe37f400640 1 --2- 172.21.15.131:0/3572374962 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3801681d0 0x7fe380166dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T19:22:24.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.926+0000 7fe376a00640 1 -- 172.21.15.131:0/3572374962 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe370015020 con 0x7fe3800b5e40 2024-04-25T19:22:24.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.926+0000 7fe376a00640 1 -- 172.21.15.131:0/3572374962 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe370011830 con 0x7fe3800b5e40 2024-04-25T19:22:24.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.926+0000 7fe376a00640 1 -- 172.21.15.131:0/3572374962 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe370011be0 con 0x7fe3800b5e40 2024-04-25T19:22:24.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.926+0000 7fe385a00640 1 -- 172.21.15.131:0/3572374962 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3800ce120 con 0x7fe3800b5e40 2024-04-25T19:22:24.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.926+0000 7fe385a00640 1 -- 172.21.15.131:0/3572374962 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3801487f0 con 0x7fe3800b5e40 2024-04-25T19:22:24.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.927+0000 7f8317400640 1 --2- 172.21.15.131:0/1897431490 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8318149df0 0x7f831814a200 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8310009df0 tx=0x7f831002a610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2992a0148c4d715e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.924+0000 7f2961800640 1 -- 172.21.15.131:0/3307532910 wait complete. 2024-04-25T19:22:24.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.925+0000 7feb41a00640 1 -- 172.21.15.131:0/2644026823 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb3c151660 con 0x7feb3c0d1120 2024-04-25T19:22:24.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.926+0000 7feb41a00640 1 -- 172.21.15.131:0/2644026823 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb3c151c20 con 0x7feb3c0d1120 2024-04-25T19:22:24.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.928+0000 7f2961800640 1 Processor -- start 2024-04-25T19:22:24.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.928+0000 7feb41a00640 1 -- 172.21.15.131:0/2644026823 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb3c0b5c50 con 0x7feb3c0d1120 2024-04-25T19:22:24.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.928+0000 7f8315600640 1 -- 172.21.15.131:0/1897431490 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8310031600 con 0x7f8318149df0 2024-04-25T19:22:24.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.928+0000 7faa23e00640 1 --2- 172.21.15.131:0/3776622931 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa24144370 0x7faa240b4790 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7faa100097a0 tx=0x7faa1002a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c507b3cd653f3ad9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.926+0000 7f4519400640 1 --2- 172.21.15.131:0/1524356468 >> v2:172.21.15.131:3300/0 conn(0x7f451c0d4f70 0x7f451c0d28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.926+0000 7f4519400640 1 -- 172.21.15.131:0/1524356468 >> v1:172.21.15.131:6789/0 conn(0x7f451c160b40 legacy=0x7f451c1617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.926+0000 7f4519400640 1 -- 172.21.15.131:0/1524356468 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f451c161210 con 0x7f451c0d2e30 2024-04-25T19:22:24.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.928+0000 7f4519e00640 1 --2- 172.21.15.131:0/1524356468 >> v2:172.21.15.131:3300/0 conn(0x7f451c0d4f70 0x7f451c0d28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T19:22:24.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.928+0000 7f8315600640 1 -- 172.21.15.131:0/1897431490 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83100317a0 con 0x7f8318149df0 2024-04-25T19:22:24.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.928+0000 7f8315600640 1 -- 172.21.15.131:0/1897431490 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8310031b70 con 0x7f8318149df0 2024-04-25T19:22:24.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.928+0000 7f2961800640 1 -- start start 2024-04-25T19:22:24.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.929+0000 7faa23400640 1 -- 172.21.15.131:0/3776622931 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10037070 con 0x7faa24144370 2024-04-25T19:22:24.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.929+0000 7f831d600640 1 -- 172.21.15.131:0/1897431490 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8318149df0 msgr2=0x7f831814a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.929+0000 7f831d600640 1 --2- 172.21.15.131:0/1897431490 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8318149df0 0x7f831814a200 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8310009df0 tx=0x7f831002a610 comp rx=0 tx=0).stop 2024-04-25T19:22:24.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.929+0000 7faa23400640 1 -- 172.21.15.131:0/3776622931 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa1002ad10 con 0x7faa24144370 2024-04-25T19:22:24.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.929+0000 7faa23400640 1 -- 172.21.15.131:0/3776622931 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10032660 con 0x7faa24144370 2024-04-25T19:22:24.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.930+0000 7f831d600640 1 -- 172.21.15.131:0/1897431490 shutdown_connections 2024-04-25T19:22:24.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.930+0000 7f831d600640 1 --2- 172.21.15.131:0/1897431490 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8318149df0 0x7f831814a200 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.930+0000 7f831d600640 1 -- 172.21.15.131:0/1897431490 >> 172.21.15.131:0/1897431490 conn(0x7f8318073050 msgr2=0x7f8318073460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:24.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.930+0000 7fe376a00640 1 -- 172.21.15.131:0/3572374962 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe370018020 con 0x7fe3800b5e40 2024-04-25T19:22:24.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.931+0000 7faa2a600640 1 -- 172.21.15.131:0/3776622931 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa24144370 msgr2=0x7faa240b4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.931+0000 7faa2a600640 1 --2- 172.21.15.131:0/3776622931 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa24144370 0x7faa240b4790 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7faa100097a0 tx=0x7faa1002a080 comp rx=0 tx=0).stop 2024-04-25T19:22:24.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.930+0000 7f4519400640 1 --2- 172.21.15.131:0/1524356468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f451c0d2e30 0x7f451c160600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f451c0d3920 tx=0x7f450c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56664de753715aa4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.931+0000 7f831d600640 1 -- 172.21.15.131:0/1897431490 shutdown_connections 2024-04-25T19:22:24.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.930+0000 7feb32a00640 1 -- 172.21.15.131:0/2644026823 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7feb2803f440 con 0x7feb3c0d1120 2024-04-25T19:22:24.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.931+0000 7f831d600640 1 -- 172.21.15.131:0/1897431490 wait complete. 2024-04-25T19:22:24.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.930+0000 7f1d16600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d100cdd60 0x7f1d1013c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.930+0000 7f1d16600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d100ce170 0x7f1d10159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.930+0000 7f1d16600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d1015fe00 0x7f1d1015a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.930+0000 7f1d16600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1d10160cf0 con 0x7f1d100cdd60 2024-04-25T19:22:24.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.930+0000 7f1d16600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1015c9b0 con 0x7f1d100ce170 2024-04-25T19:22:24.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.930+0000 7f1d16600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1d100cfcc0 con 0x7f1d1015fe00 2024-04-25T19:22:24.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.931+0000 7f1d0f400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d100cdd60 0x7f1d1013c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.931+0000 7f1d0f400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d100cdd60 0x7f1d1013c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54316/0 (socket says 172.21.15.131:54316) 2024-04-25T19:22:24.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.931+0000 7f1d0f400640 1 -- 172.21.15.131:0/3932881130 learned_addr learned my addr 172.21.15.131:0/3932881130 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:24.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.931+0000 7faa2a600640 1 -- 172.21.15.131:0/3776622931 shutdown_connections 2024-04-25T19:22:24.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.931+0000 7faa2a600640 1 --2- 172.21.15.131:0/3776622931 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa24144370 0x7faa240b4790 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.931+0000 7faa2a600640 1 --2- 172.21.15.131:0/3776622931 >> v2:172.21.15.131:3300/0 conn(0x7faa2406c5c0 0x7faa240cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.931+0000 7faa2a600640 1 -- 172.21.15.131:0/3776622931 >> 172.21.15.131:0/3776622931 conn(0x7faa240d1720 msgr2=0x7faa240d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:24.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.931+0000 7faa2a600640 1 -- 172.21.15.131:0/3776622931 shutdown_connections 2024-04-25T19:22:24.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.932+0000 7faa2a600640 1 -- 172.21.15.131:0/3776622931 wait complete. 2024-04-25T19:22:24.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.931+0000 7f2961800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f295c06eba0 0x7f295c1523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.931+0000 7f2961800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f295c0b7d80 0x7f295c09e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.932+0000 7f2961800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f295c0cec70 0x7f295c09eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.932+0000 7f2961800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f295c0b2b40 con 0x7f295c0cec70 2024-04-25T19:22:24.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.932+0000 7f295aa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f295c06eba0 0x7f295c1523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.932+0000 7f2961800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f295c0d3040 con 0x7f295c0b7d80 2024-04-25T19:22:24.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.932+0000 7f2961800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f295c0d3840 con 0x7f295c06eba0 2024-04-25T19:22:24.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.932+0000 7f295aa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f295c06eba0 0x7f295c1523f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.131:38238/0 (socket says 172.21.15.131:38238) 2024-04-25T19:22:24.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.932+0000 7f295aa00640 1 -- 172.21.15.131:0/2634100518 learned_addr learned my addr 172.21.15.131:0/2634100518 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:24.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.932+0000 7f295a000640 1 --2- 172.21.15.131:0/2634100518 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f295c0b7d80 0x7f295c09e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.932+0000 7feb32a00640 1 --2- 172.21.15.131:0/2644026823 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7feb1c0745b0 0x7feb1c076ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.933+0000 7f295b400640 1 --2- 172.21.15.131:0/2634100518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f295c0cec70 0x7f295c09eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.932+0000 7fe376a00640 1 --2- 172.21.15.131:0/3572374962 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe360074530 0x7fe360076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.931+0000 7fe385a00640 1 -- 172.21.15.131:0/3572374962 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe380050740 con 0x7fe3800b5e40 2024-04-25T19:22:24.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.932+0000 7fe376a00640 1 -- 172.21.15.131:0/3572374962 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe370094f70 con 0x7fe3800b5e40 2024-04-25T19:22:24.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.932+0000 7feb32a00640 1 -- 172.21.15.131:0/2644026823 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7feb280b5b00 con 0x7feb3c0d1120 2024-04-25T19:22:24.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.933+0000 7fe37e000640 1 --2- 172.21.15.131:0/3572374962 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe360074530 0x7fe360076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.933+0000 7f1d0f400640 1 -- 172.21.15.131:0/3932881130 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d1015fe00 msgr2=0x7f1d1015a350 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T19:22:24.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.933+0000 7f1d0f400640 1 --2- 172.21.15.131:0/3932881130 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d1015fe00 0x7f1d1015a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.933+0000 7f1d0f400640 1 -- 172.21.15.131:0/3932881130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d100ce170 msgr2=0x7f1d10159e10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T19:22:24.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.933+0000 7f1d0f400640 1 --2- 172.21.15.131:0/3932881130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d100ce170 0x7f1d10159e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.933+0000 7f1d0f400640 1 -- 172.21.15.131:0/3932881130 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1015f180 con 0x7f1d100cdd60 2024-04-25T19:22:24.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.933+0000 7feb3aa00640 1 --2- 172.21.15.131:0/2644026823 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7feb1c0745b0 0x7feb1c076ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.933+0000 7f1d0f400640 1 --2- 172.21.15.131:0/3932881130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d100cdd60 0x7f1d1013c1d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009890 tx=0x7f1d000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.933+0000 7f295aa00640 1 -- 172.21.15.131:0/2634100518 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f295c0b7d80 msgr2=0x7f295c09e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.933+0000 7f295aa00640 1 --2- 172.21.15.131:0/2634100518 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f295c0b7d80 0x7f295c09e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.933+0000 7f295aa00640 1 -- 172.21.15.131:0/2634100518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f295c0cec70 msgr2=0x7f295c09eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.933+0000 7f295aa00640 1 --2- 172.21.15.131:0/2634100518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f295c0cec70 0x7f295c09eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.933+0000 7f295aa00640 1 -- 172.21.15.131:0/2634100518 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f295c09f6f0 con 0x7f295c06eba0 2024-04-25T19:22:24.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.934+0000 7f295aa00640 1 --2- 172.21.15.131:0/2634100518 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f295c06eba0 0x7f295c1523f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f294c010e20 tx=0x7f294c00e730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.934+0000 7fe37e000640 1 --2- 172.21.15.131:0/3572374962 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe360074530 0x7fe360076a40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe36c034000 tx=0x7fe36c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.935+0000 7f2952a00640 1 -- 172.21.15.131:0/2634100518 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c01e070 con 0x7f295c06eba0 2024-04-25T19:22:24.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.935+0000 7feb3aa00640 1 --2- 172.21.15.131:0/2644026823 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7feb1c0745b0 0x7feb1c076ac0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feb2c007fd0 tx=0x7feb2c007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.935+0000 7f2952a00640 1 -- 172.21.15.131:0/2634100518 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f294c011660 con 0x7f295c06eba0 2024-04-25T19:22:24.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.935+0000 7f2952a00640 1 -- 172.21.15.131:0/2634100518 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c011a50 con 0x7f295c06eba0 2024-04-25T19:22:24.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.935+0000 7f2961800640 1 -- 172.21.15.131:0/2634100518 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f295c09f9d0 con 0x7f295c06eba0 2024-04-25T19:22:24.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.935+0000 7f831d600640 1 Processor -- start 2024-04-25T19:22:24.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.935+0000 7f831d600640 1 -- start start 2024-04-25T19:22:24.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.935+0000 7faa2a600640 1 Processor -- start 2024-04-25T19:22:24.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.935+0000 7faa2a600640 1 -- start start 2024-04-25T19:22:24.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.935+0000 7f2961800640 1 -- 172.21.15.131:0/2634100518 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f295c09ff90 con 0x7f295c06eba0 2024-04-25T19:22:24.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.936+0000 7f831d600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f831806f160 0x7f831815b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.937+0000 7f831d600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83180d0360 0x7f831815d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.937+0000 7f831d600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8318149df0 0x7f83181ef670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.937+0000 7f831d600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f831814ab90 con 0x7f83180d0360 2024-04-25T19:22:24.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.937+0000 7f831d600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f83180cde70 con 0x7f8318149df0 2024-04-25T19:22:24.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.937+0000 7f831d600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f831806f570 con 0x7f831806f160 2024-04-25T19:22:24.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.937+0000 7f61b1e00640 1 Processor -- start 2024-04-25T19:22:24.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.937+0000 7f8316000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83180d0360 0x7f831815d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.937+0000 7f61b1e00640 1 -- start start 2024-04-25T19:22:24.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.937+0000 7f8316000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83180d0360 0x7f831815d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54340/0 (socket says 172.21.15.131:54340) 2024-04-25T19:22:24.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.937+0000 7f8316a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f831806f160 0x7f831815b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.937+0000 7f8316000640 1 -- 172.21.15.131:0/2217906997 learned_addr learned my addr 172.21.15.131:0/2217906997 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:24.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.937+0000 7f8317400640 1 --2- 172.21.15.131:0/2217906997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8318149df0 0x7f83181ef670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.938+0000 7faa2a600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa2406c5c0 0x7faa241e8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.938+0000 7faa2a600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa240b4cd0 0x7faa241e7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.938+0000 7f2961800640 1 -- 172.21.15.131:0/2634100518 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f295c050740 con 0x7f295c06eba0 2024-04-25T19:22:24.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.938+0000 7faa2a600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa24144370 0x7faa241f3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.938+0000 7faa2a600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7faa240d02d0 con 0x7faa24144370 2024-04-25T19:22:24.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.938+0000 7faa2a600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7faa240d0f50 con 0x7faa240b4cd0 2024-04-25T19:22:24.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.938+0000 7faa2a600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faa240d0450 con 0x7faa2406c5c0 2024-04-25T19:22:24.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.938+0000 7f8316000640 1 -- 172.21.15.131:0/2217906997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f831806f160 msgr2=0x7f831815b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.938+0000 7f8316000640 1 --2- 172.21.15.131:0/2217906997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f831806f160 0x7f831815b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.938+0000 7f8316000640 1 -- 172.21.15.131:0/2217906997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8318149df0 msgr2=0x7f83181ef670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.938+0000 7f8316000640 1 --2- 172.21.15.131:0/2217906997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8318149df0 0x7f83181ef670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.938+0000 7f8316000640 1 -- 172.21.15.131:0/2217906997 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f831815b780 con 0x7f83180d0360 2024-04-25T19:22:24.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.939+0000 7faa29c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa24144370 0x7faa241f3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.939+0000 7faa29c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa24144370 0x7faa241f3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54348/0 (socket says 172.21.15.131:54348) 2024-04-25T19:22:24.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.939+0000 7faa29c00640 1 -- 172.21.15.131:0/115478385 learned_addr learned my addr 172.21.15.131:0/115478385 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:24.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.939+0000 7faa23e00640 1 --2- 172.21.15.131:0/115478385 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa240b4cd0 0x7faa241e7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.939+0000 7faa29c00640 1 -- 172.21.15.131:0/115478385 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa2406c5c0 msgr2=0x7faa241e8d10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T19:22:24.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.939+0000 7faa29c00640 1 --2- 172.21.15.131:0/115478385 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa2406c5c0 0x7faa241e8d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.939+0000 7faa29c00640 1 -- 172.21.15.131:0/115478385 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa240b4cd0 msgr2=0x7faa241e7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.939+0000 7faa29c00640 1 --2- 172.21.15.131:0/115478385 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa240b4cd0 0x7faa241e7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.939+0000 7faa29c00640 1 -- 172.21.15.131:0/115478385 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa241e7fb0 con 0x7faa24144370 2024-04-25T19:22:24.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.940+0000 7faa29c00640 1 --2- 172.21.15.131:0/115478385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa24144370 0x7faa241f3a00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00caf0 tx=0x7faa1c002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.940+0000 7f8316000640 1 --2- 172.21.15.131:0/2217906997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83180d0360 0x7f831815d630 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f830400c410 tx=0x7f830400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.940+0000 7f61b1e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61ac0d50e0 0x7f61ac0d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.940+0000 7f61b1e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f61ac160d60 0x7f61ac161810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.940+0000 7f61b1e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61ac0b7940 con 0x7f61ac0d2ae0 2024-04-25T19:22:24.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.940+0000 7f61b1e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f61ac0d2ef0 con 0x7f61ac160d60 2024-04-25T19:22:24.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.940+0000 7f61b1e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f61ac161280 con 0x7f61ac0d50e0 2024-04-25T19:22:24.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.940+0000 7f61b0a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61ac0d50e0 0x7f61ac0d25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.940+0000 7f61abe00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f61ac0d2ae0 0x7f61ac160650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.131:43984/0 (socket says 172.21.15.131:43984) 2024-04-25T19:22:24.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.940+0000 7f61abe00640 1 -- 172.21.15.131:0/3434204283 learned_addr learned my addr 172.21.15.131:0/3434204283 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:24.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.941+0000 7f61b1400640 1 --2- 172.21.15.131:0/3434204283 >> v2:172.21.15.195:3300/0 conn(0x7f61ac160d60 0x7f61ac161810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.941+0000 7f61b1400640 1 -- 172.21.15.131:0/3434204283 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61ac0d50e0 msgr2=0x7f61ac0d25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:24.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.941+0000 7f61b1400640 1 --2- 172.21.15.131:0/3434204283 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61ac0d50e0 0x7f61ac0d25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.941+0000 7f61b1400640 1 -- 172.21.15.131:0/3434204283 >> v1:172.21.15.195:6789/0 conn(0x7f61ac0d2ae0 legacy=0x7f61ac160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.941+0000 7f61b1400640 1 -- 172.21.15.131:0/3434204283 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61ac0d4600 con 0x7f61ac160d60 2024-04-25T19:22:24.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.942+0000 7f2952a00640 1 -- 172.21.15.131:0/2634100518 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f294c021070 con 0x7f295c06eba0 2024-04-25T19:22:24.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.942+0000 7f61b1400640 1 --2- 172.21.15.131:0/3434204283 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61ac160d60 0x7f61ac161810 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009d90 tx=0x7f61a402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88424f0d51a0d811 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.943+0000 7faa20c00640 1 -- 172.21.15.131:0/115478385 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c018070 con 0x7faa24144370 2024-04-25T19:22:24.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.943+0000 7f830ea00640 1 -- 172.21.15.131:0/2217906997 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8304017070 con 0x7f83180d0360 2024-04-25T19:22:24.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.943+0000 7f830ea00640 1 -- 172.21.15.131:0/2217906997 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8304005ce0 con 0x7f83180d0360 2024-04-25T19:22:24.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.943+0000 7f1d07400640 1 -- 172.21.15.131:0/3932881130 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00041020 con 0x7f1d100cdd60 2024-04-25T19:22:24.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.943+0000 7f1d07400640 1 -- 172.21.15.131:0/3932881130 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d0003d690 con 0x7f1d100cdd60 2024-04-25T19:22:24.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.943+0000 7f1d07400640 1 -- 172.21.15.131:0/3932881130 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00037040 con 0x7f1d100cdd60 2024-04-25T19:22:24.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.943+0000 7f830ea00640 1 -- 172.21.15.131:0/2217906997 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83040072f0 con 0x7f83180d0360 2024-04-25T19:22:24.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.943+0000 7f831d600640 1 -- 172.21.15.131:0/2217906997 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83181f06f0 con 0x7f83180d0360 2024-04-25T19:22:24.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.943+0000 7f1d16600640 1 -- 172.21.15.131:0/3932881130 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d1015ea30 con 0x7f1d100cdd60 2024-04-25T19:22:24.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.943+0000 7f1d16600640 1 -- 172.21.15.131:0/3932881130 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d1015eea0 con 0x7f1d100cdd60 2024-04-25T19:22:24.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.943+0000 7faa2a600640 1 -- 172.21.15.131:0/115478385 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa241e8290 con 0x7faa24144370 2024-04-25T19:22:24.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.943+0000 7faa2a600640 1 -- 172.21.15.131:0/115478385 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa24132d10 con 0x7faa24144370 2024-04-25T19:22:24.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.943+0000 7f831d600640 1 -- 172.21.15.131:0/2217906997 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83181ee8b0 con 0x7f83180d0360 2024-04-25T19:22:24.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.943+0000 7faa20c00640 1 -- 172.21.15.131:0/115478385 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa1c00a7c0 con 0x7faa24144370 2024-04-25T19:22:24.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.943+0000 7faa20c00640 1 -- 172.21.15.131:0/115478385 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c00ab90 con 0x7faa24144370 2024-04-25T19:22:24.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.943+0000 7fe376a00640 1 -- 172.21.15.131:0/3572374962 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe37001f020 con 0x7fe3800b5e40 2024-04-25T19:22:24.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.944+0000 7f2952a00640 1 --2- 172.21.15.131:0/2634100518 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f293c0744b0 0x7f293c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.944+0000 7f2952a00640 1 -- 172.21.15.131:0/2634100518 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f294c098150 con 0x7f295c06eba0 2024-04-25T19:22:24.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.944+0000 7f1d16600640 1 -- 172.21.15.131:0/3932881130 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d10050740 con 0x7f1d100cdd60 2024-04-25T19:22:24.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.945+0000 7f831d600640 1 -- 172.21.15.131:0/2217906997 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8318050740 con 0x7f83180d0360 2024-04-25T19:22:24.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.945+0000 7f295a000640 1 --2- 172.21.15.131:0/2634100518 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f293c0744b0 0x7f293c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.945+0000 7faa2a600640 1 -- 172.21.15.131:0/115478385 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa00005290 con 0x7faa24144370 2024-04-25T19:22:24.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.948+0000 7f295a000640 1 --2- 172.21.15.131:0/2634100518 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f293c0744b0 0x7f293c0769c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2948034000 tx=0x7f294802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.948+0000 7faa20c00640 1 -- 172.21.15.131:0/115478385 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7faa1c01b070 con 0x7faa24144370 2024-04-25T19:22:24.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.948+0000 7f1d07400640 1 -- 172.21.15.131:0/3932881130 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1d00044020 con 0x7f1d100cdd60 2024-04-25T19:22:24.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.949+0000 7faa20c00640 1 --2- 172.21.15.131:0/115478385 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7faa040744e0 0x7faa040769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.949+0000 7faa20c00640 1 -- 172.21.15.131:0/115478385 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faa1c094e80 con 0x7faa24144370 2024-04-25T19:22:24.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.949+0000 7f1d07400640 1 --2- 172.21.15.131:0/3932881130 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1cf00745b0 0x7f1cf0076ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.949+0000 7f1d07400640 1 -- 172.21.15.131:0/3932881130 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1d000b5d20 con 0x7f1d100cdd60 2024-04-25T19:22:24.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.950+0000 7f830ea00640 1 -- 172.21.15.131:0/2217906997 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f830401a070 con 0x7f83180d0360 2024-04-25T19:22:24.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.950+0000 7faa29200640 1 --2- 172.21.15.131:0/115478385 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7faa040744e0 0x7faa040769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.950+0000 7f1d0ea00640 1 --2- 172.21.15.131:0/3932881130 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1cf00745b0 0x7f1cf0076ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.951+0000 7faa29200640 1 --2- 172.21.15.131:0/115478385 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7faa040744e0 0x7faa040769f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faa18009610 tx=0x7faa18006b80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.951+0000 7f830ea00640 1 --2- 172.21.15.131:0/2217906997 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f82f80746e0 0x7f82f8076bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.952+0000 7f1d0ea00640 1 --2- 172.21.15.131:0/3932881130 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1cf00745b0 0x7f1cf0076ac0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc000f60 tx=0x7f1cfc007a00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.952+0000 7f830ea00640 1 -- 172.21.15.131:0/2217906997 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f83040070d0 con 0x7f83180d0360 2024-04-25T19:22:24.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.952+0000 7f8316a00640 1 --2- 172.21.15.131:0/2217906997 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f82f80746e0 0x7f82f8076bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.952+0000 7f1d07400640 1 -- 172.21.15.131:0/3932881130 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1d0004b030 con 0x7f1d100cdd60 2024-04-25T19:22:24.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.952+0000 7f61ab400640 1 -- 172.21.15.131:0/3434204283 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a4007740 con 0x7f61ac160d60 2024-04-25T19:22:24.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.953+0000 7feb32a00640 1 -- 172.21.15.131:0/2644026823 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feb3c0b5c50 con 0x7feb3c0d1120 2024-04-25T19:22:24.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.953+0000 7f8316a00640 1 --2- 172.21.15.131:0/2217906997 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f82f80746e0 0x7f82f8076bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f83080016c0 tx=0x7f8308009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.954+0000 7f61ab400640 1 -- 172.21.15.131:0/3434204283 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a40078e0 con 0x7f61ac160d60 2024-04-25T19:22:24.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.954+0000 7f61ab400640 1 -- 172.21.15.131:0/3434204283 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a4007cb0 con 0x7f61ac160d60 2024-04-25T19:22:24.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.953+0000 7f4518a00640 1 -- 172.21.15.131:0/1524356468 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c037070 con 0x7f451c0d2e30 2024-04-25T19:22:24.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.953+0000 7f4518a00640 1 -- 172.21.15.131:0/1524356468 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f450c032440 con 0x7f451c0d2e30 2024-04-25T19:22:24.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.953+0000 7f4518a00640 1 -- 172.21.15.131:0/1524356468 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c032850 con 0x7f451c0d2e30 2024-04-25T19:22:24.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.954+0000 7f451b200640 1 -- 172.21.15.131:0/1524356468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f451c0d2e30 msgr2=0x7f451c160600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.954+0000 7f451b200640 1 --2- 172.21.15.131:0/1524356468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f451c0d2e30 0x7f451c160600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f451c0d3920 tx=0x7f450c02a1c0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.954+0000 7f451b200640 1 -- 172.21.15.131:0/1524356468 shutdown_connections 2024-04-25T19:22:24.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.954+0000 7f451b200640 1 --2- 172.21.15.131:0/1524356468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f451c0d2e30 0x7f451c160600 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.954+0000 7f451b200640 1 --2- 172.21.15.131:0/1524356468 >> v2:172.21.15.131:3300/0 conn(0x7f451c0d4f70 0x7f451c0d28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.954+0000 7f451b200640 1 -- 172.21.15.131:0/1524356468 >> 172.21.15.131:0/1524356468 conn(0x7f451c06dfe0 msgr2=0x7f451c06e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:24.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.955+0000 7f61b1e00640 1 -- 172.21.15.131:0/3434204283 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61ac160d60 msgr2=0x7f61ac161810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.955+0000 7f61b1e00640 1 --2- 172.21.15.131:0/3434204283 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61ac160d60 0x7f61ac161810 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009d90 tx=0x7f61a402a660 comp rx=0 tx=0).stop 2024-04-25T19:22:24.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.954+0000 7f451b200640 1 -- 172.21.15.131:0/1524356468 shutdown_connections 2024-04-25T19:22:24.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.955+0000 7f451b200640 1 -- 172.21.15.131:0/1524356468 wait complete. 2024-04-25T19:22:24.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.955+0000 7f61b1e00640 1 -- 172.21.15.131:0/3434204283 shutdown_connections 2024-04-25T19:22:24.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.955+0000 7f61b1e00640 1 --2- 172.21.15.131:0/3434204283 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61ac160d60 0x7f61ac161810 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.955+0000 7f61b1e00640 1 --2- 172.21.15.131:0/3434204283 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61ac0d50e0 0x7f61ac0d25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.955+0000 7f61b1e00640 1 -- 172.21.15.131:0/3434204283 >> 172.21.15.131:0/3434204283 conn(0x7f61ac06c5c0 msgr2=0x7f61ac06c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:24.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.955+0000 7f61b1e00640 1 -- 172.21.15.131:0/3434204283 shutdown_connections 2024-04-25T19:22:24.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.956+0000 7f61b1e00640 1 -- 172.21.15.131:0/3434204283 wait complete. 2024-04-25T19:22:24.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.958+0000 7f451b200640 1 Processor -- start 2024-04-25T19:22:24.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.958+0000 7f451b200640 1 -- start start 2024-04-25T19:22:24.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.959+0000 7f61b1e00640 1 Processor -- start 2024-04-25T19:22:24.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.959+0000 7faa20c00640 1 -- 172.21.15.131:0/115478385 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faa1c022080 con 0x7faa24144370 2024-04-25T19:22:24.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.960+0000 7f451b200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f451c0d2e30 0x7f451c1f91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.960+0000 7f451b200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f451c0d4f70 0x7f451c155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.960+0000 7f451b200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f451c160b40 0x7f451c155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.960+0000 7f451b200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f451c0d4770 con 0x7f451c0d2e30 2024-04-25T19:22:24.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.960+0000 7f451b200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f451c0d4490 con 0x7f451c160b40 2024-04-25T19:22:24.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.960+0000 7f451b200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f451c0d4000 con 0x7f451c0d4f70 2024-04-25T19:22:24.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.961+0000 7f4519400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f451c0d4f70 0x7f451c155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.961+0000 7f451a800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f451c160b40 0x7f451c155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.961+0000 7f4519400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f451c0d4f70 0x7f451c155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.131:38284/0 (socket says 172.21.15.131:38284) 2024-04-25T19:22:24.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.961+0000 7f4519400640 1 -- 172.21.15.131:0/3981403773 learned_addr learned my addr 172.21.15.131:0/3981403773 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:24.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.961+0000 7f2952a00640 1 -- 172.21.15.131:0/2634100518 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f294c062300 con 0x7f295c06eba0 2024-04-25T19:22:24.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.961+0000 7f61b1e00640 1 -- start start 2024-04-25T19:22:24.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.962+0000 7f4519e00640 1 --2- 172.21.15.131:0/3981403773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f451c0d2e30 0x7f451c1f91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.962+0000 7f451a800640 1 -- 172.21.15.131:0/3981403773 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f451c0d4f70 msgr2=0x7f451c155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.962+0000 7f451a800640 1 --2- 172.21.15.131:0/3981403773 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f451c0d4f70 0x7f451c155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.962+0000 7f451a800640 1 -- 172.21.15.131:0/3981403773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f451c0d2e30 msgr2=0x7f451c1f91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.962+0000 7f451a800640 1 --2- 172.21.15.131:0/3981403773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f451c0d2e30 0x7f451c1f91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.962+0000 7f451a800640 1 -- 172.21.15.131:0/3981403773 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f451c156830 con 0x7f451c160b40 2024-04-25T19:22:24.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.962+0000 7f451a800640 1 --2- 172.21.15.131:0/3981403773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f451c160b40 0x7f451c155fd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f451c0d34d0 tx=0x7f450400c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.963+0000 7f4512000640 1 -- 172.21.15.131:0/3981403773 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4504017070 con 0x7f451c160b40 2024-04-25T19:22:24.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.963+0000 7f451b200640 1 -- 172.21.15.131:0/3981403773 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f451c156b10 con 0x7f451c160b40 2024-04-25T19:22:24.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.963+0000 7f451b200640 1 -- 172.21.15.131:0/3981403773 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f451c1570d0 con 0x7f451c160b40 2024-04-25T19:22:24.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.963+0000 7f61b1e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61ac0d2ae0 0x7f61ac1fb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.963+0000 7f61b1e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61ac0d50e0 0x7f61ac0c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.963+0000 7f61b1e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61ac160d60 0x7f61ac0b6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.963+0000 7f61b1e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f61ac161560 con 0x7f61ac0d2ae0 2024-04-25T19:22:24.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.963+0000 7f61b1e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f61ac0d4bc0 con 0x7f61ac160d60 2024-04-25T19:22:24.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.963+0000 7f61b1e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f61ac0d54f0 con 0x7f61ac0d50e0 2024-04-25T19:22:24.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.964+0000 7f61b1400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61ac160d60 0x7f61ac0b6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.964+0000 7f61b1400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61ac160d60 0x7f61ac0b6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.131:58882/0 (socket says 172.21.15.131:58882) 2024-04-25T19:22:24.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.964+0000 7f61b1400640 1 -- 172.21.15.131:0/967529034 learned_addr learned my addr 172.21.15.131:0/967529034 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:24.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.963+0000 7f4512000640 1 -- 172.21.15.131:0/3981403773 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45040052d0 con 0x7f451c160b40 2024-04-25T19:22:24.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.963+0000 7f4512000640 1 -- 172.21.15.131:0/3981403773 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4504003810 con 0x7f451c160b40 2024-04-25T19:22:24.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.965+0000 7f451b200640 1 -- 172.21.15.131:0/3981403773 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f451c1565a0 con 0x7f451c160b40 2024-04-25T19:22:24.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.965+0000 7f61b1400640 1 -- 172.21.15.131:0/967529034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61ac0d50e0 msgr2=0x7f61ac0c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.965+0000 7f61b1400640 1 --2- 172.21.15.131:0/967529034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61ac0d50e0 0x7f61ac0c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.965+0000 7f61b1400640 1 -- 172.21.15.131:0/967529034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61ac0d2ae0 msgr2=0x7f61ac1fb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:24.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.965+0000 7f61b1400640 1 --2- 172.21.15.131:0/967529034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61ac0d2ae0 0x7f61ac1fb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:24.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.965+0000 7f61b1400640 1 -- 172.21.15.131:0/967529034 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61ac071a10 con 0x7f61ac160d60 2024-04-25T19:22:24.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.967+0000 7f61b1400640 1 --2- 172.21.15.131:0/967529034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61ac160d60 0x7f61ac0b6940 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009eb0 tx=0x7f61a4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:24.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.967+0000 7f61a8c00640 1 -- 172.21.15.131:0/967529034 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a403f070 con 0x7f61ac160d60 2024-04-25T19:22:24.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.967+0000 7f61b1e00640 1 -- 172.21.15.131:0/967529034 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61ac071cf0 con 0x7f61ac160d60 2024-04-25T19:22:24.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.967+0000 7f61b1e00640 1 -- 172.21.15.131:0/967529034 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61ac072780 con 0x7f61ac160d60 2024-04-25T19:22:24.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.968+0000 7f61a8c00640 1 -- 172.21.15.131:0/967529034 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a4031bc0 con 0x7f61ac160d60 2024-04-25T19:22:24.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.968+0000 7f61a8c00640 1 -- 172.21.15.131:0/967529034 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a403f070 con 0x7f61ac160d60 2024-04-25T19:22:24.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.968+0000 7f830ea00640 1 -- 172.21.15.131:0/2217906997 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8304021020 con 0x7f83180d0360 2024-04-25T19:22:24.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.968+0000 7f4512000640 1 -- 172.21.15.131:0/3981403773 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f450401a070 con 0x7f451c160b40 2024-04-25T19:22:24.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.969+0000 7f61b1e00640 1 -- 172.21.15.131:0/967529034 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6188005290 con 0x7f61ac160d60 2024-04-25T19:22:24.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.969+0000 7f4512000640 1 --2- 172.21.15.131:0/3981403773 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f44f80744e0 0x7f44f80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:24.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.970+0000 7f4512000640 1 -- 172.21.15.131:0/3981403773 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f45040942c0 con 0x7f451c160b40 2024-04-25T19:22:24.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.970+0000 7f4519e00640 1 --2- 172.21.15.131:0/3981403773 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f44f80744e0 0x7f44f80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:24.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.972+0000 7f4519e00640 1 --2- 172.21.15.131:0/3981403773 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f44f80744e0 0x7f44f80769f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f451c163b80 tx=0x7f451400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:25.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.972+0000 7f61a8c00640 1 -- 172.21.15.131:0/967529034 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f61a403b410 con 0x7f61ac160d60 2024-04-25T19:22:25.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.974+0000 7f61a8c00640 1 --2- 172.21.15.131:0/967529034 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f618c0746b0 0x7f618c076bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:25.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.975+0000 7f61b0a00640 1 --2- 172.21.15.131:0/967529034 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f618c0746b0 0x7f618c076bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:25.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.976+0000 7f61b0a00640 1 --2- 172.21.15.131:0/967529034 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f618c0746b0 0x7f618c076bc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f61a0006a90 tx=0x7f61a0006a20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:25.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.984+0000 7f61a8c00640 1 -- 172.21.15.131:0/967529034 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f61a403cdb0 con 0x7f61ac160d60 2024-04-25T19:22:25.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.984+0000 7f4512000640 1 -- 172.21.15.131:0/3981403773 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f451c0d3240 con 0x7f451c160b40 2024-04-25T19:22:25.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:24.998+0000 7f61a8c00640 1 -- 172.21.15.131:0/967529034 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f61a4080b40 con 0x7f61ac160d60 2024-04-25T19:22:25.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.368+0000 7f2961800640 1 -- 172.21.15.131:0/2634100518 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f295c06f210 con 0x7f295c06eba0 2024-04-25T19:22:25.373 INFO:teuthology.orchestra.run.smithi131.stdout:55834574853 2024-04-25T19:22:25.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.370+0000 7f2952a00640 1 -- 172.21.15.131:0/2634100518 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f294c066600 con 0x7f295c06eba0 2024-04-25T19:22:25.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.373+0000 7f2947e00640 1 -- 172.21.15.131:0/2634100518 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f293c0744b0 msgr2=0x7f293c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:25.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.373+0000 7f2947e00640 1 --2- 172.21.15.131:0/2634100518 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f293c0744b0 0x7f293c0769c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2948034000 tx=0x7f294802e000 comp rx=0 tx=0).stop 2024-04-25T19:22:25.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.374+0000 7f2947e00640 1 -- 172.21.15.131:0/2634100518 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f295c06eba0 msgr2=0x7f295c1523f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:25.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.374+0000 7f2947e00640 1 --2- 172.21.15.131:0/2634100518 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f295c06eba0 0x7f295c1523f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f294c010e20 tx=0x7f294c00e730 comp rx=0 tx=0).stop 2024-04-25T19:22:25.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.374+0000 7f2947e00640 1 -- 172.21.15.131:0/2634100518 shutdown_connections 2024-04-25T19:22:25.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.374+0000 7f2947e00640 1 --2- 172.21.15.131:0/2634100518 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f293c0744b0 0x7f293c0769c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.374+0000 7f2947e00640 1 --2- 172.21.15.131:0/2634100518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f295c0cec70 0x7f295c09eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.374+0000 7f2947e00640 1 --2- 172.21.15.131:0/2634100518 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f295c0b7d80 0x7f295c09e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.374+0000 7f2947e00640 1 --2- 172.21.15.131:0/2634100518 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f295c06eba0 0x7f295c1523f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.374+0000 7f2947e00640 1 -- 172.21.15.131:0/2634100518 >> 172.21.15.131:0/2634100518 conn(0x7f295c09b7d0 msgr2=0x7f295c0d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:25.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.375+0000 7f2947e00640 1 -- 172.21.15.131:0/2634100518 shutdown_connections 2024-04-25T19:22:25.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.375+0000 7f2947e00640 1 -- 172.21.15.131:0/2634100518 wait complete. 2024-04-25T19:22:25.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.383+0000 7f1d16600640 1 -- 172.21.15.131:0/3932881130 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1d100b31b0 con 0x7f1d100cdd60 2024-04-25T19:22:25.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.385+0000 7f1d07400640 1 -- 172.21.15.131:0/3932881130 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1d00080520 con 0x7f1d100cdd60 2024-04-25T19:22:25.387 INFO:teuthology.orchestra.run.smithi131.stdout:55834574853 2024-04-25T19:22:25.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.387+0000 7fe385a00640 1 -- 172.21.15.131:0/3572374962 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe3800ab3e0 con 0x7fe3800b5e40 2024-04-25T19:22:25.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.388+0000 7fe376a00640 1 -- 172.21.15.131:0/3572374962 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe37005f870 con 0x7fe3800b5e40 2024-04-25T19:22:25.389 INFO:teuthology.orchestra.run.smithi131.stdout:55834574854 2024-04-25T19:22:25.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.390+0000 7f1d16600640 1 -- 172.21.15.131:0/3932881130 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1cf00745b0 msgr2=0x7f1cf0076ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:25.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.390+0000 7f1d16600640 1 --2- 172.21.15.131:0/3932881130 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1cf00745b0 0x7f1cf0076ac0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc000f60 tx=0x7f1cfc007a00 comp rx=0 tx=0).stop 2024-04-25T19:22:25.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.390+0000 7f1d16600640 1 -- 172.21.15.131:0/3932881130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d100cdd60 msgr2=0x7f1d1013c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:25.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.390+0000 7f1d16600640 1 --2- 172.21.15.131:0/3932881130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d100cdd60 0x7f1d1013c1d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009890 tx=0x7f1d000046c0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.390+0000 7fe385a00640 1 -- 172.21.15.131:0/3572374962 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe360074530 msgr2=0x7fe360076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:25.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.390+0000 7fe385a00640 1 --2- 172.21.15.131:0/3572374962 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe360074530 0x7fe360076a40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe36c034000 tx=0x7fe36c02e000 comp rx=0 tx=0).stop 2024-04-25T19:22:25.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.391+0000 7f1d16600640 1 -- 172.21.15.131:0/3932881130 shutdown_connections 2024-04-25T19:22:25.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.391+0000 7f1d16600640 1 --2- 172.21.15.131:0/3932881130 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1cf00745b0 0x7f1cf0076ac0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.391+0000 7f1d16600640 1 --2- 172.21.15.131:0/3932881130 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d1015fe00 0x7f1d1015a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.391+0000 7f1d16600640 1 --2- 172.21.15.131:0/3932881130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d100ce170 0x7f1d10159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.391+0000 7f1d16600640 1 --2- 172.21.15.131:0/3932881130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d100cdd60 0x7f1d1013c1d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.391+0000 7f1d16600640 1 -- 172.21.15.131:0/3932881130 >> 172.21.15.131:0/3932881130 conn(0x7f1d10073050 msgr2=0x7f1d10070e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:25.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.391+0000 7fe385a00640 1 -- 172.21.15.131:0/3572374962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3800b5e40 msgr2=0x7fe3801469e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:25.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.391+0000 7fe385a00640 1 --2- 172.21.15.131:0/3572374962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3800b5e40 0x7fe3801469e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe37000b3f0 tx=0x7fe37000b8b0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.391+0000 7fe385a00640 1 -- 172.21.15.131:0/3572374962 shutdown_connections 2024-04-25T19:22:25.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.391+0000 7fe385a00640 1 --2- 172.21.15.131:0/3572374962 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe360074530 0x7fe360076a40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.391+0000 7fe385a00640 1 --2- 172.21.15.131:0/3572374962 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3801681d0 0x7fe380166dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.391+0000 7fe385a00640 1 --2- 172.21.15.131:0/3572374962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe38014ad60 0x7fe380160080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.391+0000 7fe385a00640 1 --2- 172.21.15.131:0/3572374962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3800b5e40 0x7fe3801469e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.392+0000 7fe385a00640 1 -- 172.21.15.131:0/3572374962 >> 172.21.15.131:0/3572374962 conn(0x7fe3800d1ae0 msgr2=0x7fe3800b1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:25.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.391+0000 7f1d16600640 1 -- 172.21.15.131:0/3932881130 shutdown_connections 2024-04-25T19:22:25.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.392+0000 7fe385a00640 1 -- 172.21.15.131:0/3572374962 shutdown_connections 2024-04-25T19:22:25.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.392+0000 7f1d16600640 1 -- 172.21.15.131:0/3932881130 wait complete. 2024-04-25T19:22:25.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.392+0000 7fe385a00640 1 -- 172.21.15.131:0/3572374962 wait complete. 2024-04-25T19:22:25.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.398+0000 7feb41a00640 1 -- 172.21.15.131:0/2644026823 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7feb3c050740 con 0x7feb3c0d1120 2024-04-25T19:22:25.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.399+0000 7feb32a00640 1 -- 172.21.15.131:0/2644026823 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feb3c152b30 con 0x7feb3c0d1120 2024-04-25T19:22:25.402 INFO:teuthology.orchestra.run.smithi131.stdout:55834574853 2024-04-25T19:22:25.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.402+0000 7feb41a00640 1 -- 172.21.15.131:0/2644026823 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7feb1c0745b0 msgr2=0x7feb1c076ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:25.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.402+0000 7feb41a00640 1 --2- 172.21.15.131:0/2644026823 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7feb1c0745b0 0x7feb1c076ac0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feb2c007fd0 tx=0x7feb2c007de0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.403+0000 7feb41a00640 1 -- 172.21.15.131:0/2644026823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb3c0d1120 msgr2=0x7feb3c1f14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:25.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.403+0000 7feb41a00640 1 --2- 172.21.15.131:0/2644026823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb3c0d1120 0x7feb3c1f14e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feb28000c00 tx=0x7feb280046c0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.403+0000 7feb41a00640 1 -- 172.21.15.131:0/2644026823 shutdown_connections 2024-04-25T19:22:25.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.403+0000 7feb41a00640 1 --2- 172.21.15.131:0/2644026823 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7feb1c0745b0 0x7feb1c076ac0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.403+0000 7feb41a00640 1 --2- 172.21.15.131:0/2644026823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb3c141a40 0x7feb3c141e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.403+0000 7feb41a00640 1 --2- 172.21.15.131:0/2644026823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb3c0d1120 0x7feb3c1f14e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.403+0000 7feb41a00640 1 --2- 172.21.15.131:0/2644026823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb3c0d0780 0x7feb3c1525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.403+0000 7feb41a00640 1 -- 172.21.15.131:0/2644026823 >> 172.21.15.131:0/2644026823 conn(0x7feb3c0d1ae0 msgr2=0x7feb3c0b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:25.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.403+0000 7feb41a00640 1 -- 172.21.15.131:0/2644026823 shutdown_connections 2024-04-25T19:22:25.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.403+0000 7feb41a00640 1 -- 172.21.15.131:0/2644026823 wait complete. 2024-04-25T19:22:25.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.5 2024-04-25T19:22:25.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.418+0000 7faa2a600640 1 -- 172.21.15.131:0/115478385 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7faa00005850 con 0x7faa24144370 2024-04-25T19:22:25.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.419+0000 7faa20c00640 1 -- 172.21.15.131:0/115478385 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faa240b50e0 con 0x7faa24144370 2024-04-25T19:22:25.421 INFO:teuthology.orchestra.run.smithi131.stdout:55834574853 2024-04-25T19:22:25.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.421+0000 7f831d600640 1 -- 172.21.15.131:0/2217906997 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f83180b4b70 con 0x7f83180d0360 2024-04-25T19:22:25.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.422+0000 7f830ea00640 1 -- 172.21.15.131:0/2217906997 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f830405e9f0 con 0x7f83180d0360 2024-04-25T19:22:25.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.422+0000 7f61b1e00640 1 -- 172.21.15.131:0/967529034 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f6188005850 con 0x7f61ac160d60 2024-04-25T19:22:25.423 INFO:teuthology.orchestra.run.smithi131.stdout:55834574853 2024-04-25T19:22:25.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.422+0000 7faa2a600640 1 -- 172.21.15.131:0/115478385 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7faa040744e0 msgr2=0x7faa040769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:25.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.422+0000 7faa2a600640 1 --2- 172.21.15.131:0/115478385 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7faa040744e0 0x7faa040769f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faa18009610 tx=0x7faa18006b80 comp rx=0 tx=0).stop 2024-04-25T19:22:25.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.422+0000 7faa2a600640 1 -- 172.21.15.131:0/115478385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa24144370 msgr2=0x7faa241f3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:25.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.422+0000 7faa2a600640 1 --2- 172.21.15.131:0/115478385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa24144370 0x7faa241f3a00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00caf0 tx=0x7faa1c002190 comp rx=0 tx=0).stop 2024-04-25T19:22:25.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.422+0000 7faa2a600640 1 -- 172.21.15.131:0/115478385 shutdown_connections 2024-04-25T19:22:25.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.422+0000 7faa2a600640 1 --2- 172.21.15.131:0/115478385 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7faa040744e0 0x7faa040769f0 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faa18009610 tx=0x7faa18006b80 comp rx=0 tx=0).stop 2024-04-25T19:22:25.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.422+0000 7faa2a600640 1 --2- 172.21.15.131:0/115478385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa24144370 0x7faa241f3a00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.422+0000 7faa2a600640 1 --2- 172.21.15.131:0/115478385 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa240b4cd0 0x7faa241e7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.422+0000 7faa2a600640 1 --2- 172.21.15.131:0/115478385 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa2406c5c0 0x7faa241e8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.422+0000 7faa2a600640 1 -- 172.21.15.131:0/115478385 >> 172.21.15.131:0/115478385 conn(0x7faa240d1720 msgr2=0x7faa240d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:25.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.423+0000 7f61a8c00640 1 -- 172.21.15.131:0/967529034 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f61a4084e40 con 0x7f61ac160d60 2024-04-25T19:22:25.425 INFO:teuthology.orchestra.run.smithi131.stdout:55834574854 2024-04-25T19:22:25.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.423+0000 7faa2a600640 1 -- 172.21.15.131:0/115478385 shutdown_connections 2024-04-25T19:22:25.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.423+0000 7faa2a600640 1 -- 172.21.15.131:0/115478385 wait complete. 2024-04-25T19:22:25.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.425+0000 7f831d600640 1 -- 172.21.15.131:0/2217906997 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f82f80746e0 msgr2=0x7f82f8076bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:25.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.425+0000 7f831d600640 1 --2- 172.21.15.131:0/2217906997 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f82f80746e0 0x7f82f8076bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f83080016c0 tx=0x7f8308009040 comp rx=0 tx=0).stop 2024-04-25T19:22:25.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.425+0000 7f831d600640 1 -- 172.21.15.131:0/2217906997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83180d0360 msgr2=0x7f831815d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:25.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.425+0000 7f831d600640 1 --2- 172.21.15.131:0/2217906997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83180d0360 0x7f831815d630 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f830400c410 tx=0x7f830400c8d0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.425+0000 7f831d600640 1 -- 172.21.15.131:0/2217906997 shutdown_connections 2024-04-25T19:22:25.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.425+0000 7f831d600640 1 --2- 172.21.15.131:0/2217906997 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f82f80746e0 0x7f82f8076bf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.425+0000 7f831d600640 1 --2- 172.21.15.131:0/2217906997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8318149df0 0x7f83181ef670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.426+0000 7f831d600640 1 --2- 172.21.15.131:0/2217906997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83180d0360 0x7f831815d630 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.426+0000 7f831d600640 1 --2- 172.21.15.131:0/2217906997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f831806f160 0x7f831815b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.426+0000 7f831d600640 1 -- 172.21.15.131:0/2217906997 >> 172.21.15.131:0/2217906997 conn(0x7f8318073050 msgr2=0x7f8318145330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:25.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.426+0000 7f831d600640 1 -- 172.21.15.131:0/2217906997 shutdown_connections 2024-04-25T19:22:25.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.426+0000 7f831d600640 1 -- 172.21.15.131:0/2217906997 wait complete. 2024-04-25T19:22:25.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.426+0000 7f61b1e00640 1 -- 172.21.15.131:0/967529034 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f618c0746b0 msgr2=0x7f618c076bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:25.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.426+0000 7f61b1e00640 1 --2- 172.21.15.131:0/967529034 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f618c0746b0 0x7f618c076bc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f61a0006a90 tx=0x7f61a0006a20 comp rx=0 tx=0).stop 2024-04-25T19:22:25.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.427+0000 7f61b1e00640 1 -- 172.21.15.131:0/967529034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61ac160d60 msgr2=0x7f61ac0b6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:25.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.427+0000 7f61b1e00640 1 --2- 172.21.15.131:0/967529034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61ac160d60 0x7f61ac0b6940 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009eb0 tx=0x7f61a4004a40 comp rx=0 tx=0).stop 2024-04-25T19:22:25.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.427+0000 7f61b1e00640 1 -- 172.21.15.131:0/967529034 shutdown_connections 2024-04-25T19:22:25.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.427+0000 7f61b1e00640 1 --2- 172.21.15.131:0/967529034 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f618c0746b0 0x7f618c076bc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.427+0000 7f61b1e00640 1 --2- 172.21.15.131:0/967529034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61ac0d50e0 0x7f61ac0c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.427+0000 7f61b1e00640 1 --2- 172.21.15.131:0/967529034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61ac160d60 0x7f61ac0b6940 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.427+0000 7f61b1e00640 1 --2- 172.21.15.131:0/967529034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61ac0d2ae0 0x7f61ac1fb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.427+0000 7f61b1e00640 1 -- 172.21.15.131:0/967529034 >> 172.21.15.131:0/967529034 conn(0x7f61ac06c5c0 msgr2=0x7f61ac0baaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:25.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.427+0000 7f61b1e00640 1 -- 172.21.15.131:0/967529034 shutdown_connections 2024-04-25T19:22:25.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.428+0000 7f451b200640 1 -- 172.21.15.131:0/3981403773 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f451c050740 con 0x7f451c160b40 2024-04-25T19:22:25.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.427+0000 7f61b1e00640 1 -- 172.21.15.131:0/967529034 wait complete. 2024-04-25T19:22:25.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.429+0000 7f4512000640 1 -- 172.21.15.131:0/3981403773 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f45040940c0 con 0x7f451c160b40 2024-04-25T19:22:25.431 INFO:teuthology.orchestra.run.smithi131.stdout:55834574852 2024-04-25T19:22:25.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.432+0000 7f451b200640 1 -- 172.21.15.131:0/3981403773 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f44f80744e0 msgr2=0x7f44f80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:25.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.432+0000 7f451b200640 1 --2- 172.21.15.131:0/3981403773 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f44f80744e0 0x7f44f80769f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f451c163b80 tx=0x7f451400b040 comp rx=0 tx=0).stop 2024-04-25T19:22:25.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.432+0000 7f451b200640 1 -- 172.21.15.131:0/3981403773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f451c160b40 msgr2=0x7f451c155fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:25.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.432+0000 7f451b200640 1 --2- 172.21.15.131:0/3981403773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f451c160b40 0x7f451c155fd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f451c0d34d0 tx=0x7f450400c820 comp rx=0 tx=0).stop 2024-04-25T19:22:25.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.433+0000 7f451b200640 1 -- 172.21.15.131:0/3981403773 shutdown_connections 2024-04-25T19:22:25.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.433+0000 7f451b200640 1 --2- 172.21.15.131:0/3981403773 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f44f80744e0 0x7f44f80769f0 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f451c163b80 tx=0x7f451400b040 comp rx=0 tx=0).stop 2024-04-25T19:22:25.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.433+0000 7f451b200640 1 --2- 172.21.15.131:0/3981403773 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f451c0d4f70 0x7f451c155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.433+0000 7f451b200640 1 --2- 172.21.15.131:0/3981403773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f451c160b40 0x7f451c155fd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.433+0000 7f451b200640 1 --2- 172.21.15.131:0/3981403773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f451c0d2e30 0x7f451c1f91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:25.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.433+0000 7f451b200640 1 -- 172.21.15.131:0/3981403773 >> 172.21.15.131:0/3981403773 conn(0x7f451c06dfe0 msgr2=0x7f451c15de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:25.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.433+0000 7f451b200640 1 -- 172.21.15.131:0/3981403773 shutdown_connections 2024-04-25T19:22:25.435 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.3 2024-04-25T19:22:25.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:25.434+0000 7f451b200640 1 -- 172.21.15.131:0/3981403773 wait complete. 2024-04-25T19:22:25.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.2 2024-04-25T19:22:25.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.0 2024-04-25T19:22:25.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.7 2024-04-25T19:22:25.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.1 2024-04-25T19:22:25.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.6 2024-04-25T19:22:25.466 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.4 2024-04-25T19:22:26.419 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T19:22:26.436 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T19:22:26.438 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T19:22:26.440 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T19:22:26.462 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T19:22:26.464 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T19:22:26.466 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T19:22:26.466 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T19:22:26.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.820+0000 7fd3d5600640 1 Processor -- start 2024-04-25T19:22:26.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.820+0000 7fd3d5600640 1 -- start start 2024-04-25T19:22:26.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.824+0000 7fd3d5600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd3c80e3a80 0x7fd3c8057bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.825+0000 7fd3d5600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd3c80073c0 0x7fd3c80077d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.825+0000 7fd3d5600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3c8007d10 con 0x7fd3c8058b80 2024-04-25T19:22:26.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.825+0000 7fd3d5600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd3c8057720 con 0x7fd3c80e3a80 2024-04-25T19:22:26.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.825+0000 7fd3d5600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd3c8056df0 con 0x7fd3c80073c0 2024-04-25T19:22:26.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.826+0000 7fd3cea00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd3c80e3a80 0x7fd3c8057bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.826+0000 7fd3cea00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd3c80e3a80 0x7fd3c8057bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54378/0 (socket says 172.21.15.131:54378) 2024-04-25T19:22:26.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.826+0000 7fd3cea00640 1 -- 172.21.15.131:0/935290184 learned_addr learned my addr 172.21.15.131:0/935290184 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:26.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.827+0000 7fd3cf400640 1 --2- 172.21.15.131:0/935290184 >> v2:172.21.15.195:3300/0 conn(0x7fd3c80073c0 0x7fd3c80077d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.827+0000 7fd3cd600640 1 -- 172.21.15.131:0/935290184 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 318167304 0 0) 0x7fd3c0001110 con 0x7fd3c8058b80 2024-04-25T19:22:26.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.828+0000 7fd3cd600640 1 -- 172.21.15.131:0/935290184 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3b4003520 con 0x7fd3c8058b80 2024-04-25T19:22:26.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.828+0000 7fd3cea00640 1 -- 172.21.15.131:0/935290184 >> v2:172.21.15.195:3300/0 conn(0x7fd3c80073c0 msgr2=0x7fd3c80077d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:26.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.828+0000 7fd3cea00640 1 --2- 172.21.15.131:0/935290184 >> v2:172.21.15.195:3300/0 conn(0x7fd3c80073c0 0x7fd3c80077d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.828+0000 7fd3cea00640 1 -- 172.21.15.131:0/935290184 >> v1:172.21.15.195:6789/0 conn(0x7fd3c8058b80 legacy=0x7fd3c80380d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.828+0000 7fd3cea00640 1 -- 172.21.15.131:0/935290184 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c80570d0 con 0x7fd3c80e3a80 2024-04-25T19:22:26.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.830+0000 7fd3cea00640 1 --2- 172.21.15.131:0/935290184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c80e3a80 0x7fd3c8057bb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd3d002e0e0 tx=0x7fd3d006a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d777501dd67ff02d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:26.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.831+0000 7fd3cd600640 1 -- 172.21.15.131:0/935290184 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d00b4070 con 0x7fd3c80e3a80 2024-04-25T19:22:26.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.831+0000 7fd3cd600640 1 -- 172.21.15.131:0/935290184 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d00a7df0 con 0x7fd3c80e3a80 2024-04-25T19:22:26.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.831+0000 7fd3cd600640 1 -- 172.21.15.131:0/935290184 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d00af640 con 0x7fd3c80e3a80 2024-04-25T19:22:26.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.833+0000 7fd3d5600640 1 -- 172.21.15.131:0/935290184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c80e3a80 msgr2=0x7fd3c8057bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.833+0000 7fd3d5600640 1 --2- 172.21.15.131:0/935290184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c80e3a80 0x7fd3c8057bb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd3d002e0e0 tx=0x7fd3d006a5c0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.833+0000 7fd3d5600640 1 -- 172.21.15.131:0/935290184 shutdown_connections 2024-04-25T19:22:26.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.833+0000 7fd3d5600640 1 --2- 172.21.15.131:0/935290184 >> v2:172.21.15.195:3300/0 conn(0x7fd3c80073c0 0x7fd3c80077d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.833+0000 7fd3d5600640 1 --2- 172.21.15.131:0/935290184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c80e3a80 0x7fd3c8057bb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.834+0000 7fd3d5600640 1 -- 172.21.15.131:0/935290184 >> 172.21.15.131:0/935290184 conn(0x7fd3c803abe0 msgr2=0x7fd3c803aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:26.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.834+0000 7fd3d5600640 1 -- 172.21.15.131:0/935290184 shutdown_connections 2024-04-25T19:22:26.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.834+0000 7fd3d5600640 1 -- 172.21.15.131:0/935290184 wait complete. 2024-04-25T19:22:26.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.839+0000 7fd3d5600640 1 Processor -- start 2024-04-25T19:22:26.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.839+0000 7fd3d5600640 1 -- start start 2024-04-25T19:22:26.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.842+0000 7fd3d5600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3c80073c0 0x7fd3c80d81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.843+0000 7fd3d5600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c8058b80 0x7fd3c8051390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.843+0000 7fd3cea00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3c80073c0 0x7fd3c80d81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.843+0000 7fd3cea00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3c80073c0 0x7fd3c80d81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.131:38302/0 (socket says 172.21.15.131:38302) 2024-04-25T19:22:26.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.844+0000 7fd3ce000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c8058b80 0x7fd3c8051390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.844+0000 7fd3ce000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c8058b80 0x7fd3c8051390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54386/0 (socket says 172.21.15.131:54386) 2024-04-25T19:22:26.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.844+0000 7fd3d5600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3c80e3a80 0x7fd3c816d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.845+0000 7fd3ce000640 1 -- 172.21.15.131:0/3350838888 learned_addr learned my addr 172.21.15.131:0/3350838888 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:26.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.845+0000 7fd3d5600640 1 -- 172.21.15.131:0/3350838888 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c803c830 con 0x7fd3c8058b80 2024-04-25T19:22:26.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.845+0000 7fd3d5600640 1 -- 172.21.15.131:0/3350838888 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c8037d60 con 0x7fd3c80e3a80 2024-04-25T19:22:26.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.845+0000 7fd3cf400640 1 --2- 172.21.15.131:0/3350838888 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3c80e3a80 0x7fd3c816d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.846+0000 7fd3d5600640 1 -- 172.21.15.131:0/3350838888 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c803c9b0 con 0x7fd3c80073c0 2024-04-25T19:22:26.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.847+0000 7fd3ce000640 1 -- 172.21.15.131:0/3350838888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3c80073c0 msgr2=0x7fd3c80d81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.847+0000 7fd3ce000640 1 --2- 172.21.15.131:0/3350838888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3c80073c0 0x7fd3c80d81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.847+0000 7fd3ce000640 1 -- 172.21.15.131:0/3350838888 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3c80e3a80 msgr2=0x7fd3c816d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.847+0000 7fd3ce000640 1 --2- 172.21.15.131:0/3350838888 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3c80e3a80 0x7fd3c816d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.848+0000 7fd3ce000640 1 -- 172.21.15.131:0/3350838888 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c8051e50 con 0x7fd3c8058b80 2024-04-25T19:22:26.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.849+0000 7fd3ce000640 1 --2- 172.21.15.131:0/3350838888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c8058b80 0x7fd3c8051390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000c700 tx=0x7fd3c000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:26.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.849+0000 7fd3c6a00640 1 -- 172.21.15.131:0/3350838888 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c00052d0 con 0x7fd3c8058b80 2024-04-25T19:22:26.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.850+0000 7fd3c6a00640 1 -- 172.21.15.131:0/3350838888 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3c0005470 con 0x7fd3c8058b80 2024-04-25T19:22:26.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.850+0000 7fd3d5600640 1 -- 172.21.15.131:0/3350838888 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c8052130 con 0x7fd3c8058b80 2024-04-25T19:22:26.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.850+0000 7fd3c6a00640 1 -- 172.21.15.131:0/3350838888 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0003830 con 0x7fd3c8058b80 2024-04-25T19:22:26.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.850+0000 7fd3d5600640 1 -- 172.21.15.131:0/3350838888 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3c80526f0 con 0x7fd3c8058b80 2024-04-25T19:22:26.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.852+0000 7fd3d5600640 1 -- 172.21.15.131:0/3350838888 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3a8005290 con 0x7fd3c8058b80 2024-04-25T19:22:26.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.855+0000 7fd3c6a00640 1 -- 172.21.15.131:0/3350838888 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd3c00039d0 con 0x7fd3c8058b80 2024-04-25T19:22:26.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.857+0000 7fd3c6a00640 1 --2- 172.21.15.131:0/3350838888 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd3b00744e0 0x7fd3b00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.857+0000 7fd3c6a00640 1 -- 172.21.15.131:0/3350838888 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd3c0095760 con 0x7fd3c8058b80 2024-04-25T19:22:26.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.858+0000 7fd3cea00640 1 --2- 172.21.15.131:0/3350838888 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd3b00744e0 0x7fd3b00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.865+0000 7fd3cea00640 1 --2- 172.21.15.131:0/3350838888 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd3b00744e0 0x7fd3b00769f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd3c80099b0 tx=0x7fd3d00ab000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:26.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.865+0000 7fd3c6a00640 1 -- 172.21.15.131:0/3350838888 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd3c8007d10 con 0x7fd3c8058b80 2024-04-25T19:22:26.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.876+0000 7effd5400640 1 Processor -- start 2024-04-25T19:22:26.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.876+0000 7effd5400640 1 -- start start 2024-04-25T19:22:26.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.878+0000 7f434fe00640 1 Processor -- start 2024-04-25T19:22:26.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.878+0000 7f434fe00640 1 -- start start 2024-04-25T19:22:26.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.878+0000 7f6fc7e00640 1 Processor -- start 2024-04-25T19:22:26.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.879+0000 7f6fc7e00640 1 -- start start 2024-04-25T19:22:26.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.879+0000 7effd5400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7effc8058b90 0x7effc8057bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.879+0000 7f0856400640 1 Processor -- start 2024-04-25T19:22:26.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.880+0000 7effd5400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7effc80073d0 0x7effc80077e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.880+0000 7effd5400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effc8007d20 con 0x7effc80e3a90 2024-04-25T19:22:26.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.880+0000 7effd5400640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7effc8057730 con 0x7effc8058b90 2024-04-25T19:22:26.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.880+0000 7effd5400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7effc8056e00 con 0x7effc80073d0 2024-04-25T19:22:26.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.879+0000 7f0856400640 1 -- start start 2024-04-25T19:22:26.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.881+0000 7effd4a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7effc80073d0 0x7effc80077e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.881+0000 7effd4a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7effc80073d0 0x7effc80077e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.131:58904/0 (socket says 172.21.15.131:58904) 2024-04-25T19:22:26.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.881+0000 7effd4a00640 1 -- 172.21.15.131:0/332036645 learned_addr learned my addr 172.21.15.131:0/332036645 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:26.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.881+0000 7effcf400640 1 --2- 172.21.15.131:0/332036645 >> v2:172.21.15.131:3300/0 conn(0x7effc8058b90 0x7effc8057bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.882+0000 7f6fc7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6fc80cf2f0 0x7f6fc80cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.882+0000 7f6fc7e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6fc8168010 0x7f6fc8168420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.882+0000 7f6fc7e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc81649d0 0x7f6fc8164de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.882+0000 7f6fc7e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f6fc8070cf0 con 0x7f6fc80cf2f0 2024-04-25T19:22:26.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.882+0000 7f6fc7e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f6fc8168960 con 0x7f6fc8168010 2024-04-25T19:22:26.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.882+0000 7f6fc7e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6fc8071180 con 0x7f6fc81649d0 2024-04-25T19:22:26.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.882+0000 7f434fe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f43480340c0 0x7f4348006aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.882+0000 7f6fc7400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc81649d0 0x7f6fc8164de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.882+0000 7f0856400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f084804fd90 0x7f0848038560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.882+0000 7f434fe00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f43480dfd90 0x7f43480e01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.882+0000 7f6fc7400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc81649d0 0x7f6fc8164de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.131:38306/0 (socket says 172.21.15.131:38306) 2024-04-25T19:22:26.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.883+0000 7f6fc7400640 1 -- 172.21.15.131:0/853199344 learned_addr learned my addr 172.21.15.131:0/853199344 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:26.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.883+0000 7f6fc6000640 1 --2- 172.21.15.131:0/853199344 >> v2:172.21.15.195:3300/0 conn(0x7f6fc8168010 0x7f6fc8168420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.882+0000 7f0856400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0848054150 0x7f0848054560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.882+0000 7f0856400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0848054aa0 con 0x7f08480e73c0 2024-04-25T19:22:26.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.882+0000 7f0856400640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f0848006dd0 con 0x7f0848054150 2024-04-25T19:22:26.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.882+0000 7f0856400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f08480061c0 con 0x7f084804fd90 2024-04-25T19:22:26.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.883+0000 7effd4a00640 1 -- 172.21.15.131:0/332036645 >> v2:172.21.15.131:3300/0 conn(0x7effc8058b90 msgr2=0x7effc8057bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:26.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.883+0000 7f6fc6a00640 1 --2- 172.21.15.131:0/853199344 >> v2:172.21.15.131:3300/0 conn(0x7f6fc80cf2f0 0x7f6fc80cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.883+0000 7effd4a00640 1 --2- 172.21.15.131:0/332036645 >> v2:172.21.15.131:3300/0 conn(0x7effc8058b90 0x7effc8057bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.883+0000 7f434fe00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43480071d0 con 0x7f43480e06e0 2024-04-25T19:22:26.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.883+0000 7effd4a00640 1 -- 172.21.15.131:0/332036645 >> v1:172.21.15.131:6789/0 conn(0x7effc80e3a90 legacy=0x7effc80380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:26.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.883+0000 7f0855000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f084804fd90 0x7f0848038560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.883+0000 7f0855000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f084804fd90 0x7f0848038560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.131:38322/0 (socket says 172.21.15.131:38322) 2024-04-25T19:22:26.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.883+0000 7f434fe00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f43480344d0 con 0x7f43480340c0 2024-04-25T19:22:26.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.883+0000 7f434fe00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f43480074b0 con 0x7f43480dfd90 2024-04-25T19:22:26.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.883+0000 7f0855000640 1 -- 172.21.15.131:0/313086751 learned_addr learned my addr 172.21.15.131:0/313086751 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:26.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.883+0000 7f6fc7400640 1 -- 172.21.15.131:0/853199344 >> v2:172.21.15.195:3300/0 conn(0x7f6fc8168010 msgr2=0x7f6fc8168420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.883+0000 7f6fc7400640 1 --2- 172.21.15.131:0/853199344 >> v2:172.21.15.195:3300/0 conn(0x7f6fc8168010 0x7f6fc8168420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.883+0000 7f6fc7400640 1 -- 172.21.15.131:0/853199344 >> v2:172.21.15.131:3300/0 conn(0x7f6fc80cf2f0 msgr2=0x7f6fc80cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.883+0000 7f6fc7400640 1 --2- 172.21.15.131:0/853199344 >> v2:172.21.15.131:3300/0 conn(0x7f6fc80cf2f0 0x7f6fc80cf700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.883+0000 7f6fc7400640 1 -- 172.21.15.131:0/853199344 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fc80700e0 con 0x7f6fc81649d0 2024-04-25T19:22:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.884+0000 7f434e000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f43480dfd90 0x7f43480e01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.884+0000 7f434e000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f43480dfd90 0x7f43480e01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.131:58930/0 (socket says 172.21.15.131:58930) 2024-04-25T19:22:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.884+0000 7f434e000640 1 -- 172.21.15.131:0/3314531947 learned_addr learned my addr 172.21.15.131:0/3314531947 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:26.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.884+0000 7f434ea00640 1 --2- 172.21.15.131:0/3314531947 >> v2:172.21.15.131:3300/0 conn(0x7f43480340c0 0x7f4348006aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.884+0000 7effd4a00640 1 -- 172.21.15.131:0/332036645 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc80570e0 con 0x7effc80073d0 2024-04-25T19:22:26.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.884+0000 7f0855a00640 1 --2- 172.21.15.131:0/313086751 >> v2:172.21.15.131:3300/0 conn(0x7f0848054150 0x7f0848054560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.884+0000 7f0855000640 1 -- 172.21.15.131:0/313086751 >> v2:172.21.15.131:3300/0 conn(0x7f0848054150 msgr2=0x7f0848054560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:26.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.884+0000 7f0855000640 1 --2- 172.21.15.131:0/313086751 >> v2:172.21.15.131:3300/0 conn(0x7f0848054150 0x7f0848054560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.884+0000 7f0855000640 1 -- 172.21.15.131:0/313086751 >> v1:172.21.15.131:6789/0 conn(0x7f08480e73c0 legacy=0x7f0848007260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:26.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.884+0000 7f0855000640 1 -- 172.21.15.131:0/313086751 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08480064a0 con 0x7f084804fd90 2024-04-25T19:22:26.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.886+0000 7f434ea00640 1 -- 172.21.15.131:0/3314531947 >> v2:172.21.15.195:3300/0 conn(0x7f43480dfd90 msgr2=0x7f43480e01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:26.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.886+0000 7effd4a00640 1 --2- 172.21.15.131:0/332036645 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effc80073d0 0x7effc80077e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7effc803f250 tx=0x7effc402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ff9363784c9191c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:26.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.886+0000 7f6fc7400640 1 --2- 172.21.15.131:0/853199344 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc81649d0 0x7f6fc8164de0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6fc80cfed0 tx=0x7f6fb402a1d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc6d2725f299252a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:26.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.886+0000 7f0855000640 1 --2- 172.21.15.131:0/313086751 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f084804fd90 0x7f0848038560 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0848006f50 tx=0x7f083c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c60ed6b6d845afd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:26.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.886+0000 7f6fc5600640 1 -- 172.21.15.131:0/853199344 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4037070 con 0x7f6fc81649d0 2024-04-25T19:22:26.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.886+0000 7f6fc5600640 1 -- 172.21.15.131:0/853199344 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fb4032440 con 0x7f6fc81649d0 2024-04-25T19:22:26.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.886+0000 7f6fc5600640 1 -- 172.21.15.131:0/853199344 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4037070 con 0x7f6fc81649d0 2024-04-25T19:22:26.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.886+0000 7f434ea00640 1 --2- 172.21.15.131:0/3314531947 >> v2:172.21.15.195:3300/0 conn(0x7f43480dfd90 0x7f43480e01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.886+0000 7f434ea00640 1 -- 172.21.15.131:0/3314531947 >> v1:172.21.15.131:6789/0 conn(0x7f43480e06e0 legacy=0x7f43480e3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.886+0000 7f434ea00640 1 -- 172.21.15.131:0/3314531947 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4348007790 con 0x7f43480340c0 2024-04-25T19:22:26.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.887+0000 7effcea00640 1 -- 172.21.15.131:0/332036645 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc4037070 con 0x7effc80073d0 2024-04-25T19:22:26.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.887+0000 7effcea00640 1 -- 172.21.15.131:0/332036645 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc4032440 con 0x7effc80073d0 2024-04-25T19:22:26.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.887+0000 7effcea00640 1 -- 172.21.15.131:0/332036645 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc4032810 con 0x7effc80073d0 2024-04-25T19:22:26.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.887+0000 7f084f400640 1 -- 172.21.15.131:0/313086751 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c037070 con 0x7f084804fd90 2024-04-25T19:22:26.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.887+0000 7f084f400640 1 -- 172.21.15.131:0/313086751 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f083c02ae10 con 0x7f084804fd90 2024-04-25T19:22:26.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.887+0000 7f084f400640 1 -- 172.21.15.131:0/313086751 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c032660 con 0x7f084804fd90 2024-04-25T19:22:26.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.887+0000 7f434ea00640 1 --2- 172.21.15.131:0/3314531947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43480340c0 0x7f4348006aa0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f43500514f0 tx=0x7f43500695d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b5b40281a71e65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:26.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.888+0000 7f6fc7e00640 1 -- 172.21.15.131:0/853199344 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc81649d0 msgr2=0x7f6fc8164de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.888+0000 7f6fc7e00640 1 --2- 172.21.15.131:0/853199344 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc81649d0 0x7f6fc8164de0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6fc80cfed0 tx=0x7f6fb402a1d0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.888+0000 7f434d600640 1 -- 172.21.15.131:0/3314531947 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43500b4070 con 0x7f43480340c0 2024-04-25T19:22:26.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.888+0000 7f434d600640 1 -- 172.21.15.131:0/3314531947 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43500a7d20 con 0x7f43480340c0 2024-04-25T19:22:26.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.888+0000 7f434d600640 1 -- 172.21.15.131:0/3314531947 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43500b4070 con 0x7f43480340c0 2024-04-25T19:22:26.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.888+0000 7f6fc7e00640 1 -- 172.21.15.131:0/853199344 shutdown_connections 2024-04-25T19:22:26.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.888+0000 7f6fc7e00640 1 --2- 172.21.15.131:0/853199344 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc81649d0 0x7f6fc8164de0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.888+0000 7f6fc7e00640 1 --2- 172.21.15.131:0/853199344 >> v2:172.21.15.195:3300/0 conn(0x7f6fc8168010 0x7f6fc8168420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.889+0000 7f6fc7e00640 1 --2- 172.21.15.131:0/853199344 >> v2:172.21.15.131:3300/0 conn(0x7f6fc80cf2f0 0x7f6fc80cf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.889+0000 7f6fc7e00640 1 -- 172.21.15.131:0/853199344 >> 172.21.15.131:0/853199344 conn(0x7f6fc80d1720 msgr2=0x7f6fc80d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:26.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.888+0000 7effd5400640 1 -- 172.21.15.131:0/332036645 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effc80073d0 msgr2=0x7effc80077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.888+0000 7effd5400640 1 --2- 172.21.15.131:0/332036645 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effc80073d0 0x7effc80077e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7effc803f250 tx=0x7effc402a1a0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.889+0000 7effd5400640 1 -- 172.21.15.131:0/332036645 shutdown_connections 2024-04-25T19:22:26.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.889+0000 7effd5400640 1 --2- 172.21.15.131:0/332036645 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effc80073d0 0x7effc80077e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.889+0000 7effd5400640 1 --2- 172.21.15.131:0/332036645 >> v2:172.21.15.131:3300/0 conn(0x7effc8058b90 0x7effc8057bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.889+0000 7effd5400640 1 -- 172.21.15.131:0/332036645 >> 172.21.15.131:0/332036645 conn(0x7effc803abf0 msgr2=0x7effc803b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:26.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.889+0000 7f8da4e00640 1 Processor -- start 2024-04-25T19:22:26.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.889+0000 7effd5400640 1 -- 172.21.15.131:0/332036645 shutdown_connections 2024-04-25T19:22:26.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.889+0000 7f0856400640 1 -- 172.21.15.131:0/313086751 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f084804fd90 msgr2=0x7f0848038560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.889+0000 7f0856400640 1 --2- 172.21.15.131:0/313086751 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f084804fd90 0x7f0848038560 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0848006f50 tx=0x7f083c02a100 comp rx=0 tx=0).stop 2024-04-25T19:22:26.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.890+0000 7f6fc7e00640 1 -- 172.21.15.131:0/853199344 shutdown_connections 2024-04-25T19:22:26.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.889+0000 7f434fe00640 1 -- 172.21.15.131:0/3314531947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43480340c0 msgr2=0x7f4348006aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.889+0000 7f434fe00640 1 --2- 172.21.15.131:0/3314531947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43480340c0 0x7f4348006aa0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f43500514f0 tx=0x7f43500695d0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.890+0000 7f434fe00640 1 -- 172.21.15.131:0/3314531947 shutdown_connections 2024-04-25T19:22:26.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.890+0000 7f434fe00640 1 --2- 172.21.15.131:0/3314531947 >> v2:172.21.15.195:3300/0 conn(0x7f43480dfd90 0x7f43480e01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.890+0000 7f434fe00640 1 --2- 172.21.15.131:0/3314531947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43480340c0 0x7f4348006aa0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.890+0000 7f434fe00640 1 -- 172.21.15.131:0/3314531947 >> 172.21.15.131:0/3314531947 conn(0x7f4348054cf0 msgr2=0x7f4348055100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:26.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.890+0000 7f0856400640 1 -- 172.21.15.131:0/313086751 shutdown_connections 2024-04-25T19:22:26.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.890+0000 7f0856400640 1 --2- 172.21.15.131:0/313086751 >> v2:172.21.15.131:3300/0 conn(0x7f0848054150 0x7f0848054560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.890+0000 7f0856400640 1 --2- 172.21.15.131:0/313086751 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f084804fd90 0x7f0848038560 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.890+0000 7f0856400640 1 -- 172.21.15.131:0/313086751 >> 172.21.15.131:0/313086751 conn(0x7f084803ac70 msgr2=0x7f084803b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:26.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.889+0000 7effd5400640 1 -- 172.21.15.131:0/332036645 wait complete. 2024-04-25T19:22:26.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.890+0000 7f434fe00640 1 -- 172.21.15.131:0/3314531947 shutdown_connections 2024-04-25T19:22:26.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.890+0000 7f0856400640 1 -- 172.21.15.131:0/313086751 shutdown_connections 2024-04-25T19:22:26.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.889+0000 7f8da4e00640 1 -- start start 2024-04-25T19:22:26.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.890+0000 7f6fc7e00640 1 -- 172.21.15.131:0/853199344 wait complete. 2024-04-25T19:22:26.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.893+0000 7f8da4e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8d98037d20 0x7f8d98038130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.894+0000 7effd5400640 1 Processor -- start 2024-04-25T19:22:26.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.891+0000 7f434fe00640 1 -- 172.21.15.131:0/3314531947 wait complete. 2024-04-25T19:22:26.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.893+0000 7f8da4e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8d98038670 0x7f8d980e7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.893+0000 7f8da4e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d98038a80 con 0x7f8d980e1400 2024-04-25T19:22:26.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.894+0000 7f8da4e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f8d98050250 con 0x7f8d98038670 2024-04-25T19:22:26.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.894+0000 7f8da4e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f8d98007580 con 0x7f8d98037d20 2024-04-25T19:22:26.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.891+0000 7f0856400640 1 -- 172.21.15.131:0/313086751 wait complete. 2024-04-25T19:22:26.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.894+0000 7effd5400640 1 -- start start 2024-04-25T19:22:26.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.894+0000 7f434fe00640 1 Processor -- start 2024-04-25T19:22:26.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.894+0000 7f0856400640 1 Processor -- start 2024-04-25T19:22:26.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.895+0000 7f0856400640 1 -- start start 2024-04-25T19:22:26.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.894+0000 7f434fe00640 1 -- start start 2024-04-25T19:22:26.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.895+0000 7f8d9f200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8d98038670 0x7f8d980e7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.895+0000 7f8d9f200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8d98038670 0x7f8d980e7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54432/0 (socket says 172.21.15.131:54432) 2024-04-25T19:22:26.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.895+0000 7f8d9f200640 1 -- 172.21.15.131:0/1170290046 learned_addr learned my addr 172.21.15.131:0/1170290046 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:26.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.895+0000 7f6fc7e00640 1 Processor -- start 2024-04-25T19:22:26.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.895+0000 7f6fc7e00640 1 -- start start 2024-04-25T19:22:26.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.897+0000 7f6fc7e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc80cf2f0 0x7f6fc80c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.897+0000 7f6fc7e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fc81649d0 0x7f6fc8161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.897+0000 7f6fc7e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fc8168010 0x7f6fc815d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.897+0000 7f6fc7e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc8070980 con 0x7f6fc81649d0 2024-04-25T19:22:26.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.897+0000 7f6fc7e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc80706a0 con 0x7f6fc8168010 2024-04-25T19:22:26.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.897+0000 7f6fc7e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6fc8168d00 con 0x7f6fc80cf2f0 2024-04-25T19:22:26.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.897+0000 7f8d9f200640 1 -- 172.21.15.131:0/1170290046 >> v2:172.21.15.195:3300/0 conn(0x7f8d98037d20 msgr2=0x7f8d98038130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:26.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.897+0000 7f434fe00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43480340c0 0x7f43480cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.897+0000 7f434fe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43480dfd90 0x7f43480d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.897+0000 7f8d9f200640 1 --2- 172.21.15.131:0/1170290046 >> v2:172.21.15.195:3300/0 conn(0x7f8d98037d20 0x7f8d98038130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.897+0000 7f8d9f200640 1 -- 172.21.15.131:0/1170290046 >> v1:172.21.15.131:6789/0 conn(0x7f8d980e1400 legacy=0x7f8d980548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.897+0000 7f8d9f200640 1 -- 172.21.15.131:0/1170290046 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d980579f0 con 0x7f8d98038670 2024-04-25T19:22:26.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.898+0000 7f6fc7400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fc8168010 0x7f6fc815d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.898+0000 7f6fc7400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fc8168010 0x7f6fc815d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.131:58948/0 (socket says 172.21.15.131:58948) 2024-04-25T19:22:26.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.898+0000 7f6fc7400640 1 -- 172.21.15.131:0/2723334853 learned_addr learned my addr 172.21.15.131:0/2723334853 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:26.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.898+0000 7f6fc6a00640 1 --2- 172.21.15.131:0/2723334853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc80cf2f0 0x7f6fc80c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.898+0000 7f0856400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f084804fd90 0x7f08480cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.897+0000 7f434fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43480e06e0 0x7f43480d1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.897+0000 7f434fe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f434800c450 con 0x7f43480e06e0 2024-04-25T19:22:26.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.897+0000 7f434fe00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f434800c2d0 con 0x7f43480340c0 2024-04-25T19:22:26.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.897+0000 7f434fe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4348050a10 con 0x7f43480dfd90 2024-04-25T19:22:26.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.898+0000 7f0856400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0848054150 0x7f0848051390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.898+0000 7f434ea00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43480340c0 0x7f43480cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.898+0000 7f0856400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08480e73c0 0x7f08480cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.898+0000 7f434ea00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43480340c0 0x7f43480cdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.131:58960/0 (socket says 172.21.15.131:58960) 2024-04-25T19:22:26.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.898+0000 7f434e000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43480dfd90 0x7f43480d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.898+0000 7f8d9f200640 1 --2- 172.21.15.131:0/1170290046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d98038670 0x7f8d980e7380 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8da002e0e0 tx=0x7f8da006a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3658ef8d3ba4aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:26.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.898+0000 7f0856400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0848007970 con 0x7f0848054150 2024-04-25T19:22:26.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.898+0000 7f434ea00640 1 -- 172.21.15.131:0/3160773454 learned_addr learned my addr 172.21.15.131:0/3160773454 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:26.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.898+0000 7f6fc7400640 1 -- 172.21.15.131:0/2723334853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc80cf2f0 msgr2=0x7f6fc80c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.898+0000 7f6fc7400640 1 --2- 172.21.15.131:0/2723334853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc80cf2f0 0x7f6fc80c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.898+0000 7f6fc7400640 1 -- 172.21.15.131:0/2723334853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fc81649d0 msgr2=0x7f6fc8161fa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T19:22:26.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.899+0000 7f6fc7400640 1 --2- 172.21.15.131:0/2723334853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fc81649d0 0x7f6fc8161fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.899+0000 7f6fc7400640 1 -- 172.21.15.131:0/2723334853 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fc8160f00 con 0x7f6fc8168010 2024-04-25T19:22:26.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.898+0000 7f0856400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0848006a60 con 0x7f084804fd90 2024-04-25T19:22:26.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.898+0000 7f0856400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0848055930 con 0x7f08480e73c0 2024-04-25T19:22:26.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.899+0000 7f0855000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f084804fd90 0x7f08480cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.899+0000 7f0855000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f084804fd90 0x7f08480cc6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.131:58968/0 (socket says 172.21.15.131:58968) 2024-04-25T19:22:26.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.899+0000 7f0855000640 1 -- 172.21.15.131:0/3406606003 learned_addr learned my addr 172.21.15.131:0/3406606003 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:26.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.899+0000 7f0855a00640 1 --2- 172.21.15.131:0/3406606003 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08480e73c0 0x7f08480cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.899+0000 7f434f400640 1 --2- 172.21.15.131:0/3160773454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43480e06e0 0x7f43480d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.899+0000 7f084fe00640 1 --2- 172.21.15.131:0/3406606003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0848054150 0x7f0848051390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.899+0000 7f8d9ca00640 1 -- 172.21.15.131:0/1170290046 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da00b4070 con 0x7f8d98038670 2024-04-25T19:22:26.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.899+0000 7f8d9ca00640 1 -- 172.21.15.131:0/1170290046 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8da00a7c80 con 0x7f8d98038670 2024-04-25T19:22:26.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.899+0000 7f8d9ca00640 1 -- 172.21.15.131:0/1170290046 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da00af640 con 0x7f8d98038670 2024-04-25T19:22:26.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.899+0000 7effd5400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effc80073d0 0x7effc8169540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.900+0000 7f084fe00640 1 -- 172.21.15.131:0/3406606003 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08480e73c0 msgr2=0x7f08480cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.900+0000 7f084fe00640 1 --2- 172.21.15.131:0/3406606003 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08480e73c0 0x7f08480cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.900+0000 7f084fe00640 1 -- 172.21.15.131:0/3406606003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f084804fd90 msgr2=0x7f08480cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.900+0000 7f084fe00640 1 --2- 172.21.15.131:0/3406606003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f084804fd90 0x7f08480cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.900+0000 7f084fe00640 1 -- 172.21.15.131:0/3406606003 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08480cd100 con 0x7f0848054150 2024-04-25T19:22:26.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.899+0000 7f434ea00640 1 -- 172.21.15.131:0/3160773454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43480dfd90 msgr2=0x7f43480d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.899+0000 7f6fc7400640 1 --2- 172.21.15.131:0/2723334853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fc8168010 0x7f6fc815d570 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40090b0 tx=0x7f6fb40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:26.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.900+0000 7effd5400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effc8058b90 0x7effc80da0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.900+0000 7f084fe00640 1 --2- 172.21.15.131:0/3406606003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0848054150 0x7f0848051390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f084400b410 tx=0x7f084400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:26.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.900+0000 7f434ea00640 1 --2- 172.21.15.131:0/3160773454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43480dfd90 0x7f43480d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.900+0000 7f434ea00640 1 -- 172.21.15.131:0/3160773454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43480e06e0 msgr2=0x7f43480d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.900+0000 7f434ea00640 1 --2- 172.21.15.131:0/3160773454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43480e06e0 0x7f43480d1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.900+0000 7f434ea00640 1 -- 172.21.15.131:0/3160773454 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43480ce4a0 con 0x7f43480340c0 2024-04-25T19:22:26.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.900+0000 7f6fbea00640 1 -- 172.21.15.131:0/2723334853 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4041020 con 0x7f6fc8168010 2024-04-25T19:22:26.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.900+0000 7f6fbea00640 1 -- 172.21.15.131:0/2723334853 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fb4030650 con 0x7f6fc8168010 2024-04-25T19:22:26.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.900+0000 7effd5400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effc80e3a90 0x7effc8179b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.900+0000 7effd5400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7effc803c840 con 0x7effc80073d0 2024-04-25T19:22:26.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.900+0000 7effd5400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7effc8037d70 con 0x7effc80e3a90 2024-04-25T19:22:26.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.900+0000 7f6fbea00640 1 -- 172.21.15.131:0/2723334853 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4037070 con 0x7f6fc8168010 2024-04-25T19:22:26.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.900+0000 7effd5400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7effc803c9c0 con 0x7effc8058b90 2024-04-25T19:22:26.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.900+0000 7f6fc7e00640 1 -- 172.21.15.131:0/2723334853 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fc81611e0 con 0x7f6fc8168010 2024-04-25T19:22:26.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.901+0000 7effcfe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effc80073d0 0x7effc8169540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.901+0000 7effcfe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effc80073d0 0x7effc8169540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54468/0 (socket says 172.21.15.131:54468) 2024-04-25T19:22:26.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.901+0000 7effcfe00640 1 -- 172.21.15.131:0/698651530 learned_addr learned my addr 172.21.15.131:0/698651530 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:26.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.901+0000 7effd4a00640 1 --2- 172.21.15.131:0/698651530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effc80e3a90 0x7effc8179b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.901+0000 7effcf400640 1 --2- 172.21.15.131:0/698651530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effc8058b90 0x7effc80da0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.902+0000 7effcfe00640 1 -- 172.21.15.131:0/698651530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effc8058b90 msgr2=0x7effc80da0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.902+0000 7effcfe00640 1 --2- 172.21.15.131:0/698651530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effc8058b90 0x7effc80da0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.902+0000 7effcfe00640 1 -- 172.21.15.131:0/698651530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effc80e3a90 msgr2=0x7effc8179b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.902+0000 7effcfe00640 1 --2- 172.21.15.131:0/698651530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effc80e3a90 0x7effc8179b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.902+0000 7effcfe00640 1 -- 172.21.15.131:0/698651530 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc816ba70 con 0x7effc80073d0 2024-04-25T19:22:26.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.901+0000 7f084cc00640 1 -- 172.21.15.131:0/3406606003 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0844015020 con 0x7f0848054150 2024-04-25T19:22:26.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.901+0000 7f084cc00640 1 -- 172.21.15.131:0/3406606003 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0844011830 con 0x7f0848054150 2024-04-25T19:22:26.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.901+0000 7f084cc00640 1 -- 172.21.15.131:0/3406606003 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0844011c20 con 0x7f0848054150 2024-04-25T19:22:26.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.901+0000 7f0856400640 1 -- 172.21.15.131:0/3406606003 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08480cd3e0 con 0x7f0848054150 2024-04-25T19:22:26.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.901+0000 7f0856400640 1 -- 172.21.15.131:0/3406606003 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08480cd9a0 con 0x7f0848054150 2024-04-25T19:22:26.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.900+0000 7f8da4e00640 1 -- 172.21.15.131:0/1170290046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d98038670 msgr2=0x7f8d980e7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.900+0000 7f8da4e00640 1 --2- 172.21.15.131:0/1170290046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d98038670 0x7f8d980e7380 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8da002e0e0 tx=0x7f8da006a5c0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.901+0000 7f8da4e00640 1 -- 172.21.15.131:0/1170290046 shutdown_connections 2024-04-25T19:22:26.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.901+0000 7f8da4e00640 1 --2- 172.21.15.131:0/1170290046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d98038670 0x7f8d980e7380 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.901+0000 7f8da4e00640 1 --2- 172.21.15.131:0/1170290046 >> v2:172.21.15.195:3300/0 conn(0x7f8d98037d20 0x7f8d98038130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.901+0000 7f8da4e00640 1 -- 172.21.15.131:0/1170290046 >> 172.21.15.131:0/1170290046 conn(0x7f8d9803ae20 msgr2=0x7f8d9803b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:26.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.902+0000 7f8da4e00640 1 -- 172.21.15.131:0/1170290046 shutdown_connections 2024-04-25T19:22:26.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.901+0000 7f0c0c800640 1 Processor -- start 2024-04-25T19:22:26.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.902+0000 7f434ea00640 1 --2- 172.21.15.131:0/3160773454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43480340c0 0x7f43480cdac0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4350069ed0 tx=0x7f4350075af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:26.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.902+0000 7f8da4e00640 1 -- 172.21.15.131:0/1170290046 wait complete. 2024-04-25T19:22:26.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.903+0000 7effcfe00640 1 --2- 172.21.15.131:0/698651530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effc80073d0 0x7effc8169540 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7effbc00b3c0 tx=0x7effbc00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:26.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.903+0000 7f0856400640 1 -- 172.21.15.131:0/3406606003 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08480cce50 con 0x7f0848054150 2024-04-25T19:22:26.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.901+0000 7f0c0c800640 1 -- start start 2024-04-25T19:22:26.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.903+0000 7effc3e00640 1 -- 172.21.15.131:0/698651530 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effbc011830 con 0x7effc80073d0 2024-04-25T19:22:26.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.903+0000 7f4346a00640 1 -- 172.21.15.131:0/3160773454 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43500bc070 con 0x7f43480340c0 2024-04-25T19:22:26.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.903+0000 7effd5400640 1 -- 172.21.15.131:0/698651530 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effc817aa50 con 0x7effc80073d0 2024-04-25T19:22:26.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.903+0000 7effc3e00640 1 -- 172.21.15.131:0/698651530 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effbc016070 con 0x7effc80073d0 2024-04-25T19:22:26.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.903+0000 7effc3e00640 1 -- 172.21.15.131:0/698651530 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effbc011830 con 0x7effc80073d0 2024-04-25T19:22:26.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.904+0000 7effd5400640 1 -- 172.21.15.131:0/698651530 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effc816bfc0 con 0x7effc80073d0 2024-04-25T19:22:26.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.904+0000 7f434fe00640 1 -- 172.21.15.131:0/3160773454 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43480ce780 con 0x7f43480340c0 2024-04-25T19:22:26.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.904+0000 7f4346a00640 1 -- 172.21.15.131:0/3160773454 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43500b8610 con 0x7f43480340c0 2024-04-25T19:22:26.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.904+0000 7f434fe00640 1 -- 172.21.15.131:0/3160773454 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43480d3700 con 0x7f43480340c0 2024-04-25T19:22:26.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.904+0000 7f4346a00640 1 -- 172.21.15.131:0/3160773454 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43500bc070 con 0x7f43480340c0 2024-04-25T19:22:26.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.905+0000 7f0c0c800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0c040b7f50 0x7f0c040b2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.905+0000 7f0c0c800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c040d2a80 con 0x7f0c040cec70 2024-04-25T19:22:26.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.905+0000 7f0c0c800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c040d2d60 con 0x7f0c0406eba0 2024-04-25T19:22:26.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.905+0000 7f0c0c800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f0c040b4420 con 0x7f0c040b7f50 2024-04-25T19:22:26.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.905+0000 7f084cc00640 1 -- 172.21.15.131:0/3406606003 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0844018020 con 0x7f0848054150 2024-04-25T19:22:26.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.902+0000 7f6fc7e00640 1 -- 172.21.15.131:0/2723334853 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fc81617a0 con 0x7f6fc8168010 2024-04-25T19:22:26.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.904+0000 7f6fc7e00640 1 -- 172.21.15.131:0/2723334853 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fc8050740 con 0x7f6fc8168010 2024-04-25T19:22:26.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.906+0000 7f0c09400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0c040b7f50 0x7f0c040b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.906+0000 7f0c09400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0c040b7f50 0x7f0c040b2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.131:58988/0 (socket says 172.21.15.131:58988) 2024-04-25T19:22:26.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.906+0000 7f0c09400640 1 -- 172.21.15.131:0/3407804271 learned_addr learned my addr 172.21.15.131:0/3407804271 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:26.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.906+0000 7f084cc00640 1 --2- 172.21.15.131:0/3406606003 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0830074530 0x7f0830076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.907+0000 7f434fe00640 1 -- 172.21.15.131:0/3160773454 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4328005290 con 0x7f43480340c0 2024-04-25T19:22:26.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.907+0000 7f0c09400640 1 -- 172.21.15.131:0/3407804271 >> v1:172.21.15.195:6789/0 conn(0x7f0c0406eba0 legacy=0x7f0c040cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:26.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.907+0000 7f0c09400640 1 -- 172.21.15.131:0/3407804271 >> v1:172.21.15.131:6789/0 conn(0x7f0c040cec70 legacy=0x7f0c040b7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:26.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.907+0000 7f0c09400640 1 -- 172.21.15.131:0/3407804271 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c040d3040 con 0x7f0c040b7f50 2024-04-25T19:22:26.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.907+0000 7f084cc00640 1 -- 172.21.15.131:0/3406606003 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0844094fe0 con 0x7f0848054150 2024-04-25T19:22:26.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.907+0000 7f0855000640 1 --2- 172.21.15.131:0/3406606003 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0830074530 0x7f0830076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.908+0000 7f8da4e00640 1 Processor -- start 2024-04-25T19:22:26.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.908+0000 7f8da4e00640 1 -- start start 2024-04-25T19:22:26.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.907+0000 7effd5400640 1 -- 172.21.15.131:0/698651530 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effc8005570 con 0x7effc80073d0 2024-04-25T19:22:26.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.909+0000 7f0855000640 1 --2- 172.21.15.131:0/3406606003 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0830074530 0x7f0830076a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f083c000c00 tx=0x7f083c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:26.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.908+0000 7f6fbea00640 1 -- 172.21.15.131:0/2723334853 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6fb4044020 con 0x7f6fc8168010 2024-04-25T19:22:26.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.910+0000 7f4346a00640 1 -- 172.21.15.131:0/3160773454 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f43500bf070 con 0x7f43480340c0 2024-04-25T19:22:26.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.910+0000 7f0c09400640 1 --2- 172.21.15.131:0/3407804271 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c040b7f50 0x7f0c040b2410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4009870 tx=0x7f0bf402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30bc83988dd5c8df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:26.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.911+0000 7effc3e00640 1 -- 172.21.15.131:0/698651530 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7effbc011a10 con 0x7effc80073d0 2024-04-25T19:22:26.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.911+0000 7f6fbea00640 1 --2- 172.21.15.131:0/2723334853 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6fa8074580 0x7f6fa8076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.911+0000 7f8da4e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d98037d20 0x7f8d980ddb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.911+0000 7f8da4e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d98038670 0x7f8d9804ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.911+0000 7f6fbea00640 1 -- 172.21.15.131:0/2723334853 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6fb40b5b70 con 0x7f6fc8168010 2024-04-25T19:22:26.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.911+0000 7f8da4e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8d980e1400 0x7f8d98039ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.912+0000 7f4346a00640 1 --2- 172.21.15.131:0/3160773454 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f43300746e0 0x7f4330076bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.912+0000 7f6fc6a00640 1 --2- 172.21.15.131:0/2723334853 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6fa8074580 0x7f6fa8076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.912+0000 7f8da4e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8d98058290 con 0x7f8d98037d20 2024-04-25T19:22:26.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.912+0000 7f8d9de00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d98037d20 0x7f8d980ddb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.912+0000 7f8da4e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8d98057fb0 con 0x7f8d98038670 2024-04-25T19:22:26.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.912+0000 7f8da4e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8d98058570 con 0x7f8d980e1400 2024-04-25T19:22:26.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.912+0000 7f8d9de00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d98037d20 0x7f8d980ddb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54480/0 (socket says 172.21.15.131:54480) 2024-04-25T19:22:26.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.912+0000 7f8d9de00640 1 -- 172.21.15.131:0/1800622596 learned_addr learned my addr 172.21.15.131:0/1800622596 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:26.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.912+0000 7f8d9d400640 1 --2- 172.21.15.131:0/1800622596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d98038670 0x7f8d9804ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.912+0000 7effc3e00640 1 --2- 172.21.15.131:0/698651530 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7effb00746b0 0x7effb0076bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.912+0000 7f4346a00640 1 -- 172.21.15.131:0/3160773454 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4350131e80 con 0x7f43480340c0 2024-04-25T19:22:26.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.912+0000 7f8d9de00640 1 -- 172.21.15.131:0/1800622596 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8d980e1400 msgr2=0x7f8d98039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.912+0000 7f8d9de00640 1 --2- 172.21.15.131:0/1800622596 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8d980e1400 0x7f8d98039ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.912+0000 7f434e000640 1 --2- 172.21.15.131:0/3160773454 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f43300746e0 0x7f4330076bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.912+0000 7effc3e00640 1 -- 172.21.15.131:0/698651530 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7effbc0948c0 con 0x7effc80073d0 2024-04-25T19:22:26.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.912+0000 7f8d9de00640 1 -- 172.21.15.131:0/1800622596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d98038670 msgr2=0x7f8d9804ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.912+0000 7f8d9de00640 1 --2- 172.21.15.131:0/1800622596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d98038670 0x7f8d9804ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.912+0000 7f8d9de00640 1 -- 172.21.15.131:0/1800622596 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d9804da40 con 0x7f8d98037d20 2024-04-25T19:22:26.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.913+0000 7f8d9d400640 1 --2- 172.21.15.131:0/1800622596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d98038670 0x7f8d9804ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T19:22:26.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.913+0000 7effcf400640 1 --2- 172.21.15.131:0/698651530 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7effb00746b0 0x7effb0076bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.913+0000 7f8d9de00640 1 --2- 172.21.15.131:0/1800622596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d98037d20 0x7f8d980ddb10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000c520 tx=0x7f8d9000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:26.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.914+0000 7f434e000640 1 --2- 172.21.15.131:0/3160773454 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f43300746e0 0x7f4330076bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f43480dda20 tx=0x7f433c009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:26.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.914+0000 7f6fc6a00640 1 --2- 172.21.15.131:0/2723334853 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6fa8074580 0x7f6fa8076a90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6fc80d11e0 tx=0x7f6fc0009830 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:26.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.914+0000 7effcf400640 1 --2- 172.21.15.131:0/698651530 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7effb00746b0 0x7effb0076bc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7effd0066010 tx=0x7effd006a5c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:26.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.918+0000 7f084cc00640 1 -- 172.21.15.131:0/3406606003 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f084401f020 con 0x7f0848054150 2024-04-25T19:22:26.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.920+0000 7fdf43e00640 1 Processor -- start 2024-04-25T19:22:26.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.920+0000 7fdf43e00640 1 -- start start 2024-04-25T19:22:26.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.920+0000 7f8d96000640 1 -- 172.21.15.131:0/1800622596 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d90017070 con 0x7f8d98037d20 2024-04-25T19:22:26.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.921+0000 7f8d96000640 1 -- 172.21.15.131:0/1800622596 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d900035f0 con 0x7f8d98037d20 2024-04-25T19:22:26.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.921+0000 7effc3e00640 1 -- 172.21.15.131:0/698651530 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7effbc020020 con 0x7effc80073d0 2024-04-25T19:22:26.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.921+0000 7f8d96000640 1 -- 172.21.15.131:0/1800622596 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d90003a20 con 0x7f8d98037d20 2024-04-25T19:22:26.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.922+0000 7f8da4e00640 1 -- 172.21.15.131:0/1800622596 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d9804ee50 con 0x7f8d98037d20 2024-04-25T19:22:26.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.922+0000 7f8da4e00640 1 -- 172.21.15.131:0/1800622596 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d9804f410 con 0x7f8d98037d20 2024-04-25T19:22:26.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.922+0000 7fdf43e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdf3c164b00 0x7fdf3c0b7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.922+0000 7fdf43e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdf3c160fa0 0x7fdf3c0b80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.922+0000 7fdf43e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf3c1615f0 con 0x7fdf3c15df80 2024-04-25T19:22:26.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.922+0000 7fdf43e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fdf3c1613b0 con 0x7fdf3c164b00 2024-04-25T19:22:26.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.922+0000 7fdf43e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fdf3c164670 con 0x7fdf3c160fa0 2024-04-25T19:22:26.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.922+0000 7fdf41400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdf3c164b00 0x7fdf3c0b7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.922+0000 7fdf41400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdf3c164b00 0x7fdf3c0b7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54490/0 (socket says 172.21.15.131:54490) 2024-04-25T19:22:26.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.922+0000 7fdf41400640 1 -- 172.21.15.131:0/1845853567 learned_addr learned my addr 172.21.15.131:0/1845853567 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:26.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.922+0000 7fdf41e00640 1 --2- 172.21.15.131:0/1845853567 >> v2:172.21.15.195:3300/0 conn(0x7fdf3c160fa0 0x7fdf3c0b80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.923+0000 7fdf41400640 1 -- 172.21.15.131:0/1845853567 >> v2:172.21.15.195:3300/0 conn(0x7fdf3c160fa0 msgr2=0x7fdf3c0b80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:26.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.923+0000 7fdf41400640 1 --2- 172.21.15.131:0/1845853567 >> v2:172.21.15.195:3300/0 conn(0x7fdf3c160fa0 0x7fdf3c0b80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.923+0000 7f8da4e00640 1 -- 172.21.15.131:0/1800622596 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d98004a30 con 0x7f8d98037d20 2024-04-25T19:22:26.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.923+0000 7fdf41400640 1 -- 172.21.15.131:0/1845853567 >> v1:172.21.15.131:6789/0 conn(0x7fdf3c15df80 legacy=0x7fdf3c160890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:26.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.923+0000 7fdf41400640 1 -- 172.21.15.131:0/1845853567 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf3c164020 con 0x7fdf3c164b00 2024-04-25T19:22:26.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.925+0000 7fdf41400640 1 --2- 172.21.15.131:0/1845853567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf3c164b00 0x7fdf3c0b7b80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c0d3e80 tx=0x7fdf3002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887ef04069a4cbb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:26.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.926+0000 7f6fbea00640 1 -- 172.21.15.131:0/2723334853 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6fb404b030 con 0x7f6fc8168010 2024-04-25T19:22:26.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.926+0000 7f8d96000640 1 -- 172.21.15.131:0/1800622596 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8d9001a070 con 0x7f8d98037d20 2024-04-25T19:22:26.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.926+0000 7fdf3be00640 1 -- 172.21.15.131:0/1845853567 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf30037070 con 0x7fdf3c164b00 2024-04-25T19:22:26.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.926+0000 7fdf3be00640 1 -- 172.21.15.131:0/1845853567 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf30032440 con 0x7fdf3c164b00 2024-04-25T19:22:26.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.926+0000 7fdf3be00640 1 -- 172.21.15.131:0/1845853567 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf30032810 con 0x7fdf3c164b00 2024-04-25T19:22:26.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.927+0000 7f8d96000640 1 --2- 172.21.15.131:0/1800622596 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8d800744e0 0x7f8d800769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.928+0000 7f8d96000640 1 -- 172.21.15.131:0/1800622596 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8d900946e0 con 0x7f8d98037d20 2024-04-25T19:22:26.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.928+0000 7f8d9d400640 1 --2- 172.21.15.131:0/1800622596 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8d800744e0 0x7f8d800769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.929+0000 7fdf43e00640 1 -- 172.21.15.131:0/1845853567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf3c164b00 msgr2=0x7fdf3c0b7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.929+0000 7fdf43e00640 1 --2- 172.21.15.131:0/1845853567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf3c164b00 0x7fdf3c0b7b80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c0d3e80 tx=0x7fdf3002a230 comp rx=0 tx=0).stop 2024-04-25T19:22:26.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.929+0000 7fdf43e00640 1 -- 172.21.15.131:0/1845853567 shutdown_connections 2024-04-25T19:22:26.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.929+0000 7fdf43e00640 1 --2- 172.21.15.131:0/1845853567 >> v2:172.21.15.195:3300/0 conn(0x7fdf3c160fa0 0x7fdf3c0b80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.929+0000 7fdf43e00640 1 --2- 172.21.15.131:0/1845853567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf3c164b00 0x7fdf3c0b7b80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.929+0000 7fdf43e00640 1 -- 172.21.15.131:0/1845853567 >> 172.21.15.131:0/1845853567 conn(0x7fdf3c0d2bc0 msgr2=0x7fdf3c0d2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:26.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.930+0000 7fdf43e00640 1 -- 172.21.15.131:0/1845853567 shutdown_connections 2024-04-25T19:22:26.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.930+0000 7fdf43e00640 1 -- 172.21.15.131:0/1845853567 wait complete. 2024-04-25T19:22:26.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.932+0000 7f8d9d400640 1 --2- 172.21.15.131:0/1800622596 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8d800744e0 0x7f8d800769f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8d980e24a0 tx=0x7f8d8c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:26.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.934+0000 7fdf43e00640 1 Processor -- start 2024-04-25T19:22:26.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.934+0000 7fdf43e00640 1 -- start start 2024-04-25T19:22:26.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.936+0000 7f8d96000640 1 -- 172.21.15.131:0/1800622596 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8d9005ee90 con 0x7f8d98037d20 2024-04-25T19:22:26.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.937+0000 7fdf43e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf3c15df80 0x7fdf3c152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.937+0000 7fdf43e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf3c160fa0 0x7fdf3c0c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.937+0000 7fdf43e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf3c164b00 0x7fdf3c15a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.937+0000 7fdf43e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3c0b4a00 con 0x7fdf3c15df80 2024-04-25T19:22:26.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.937+0000 7fdf43e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3c0b4880 con 0x7fdf3c164b00 2024-04-25T19:22:26.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.937+0000 7fdf43e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdf3c0b4b80 con 0x7fdf3c160fa0 2024-04-25T19:22:26.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.938+0000 7fdf40a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf3c160fa0 0x7fdf3c0c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.938+0000 7fdf41400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf3c15df80 0x7fdf3c152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.938+0000 7fdf40a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf3c160fa0 0x7fdf3c0c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.131:38382/0 (socket says 172.21.15.131:38382) 2024-04-25T19:22:26.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.938+0000 7fdf40a00640 1 -- 172.21.15.131:0/3568759478 learned_addr learned my addr 172.21.15.131:0/3568759478 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:26.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.938+0000 7fdf41e00640 1 --2- 172.21.15.131:0/3568759478 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf3c164b00 0x7fdf3c15a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.939+0000 7fdf41400640 1 -- 172.21.15.131:0/3568759478 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf3c160fa0 msgr2=0x7fdf3c0c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.939+0000 7fdf41400640 1 --2- 172.21.15.131:0/3568759478 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf3c160fa0 0x7fdf3c0c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.939+0000 7fdf41400640 1 -- 172.21.15.131:0/3568759478 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf3c164b00 msgr2=0x7fdf3c15a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.939+0000 7fdf41400640 1 --2- 172.21.15.131:0/3568759478 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf3c164b00 0x7fdf3c15a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.939+0000 7fdf41400640 1 -- 172.21.15.131:0/3568759478 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf3c153780 con 0x7fdf3c15df80 2024-04-25T19:22:26.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.939+0000 7fdf40a00640 1 --2- 172.21.15.131:0/3568759478 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf3c160fa0 0x7fdf3c0c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T19:22:26.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.939+0000 7fdf41400640 1 --2- 172.21.15.131:0/3568759478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf3c15df80 0x7fdf3c152e80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdf30031000 tx=0x7fdf300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:26.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.940+0000 7fdf39600640 1 -- 172.21.15.131:0/3568759478 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf30041020 con 0x7fdf3c15df80 2024-04-25T19:22:26.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.940+0000 7fdf39600640 1 -- 172.21.15.131:0/3568759478 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf30030640 con 0x7fdf3c15df80 2024-04-25T19:22:26.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.940+0000 7fdf39600640 1 -- 172.21.15.131:0/3568759478 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf30041020 con 0x7fdf3c15df80 2024-04-25T19:22:26.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.941+0000 7f0c08a00640 1 -- 172.21.15.131:0/3407804271 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4037070 con 0x7f0c040b7f50 2024-04-25T19:22:26.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.941+0000 7f0c08a00640 1 -- 172.21.15.131:0/3407804271 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf4032440 con 0x7f0c040b7f50 2024-04-25T19:22:26.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.941+0000 7f0c08a00640 1 -- 172.21.15.131:0/3407804271 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4032810 con 0x7f0c040b7f50 2024-04-25T19:22:26.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.941+0000 7fdf43e00640 1 -- 172.21.15.131:0/3568759478 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf3c153a60 con 0x7fdf3c15df80 2024-04-25T19:22:26.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.941+0000 7f4346a00640 1 -- 172.21.15.131:0/3160773454 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f43500fc0c0 con 0x7f43480340c0 2024-04-25T19:22:26.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.942+0000 7f0c0c800640 1 -- 172.21.15.131:0/3407804271 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c040b7f50 msgr2=0x7f0c040b2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.942+0000 7f0c0c800640 1 --2- 172.21.15.131:0/3407804271 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c040b7f50 0x7f0c040b2410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4009870 tx=0x7f0bf402a1c0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.942+0000 7fdf43e00640 1 -- 172.21.15.131:0/3568759478 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf3c154020 con 0x7fdf3c15df80 2024-04-25T19:22:26.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.942+0000 7f0c0c800640 1 -- 172.21.15.131:0/3407804271 shutdown_connections 2024-04-25T19:22:26.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.942+0000 7f0c0c800640 1 --2- 172.21.15.131:0/3407804271 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c040b7f50 0x7f0c040b2410 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.942+0000 7f0c0c800640 1 -- 172.21.15.131:0/3407804271 >> 172.21.15.131:0/3407804271 conn(0x7f0c0409b7d0 msgr2=0x7f0c0409bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:26.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.943+0000 7f0c0c800640 1 -- 172.21.15.131:0/3407804271 shutdown_connections 2024-04-25T19:22:26.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.943+0000 7f0c0c800640 1 -- 172.21.15.131:0/3407804271 wait complete. 2024-04-25T19:22:26.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.945+0000 7fdf43e00640 1 -- 172.21.15.131:0/3568759478 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf3c050740 con 0x7fdf3c15df80 2024-04-25T19:22:26.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.945+0000 7fdf39600640 1 -- 172.21.15.131:0/3568759478 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fdf30044020 con 0x7fdf3c15df80 2024-04-25T19:22:26.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.947+0000 7fdf39600640 1 --2- 172.21.15.131:0/3568759478 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdf1c0746b0 0x7fdf1c076bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.948+0000 7fdf39600640 1 -- 172.21.15.131:0/3568759478 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdf3007b900 con 0x7fdf3c15df80 2024-04-25T19:22:26.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.948+0000 7f0c0c800640 1 Processor -- start 2024-04-25T19:22:26.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.949+0000 7f0c0c800640 1 -- start start 2024-04-25T19:22:26.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.952+0000 7f0c0c800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c0406eba0 0x7f0c0414e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.952+0000 7f0c0c800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c040cec70 0x7f0c0409dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.952+0000 7f0c0c800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c040cc1b0 0x7f0c040cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.952+0000 7f0c0c800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0c040d3840 con 0x7f0c0406eba0 2024-04-25T19:22:26.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.952+0000 7f0c0c800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0c040d33b0 con 0x7f0c040cc1b0 2024-04-25T19:22:26.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.952+0000 7f0c0c800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0c040cd810 con 0x7f0c040cec70 2024-04-25T19:22:26.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.954+0000 7fdf40a00640 1 --2- 172.21.15.131:0/3568759478 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdf1c0746b0 0x7fdf1c076bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.954+0000 7f0c09e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c0406eba0 0x7f0c0414e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.954+0000 7f0c09400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c040cec70 0x7f0c0409dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.954+0000 7f0c09400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c040cec70 0x7f0c0409dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.131:38386/0 (socket says 172.21.15.131:38386) 2024-04-25T19:22:26.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.954+0000 7f0c09400640 1 -- 172.21.15.131:0/309546966 learned_addr learned my addr 172.21.15.131:0/309546966 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:26.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.954+0000 7f0c0a800640 1 --2- 172.21.15.131:0/309546966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c040cc1b0 0x7f0c040cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.956+0000 7f0c09e00640 1 -- 172.21.15.131:0/309546966 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c040cec70 msgr2=0x7f0c0409dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.956+0000 7f0c09e00640 1 --2- 172.21.15.131:0/309546966 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c040cec70 0x7f0c0409dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.956+0000 7f0c09e00640 1 -- 172.21.15.131:0/309546966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c040cc1b0 msgr2=0x7f0c040cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:26.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.956+0000 7f0c09e00640 1 --2- 172.21.15.131:0/309546966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c040cc1b0 0x7f0c040cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:26.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.956+0000 7f0c09e00640 1 -- 172.21.15.131:0/309546966 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c0409e2c0 con 0x7f0c0406eba0 2024-04-25T19:22:26.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.957+0000 7fdf40a00640 1 --2- 172.21.15.131:0/3568759478 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdf1c0746b0 0x7fdf1c076bc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c159930 tx=0x7fdf28009110 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:26.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.957+0000 7f0c09e00640 1 --2- 172.21.15.131:0/309546966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c0406eba0 0x7f0c0414e000 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800b780 tx=0x7f0bf800bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:26.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.959+0000 7f0bfe000640 1 -- 172.21.15.131:0/309546966 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8019070 con 0x7f0c0406eba0 2024-04-25T19:22:26.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.959+0000 7f0bfe000640 1 -- 172.21.15.131:0/309546966 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf800c720 con 0x7f0c0406eba0 2024-04-25T19:22:26.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.959+0000 7f0bfe000640 1 -- 172.21.15.131:0/309546966 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf800caf0 con 0x7f0c0406eba0 2024-04-25T19:22:26.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.960+0000 7f0c0c800640 1 -- 172.21.15.131:0/309546966 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c040ca6f0 con 0x7f0c0406eba0 2024-04-25T19:22:26.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.960+0000 7fdf39600640 1 -- 172.21.15.131:0/3568759478 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdf3004b070 con 0x7fdf3c15df80 2024-04-25T19:22:26.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.964+0000 7f0c0c800640 1 -- 172.21.15.131:0/309546966 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c040cacb0 con 0x7f0c0406eba0 2024-04-25T19:22:26.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.966+0000 7f0bfe000640 1 -- 172.21.15.131:0/309546966 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0bf801c070 con 0x7f0c0406eba0 2024-04-25T19:22:26.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.966+0000 7f0c0c800640 1 -- 172.21.15.131:0/309546966 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c04050740 con 0x7f0c0406eba0 2024-04-25T19:22:26.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.967+0000 7f0bfe000640 1 --2- 172.21.15.131:0/309546966 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0be8074580 0x7f0be8076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:26.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.968+0000 7f0bfe000640 1 -- 172.21.15.131:0/309546966 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0bf8099060 con 0x7f0c0406eba0 2024-04-25T19:22:26.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.969+0000 7f0c09400640 1 --2- 172.21.15.131:0/309546966 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0be8074580 0x7f0be8076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:26.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.970+0000 7f0c09400640 1 --2- 172.21.15.131:0/309546966 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0be8074580 0x7f0be8076a90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4000c00 tx=0x7f0bf402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:26.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:26.979+0000 7f0bfe000640 1 -- 172.21.15.131:0/309546966 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0bf805e440 con 0x7f0c0406eba0 2024-04-25T19:22:27.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.276+0000 7fd3d5600640 1 -- 172.21.15.131:0/3350838888 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd3a8005850 con 0x7fd3c8058b80 2024-04-25T19:22:27.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.280+0000 7fd3c6a00640 1 -- 172.21.15.131:0/3350838888 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd3c005ffd0 con 0x7fd3c8058b80 2024-04-25T19:22:27.280 INFO:teuthology.orchestra.run.smithi131.stdout:55834574855 2024-04-25T19:22:27.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.287+0000 7fd3d5600640 1 -- 172.21.15.131:0/3350838888 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd3b00744e0 msgr2=0x7fd3b00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:27.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.287+0000 7fd3d5600640 1 --2- 172.21.15.131:0/3350838888 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd3b00744e0 0x7fd3b00769f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd3c80099b0 tx=0x7fd3d00ab000 comp rx=0 tx=0).stop 2024-04-25T19:22:27.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.287+0000 7fd3d5600640 1 -- 172.21.15.131:0/3350838888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c8058b80 msgr2=0x7fd3c8051390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:27.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.287+0000 7fd3d5600640 1 --2- 172.21.15.131:0/3350838888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c8058b80 0x7fd3c8051390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000c700 tx=0x7fd3c000cbc0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.287+0000 7fd3d5600640 1 -- 172.21.15.131:0/3350838888 shutdown_connections 2024-04-25T19:22:27.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.287+0000 7fd3d5600640 1 --2- 172.21.15.131:0/3350838888 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd3b00744e0 0x7fd3b00769f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.288+0000 7fd3d5600640 1 --2- 172.21.15.131:0/3350838888 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3c80e3a80 0x7fd3c816d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.288+0000 7fd3d5600640 1 --2- 172.21.15.131:0/3350838888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c8058b80 0x7fd3c8051390 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.288+0000 7fd3d5600640 1 --2- 172.21.15.131:0/3350838888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3c80073c0 0x7fd3c80d81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.288+0000 7fd3d5600640 1 -- 172.21.15.131:0/3350838888 >> 172.21.15.131:0/3350838888 conn(0x7fd3c803abe0 msgr2=0x7fd3c8039dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:27.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.288+0000 7fd3d5600640 1 -- 172.21.15.131:0/3350838888 shutdown_connections 2024-04-25T19:22:27.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.288+0000 7fd3d5600640 1 -- 172.21.15.131:0/3350838888 wait complete. 2024-04-25T19:22:27.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-04-25T19:22:27.326 DEBUG:teuthology.parallel:result is None 2024-04-25T19:22:27.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.349+0000 7f0856400640 1 -- 172.21.15.131:0/3406606003 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0848005570 con 0x7f0848054150 2024-04-25T19:22:27.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.351+0000 7f084cc00640 1 -- 172.21.15.131:0/3406606003 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f084405f140 con 0x7f0848054150 2024-04-25T19:22:27.351 INFO:teuthology.orchestra.run.smithi131.stdout:55834574855 2024-04-25T19:22:27.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.354+0000 7effd5400640 1 -- 172.21.15.131:0/698651530 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7effc803b710 con 0x7effc80073d0 2024-04-25T19:22:27.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.354+0000 7f0856400640 1 -- 172.21.15.131:0/3406606003 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0830074530 msgr2=0x7f0830076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:27.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.354+0000 7f0856400640 1 --2- 172.21.15.131:0/3406606003 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0830074530 0x7f0830076a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f083c000c00 tx=0x7f083c02e000 comp rx=0 tx=0).stop 2024-04-25T19:22:27.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.354+0000 7f0856400640 1 -- 172.21.15.131:0/3406606003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0848054150 msgr2=0x7f0848051390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:27.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.354+0000 7f0856400640 1 --2- 172.21.15.131:0/3406606003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0848054150 0x7f0848051390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f084400b410 tx=0x7f084400b8d0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.354+0000 7effc3e00640 1 -- 172.21.15.131:0/698651530 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7effbc05efb0 con 0x7effc80073d0 2024-04-25T19:22:27.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.354+0000 7f0856400640 1 -- 172.21.15.131:0/3406606003 shutdown_connections 2024-04-25T19:22:27.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.354+0000 7f0856400640 1 --2- 172.21.15.131:0/3406606003 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0830074530 0x7f0830076a40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.354+0000 7f0856400640 1 --2- 172.21.15.131:0/3406606003 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08480e73c0 0x7f08480cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.354+0000 7f0856400640 1 --2- 172.21.15.131:0/3406606003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0848054150 0x7f0848051390 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.354+0000 7f0856400640 1 --2- 172.21.15.131:0/3406606003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f084804fd90 0x7f08480cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.354+0000 7f0856400640 1 -- 172.21.15.131:0/3406606003 >> 172.21.15.131:0/3406606003 conn(0x7f084803ac70 msgr2=0x7f08480588b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:27.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.355+0000 7f0856400640 1 -- 172.21.15.131:0/3406606003 shutdown_connections 2024-04-25T19:22:27.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.355+0000 7f0856400640 1 -- 172.21.15.131:0/3406606003 wait complete. 2024-04-25T19:22:27.357 INFO:teuthology.orchestra.run.smithi131.stdout:55834574856 2024-04-25T19:22:27.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.358+0000 7effd5400640 1 -- 172.21.15.131:0/698651530 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7effb00746b0 msgr2=0x7effb0076bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:27.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.358+0000 7effd5400640 1 --2- 172.21.15.131:0/698651530 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7effb00746b0 0x7effb0076bc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7effd0066010 tx=0x7effd006a5c0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.358+0000 7effd5400640 1 -- 172.21.15.131:0/698651530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effc80073d0 msgr2=0x7effc8169540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:27.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.358+0000 7effd5400640 1 --2- 172.21.15.131:0/698651530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effc80073d0 0x7effc8169540 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7effbc00b3c0 tx=0x7effbc00b880 comp rx=0 tx=0).stop 2024-04-25T19:22:27.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.359+0000 7effd5400640 1 -- 172.21.15.131:0/698651530 shutdown_connections 2024-04-25T19:22:27.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.359+0000 7effd5400640 1 --2- 172.21.15.131:0/698651530 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7effb00746b0 0x7effb0076bc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.359+0000 7effd5400640 1 --2- 172.21.15.131:0/698651530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effc8058b90 0x7effc80da0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.359+0000 7effd5400640 1 --2- 172.21.15.131:0/698651530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effc80e3a90 0x7effc8179b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.359+0000 7effd5400640 1 --2- 172.21.15.131:0/698651530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effc80073d0 0x7effc8169540 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.359+0000 7effd5400640 1 -- 172.21.15.131:0/698651530 >> 172.21.15.131:0/698651530 conn(0x7effc803abf0 msgr2=0x7effc80388a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:27.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.359+0000 7effd5400640 1 -- 172.21.15.131:0/698651530 shutdown_connections 2024-04-25T19:22:27.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.359+0000 7effd5400640 1 -- 172.21.15.131:0/698651530 wait complete. 2024-04-25T19:22:27.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.363+0000 7f6fc7e00640 1 -- 172.21.15.131:0/2723334853 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f6fc80cd9a0 con 0x7f6fc8168010 2024-04-25T19:22:27.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.364+0000 7f6fbea00640 1 -- 172.21.15.131:0/2723334853 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6fb40802e0 con 0x7f6fc8168010 2024-04-25T19:22:27.365 INFO:teuthology.orchestra.run.smithi131.stdout:55834574855 2024-04-25T19:22:27.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.365+0000 7f0c0c800640 1 -- 172.21.15.131:0/309546966 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0c0406f210 con 0x7f0c0406eba0 2024-04-25T19:22:27.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.366+0000 7f0bfe000640 1 -- 172.21.15.131:0/309546966 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0bf8062740 con 0x7f0c0406eba0 2024-04-25T19:22:27.367 INFO:teuthology.orchestra.run.smithi131.stdout:55834574854 2024-04-25T19:22:27.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.368+0000 7f6fc7e00640 1 -- 172.21.15.131:0/2723334853 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6fa8074580 msgr2=0x7f6fa8076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:27.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.368+0000 7f6fc7e00640 1 --2- 172.21.15.131:0/2723334853 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6fa8074580 0x7f6fa8076a90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6fc80d11e0 tx=0x7f6fc0009830 comp rx=0 tx=0).stop 2024-04-25T19:22:27.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.368+0000 7f6fc7e00640 1 -- 172.21.15.131:0/2723334853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fc8168010 msgr2=0x7f6fc815d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:27.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.368+0000 7f6fc7e00640 1 --2- 172.21.15.131:0/2723334853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fc8168010 0x7f6fc815d570 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40090b0 tx=0x7f6fb40046c0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.368+0000 7f6fc7e00640 1 -- 172.21.15.131:0/2723334853 shutdown_connections 2024-04-25T19:22:27.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.368+0000 7f6fc7e00640 1 --2- 172.21.15.131:0/2723334853 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6fa8074580 0x7f6fa8076a90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.368+0000 7f6fc7e00640 1 --2- 172.21.15.131:0/2723334853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fc8168010 0x7f6fc815d570 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.368+0000 7f6fc7e00640 1 --2- 172.21.15.131:0/2723334853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fc81649d0 0x7f6fc8161fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.368+0000 7f6fc7e00640 1 --2- 172.21.15.131:0/2723334853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc80cf2f0 0x7f6fc80c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.368+0000 7f6fc7e00640 1 -- 172.21.15.131:0/2723334853 >> 172.21.15.131:0/2723334853 conn(0x7f6fc80d1720 msgr2=0x7f6fc8165f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:27.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.368+0000 7f6fc7e00640 1 -- 172.21.15.131:0/2723334853 shutdown_connections 2024-04-25T19:22:27.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.369+0000 7f6fc7e00640 1 -- 172.21.15.131:0/2723334853 wait complete. 2024-04-25T19:22:27.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.370+0000 7f0c0c800640 1 -- 172.21.15.131:0/309546966 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0be8074580 msgr2=0x7f0be8076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:27.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.370+0000 7f0c0c800640 1 --2- 172.21.15.131:0/309546966 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0be8074580 0x7f0be8076a90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4000c00 tx=0x7f0bf402e000 comp rx=0 tx=0).stop 2024-04-25T19:22:27.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.370+0000 7f0c0c800640 1 -- 172.21.15.131:0/309546966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c0406eba0 msgr2=0x7f0c0414e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:27.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.370+0000 7f0c0c800640 1 --2- 172.21.15.131:0/309546966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c0406eba0 0x7f0c0414e000 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800b780 tx=0x7f0bf800bc40 comp rx=0 tx=0).stop 2024-04-25T19:22:27.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.370+0000 7f0c0c800640 1 -- 172.21.15.131:0/309546966 shutdown_connections 2024-04-25T19:22:27.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.370+0000 7f0c0c800640 1 --2- 172.21.15.131:0/309546966 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0be8074580 0x7f0be8076a90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.370+0000 7f0c0c800640 1 --2- 172.21.15.131:0/309546966 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c040cec70 0x7f0c0409dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.370+0000 7f0c0c800640 1 --2- 172.21.15.131:0/309546966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c040cc1b0 0x7f0c040cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.370+0000 7f0c0c800640 1 --2- 172.21.15.131:0/309546966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c0406eba0 0x7f0c0414e000 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.370+0000 7f0c0c800640 1 -- 172.21.15.131:0/309546966 >> 172.21.15.131:0/309546966 conn(0x7f0c0409b7d0 msgr2=0x7f0c0409bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:27.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.371+0000 7f0c0c800640 1 -- 172.21.15.131:0/309546966 shutdown_connections 2024-04-25T19:22:27.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.371+0000 7f0c0c800640 1 -- 172.21.15.131:0/309546966 wait complete. 2024-04-25T19:22:27.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.372+0000 7f8da4e00640 1 -- 172.21.15.131:0/1800622596 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8d98005b90 con 0x7f8d98037d20 2024-04-25T19:22:27.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.373+0000 7f8d96000640 1 -- 172.21.15.131:0/1800622596 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8d900011d0 con 0x7f8d98037d20 2024-04-25T19:22:27.374 INFO:teuthology.orchestra.run.smithi131.stdout:55834574856 2024-04-25T19:22:27.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.376+0000 7f8da4e00640 1 -- 172.21.15.131:0/1800622596 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8d800744e0 msgr2=0x7f8d800769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:27.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.376+0000 7f8da4e00640 1 --2- 172.21.15.131:0/1800622596 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8d800744e0 0x7f8d800769f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8d980e24a0 tx=0x7f8d8c008040 comp rx=0 tx=0).stop 2024-04-25T19:22:27.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.376+0000 7f8da4e00640 1 -- 172.21.15.131:0/1800622596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d98037d20 msgr2=0x7f8d980ddb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:27.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.376+0000 7f8da4e00640 1 --2- 172.21.15.131:0/1800622596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d98037d20 0x7f8d980ddb10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000c520 tx=0x7f8d9000c9e0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.377+0000 7f8da4e00640 1 -- 172.21.15.131:0/1800622596 shutdown_connections 2024-04-25T19:22:27.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.377+0000 7f8da4e00640 1 --2- 172.21.15.131:0/1800622596 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8d800744e0 0x7f8d800769f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.377+0000 7f8da4e00640 1 --2- 172.21.15.131:0/1800622596 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8d980e1400 0x7f8d98039ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.377+0000 7f8da4e00640 1 --2- 172.21.15.131:0/1800622596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d98038670 0x7f8d9804ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.377+0000 7f8da4e00640 1 --2- 172.21.15.131:0/1800622596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d98037d20 0x7f8d980ddb10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.377+0000 7f8da4e00640 1 -- 172.21.15.131:0/1800622596 >> 172.21.15.131:0/1800622596 conn(0x7f8d9803ae20 msgr2=0x7f8d980e1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:27.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.377+0000 7f8da4e00640 1 -- 172.21.15.131:0/1800622596 shutdown_connections 2024-04-25T19:22:27.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.377+0000 7f8da4e00640 1 -- 172.21.15.131:0/1800622596 wait complete. 2024-04-25T19:22:27.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.378+0000 7f434fe00640 1 -- 172.21.15.131:0/3160773454 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f4328005850 con 0x7f43480340c0 2024-04-25T19:22:27.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.379+0000 7f4346a00640 1 -- 172.21.15.131:0/3160773454 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f43501003c0 con 0x7f43480340c0 2024-04-25T19:22:27.379 INFO:teuthology.orchestra.run.smithi131.stdout:55834574855 2024-04-25T19:22:27.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.383+0000 7f434fe00640 1 -- 172.21.15.131:0/3160773454 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f43300746e0 msgr2=0x7f4330076bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:27.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.383+0000 7f434fe00640 1 --2- 172.21.15.131:0/3160773454 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f43300746e0 0x7f4330076bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f43480dda20 tx=0x7f433c009240 comp rx=0 tx=0).stop 2024-04-25T19:22:27.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.383+0000 7f434fe00640 1 -- 172.21.15.131:0/3160773454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43480340c0 msgr2=0x7f43480cdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:27.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.383+0000 7f434fe00640 1 --2- 172.21.15.131:0/3160773454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43480340c0 0x7f43480cdac0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4350069ed0 tx=0x7f4350075af0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.383+0000 7f434fe00640 1 -- 172.21.15.131:0/3160773454 shutdown_connections 2024-04-25T19:22:27.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.383+0000 7f434fe00640 1 --2- 172.21.15.131:0/3160773454 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f43300746e0 0x7f4330076bf0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.383+0000 7f434fe00640 1 --2- 172.21.15.131:0/3160773454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43480dfd90 0x7f43480d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.383+0000 7f434fe00640 1 --2- 172.21.15.131:0/3160773454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43480e06e0 0x7f43480d1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.383+0000 7f434fe00640 1 --2- 172.21.15.131:0/3160773454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43480340c0 0x7f43480cdac0 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4350069ed0 tx=0x7f4350075af0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.383+0000 7f434fe00640 1 -- 172.21.15.131:0/3160773454 >> 172.21.15.131:0/3160773454 conn(0x7f4348054cf0 msgr2=0x7f434804f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:27.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.384+0000 7f434fe00640 1 -- 172.21.15.131:0/3160773454 shutdown_connections 2024-04-25T19:22:27.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.384+0000 7f434fe00640 1 -- 172.21.15.131:0/3160773454 wait complete. 2024-04-25T19:22:27.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-04-25T19:22:27.388 DEBUG:teuthology.parallel:result is None 2024-04-25T19:22:27.393 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2024-04-25T19:22:27.393 DEBUG:teuthology.parallel:result is None 2024-04-25T19:22:27.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.395+0000 7fdf43e00640 1 -- 172.21.15.131:0/3568759478 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fdf3c160d60 con 0x7fdf3c15df80 2024-04-25T19:22:27.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.396+0000 7fdf39600640 1 -- 172.21.15.131:0/3568759478 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdf3007fa10 con 0x7fdf3c15df80 2024-04-25T19:22:27.397 INFO:teuthology.orchestra.run.smithi131.stdout:55834574855 2024-04-25T19:22:27.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.399+0000 7fdf43e00640 1 -- 172.21.15.131:0/3568759478 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdf1c0746b0 msgr2=0x7fdf1c076bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:27.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.399+0000 7fdf43e00640 1 --2- 172.21.15.131:0/3568759478 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdf1c0746b0 0x7fdf1c076bc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c159930 tx=0x7fdf28009110 comp rx=0 tx=0).stop 2024-04-25T19:22:27.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.399+0000 7fdf43e00640 1 -- 172.21.15.131:0/3568759478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf3c15df80 msgr2=0x7fdf3c152e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:27.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.399+0000 7fdf43e00640 1 --2- 172.21.15.131:0/3568759478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf3c15df80 0x7fdf3c152e80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdf30031000 tx=0x7fdf300046c0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.399+0000 7fdf43e00640 1 -- 172.21.15.131:0/3568759478 shutdown_connections 2024-04-25T19:22:27.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.399+0000 7fdf43e00640 1 --2- 172.21.15.131:0/3568759478 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdf1c0746b0 0x7fdf1c076bc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.399+0000 7fdf43e00640 1 --2- 172.21.15.131:0/3568759478 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf3c160fa0 0x7fdf3c0c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.399+0000 7fdf43e00640 1 --2- 172.21.15.131:0/3568759478 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf3c164b00 0x7fdf3c15a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.399+0000 7fdf43e00640 1 --2- 172.21.15.131:0/3568759478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf3c15df80 0x7fdf3c152e80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.399+0000 7fdf43e00640 1 -- 172.21.15.131:0/3568759478 >> 172.21.15.131:0/3568759478 conn(0x7fdf3c0d2bc0 msgr2=0x7fdf3c0d06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:27.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.399+0000 7fdf43e00640 1 -- 172.21.15.131:0/3568759478 shutdown_connections 2024-04-25T19:22:27.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.400+0000 7fdf43e00640 1 -- 172.21.15.131:0/3568759478 wait complete. 2024-04-25T19:22:27.404 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-04-25T19:22:27.404 DEBUG:teuthology.parallel:result is None 2024-04-25T19:22:27.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-04-25T19:22:27.410 DEBUG:teuthology.parallel:result is None 2024-04-25T19:22:27.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2024-04-25T19:22:27.411 DEBUG:teuthology.parallel:result is None 2024-04-25T19:22:27.421 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2024-04-25T19:22:27.421 DEBUG:teuthology.parallel:result is None 2024-04-25T19:22:27.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-04-25T19:22:27.433 DEBUG:teuthology.parallel:result is None 2024-04-25T19:22:27.433 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T19:22:27.433 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T19:22:27.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.724+0000 7fca8d800640 1 Processor -- start 2024-04-25T19:22:27.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.724+0000 7fca8d800640 1 -- start start 2024-04-25T19:22:27.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.726+0000 7fca8d800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fca88164860 0x7fca880b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:27.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.726+0000 7fca8d800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca880b7540 0x7fca880b7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:27.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.726+0000 7fca8d800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca88161650 con 0x7fca880d44a0 2024-04-25T19:22:27.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.726+0000 7fca8d800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fca881643d0 con 0x7fca88164860 2024-04-25T19:22:27.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.726+0000 7fca8d800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fca880b5270 con 0x7fca880b7540 2024-04-25T19:22:27.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.726+0000 7fca87e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fca88164860 0x7fca880b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:27.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.726+0000 7fca87e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fca88164860 0x7fca880b4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54528/0 (socket says 172.21.15.131:54528) 2024-04-25T19:22:27.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.726+0000 7fca87e00640 1 -- 172.21.15.131:0/3786704648 learned_addr learned my addr 172.21.15.131:0/3786704648 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:27.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.727+0000 7fca87e00640 1 -- 172.21.15.131:0/3786704648 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca880b7540 msgr2=0x7fca880b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:27.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.727+0000 7fca87e00640 1 --2- 172.21.15.131:0/3786704648 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca880b7540 0x7fca880b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.727+0000 7fca87e00640 1 -- 172.21.15.131:0/3786704648 >> v1:172.21.15.195:6789/0 conn(0x7fca880d44a0 legacy=0x7fca880d48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:27.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.727+0000 7fca87e00640 1 -- 172.21.15.131:0/3786704648 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca880b7e90 con 0x7fca88164860 2024-04-25T19:22:27.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.728+0000 7fca87e00640 1 --2- 172.21.15.131:0/3786704648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca88164860 0x7fca880b4d30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fca78009870 tx=0x7fca7802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2886535b737c97d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:27.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.728+0000 7fca86a00640 1 -- 172.21.15.131:0/3786704648 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca78037070 con 0x7fca88164860 2024-04-25T19:22:27.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.728+0000 7fca86a00640 1 -- 172.21.15.131:0/3786704648 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca78032440 con 0x7fca88164860 2024-04-25T19:22:27.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.728+0000 7fca86a00640 1 -- 172.21.15.131:0/3786704648 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca78032810 con 0x7fca88164860 2024-04-25T19:22:27.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.729+0000 7fca8d800640 1 -- 172.21.15.131:0/3786704648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca88164860 msgr2=0x7fca880b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:27.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.729+0000 7fca8d800640 1 --2- 172.21.15.131:0/3786704648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca88164860 0x7fca880b4d30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fca78009870 tx=0x7fca7802a200 comp rx=0 tx=0).stop 2024-04-25T19:22:27.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.729+0000 7fca8d800640 1 -- 172.21.15.131:0/3786704648 shutdown_connections 2024-04-25T19:22:27.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.729+0000 7fca8d800640 1 --2- 172.21.15.131:0/3786704648 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca880b7540 0x7fca880b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.729+0000 7fca8d800640 1 --2- 172.21.15.131:0/3786704648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca88164860 0x7fca880b4d30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.729+0000 7fca8d800640 1 -- 172.21.15.131:0/3786704648 >> 172.21.15.131:0/3786704648 conn(0x7fca880d2720 msgr2=0x7fca880d2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:27.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.729+0000 7fca8d800640 1 -- 172.21.15.131:0/3786704648 shutdown_connections 2024-04-25T19:22:27.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.729+0000 7fca8d800640 1 -- 172.21.15.131:0/3786704648 wait complete. 2024-04-25T19:22:27.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.732+0000 7fca8d800640 1 Processor -- start 2024-04-25T19:22:27.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.732+0000 7fca8d800640 1 -- start start 2024-04-25T19:22:27.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.734+0000 7fca8d800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca880b7540 0x7fca88158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:27.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.734+0000 7fca8d800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca880d44a0 0x7fca880c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:27.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.734+0000 7fca8d800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca88164860 0x7fca880cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:27.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.734+0000 7fca8d800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fca88164060 con 0x7fca880b7540 2024-04-25T19:22:27.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.734+0000 7fca8d800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fca88163d80 con 0x7fca880d44a0 2024-04-25T19:22:27.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.734+0000 7fca8d800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fca880d4fc0 con 0x7fca88164860 2024-04-25T19:22:27.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.734+0000 7fca87e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca880b7540 0x7fca88158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:27.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.734+0000 7fca87e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca880b7540 0x7fca88158880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54540/0 (socket says 172.21.15.131:54540) 2024-04-25T19:22:27.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.734+0000 7fca87e00640 1 -- 172.21.15.131:0/2738879292 learned_addr learned my addr 172.21.15.131:0/2738879292 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:27.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.734+0000 7fca87e00640 1 -- 172.21.15.131:0/2738879292 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca88164860 msgr2=0x7fca880cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:27.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.734+0000 7fca87e00640 1 --2- 172.21.15.131:0/2738879292 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca88164860 0x7fca880cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.734+0000 7fca87e00640 1 -- 172.21.15.131:0/2738879292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca880d44a0 msgr2=0x7fca880c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:27.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.734+0000 7fca87e00640 1 --2- 172.21.15.131:0/2738879292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca880d44a0 0x7fca880c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.734+0000 7fca87e00640 1 -- 172.21.15.131:0/2738879292 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca8815fa90 con 0x7fca880b7540 2024-04-25T19:22:27.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.735+0000 7fca87e00640 1 --2- 172.21.15.131:0/2738879292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca880b7540 0x7fca88158880 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fca78009870 tx=0x7fca780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:27.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.735+0000 7fca7fe00640 1 -- 172.21.15.131:0/2738879292 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca78041070 con 0x7fca880b7540 2024-04-25T19:22:27.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.735+0000 7fca7fe00640 1 -- 172.21.15.131:0/2738879292 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca7803c870 con 0x7fca880b7540 2024-04-25T19:22:27.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.735+0000 7fca7fe00640 1 -- 172.21.15.131:0/2738879292 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca78037040 con 0x7fca880b7540 2024-04-25T19:22:27.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.735+0000 7fca8d800640 1 -- 172.21.15.131:0/2738879292 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca8815dbb0 con 0x7fca880b7540 2024-04-25T19:22:27.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.735+0000 7fca8d800640 1 -- 172.21.15.131:0/2738879292 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca8815e170 con 0x7fca880b7540 2024-04-25T19:22:27.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.736+0000 7fca8d800640 1 -- 172.21.15.131:0/2738879292 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca88050740 con 0x7fca880b7540 2024-04-25T19:22:27.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.737+0000 7fca7fe00640 1 -- 172.21.15.131:0/2738879292 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fca78044070 con 0x7fca880b7540 2024-04-25T19:22:27.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.738+0000 7fca7fe00640 1 --2- 172.21.15.131:0/2738879292 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fca680744b0 0x7fca680769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:27.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.738+0000 7fca7fe00640 1 -- 172.21.15.131:0/2738879292 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fca780b5e00 con 0x7fca880b7540 2024-04-25T19:22:27.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.739+0000 7fca87400640 1 --2- 172.21.15.131:0/2738879292 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fca680744b0 0x7fca680769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:27.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.740+0000 7fca87400640 1 --2- 172.21.15.131:0/2738879292 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fca680744b0 0x7fca680769c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fca881faee0 tx=0x7fca74009250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:27.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.744+0000 7fca7fe00640 1 -- 172.21.15.131:0/2738879292 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fca880b7e90 con 0x7fca880b7540 2024-04-25T19:22:27.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.930+0000 7fca8d800640 1 -- 172.21.15.131:0/2738879292 --> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fca880d0a90 con 0x7fca680744b0 2024-04-25T19:22:27.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.950+0000 7fca7fe00640 1 -- 172.21.15.131:0/2738879292 <== mgr.4105 v2:172.21.15.195:6832/2541913764 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251825 (secure 0 0 0) 0x7fca880d0a90 con 0x7fca680744b0 2024-04-25T19:22:27.955 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:27.956 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-04-25T19:22:27.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.955+0000 7fca8d800640 1 -- 172.21.15.131:0/2738879292 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fca680744b0 msgr2=0x7fca680769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:27.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.955+0000 7fca8d800640 1 --2- 172.21.15.131:0/2738879292 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fca680744b0 0x7fca680769c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fca881faee0 tx=0x7fca74009250 comp rx=0 tx=0).stop 2024-04-25T19:22:27.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.955+0000 7fca8d800640 1 -- 172.21.15.131:0/2738879292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca880b7540 msgr2=0x7fca88158880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:27.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.955+0000 7fca8d800640 1 --2- 172.21.15.131:0/2738879292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca880b7540 0x7fca88158880 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fca78009870 tx=0x7fca780046c0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.955+0000 7fca8d800640 1 -- 172.21.15.131:0/2738879292 shutdown_connections 2024-04-25T19:22:27.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.955+0000 7fca8d800640 1 --2- 172.21.15.131:0/2738879292 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fca680744b0 0x7fca680769c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.955+0000 7fca8d800640 1 --2- 172.21.15.131:0/2738879292 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca88164860 0x7fca880cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.955+0000 7fca8d800640 1 --2- 172.21.15.131:0/2738879292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca880d44a0 0x7fca880c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.955+0000 7fca8d800640 1 --2- 172.21.15.131:0/2738879292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca880b7540 0x7fca88158880 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:27.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.955+0000 7fca8d800640 1 -- 172.21.15.131:0/2738879292 >> 172.21.15.131:0/2738879292 conn(0x7fca880d2720 msgr2=0x7fca88163190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:27.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.955+0000 7fca8d800640 1 -- 172.21.15.131:0/2738879292 shutdown_connections 2024-04-25T19:22:27.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:27.955+0000 7fca8d800640 1 -- 172.21.15.131:0/2738879292 wait complete. 2024-04-25T19:22:27.980 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-25T19:22:26.138970+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235636,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739084,"statfs":{"total":773094113280,"available":772852822016,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.100489"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138347+0000","last_change":"2024-04-25T19:22:17.084552+0000","last_active":"2024-04-25T19:22:18.138347+0000","last_peered":"2024-04-25T19:22:18.138347+0000","last_clean":"2024-04-25T19:22:18.138347+0000","last_became_active":"2024-04-25T19:22:17.083645+0000","last_became_peered":"2024-04-25T19:22:17.083645+0000","last_unstale":"2024-04-25T19:22:18.138347+0000","last_undegraded":"2024-04-25T19:22:18.138347+0000","last_fullsized":"2024-04-25T19:22:18.138347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:49:42.415156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073420+0000","last_change":"2024-04-25T19:22:17.069431+0000","last_active":"2024-04-25T19:22:18.073420+0000","last_peered":"2024-04-25T19:22:18.073420+0000","last_clean":"2024-04-25T19:22:18.073420+0000","last_became_active":"2024-04-25T19:22:17.069036+0000","last_became_peered":"2024-04-25T19:22:17.069036+0000","last_unstale":"2024-04-25T19:22:18.073420+0000","last_undegraded":"2024-04-25T19:22:18.073420+0000","last_fullsized":"2024-04-25T19:22:18.073420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:52.165740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135315+0000","last_change":"2024-04-25T19:22:17.063030+0000","last_active":"2024-04-25T19:22:18.135315+0000","last_peered":"2024-04-25T19:22:18.135315+0000","last_clean":"2024-04-25T19:22:18.135315+0000","last_became_active":"2024-04-25T19:22:17.059484+0000","last_became_peered":"2024-04-25T19:22:17.059484+0000","last_unstale":"2024-04-25T19:22:18.135315+0000","last_undegraded":"2024-04-25T19:22:18.135315+0000","last_fullsized":"2024-04-25T19:22:18.135315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:59.050894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076254+0000","last_change":"2024-04-25T19:22:17.081742+0000","last_active":"2024-04-25T19:22:18.076254+0000","last_peered":"2024-04-25T19:22:18.076254+0000","last_clean":"2024-04-25T19:22:18.076254+0000","last_became_active":"2024-04-25T19:22:17.080753+0000","last_became_peered":"2024-04-25T19:22:17.080753+0000","last_unstale":"2024-04-25T19:22:18.076254+0000","last_undegraded":"2024-04-25T19:22:18.076254+0000","last_fullsized":"2024-04-25T19:22:18.076254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:58:50.378291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.137965+0000","last_change":"2024-04-25T19:22:17.074651+0000","last_active":"2024-04-25T19:22:18.137965+0000","last_peered":"2024-04-25T19:22:18.137965+0000","last_clean":"2024-04-25T19:22:18.137965+0000","last_became_active":"2024-04-25T19:22:17.073983+0000","last_became_peered":"2024-04-25T19:22:17.073983+0000","last_unstale":"2024-04-25T19:22:18.137965+0000","last_undegraded":"2024-04-25T19:22:18.137965+0000","last_fullsized":"2024-04-25T19:22:18.137965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:11.217132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.075816+0000","last_change":"2024-04-25T19:22:17.073457+0000","last_active":"2024-04-25T19:22:18.075816+0000","last_peered":"2024-04-25T19:22:18.075816+0000","last_clean":"2024-04-25T19:22:18.075816+0000","last_became_active":"2024-04-25T19:22:17.071400+0000","last_became_peered":"2024-04-25T19:22:17.071400+0000","last_unstale":"2024-04-25T19:22:18.075816+0000","last_undegraded":"2024-04-25T19:22:18.075816+0000","last_fullsized":"2024-04-25T19:22:18.075816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:36:53.730051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.136942+0000","last_change":"2024-04-25T19:22:17.082930+0000","last_active":"2024-04-25T19:22:18.136942+0000","last_peered":"2024-04-25T19:22:18.136942+0000","last_clean":"2024-04-25T19:22:18.136942+0000","last_became_active":"2024-04-25T19:22:17.082555+0000","last_became_peered":"2024-04-25T19:22:17.082555+0000","last_unstale":"2024-04-25T19:22:18.136942+0000","last_undegraded":"2024-04-25T19:22:18.136942+0000","last_fullsized":"2024-04-25T19:22:18.136942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:15:59.386088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134476+0000","last_change":"2024-04-25T19:22:17.081565+0000","last_active":"2024-04-25T19:22:18.134476+0000","last_peered":"2024-04-25T19:22:18.134476+0000","last_clean":"2024-04-25T19:22:18.134476+0000","last_became_active":"2024-04-25T19:22:17.080933+0000","last_became_peered":"2024-04-25T19:22:17.080933+0000","last_unstale":"2024-04-25T19:22:18.134476+0000","last_undegraded":"2024-04-25T19:22:18.134476+0000","last_fullsized":"2024-04-25T19:22:18.134476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:05.392241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138545+0000","last_change":"2024-04-25T19:22:17.096675+0000","last_active":"2024-04-25T19:22:18.138545+0000","last_peered":"2024-04-25T19:22:18.138545+0000","last_clean":"2024-04-25T19:22:18.138545+0000","last_became_active":"2024-04-25T19:22:17.096054+0000","last_became_peered":"2024-04-25T19:22:17.096054+0000","last_unstale":"2024-04-25T19:22:18.138545+0000","last_undegraded":"2024-04-25T19:22:18.138545+0000","last_fullsized":"2024-04-25T19:22:18.138545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:34.594467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.082280+0000","last_change":"2024-04-25T19:22:17.092042+0000","last_active":"2024-04-25T19:22:18.082280+0000","last_peered":"2024-04-25T19:22:18.082280+0000","last_clean":"2024-04-25T19:22:18.082280+0000","last_became_active":"2024-04-25T19:22:17.091661+0000","last_became_peered":"2024-04-25T19:22:17.091661+0000","last_unstale":"2024-04-25T19:22:18.082280+0000","last_undegraded":"2024-04-25T19:22:18.082280+0000","last_fullsized":"2024-04-25T19:22:18.082280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.514449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081825+0000","last_change":"2024-04-25T19:22:17.089728+0000","last_active":"2024-04-25T19:22:18.081825+0000","last_peered":"2024-04-25T19:22:18.081825+0000","last_clean":"2024-04-25T19:22:18.081825+0000","last_became_active":"2024-04-25T19:22:17.089366+0000","last_became_peered":"2024-04-25T19:22:17.089366+0000","last_unstale":"2024-04-25T19:22:18.081825+0000","last_undegraded":"2024-04-25T19:22:18.081825+0000","last_fullsized":"2024-04-25T19:22:18.081825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:59.050894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073574+0000","last_change":"2024-04-25T19:22:17.076934+0000","last_active":"2024-04-25T19:22:18.073574+0000","last_peered":"2024-04-25T19:22:18.073574+0000","last_clean":"2024-04-25T19:22:18.073574+0000","last_became_active":"2024-04-25T19:22:17.074228+0000","last_became_peered":"2024-04-25T19:22:17.074228+0000","last_unstale":"2024-04-25T19:22:18.073574+0000","last_undegraded":"2024-04-25T19:22:18.073574+0000","last_fullsized":"2024-04-25T19:22:18.073574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:45.772456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134905+0000","last_change":"2024-04-25T19:22:17.074643+0000","last_active":"2024-04-25T19:22:18.134905+0000","last_peered":"2024-04-25T19:22:18.134905+0000","last_clean":"2024-04-25T19:22:18.134905+0000","last_became_active":"2024-04-25T19:22:17.074222+0000","last_became_peered":"2024-04-25T19:22:17.074222+0000","last_unstale":"2024-04-25T19:22:18.134905+0000","last_undegraded":"2024-04-25T19:22:18.134905+0000","last_fullsized":"2024-04-25T19:22:18.134905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:42.370408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134334+0000","last_change":"2024-04-25T19:22:17.080879+0000","last_active":"2024-04-25T19:22:18.134334+0000","last_peered":"2024-04-25T19:22:18.134334+0000","last_clean":"2024-04-25T19:22:18.134334+0000","last_became_active":"2024-04-25T19:22:17.080532+0000","last_became_peered":"2024-04-25T19:22:17.080532+0000","last_unstale":"2024-04-25T19:22:18.134334+0000","last_undegraded":"2024-04-25T19:22:18.134334+0000","last_fullsized":"2024-04-25T19:22:18.134334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:02.635176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072556+0000","last_change":"2024-04-25T19:22:17.073160+0000","last_active":"2024-04-25T19:22:18.072556+0000","last_peered":"2024-04-25T19:22:18.072556+0000","last_clean":"2024-04-25T19:22:18.072556+0000","last_became_active":"2024-04-25T19:22:17.072815+0000","last_became_peered":"2024-04-25T19:22:17.072815+0000","last_unstale":"2024-04-25T19:22:18.072556+0000","last_undegraded":"2024-04-25T19:22:18.072556+0000","last_fullsized":"2024-04-25T19:22:18.072556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:59.050894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.075591+0000","last_change":"2024-04-25T19:22:17.071757+0000","last_active":"2024-04-25T19:22:18.075591+0000","last_peered":"2024-04-25T19:22:18.075591+0000","last_clean":"2024-04-25T19:22:18.075591+0000","last_became_active":"2024-04-25T19:22:17.071385+0000","last_became_peered":"2024-04-25T19:22:17.071385+0000","last_unstale":"2024-04-25T19:22:18.075591+0000","last_undegraded":"2024-04-25T19:22:18.075591+0000","last_fullsized":"2024-04-25T19:22:18.075591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:52.165740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.077244+0000","last_change":"2024-04-25T19:22:17.082098+0000","last_active":"2024-04-25T19:22:18.077244+0000","last_peered":"2024-04-25T19:22:18.077244+0000","last_clean":"2024-04-25T19:22:18.077244+0000","last_became_active":"2024-04-25T19:22:17.080035+0000","last_became_peered":"2024-04-25T19:22:17.080035+0000","last_unstale":"2024-04-25T19:22:18.077244+0000","last_undegraded":"2024-04-25T19:22:18.077244+0000","last_fullsized":"2024-04-25T19:22:18.077244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:49:42.415156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.133867+0000","last_change":"2024-04-25T19:22:17.071266+0000","last_active":"2024-04-25T19:22:18.133867+0000","last_peered":"2024-04-25T19:22:18.133867+0000","last_clean":"2024-04-25T19:22:18.133867+0000","last_became_active":"2024-04-25T19:22:17.070270+0000","last_became_peered":"2024-04-25T19:22:17.070270+0000","last_unstale":"2024-04-25T19:22:18.133867+0000","last_undegraded":"2024-04-25T19:22:18.133867+0000","last_fullsized":"2024-04-25T19:22:18.133867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:49:46.991384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138169+0000","last_change":"2024-04-25T19:22:17.089998+0000","last_active":"2024-04-25T19:22:18.138169+0000","last_peered":"2024-04-25T19:22:18.138169+0000","last_clean":"2024-04-25T19:22:18.138169+0000","last_became_active":"2024-04-25T19:22:17.087637+0000","last_became_peered":"2024-04-25T19:22:17.087637+0000","last_unstale":"2024-04-25T19:22:18.138169+0000","last_undegraded":"2024-04-25T19:22:18.138169+0000","last_fullsized":"2024-04-25T19:22:18.138169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:31.122370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081737+0000","last_change":"2024-04-25T19:22:17.085745+0000","last_active":"2024-04-25T19:22:18.081737+0000","last_peered":"2024-04-25T19:22:18.081737+0000","last_clean":"2024-04-25T19:22:18.081737+0000","last_became_active":"2024-04-25T19:22:17.084164+0000","last_became_peered":"2024-04-25T19:22:17.084164+0000","last_unstale":"2024-04-25T19:22:18.081737+0000","last_undegraded":"2024-04-25T19:22:18.081737+0000","last_fullsized":"2024-04-25T19:22:18.081737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:23.797191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134984+0000","last_change":"2024-04-25T19:22:17.071037+0000","last_active":"2024-04-25T19:22:18.134984+0000","last_peered":"2024-04-25T19:22:18.134984+0000","last_clean":"2024-04-25T19:22:18.134984+0000","last_became_active":"2024-04-25T19:22:17.070692+0000","last_became_peered":"2024-04-25T19:22:17.070692+0000","last_unstale":"2024-04-25T19:22:18.134984+0000","last_undegraded":"2024-04-25T19:22:18.134984+0000","last_fullsized":"2024-04-25T19:22:18.134984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:06.030063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.075876+0000","last_change":"2024-04-25T19:22:17.082746+0000","last_active":"2024-04-25T19:22:18.075876+0000","last_peered":"2024-04-25T19:22:18.075876+0000","last_clean":"2024-04-25T19:22:18.075876+0000","last_became_active":"2024-04-25T19:22:17.081725+0000","last_became_peered":"2024-04-25T19:22:17.081725+0000","last_unstale":"2024-04-25T19:22:18.075876+0000","last_undegraded":"2024-04-25T19:22:18.075876+0000","last_fullsized":"2024-04-25T19:22:18.075876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:42.285229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134792+0000","last_change":"2024-04-25T19:22:17.085784+0000","last_active":"2024-04-25T19:22:18.134792+0000","last_peered":"2024-04-25T19:22:18.134792+0000","last_clean":"2024-04-25T19:22:18.134792+0000","last_became_active":"2024-04-25T19:22:17.085388+0000","last_became_peered":"2024-04-25T19:22:17.085388+0000","last_unstale":"2024-04-25T19:22:18.134792+0000","last_undegraded":"2024-04-25T19:22:18.134792+0000","last_fullsized":"2024-04-25T19:22:18.134792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:59.050894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.075802+0000","last_change":"2024-04-25T19:22:17.083578+0000","last_active":"2024-04-25T19:22:18.075802+0000","last_peered":"2024-04-25T19:22:18.075802+0000","last_clean":"2024-04-25T19:22:18.075802+0000","last_became_active":"2024-04-25T19:22:17.082843+0000","last_became_peered":"2024-04-25T19:22:17.082843+0000","last_unstale":"2024-04-25T19:22:18.075802+0000","last_undegraded":"2024-04-25T19:22:18.075802+0000","last_fullsized":"2024-04-25T19:22:18.075802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.514449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135247+0000","last_change":"2024-04-25T19:22:17.086133+0000","last_active":"2024-04-25T19:22:18.135247+0000","last_peered":"2024-04-25T19:22:18.135247+0000","last_clean":"2024-04-25T19:22:18.135247+0000","last_became_active":"2024-04-25T19:22:17.084935+0000","last_became_peered":"2024-04-25T19:22:17.084935+0000","last_unstale":"2024-04-25T19:22:18.135247+0000","last_undegraded":"2024-04-25T19:22:18.135247+0000","last_fullsized":"2024-04-25T19:22:18.135247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.514449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.082077+0000","last_change":"2024-04-25T19:22:17.072128+0000","last_active":"2024-04-25T19:22:18.082077+0000","last_peered":"2024-04-25T19:22:18.082077+0000","last_clean":"2024-04-25T19:22:18.082077+0000","last_became_active":"2024-04-25T19:22:17.071637+0000","last_became_peered":"2024-04-25T19:22:17.071637+0000","last_unstale":"2024-04-25T19:22:18.082077+0000","last_undegraded":"2024-04-25T19:22:18.082077+0000","last_fullsized":"2024-04-25T19:22:18.082077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:52.165740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072909+0000","last_change":"2024-04-25T19:22:17.077813+0000","last_active":"2024-04-25T19:22:18.072909+0000","last_peered":"2024-04-25T19:22:18.072909+0000","last_clean":"2024-04-25T19:22:18.072909+0000","last_became_active":"2024-04-25T19:22:17.076972+0000","last_became_peered":"2024-04-25T19:22:17.076972+0000","last_unstale":"2024-04-25T19:22:18.072909+0000","last_undegraded":"2024-04-25T19:22:18.072909+0000","last_fullsized":"2024-04-25T19:22:18.072909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:27.385683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135131+0000","last_change":"2024-04-25T19:22:17.085634+0000","last_active":"2024-04-25T19:22:18.135131+0000","last_peered":"2024-04-25T19:22:18.135131+0000","last_clean":"2024-04-25T19:22:18.135131+0000","last_became_active":"2024-04-25T19:22:17.085069+0000","last_became_peered":"2024-04-25T19:22:17.085069+0000","last_unstale":"2024-04-25T19:22:18.135131+0000","last_undegraded":"2024-04-25T19:22:18.135131+0000","last_fullsized":"2024-04-25T19:22:18.135131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:27.385683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135179+0000","last_change":"2024-04-25T19:22:17.081785+0000","last_active":"2024-04-25T19:22:18.135179+0000","last_peered":"2024-04-25T19:22:18.135179+0000","last_clean":"2024-04-25T19:22:18.135179+0000","last_became_active":"2024-04-25T19:22:17.081478+0000","last_became_peered":"2024-04-25T19:22:17.081478+0000","last_unstale":"2024-04-25T19:22:18.135179+0000","last_undegraded":"2024-04-25T19:22:18.135179+0000","last_fullsized":"2024-04-25T19:22:18.135179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:23.797191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076049+0000","last_change":"2024-04-25T19:22:17.084665+0000","last_active":"2024-04-25T19:22:18.076049+0000","last_peered":"2024-04-25T19:22:18.076049+0000","last_clean":"2024-04-25T19:22:18.076049+0000","last_became_active":"2024-04-25T19:22:17.082107+0000","last_became_peered":"2024-04-25T19:22:17.082107+0000","last_unstale":"2024-04-25T19:22:18.076049+0000","last_undegraded":"2024-04-25T19:22:18.076049+0000","last_fullsized":"2024-04-25T19:22:18.076049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:15:59.386088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.133567+0000","last_change":"2024-04-25T19:22:17.082056+0000","last_active":"2024-04-25T19:22:18.133567+0000","last_peered":"2024-04-25T19:22:18.133567+0000","last_clean":"2024-04-25T19:22:18.133567+0000","last_became_active":"2024-04-25T19:22:17.079951+0000","last_became_peered":"2024-04-25T19:22:17.079951+0000","last_unstale":"2024-04-25T19:22:18.133567+0000","last_undegraded":"2024-04-25T19:22:18.133567+0000","last_fullsized":"2024-04-25T19:22:18.133567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:19.060353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081500+0000","last_change":"2024-04-25T19:22:17.082235+0000","last_active":"2024-04-25T19:22:18.081500+0000","last_peered":"2024-04-25T19:22:18.081500+0000","last_clean":"2024-04-25T19:22:18.081500+0000","last_became_active":"2024-04-25T19:22:17.081806+0000","last_became_peered":"2024-04-25T19:22:17.081806+0000","last_unstale":"2024-04-25T19:22:18.081500+0000","last_undegraded":"2024-04-25T19:22:18.081500+0000","last_fullsized":"2024-04-25T19:22:18.081500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:06.030063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073096+0000","last_change":"2024-04-25T19:22:17.080063+0000","last_active":"2024-04-25T19:22:18.073096+0000","last_peered":"2024-04-25T19:22:18.073096+0000","last_clean":"2024-04-25T19:22:18.073096+0000","last_became_active":"2024-04-25T19:22:17.079696+0000","last_became_peered":"2024-04-25T19:22:17.079696+0000","last_unstale":"2024-04-25T19:22:18.073096+0000","last_undegraded":"2024-04-25T19:22:18.073096+0000","last_fullsized":"2024-04-25T19:22:18.073096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:26.080591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135311+0000","last_change":"2024-04-25T19:22:16.067625+0000","last_active":"2024-04-25T19:22:18.135311+0000","last_peered":"2024-04-25T19:22:18.135311+0000","last_clean":"2024-04-25T19:22:18.135311+0000","last_became_active":"2024-04-25T19:22:16.067277+0000","last_became_peered":"2024-04-25T19:22:16.067277+0000","last_unstale":"2024-04-25T19:22:18.135311+0000","last_undegraded":"2024-04-25T19:22:18.135311+0000","last_fullsized":"2024-04-25T19:22:18.135311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:38.378131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135442+0000","last_change":"2024-04-25T19:22:17.067796+0000","last_active":"2024-04-25T19:22:18.135442+0000","last_peered":"2024-04-25T19:22:18.135442+0000","last_clean":"2024-04-25T19:22:18.135442+0000","last_became_active":"2024-04-25T19:22:17.067488+0000","last_became_peered":"2024-04-25T19:22:17.067488+0000","last_unstale":"2024-04-25T19:22:18.135442+0000","last_undegraded":"2024-04-25T19:22:18.135442+0000","last_fullsized":"2024-04-25T19:22:18.135442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:42.370408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.082142+0000","last_change":"2024-04-25T19:22:16.073203+0000","last_active":"2024-04-25T19:22:18.082142+0000","last_peered":"2024-04-25T19:22:18.082142+0000","last_clean":"2024-04-25T19:22:18.082142+0000","last_became_active":"2024-04-25T19:22:16.072711+0000","last_became_peered":"2024-04-25T19:22:16.072711+0000","last_unstale":"2024-04-25T19:22:18.082142+0000","last_undegraded":"2024-04-25T19:22:18.082142+0000","last_fullsized":"2024-04-25T19:22:18.082142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:39:11.697383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134798+0000","last_change":"2024-04-25T19:22:16.066248+0000","last_active":"2024-04-25T19:22:18.134798+0000","last_peered":"2024-04-25T19:22:18.134798+0000","last_clean":"2024-04-25T19:22:18.134798+0000","last_became_active":"2024-04-25T19:22:16.065906+0000","last_became_peered":"2024-04-25T19:22:16.065906+0000","last_unstale":"2024-04-25T19:22:18.134798+0000","last_undegraded":"2024-04-25T19:22:18.134798+0000","last_fullsized":"2024-04-25T19:22:18.134798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:32:14.300239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134508+0000","last_change":"2024-04-25T19:22:17.076260+0000","last_active":"2024-04-25T19:22:18.134508+0000","last_peered":"2024-04-25T19:22:18.134508+0000","last_clean":"2024-04-25T19:22:18.134508+0000","last_became_active":"2024-04-25T19:22:17.075601+0000","last_became_peered":"2024-04-25T19:22:17.075601+0000","last_unstale":"2024-04-25T19:22:18.134508+0000","last_undegraded":"2024-04-25T19:22:18.134508+0000","last_fullsized":"2024-04-25T19:22:18.134508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:06.030063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.075730+0000","last_change":"2024-04-25T19:22:16.071937+0000","last_active":"2024-04-25T19:22:18.075730+0000","last_peered":"2024-04-25T19:22:18.075730+0000","last_clean":"2024-04-25T19:22:18.075730+0000","last_became_active":"2024-04-25T19:22:16.071520+0000","last_became_peered":"2024-04-25T19:22:16.071520+0000","last_unstale":"2024-04-25T19:22:18.075730+0000","last_undegraded":"2024-04-25T19:22:18.075730+0000","last_fullsized":"2024-04-25T19:22:18.075730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:44.758262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072358+0000","last_change":"2024-04-25T19:22:17.077394+0000","last_active":"2024-04-25T19:22:18.072358+0000","last_peered":"2024-04-25T19:22:18.072358+0000","last_clean":"2024-04-25T19:22:18.072358+0000","last_became_active":"2024-04-25T19:22:17.077051+0000","last_became_peered":"2024-04-25T19:22:17.077051+0000","last_unstale":"2024-04-25T19:22:18.072358+0000","last_undegraded":"2024-04-25T19:22:18.072358+0000","last_fullsized":"2024-04-25T19:22:18.072358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:06.030063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081976+0000","last_change":"2024-04-25T19:22:16.072385+0000","last_active":"2024-04-25T19:22:18.081976+0000","last_peered":"2024-04-25T19:22:18.081976+0000","last_clean":"2024-04-25T19:22:18.081976+0000","last_became_active":"2024-04-25T19:22:16.070426+0000","last_became_peered":"2024-04-25T19:22:16.070426+0000","last_unstale":"2024-04-25T19:22:18.081976+0000","last_undegraded":"2024-04-25T19:22:18.081976+0000","last_fullsized":"2024-04-25T19:22:18.081976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:44.758262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076712+0000","last_change":"2024-04-25T19:22:17.082646+0000","last_active":"2024-04-25T19:22:18.076712+0000","last_peered":"2024-04-25T19:22:18.076712+0000","last_clean":"2024-04-25T19:22:18.076712+0000","last_became_active":"2024-04-25T19:22:17.080730+0000","last_became_peered":"2024-04-25T19:22:17.080730+0000","last_unstale":"2024-04-25T19:22:18.076712+0000","last_undegraded":"2024-04-25T19:22:18.076712+0000","last_fullsized":"2024-04-25T19:22:18.076712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:31.122370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.077020+0000","last_change":"2024-04-25T19:22:16.074350+0000","last_active":"2024-04-25T19:22:18.077020+0000","last_peered":"2024-04-25T19:22:18.077020+0000","last_clean":"2024-04-25T19:22:18.077020+0000","last_became_active":"2024-04-25T19:22:16.074011+0000","last_became_peered":"2024-04-25T19:22:16.074011+0000","last_unstale":"2024-04-25T19:22:18.077020+0000","last_undegraded":"2024-04-25T19:22:18.077020+0000","last_fullsized":"2024-04-25T19:22:18.077020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:26.277490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135604+0000","last_change":"2024-04-25T19:22:17.064011+0000","last_active":"2024-04-25T19:22:18.135604+0000","last_peered":"2024-04-25T19:22:18.135604+0000","last_clean":"2024-04-25T19:22:18.135604+0000","last_became_active":"2024-04-25T19:22:17.062182+0000","last_became_peered":"2024-04-25T19:22:17.062182+0000","last_unstale":"2024-04-25T19:22:18.135604+0000","last_undegraded":"2024-04-25T19:22:18.135604+0000","last_fullsized":"2024-04-25T19:22:18.135604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:52.165740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073457+0000","last_change":"2024-04-25T19:22:16.071057+0000","last_active":"2024-04-25T19:22:18.073457+0000","last_peered":"2024-04-25T19:22:18.073457+0000","last_clean":"2024-04-25T19:22:18.073457+0000","last_became_active":"2024-04-25T19:22:16.070791+0000","last_became_peered":"2024-04-25T19:22:16.070791+0000","last_unstale":"2024-04-25T19:22:18.073457+0000","last_undegraded":"2024-04-25T19:22:18.073457+0000","last_fullsized":"2024-04-25T19:22:18.073457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:52.491459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073601+0000","last_change":"2024-04-25T19:22:17.077831+0000","last_active":"2024-04-25T19:22:18.073601+0000","last_peered":"2024-04-25T19:22:18.073601+0000","last_clean":"2024-04-25T19:22:18.073601+0000","last_became_active":"2024-04-25T19:22:17.077469+0000","last_became_peered":"2024-04-25T19:22:17.077469+0000","last_unstale":"2024-04-25T19:22:18.073601+0000","last_undegraded":"2024-04-25T19:22:18.073601+0000","last_fullsized":"2024-04-25T19:22:18.073601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:52:35.971335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081891+0000","last_change":"2024-04-25T19:22:16.071427+0000","last_active":"2024-04-25T19:22:18.081891+0000","last_peered":"2024-04-25T19:22:18.081891+0000","last_clean":"2024-04-25T19:22:18.081891+0000","last_became_active":"2024-04-25T19:22:16.070575+0000","last_became_peered":"2024-04-25T19:22:16.070575+0000","last_unstale":"2024-04-25T19:22:18.081891+0000","last_undegraded":"2024-04-25T19:22:18.081891+0000","last_fullsized":"2024-04-25T19:22:18.081891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:25.066396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.137428+0000","last_change":"2024-04-25T19:22:17.084347+0000","last_active":"2024-04-25T19:22:18.137428+0000","last_peered":"2024-04-25T19:22:18.137428+0000","last_clean":"2024-04-25T19:22:18.137428+0000","last_became_active":"2024-04-25T19:22:17.084024+0000","last_became_peered":"2024-04-25T19:22:17.084024+0000","last_unstale":"2024-04-25T19:22:18.137428+0000","last_undegraded":"2024-04-25T19:22:18.137428+0000","last_fullsized":"2024-04-25T19:22:18.137428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:58:50.378291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135604+0000","last_change":"2024-04-25T19:22:16.070227+0000","last_active":"2024-04-25T19:22:18.135604+0000","last_peered":"2024-04-25T19:22:18.135604+0000","last_clean":"2024-04-25T19:22:18.135604+0000","last_became_active":"2024-04-25T19:22:16.069762+0000","last_became_peered":"2024-04-25T19:22:16.069762+0000","last_unstale":"2024-04-25T19:22:18.135604+0000","last_undegraded":"2024-04-25T19:22:18.135604+0000","last_fullsized":"2024-04-25T19:22:18.135604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:32:14.300239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134514+0000","last_change":"2024-04-25T19:22:17.072239+0000","last_active":"2024-04-25T19:22:18.134514+0000","last_peered":"2024-04-25T19:22:18.134514+0000","last_clean":"2024-04-25T19:22:18.134514+0000","last_became_active":"2024-04-25T19:22:17.070501+0000","last_became_peered":"2024-04-25T19:22:17.070501+0000","last_unstale":"2024-04-25T19:22:18.134514+0000","last_undegraded":"2024-04-25T19:22:18.134514+0000","last_fullsized":"2024-04-25T19:22:18.134514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:02.462274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076023+0000","last_change":"2024-04-25T19:22:16.065013+0000","last_active":"2024-04-25T19:22:18.076023+0000","last_peered":"2024-04-25T19:22:18.076023+0000","last_clean":"2024-04-25T19:22:18.076023+0000","last_became_active":"2024-04-25T19:22:16.063969+0000","last_became_peered":"2024-04-25T19:22:16.063969+0000","last_unstale":"2024-04-25T19:22:18.076023+0000","last_undegraded":"2024-04-25T19:22:18.076023+0000","last_fullsized":"2024-04-25T19:22:18.076023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:39:11.697383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.137925+0000","last_change":"2024-04-25T19:22:17.100962+0000","last_active":"2024-04-25T19:22:18.137925+0000","last_peered":"2024-04-25T19:22:18.137925+0000","last_clean":"2024-04-25T19:22:18.137925+0000","last_became_active":"2024-04-25T19:22:17.099677+0000","last_became_peered":"2024-04-25T19:22:17.099677+0000","last_unstale":"2024-04-25T19:22:18.137925+0000","last_undegraded":"2024-04-25T19:22:18.137925+0000","last_fullsized":"2024-04-25T19:22:18.137925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:43.115713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081451+0000","last_change":"2024-04-25T19:22:16.073130+0000","last_active":"2024-04-25T19:22:18.081451+0000","last_peered":"2024-04-25T19:22:18.081451+0000","last_clean":"2024-04-25T19:22:18.081451+0000","last_became_active":"2024-04-25T19:22:16.070679+0000","last_became_peered":"2024-04-25T19:22:16.070679+0000","last_unstale":"2024-04-25T19:22:18.081451+0000","last_undegraded":"2024-04-25T19:22:18.081451+0000","last_fullsized":"2024-04-25T19:22:18.081451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:51.334418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081928+0000","last_change":"2024-04-25T19:22:17.081998+0000","last_active":"2024-04-25T19:22:18.081928+0000","last_peered":"2024-04-25T19:22:18.081928+0000","last_clean":"2024-04-25T19:22:18.081928+0000","last_became_active":"2024-04-25T19:22:17.081424+0000","last_became_peered":"2024-04-25T19:22:17.081424+0000","last_unstale":"2024-04-25T19:22:18.081928+0000","last_undegraded":"2024-04-25T19:22:18.081928+0000","last_fullsized":"2024-04-25T19:22:18.081928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:42.370408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.133344+0000","last_change":"2024-04-25T19:22:16.055538+0000","last_active":"2024-04-25T19:22:18.133344+0000","last_peered":"2024-04-25T19:22:18.133344+0000","last_clean":"2024-04-25T19:22:18.133344+0000","last_became_active":"2024-04-25T19:22:16.055142+0000","last_became_peered":"2024-04-25T19:22:16.055142+0000","last_unstale":"2024-04-25T19:22:18.133344+0000","last_undegraded":"2024-04-25T19:22:18.133344+0000","last_fullsized":"2024-04-25T19:22:18.133344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:51.334418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.136896+0000","last_change":"2024-04-25T19:22:17.085913+0000","last_active":"2024-04-25T19:22:18.136896+0000","last_peered":"2024-04-25T19:22:18.136896+0000","last_clean":"2024-04-25T19:22:18.136896+0000","last_became_active":"2024-04-25T19:22:17.081882+0000","last_became_peered":"2024-04-25T19:22:17.081882+0000","last_unstale":"2024-04-25T19:22:18.136896+0000","last_undegraded":"2024-04-25T19:22:18.136896+0000","last_fullsized":"2024-04-25T19:22:18.136896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:42.285229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.074059+0000","last_change":"2024-04-25T19:22:16.063433+0000","last_active":"2024-04-25T19:22:18.074059+0000","last_peered":"2024-04-25T19:22:18.074059+0000","last_clean":"2024-04-25T19:22:18.074059+0000","last_became_active":"2024-04-25T19:22:16.062287+0000","last_became_peered":"2024-04-25T19:22:16.062287+0000","last_unstale":"2024-04-25T19:22:18.074059+0000","last_undegraded":"2024-04-25T19:22:18.074059+0000","last_fullsized":"2024-04-25T19:22:18.074059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:03:07.738217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.137576+0000","last_change":"2024-04-25T19:22:17.075699+0000","last_active":"2024-04-25T19:22:18.137576+0000","last_peered":"2024-04-25T19:22:18.137576+0000","last_clean":"2024-04-25T19:22:18.137576+0000","last_became_active":"2024-04-25T19:22:17.075238+0000","last_became_peered":"2024-04-25T19:22:17.075238+0000","last_unstale":"2024-04-25T19:22:18.137576+0000","last_undegraded":"2024-04-25T19:22:18.137576+0000","last_fullsized":"2024-04-25T19:22:18.137576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:37.277654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.133800+0000","last_change":"2024-04-25T19:22:16.056199+0000","last_active":"2024-04-25T19:22:18.133800+0000","last_peered":"2024-04-25T19:22:18.133800+0000","last_clean":"2024-04-25T19:22:18.133800+0000","last_became_active":"2024-04-25T19:22:16.055898+0000","last_became_peered":"2024-04-25T19:22:16.055898+0000","last_unstale":"2024-04-25T19:22:18.133800+0000","last_undegraded":"2024-04-25T19:22:18.133800+0000","last_fullsized":"2024-04-25T19:22:18.133800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:25.066396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138688+0000","last_change":"2024-04-25T19:22:17.075542+0000","last_active":"2024-04-25T19:22:18.138688+0000","last_peered":"2024-04-25T19:22:18.138688+0000","last_clean":"2024-04-25T19:22:18.138688+0000","last_became_active":"2024-04-25T19:22:17.075208+0000","last_became_peered":"2024-04-25T19:22:17.075208+0000","last_unstale":"2024-04-25T19:22:18.138688+0000","last_undegraded":"2024-04-25T19:22:18.138688+0000","last_fullsized":"2024-04-25T19:22:18.138688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:07.456013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073013+0000","last_change":"2024-04-25T19:22:16.057412+0000","last_active":"2024-04-25T19:22:18.073013+0000","last_peered":"2024-04-25T19:22:18.073013+0000","last_clean":"2024-04-25T19:22:18.073013+0000","last_became_active":"2024-04-25T19:22:16.056998+0000","last_became_peered":"2024-04-25T19:22:16.056998+0000","last_unstale":"2024-04-25T19:22:18.073013+0000","last_undegraded":"2024-04-25T19:22:18.073013+0000","last_fullsized":"2024-04-25T19:22:18.073013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:49:45.977189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076474+0000","last_change":"2024-04-25T19:22:17.083087+0000","last_active":"2024-04-25T19:22:18.076474+0000","last_peered":"2024-04-25T19:22:18.076474+0000","last_clean":"2024-04-25T19:22:18.076474+0000","last_became_active":"2024-04-25T19:22:17.080584+0000","last_became_peered":"2024-04-25T19:22:17.080584+0000","last_unstale":"2024-04-25T19:22:18.076474+0000","last_undegraded":"2024-04-25T19:22:18.076474+0000","last_fullsized":"2024-04-25T19:22:18.076474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:43.115713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.133601+0000","last_change":"2024-04-25T19:22:16.064556+0000","last_active":"2024-04-25T19:22:18.133601+0000","last_peered":"2024-04-25T19:22:18.133601+0000","last_clean":"2024-04-25T19:22:18.133601+0000","last_became_active":"2024-04-25T19:22:16.063605+0000","last_became_peered":"2024-04-25T19:22:16.063605+0000","last_unstale":"2024-04-25T19:22:18.133601+0000","last_undegraded":"2024-04-25T19:22:18.133601+0000","last_fullsized":"2024-04-25T19:22:18.133601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:39:11.697383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.137672+0000","last_change":"2024-04-25T19:22:17.091739+0000","last_active":"2024-04-25T19:22:18.137672+0000","last_peered":"2024-04-25T19:22:18.137672+0000","last_clean":"2024-04-25T19:22:18.137672+0000","last_became_active":"2024-04-25T19:22:17.091329+0000","last_became_peered":"2024-04-25T19:22:17.091329+0000","last_unstale":"2024-04-25T19:22:18.137672+0000","last_undegraded":"2024-04-25T19:22:18.137672+0000","last_fullsized":"2024-04-25T19:22:18.137672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:25.008654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.136813+0000","last_change":"2024-04-25T19:22:06.081655+0000","last_active":"2024-04-25T19:22:18.136813+0000","last_peered":"2024-04-25T19:22:18.136813+0000","last_clean":"2024-04-25T19:22:18.136813+0000","last_became_active":"2024-04-25T19:22:06.078999+0000","last_became_peered":"2024-04-25T19:22:06.078999+0000","last_unstale":"2024-04-25T19:22:18.136813+0000","last_undegraded":"2024-04-25T19:22:18.136813+0000","last_fullsized":"2024-04-25T19:22:18.136813+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_clean_scrub_stamp":"2024-04-25T19:22:04.921147+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:30.543734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.075905+0000","last_change":"2024-04-25T19:22:16.058023+0000","last_active":"2024-04-25T19:22:18.075905+0000","last_peered":"2024-04-25T19:22:18.075905+0000","last_clean":"2024-04-25T19:22:18.075905+0000","last_became_active":"2024-04-25T19:22:16.057585+0000","last_became_peered":"2024-04-25T19:22:16.057585+0000","last_unstale":"2024-04-25T19:22:18.075905+0000","last_undegraded":"2024-04-25T19:22:18.075905+0000","last_fullsized":"2024-04-25T19:22:18.075905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:51.334418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135269+0000","last_change":"2024-04-25T19:22:17.080786+0000","last_active":"2024-04-25T19:22:18.135269+0000","last_peered":"2024-04-25T19:22:18.135269+0000","last_clean":"2024-04-25T19:22:18.135269+0000","last_became_active":"2024-04-25T19:22:17.080103+0000","last_became_peered":"2024-04-25T19:22:17.080103+0000","last_unstale":"2024-04-25T19:22:18.135269+0000","last_undegraded":"2024-04-25T19:22:18.135269+0000","last_fullsized":"2024-04-25T19:22:18.135269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:36:53.730051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.136579+0000","last_change":"2024-04-25T19:22:16.079452+0000","last_active":"2024-04-25T19:22:18.136579+0000","last_peered":"2024-04-25T19:22:18.136579+0000","last_clean":"2024-04-25T19:22:18.136579+0000","last_became_active":"2024-04-25T19:22:16.078988+0000","last_became_peered":"2024-04-25T19:22:16.078988+0000","last_unstale":"2024-04-25T19:22:18.136579+0000","last_undegraded":"2024-04-25T19:22:18.136579+0000","last_fullsized":"2024-04-25T19:22:18.136579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:52:34.957140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134617+0000","last_change":"2024-04-25T19:22:17.063481+0000","last_active":"2024-04-25T19:22:18.134617+0000","last_peered":"2024-04-25T19:22:18.134617+0000","last_clean":"2024-04-25T19:22:18.134617+0000","last_became_active":"2024-04-25T19:22:17.061000+0000","last_became_peered":"2024-04-25T19:22:17.061000+0000","last_unstale":"2024-04-25T19:22:18.134617+0000","last_undegraded":"2024-04-25T19:22:18.134617+0000","last_fullsized":"2024-04-25T19:22:18.134617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:05.392241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.133582+0000","last_change":"2024-04-25T19:22:16.060594+0000","last_active":"2024-04-25T19:22:18.133582+0000","last_peered":"2024-04-25T19:22:18.133582+0000","last_clean":"2024-04-25T19:22:18.133582+0000","last_became_active":"2024-04-25T19:22:16.060250+0000","last_became_peered":"2024-04-25T19:22:16.060250+0000","last_unstale":"2024-04-25T19:22:18.133582+0000","last_undegraded":"2024-04-25T19:22:18.133582+0000","last_fullsized":"2024-04-25T19:22:18.133582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:38.378131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072506+0000","last_change":"2024-04-25T19:22:17.068935+0000","last_active":"2024-04-25T19:22:18.072506+0000","last_peered":"2024-04-25T19:22:18.072506+0000","last_clean":"2024-04-25T19:22:18.072506+0000","last_became_active":"2024-04-25T19:22:17.068017+0000","last_became_peered":"2024-04-25T19:22:17.068017+0000","last_unstale":"2024-04-25T19:22:18.072506+0000","last_undegraded":"2024-04-25T19:22:18.072506+0000","last_fullsized":"2024-04-25T19:22:18.072506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:23.797191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076158+0000","last_change":"2024-04-25T19:22:16.064341+0000","last_active":"2024-04-25T19:22:18.076158+0000","last_peered":"2024-04-25T19:22:18.076158+0000","last_clean":"2024-04-25T19:22:18.076158+0000","last_became_active":"2024-04-25T19:22:16.063393+0000","last_became_peered":"2024-04-25T19:22:16.063393+0000","last_unstale":"2024-04-25T19:22:18.076158+0000","last_undegraded":"2024-04-25T19:22:18.076158+0000","last_fullsized":"2024-04-25T19:22:18.076158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:25.066396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073702+0000","last_change":"2024-04-25T19:22:17.085013+0000","last_active":"2024-04-25T19:22:18.073702+0000","last_peered":"2024-04-25T19:22:18.073702+0000","last_clean":"2024-04-25T19:22:18.073702+0000","last_became_active":"2024-04-25T19:22:17.084714+0000","last_became_peered":"2024-04-25T19:22:17.084714+0000","last_unstale":"2024-04-25T19:22:18.073702+0000","last_undegraded":"2024-04-25T19:22:18.073702+0000","last_fullsized":"2024-04-25T19:22:18.073702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:19.060353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072843+0000","last_change":"2024-04-25T19:22:16.055692+0000","last_active":"2024-04-25T19:22:18.072843+0000","last_peered":"2024-04-25T19:22:18.072843+0000","last_clean":"2024-04-25T19:22:18.072843+0000","last_became_active":"2024-04-25T19:22:16.054860+0000","last_became_peered":"2024-04-25T19:22:16.054860+0000","last_unstale":"2024-04-25T19:22:18.072843+0000","last_undegraded":"2024-04-25T19:22:18.072843+0000","last_fullsized":"2024-04-25T19:22:18.072843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:26.277490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076489+0000","last_change":"2024-04-25T19:22:17.085772+0000","last_active":"2024-04-25T19:22:18.076489+0000","last_peered":"2024-04-25T19:22:18.076489+0000","last_clean":"2024-04-25T19:22:18.076489+0000","last_became_active":"2024-04-25T19:22:17.085385+0000","last_became_peered":"2024-04-25T19:22:17.085385+0000","last_unstale":"2024-04-25T19:22:18.076489+0000","last_undegraded":"2024-04-25T19:22:18.076489+0000","last_fullsized":"2024-04-25T19:22:18.076489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:11.217132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138639+0000","last_change":"2024-04-25T19:22:16.081834+0000","last_active":"2024-04-25T19:22:18.138639+0000","last_peered":"2024-04-25T19:22:18.138639+0000","last_clean":"2024-04-25T19:22:18.138639+0000","last_became_active":"2024-04-25T19:22:16.081457+0000","last_became_peered":"2024-04-25T19:22:16.081457+0000","last_unstale":"2024-04-25T19:22:18.138639+0000","last_undegraded":"2024-04-25T19:22:18.138639+0000","last_fullsized":"2024-04-25T19:22:18.138639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:30.978869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072883+0000","last_change":"2024-04-25T19:22:17.077342+0000","last_active":"2024-04-25T19:22:18.072883+0000","last_peered":"2024-04-25T19:22:18.072883+0000","last_clean":"2024-04-25T19:22:18.072883+0000","last_became_active":"2024-04-25T19:22:17.076548+0000","last_became_peered":"2024-04-25T19:22:17.076548+0000","last_unstale":"2024-04-25T19:22:18.072883+0000","last_undegraded":"2024-04-25T19:22:18.072883+0000","last_fullsized":"2024-04-25T19:22:18.072883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:42.370408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.080648+0000","last_change":"2024-04-25T19:22:16.068620+0000","last_active":"2024-04-25T19:22:18.080648+0000","last_peered":"2024-04-25T19:22:18.080648+0000","last_clean":"2024-04-25T19:22:18.080648+0000","last_became_active":"2024-04-25T19:22:16.068220+0000","last_became_peered":"2024-04-25T19:22:16.068220+0000","last_unstale":"2024-04-25T19:22:18.080648+0000","last_undegraded":"2024-04-25T19:22:18.080648+0000","last_fullsized":"2024-04-25T19:22:18.080648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:30.978869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135459+0000","last_change":"2024-04-25T19:22:17.075136+0000","last_active":"2024-04-25T19:22:18.135459+0000","last_peered":"2024-04-25T19:22:18.135459+0000","last_clean":"2024-04-25T19:22:18.135459+0000","last_became_active":"2024-04-25T19:22:17.074780+0000","last_became_peered":"2024-04-25T19:22:17.074780+0000","last_unstale":"2024-04-25T19:22:18.135459+0000","last_undegraded":"2024-04-25T19:22:18.135459+0000","last_fullsized":"2024-04-25T19:22:18.135459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:42.285229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.082026+0000","last_change":"2024-04-25T19:22:16.073857+0000","last_active":"2024-04-25T19:22:18.082026+0000","last_peered":"2024-04-25T19:22:18.082026+0000","last_clean":"2024-04-25T19:22:18.082026+0000","last_became_active":"2024-04-25T19:22:16.073078+0000","last_became_peered":"2024-04-25T19:22:16.073078+0000","last_unstale":"2024-04-25T19:22:18.082026+0000","last_undegraded":"2024-04-25T19:22:18.082026+0000","last_fullsized":"2024-04-25T19:22:18.082026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:26.277490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135943+0000","last_change":"2024-04-25T19:22:17.070172+0000","last_active":"2024-04-25T19:22:18.135943+0000","last_peered":"2024-04-25T19:22:18.135943+0000","last_clean":"2024-04-25T19:22:18.135943+0000","last_became_active":"2024-04-25T19:22:17.069803+0000","last_became_peered":"2024-04-25T19:22:17.069803+0000","last_unstale":"2024-04-25T19:22:18.135943+0000","last_undegraded":"2024-04-25T19:22:18.135943+0000","last_fullsized":"2024-04-25T19:22:18.135943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.514449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.136579+0000","last_change":"2024-04-25T19:22:16.078887+0000","last_active":"2024-04-25T19:22:18.136579+0000","last_peered":"2024-04-25T19:22:18.136579+0000","last_clean":"2024-04-25T19:22:18.136579+0000","last_became_active":"2024-04-25T19:22:16.078375+0000","last_became_peered":"2024-04-25T19:22:16.078375+0000","last_unstale":"2024-04-25T19:22:18.136579+0000","last_undegraded":"2024-04-25T19:22:18.136579+0000","last_fullsized":"2024-04-25T19:22:18.136579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:44.758262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073176+0000","last_change":"2024-04-25T19:22:17.076840+0000","last_active":"2024-04-25T19:22:18.073176+0000","last_peered":"2024-04-25T19:22:18.073176+0000","last_clean":"2024-04-25T19:22:18.073176+0000","last_became_active":"2024-04-25T19:22:17.071951+0000","last_became_peered":"2024-04-25T19:22:17.071951+0000","last_unstale":"2024-04-25T19:22:18.073176+0000","last_undegraded":"2024-04-25T19:22:18.073176+0000","last_fullsized":"2024-04-25T19:22:18.073176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:27.291685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072526+0000","last_change":"2024-04-25T19:22:16.068098+0000","last_active":"2024-04-25T19:22:18.072526+0000","last_peered":"2024-04-25T19:22:18.072526+0000","last_clean":"2024-04-25T19:22:18.072526+0000","last_became_active":"2024-04-25T19:22:16.067726+0000","last_became_peered":"2024-04-25T19:22:16.067726+0000","last_unstale":"2024-04-25T19:22:18.072526+0000","last_undegraded":"2024-04-25T19:22:18.072526+0000","last_fullsized":"2024-04-25T19:22:18.072526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:44.758262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134620+0000","last_change":"2024-04-25T19:22:17.075489+0000","last_active":"2024-04-25T19:22:18.134620+0000","last_peered":"2024-04-25T19:22:18.134620+0000","last_clean":"2024-04-25T19:22:18.134620+0000","last_became_active":"2024-04-25T19:22:17.075103+0000","last_became_peered":"2024-04-25T19:22:17.075103+0000","last_unstale":"2024-04-25T19:22:18.134620+0000","last_undegraded":"2024-04-25T19:22:18.134620+0000","last_fullsized":"2024-04-25T19:22:18.134620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:23.797191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072600+0000","last_change":"2024-04-25T19:22:16.062470+0000","last_active":"2024-04-25T19:22:18.072600+0000","last_peered":"2024-04-25T19:22:18.072600+0000","last_clean":"2024-04-25T19:22:18.072600+0000","last_became_active":"2024-04-25T19:22:16.062069+0000","last_became_peered":"2024-04-25T19:22:16.062069+0000","last_unstale":"2024-04-25T19:22:18.072600+0000","last_undegraded":"2024-04-25T19:22:18.072600+0000","last_fullsized":"2024-04-25T19:22:18.072600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:52:34.957140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135155+0000","last_change":"2024-04-25T19:22:17.074489+0000","last_active":"2024-04-25T19:22:18.135155+0000","last_peered":"2024-04-25T19:22:18.135155+0000","last_clean":"2024-04-25T19:22:18.135155+0000","last_became_active":"2024-04-25T19:22:17.073799+0000","last_became_peered":"2024-04-25T19:22:17.073799+0000","last_unstale":"2024-04-25T19:22:18.135155+0000","last_undegraded":"2024-04-25T19:22:18.135155+0000","last_fullsized":"2024-04-25T19:22:18.135155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:52.165740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138381+0000","last_change":"2024-04-25T19:22:16.080827+0000","last_active":"2024-04-25T19:22:18.138381+0000","last_peered":"2024-04-25T19:22:18.138381+0000","last_clean":"2024-04-25T19:22:18.138381+0000","last_became_active":"2024-04-25T19:22:16.080356+0000","last_became_peered":"2024-04-25T19:22:16.080356+0000","last_unstale":"2024-04-25T19:22:18.138381+0000","last_undegraded":"2024-04-25T19:22:18.138381+0000","last_fullsized":"2024-04-25T19:22:18.138381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:18.046159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081947+0000","last_change":"2024-04-25T19:22:17.077563+0000","last_active":"2024-04-25T19:22:18.081947+0000","last_peered":"2024-04-25T19:22:18.081947+0000","last_clean":"2024-04-25T19:22:18.081947+0000","last_became_active":"2024-04-25T19:22:17.073123+0000","last_became_peered":"2024-04-25T19:22:17.073123+0000","last_unstale":"2024-04-25T19:22:18.081947+0000","last_undegraded":"2024-04-25T19:22:18.081947+0000","last_fullsized":"2024-04-25T19:22:18.081947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:27.385683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076484+0000","last_change":"2024-04-25T19:22:17.079364+0000","last_active":"2024-04-25T19:22:18.076484+0000","last_peered":"2024-04-25T19:22:18.076484+0000","last_clean":"2024-04-25T19:22:18.076484+0000","last_became_active":"2024-04-25T19:22:17.079025+0000","last_became_peered":"2024-04-25T19:22:17.079025+0000","last_unstale":"2024-04-25T19:22:18.076484+0000","last_undegraded":"2024-04-25T19:22:18.076484+0000","last_fullsized":"2024-04-25T19:22:18.076484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:25.008654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.137489+0000","last_change":"2024-04-25T19:22:16.081730+0000","last_active":"2024-04-25T19:22:18.137489+0000","last_peered":"2024-04-25T19:22:18.137489+0000","last_clean":"2024-04-25T19:22:18.137489+0000","last_became_active":"2024-04-25T19:22:16.081421+0000","last_became_peered":"2024-04-25T19:22:16.081421+0000","last_unstale":"2024-04-25T19:22:18.137489+0000","last_undegraded":"2024-04-25T19:22:18.137489+0000","last_fullsized":"2024-04-25T19:22:18.137489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:49:45.977189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076421+0000","last_change":"2024-04-25T19:22:17.080305+0000","last_active":"2024-04-25T19:22:18.076421+0000","last_peered":"2024-04-25T19:22:18.076421+0000","last_clean":"2024-04-25T19:22:18.076421+0000","last_became_active":"2024-04-25T19:22:17.079799+0000","last_became_peered":"2024-04-25T19:22:17.079799+0000","last_unstale":"2024-04-25T19:22:18.076421+0000","last_undegraded":"2024-04-25T19:22:18.076421+0000","last_fullsized":"2024-04-25T19:22:18.076421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:37.277654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138286+0000","last_change":"2024-04-25T19:22:16.081114+0000","last_active":"2024-04-25T19:22:18.138286+0000","last_peered":"2024-04-25T19:22:18.138286+0000","last_clean":"2024-04-25T19:22:18.138286+0000","last_became_active":"2024-04-25T19:22:16.080449+0000","last_became_peered":"2024-04-25T19:22:16.080449+0000","last_unstale":"2024-04-25T19:22:18.138286+0000","last_undegraded":"2024-04-25T19:22:18.138286+0000","last_fullsized":"2024-04-25T19:22:18.138286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:52.491459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135509+0000","last_change":"2024-04-25T19:22:17.065056+0000","last_active":"2024-04-25T19:22:18.135509+0000","last_peered":"2024-04-25T19:22:18.135509+0000","last_clean":"2024-04-25T19:22:18.135509+0000","last_became_active":"2024-04-25T19:22:17.062680+0000","last_became_peered":"2024-04-25T19:22:17.062680+0000","last_unstale":"2024-04-25T19:22:18.135509+0000","last_undegraded":"2024-04-25T19:22:18.135509+0000","last_fullsized":"2024-04-25T19:22:18.135509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:27.385683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135590+0000","last_change":"2024-04-25T19:22:16.056898+0000","last_active":"2024-04-25T19:22:18.135590+0000","last_peered":"2024-04-25T19:22:18.135590+0000","last_clean":"2024-04-25T19:22:18.135590+0000","last_became_active":"2024-04-25T19:22:16.056528+0000","last_became_peered":"2024-04-25T19:22:16.056528+0000","last_unstale":"2024-04-25T19:22:18.135590+0000","last_undegraded":"2024-04-25T19:22:18.135590+0000","last_fullsized":"2024-04-25T19:22:18.135590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:51.334418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135596+0000","last_change":"2024-04-25T19:22:17.075549+0000","last_active":"2024-04-25T19:22:18.135596+0000","last_peered":"2024-04-25T19:22:18.135596+0000","last_clean":"2024-04-25T19:22:18.135596+0000","last_became_active":"2024-04-25T19:22:17.075224+0000","last_became_peered":"2024-04-25T19:22:17.075224+0000","last_unstale":"2024-04-25T19:22:18.135596+0000","last_undegraded":"2024-04-25T19:22:18.135596+0000","last_fullsized":"2024-04-25T19:22:18.135596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:15:59.386088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135671+0000","last_change":"2024-04-25T19:22:16.073541+0000","last_active":"2024-04-25T19:22:18.135671+0000","last_peered":"2024-04-25T19:22:18.135671+0000","last_clean":"2024-04-25T19:22:18.135671+0000","last_became_active":"2024-04-25T19:22:16.073195+0000","last_became_peered":"2024-04-25T19:22:16.073195+0000","last_unstale":"2024-04-25T19:22:18.135671+0000","last_undegraded":"2024-04-25T19:22:18.135671+0000","last_fullsized":"2024-04-25T19:22:18.135671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:21.114512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T19:22:27.984 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T19:22:28.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.287+0000 7fb9bf200640 1 Processor -- start 2024-04-25T19:22:28.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.288+0000 7fb9bf200640 1 -- start start 2024-04-25T19:22:28.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.290+0000 7fb9bf200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb9c00b4ff0 0x7fb9c00b67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:28.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.290+0000 7fb9bf200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb9c00d21c0 0x7fb9c00cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:28.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.290+0000 7fb9bf200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9c00d26f0 con 0x7fb9c00cf7f0 2024-04-25T19:22:28.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.290+0000 7fb9bf200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fb9c00ce7d0 con 0x7fb9c00b4ff0 2024-04-25T19:22:28.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.290+0000 7fb9bf200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb9c00ceab0 con 0x7fb9c00d21c0 2024-04-25T19:22:28.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.290+0000 7fb9bde00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb9c00b4ff0 0x7fb9c00b67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:28.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.290+0000 7fb9bde00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb9c00b4ff0 0x7fb9c00b67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:60858/0 (socket says 172.21.15.131:60858) 2024-04-25T19:22:28.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.290+0000 7fb9bde00640 1 -- 172.21.15.131:0/3522879214 learned_addr learned my addr 172.21.15.131:0/3522879214 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:28.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.290+0000 7fb9bde00640 1 -- 172.21.15.131:0/3522879214 >> v2:172.21.15.195:3300/0 conn(0x7fb9c00d21c0 msgr2=0x7fb9c00cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:28.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.290+0000 7fb9bde00640 1 --2- 172.21.15.131:0/3522879214 >> v2:172.21.15.195:3300/0 conn(0x7fb9c00d21c0 0x7fb9c00cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:28.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.290+0000 7fb9bde00640 1 -- 172.21.15.131:0/3522879214 >> v1:172.21.15.195:6789/0 conn(0x7fb9c00cf7f0 legacy=0x7fb9c008cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:28.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.290+0000 7fb9bde00640 1 -- 172.21.15.131:0/3522879214 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c00ced90 con 0x7fb9c00b4ff0 2024-04-25T19:22:28.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.291+0000 7fb9bde00640 1 --2- 172.21.15.131:0/3522879214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9c00b4ff0 0x7fb9c00b67c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0074030 tx=0x7fb9b002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd14f265a055ab5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:28.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.292+0000 7fb9bca00640 1 -- 172.21.15.131:0/3522879214 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0004030 con 0x7fb9c00b4ff0 2024-04-25T19:22:28.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.292+0000 7fb9bca00640 1 -- 172.21.15.131:0/3522879214 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b00041d0 con 0x7fb9c00b4ff0 2024-04-25T19:22:28.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.292+0000 7fb9bca00640 1 -- 172.21.15.131:0/3522879214 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0003610 con 0x7fb9c00b4ff0 2024-04-25T19:22:28.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.292+0000 7fb9bf200640 1 -- 172.21.15.131:0/3522879214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9c00b4ff0 msgr2=0x7fb9c00b67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:28.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.292+0000 7fb9bf200640 1 --2- 172.21.15.131:0/3522879214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9c00b4ff0 0x7fb9c00b67c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0074030 tx=0x7fb9b002a230 comp rx=0 tx=0).stop 2024-04-25T19:22:28.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.292+0000 7fb9bf200640 1 -- 172.21.15.131:0/3522879214 shutdown_connections 2024-04-25T19:22:28.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.292+0000 7fb9bf200640 1 --2- 172.21.15.131:0/3522879214 >> v2:172.21.15.195:3300/0 conn(0x7fb9c00d21c0 0x7fb9c00cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:28.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.292+0000 7fb9bf200640 1 --2- 172.21.15.131:0/3522879214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9c00b4ff0 0x7fb9c00b67c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:28.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.292+0000 7fb9bf200640 1 -- 172.21.15.131:0/3522879214 >> 172.21.15.131:0/3522879214 conn(0x7fb9c00b5460 msgr2=0x7fb9c00b5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:28.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.292+0000 7fb9bf200640 1 -- 172.21.15.131:0/3522879214 shutdown_connections 2024-04-25T19:22:28.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.292+0000 7fb9bf200640 1 -- 172.21.15.131:0/3522879214 wait complete. 2024-04-25T19:22:28.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.295+0000 7fb9bf200640 1 Processor -- start 2024-04-25T19:22:28.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.295+0000 7fb9bf200640 1 -- start start 2024-04-25T19:22:28.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.296+0000 7fb9bf200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9c00b4ff0 0x7fb9c01549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:28.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.296+0000 7fb9bf200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9c00cf7f0 0x7fb9c0149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:28.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.296+0000 7fb9bf200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9c00d21c0 0x7fb9c01563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:28.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.296+0000 7fb9bf200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c00d29d0 con 0x7fb9c00d21c0 2024-04-25T19:22:28.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.296+0000 7fb9bf200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c00cfc00 con 0x7fb9c00b4ff0 2024-04-25T19:22:28.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.296+0000 7fb9bf200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c00d2b50 con 0x7fb9c00cf7f0 2024-04-25T19:22:28.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.296+0000 7fb9be800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9c00d21c0 0x7fb9c01563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:28.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.296+0000 7fb9be800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9c00d21c0 0x7fb9c01563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:60862/0 (socket says 172.21.15.131:60862) 2024-04-25T19:22:28.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.296+0000 7fb9be800640 1 -- 172.21.15.131:0/3229413477 learned_addr learned my addr 172.21.15.131:0/3229413477 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:28.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.297+0000 7fb9bde00640 1 --2- 172.21.15.131:0/3229413477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9c00b4ff0 0x7fb9c01549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:28.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.297+0000 7fb9be800640 1 -- 172.21.15.131:0/3229413477 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9c00cf7f0 msgr2=0x7fb9c0149bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:28.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.297+0000 7fb9bd400640 1 --2- 172.21.15.131:0/3229413477 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9c00cf7f0 0x7fb9c0149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:28.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.297+0000 7fb9be800640 1 --2- 172.21.15.131:0/3229413477 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9c00cf7f0 0x7fb9c0149bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:28.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.297+0000 7fb9be800640 1 -- 172.21.15.131:0/3229413477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9c00b4ff0 msgr2=0x7fb9c01549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:28.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.297+0000 7fb9be800640 1 --2- 172.21.15.131:0/3229413477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9c00b4ff0 0x7fb9c01549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:28.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.297+0000 7fb9be800640 1 -- 172.21.15.131:0/3229413477 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c01572d0 con 0x7fb9c00d21c0 2024-04-25T19:22:28.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.297+0000 7fb9bde00640 1 --2- 172.21.15.131:0/3229413477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9c00b4ff0 0x7fb9c01549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:28.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.297+0000 7fb9be800640 1 --2- 172.21.15.131:0/3229413477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9c00d21c0 0x7fb9c01563c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800b990 tx=0x7fb9b800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:28.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.297+0000 7fb9b6000640 1 -- 172.21.15.131:0/3229413477 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8019070 con 0x7fb9c00d21c0 2024-04-25T19:22:28.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.297+0000 7fb9b6000640 1 -- 172.21.15.131:0/3229413477 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b800cba0 con 0x7fb9c00d21c0 2024-04-25T19:22:28.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.297+0000 7fb9bf200640 1 -- 172.21.15.131:0/3229413477 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9c00cb510 con 0x7fb9c00d21c0 2024-04-25T19:22:28.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.297+0000 7fb9b6000640 1 -- 172.21.15.131:0/3229413477 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8014440 con 0x7fb9c00d21c0 2024-04-25T19:22:28.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.298+0000 7fb9bf200640 1 -- 172.21.15.131:0/3229413477 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9c00cd070 con 0x7fb9c00d21c0 2024-04-25T19:22:28.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.299+0000 7fb9bf200640 1 -- 172.21.15.131:0/3229413477 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9c0157040 con 0x7fb9c00d21c0 2024-04-25T19:22:28.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.300+0000 7fb9b6000640 1 -- 172.21.15.131:0/3229413477 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb9b801c070 con 0x7fb9c00d21c0 2024-04-25T19:22:28.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.301+0000 7fb9b6000640 1 --2- 172.21.15.131:0/3229413477 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb9a00744b0 0x7fb9a00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:28.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.301+0000 7fb9b6000640 1 -- 172.21.15.131:0/3229413477 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb9b8095060 con 0x7fb9c00d21c0 2024-04-25T19:22:28.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.302+0000 7fb9bde00640 1 --2- 172.21.15.131:0/3229413477 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb9a00744b0 0x7fb9a00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:28.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.303+0000 7fb9bde00640 1 --2- 172.21.15.131:0/3229413477 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb9a00744b0 0x7fb9a00769c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0033000 tx=0x7fb9b002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:28.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.306+0000 7fb9b6000640 1 -- 172.21.15.131:0/3229413477 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb9b805f750 con 0x7fb9c00d21c0 2024-04-25T19:22:28.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.487+0000 7fb9bf200640 1 -- 172.21.15.131:0/3229413477 --> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb9c00cd2d0 con 0x7fb9a00744b0 2024-04-25T19:22:28.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.508+0000 7fb9b6000640 1 -- 172.21.15.131:0/3229413477 <== mgr.4105 v2:172.21.15.195:6832/2541913764 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7fb9c00cd2d0 con 0x7fb9a00744b0 2024-04-25T19:22:28.510 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:28.513 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-04-25T19:22:28.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.514+0000 7fb9bf200640 1 -- 172.21.15.131:0/3229413477 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb9a00744b0 msgr2=0x7fb9a00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:28.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.514+0000 7fb9bf200640 1 --2- 172.21.15.131:0/3229413477 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb9a00744b0 0x7fb9a00769c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0033000 tx=0x7fb9b002e000 comp rx=0 tx=0).stop 2024-04-25T19:22:28.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.514+0000 7fb9bf200640 1 -- 172.21.15.131:0/3229413477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9c00d21c0 msgr2=0x7fb9c01563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:28.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.514+0000 7fb9bf200640 1 --2- 172.21.15.131:0/3229413477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9c00d21c0 0x7fb9c01563c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800b990 tx=0x7fb9b800be50 comp rx=0 tx=0).stop 2024-04-25T19:22:28.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.514+0000 7fb9bf200640 1 -- 172.21.15.131:0/3229413477 shutdown_connections 2024-04-25T19:22:28.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.514+0000 7fb9bf200640 1 --2- 172.21.15.131:0/3229413477 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb9a00744b0 0x7fb9a00769c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:28.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.514+0000 7fb9bf200640 1 --2- 172.21.15.131:0/3229413477 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9c00cf7f0 0x7fb9c0149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:28.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.514+0000 7fb9bf200640 1 --2- 172.21.15.131:0/3229413477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9c00d21c0 0x7fb9c01563c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:28.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.514+0000 7fb9bf200640 1 --2- 172.21.15.131:0/3229413477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9c00b4ff0 0x7fb9c01549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:28.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.514+0000 7fb9bf200640 1 -- 172.21.15.131:0/3229413477 >> 172.21.15.131:0/3229413477 conn(0x7fb9c00b5460 msgr2=0x7fb9c01618f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:28.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.514+0000 7fb9bf200640 1 -- 172.21.15.131:0/3229413477 shutdown_connections 2024-04-25T19:22:28.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.514+0000 7fb9bf200640 1 -- 172.21.15.131:0/3229413477 wait complete. 2024-04-25T19:22:28.540 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-25T19:22:28.140054+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235636,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739084,"statfs":{"total":773094113280,"available":772852822016,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.070045"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138347+0000","last_change":"2024-04-25T19:22:17.084552+0000","last_active":"2024-04-25T19:22:18.138347+0000","last_peered":"2024-04-25T19:22:18.138347+0000","last_clean":"2024-04-25T19:22:18.138347+0000","last_became_active":"2024-04-25T19:22:17.083645+0000","last_became_peered":"2024-04-25T19:22:17.083645+0000","last_unstale":"2024-04-25T19:22:18.138347+0000","last_undegraded":"2024-04-25T19:22:18.138347+0000","last_fullsized":"2024-04-25T19:22:18.138347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:49:42.415156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073420+0000","last_change":"2024-04-25T19:22:17.069431+0000","last_active":"2024-04-25T19:22:18.073420+0000","last_peered":"2024-04-25T19:22:18.073420+0000","last_clean":"2024-04-25T19:22:18.073420+0000","last_became_active":"2024-04-25T19:22:17.069036+0000","last_became_peered":"2024-04-25T19:22:17.069036+0000","last_unstale":"2024-04-25T19:22:18.073420+0000","last_undegraded":"2024-04-25T19:22:18.073420+0000","last_fullsized":"2024-04-25T19:22:18.073420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:52.165740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135315+0000","last_change":"2024-04-25T19:22:17.063030+0000","last_active":"2024-04-25T19:22:18.135315+0000","last_peered":"2024-04-25T19:22:18.135315+0000","last_clean":"2024-04-25T19:22:18.135315+0000","last_became_active":"2024-04-25T19:22:17.059484+0000","last_became_peered":"2024-04-25T19:22:17.059484+0000","last_unstale":"2024-04-25T19:22:18.135315+0000","last_undegraded":"2024-04-25T19:22:18.135315+0000","last_fullsized":"2024-04-25T19:22:18.135315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:59.050894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076254+0000","last_change":"2024-04-25T19:22:17.081742+0000","last_active":"2024-04-25T19:22:18.076254+0000","last_peered":"2024-04-25T19:22:18.076254+0000","last_clean":"2024-04-25T19:22:18.076254+0000","last_became_active":"2024-04-25T19:22:17.080753+0000","last_became_peered":"2024-04-25T19:22:17.080753+0000","last_unstale":"2024-04-25T19:22:18.076254+0000","last_undegraded":"2024-04-25T19:22:18.076254+0000","last_fullsized":"2024-04-25T19:22:18.076254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:58:50.378291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.137965+0000","last_change":"2024-04-25T19:22:17.074651+0000","last_active":"2024-04-25T19:22:18.137965+0000","last_peered":"2024-04-25T19:22:18.137965+0000","last_clean":"2024-04-25T19:22:18.137965+0000","last_became_active":"2024-04-25T19:22:17.073983+0000","last_became_peered":"2024-04-25T19:22:17.073983+0000","last_unstale":"2024-04-25T19:22:18.137965+0000","last_undegraded":"2024-04-25T19:22:18.137965+0000","last_fullsized":"2024-04-25T19:22:18.137965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:11.217132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.075816+0000","last_change":"2024-04-25T19:22:17.073457+0000","last_active":"2024-04-25T19:22:18.075816+0000","last_peered":"2024-04-25T19:22:18.075816+0000","last_clean":"2024-04-25T19:22:18.075816+0000","last_became_active":"2024-04-25T19:22:17.071400+0000","last_became_peered":"2024-04-25T19:22:17.071400+0000","last_unstale":"2024-04-25T19:22:18.075816+0000","last_undegraded":"2024-04-25T19:22:18.075816+0000","last_fullsized":"2024-04-25T19:22:18.075816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:36:53.730051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.136942+0000","last_change":"2024-04-25T19:22:17.082930+0000","last_active":"2024-04-25T19:22:18.136942+0000","last_peered":"2024-04-25T19:22:18.136942+0000","last_clean":"2024-04-25T19:22:18.136942+0000","last_became_active":"2024-04-25T19:22:17.082555+0000","last_became_peered":"2024-04-25T19:22:17.082555+0000","last_unstale":"2024-04-25T19:22:18.136942+0000","last_undegraded":"2024-04-25T19:22:18.136942+0000","last_fullsized":"2024-04-25T19:22:18.136942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:15:59.386088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134476+0000","last_change":"2024-04-25T19:22:17.081565+0000","last_active":"2024-04-25T19:22:18.134476+0000","last_peered":"2024-04-25T19:22:18.134476+0000","last_clean":"2024-04-25T19:22:18.134476+0000","last_became_active":"2024-04-25T19:22:17.080933+0000","last_became_peered":"2024-04-25T19:22:17.080933+0000","last_unstale":"2024-04-25T19:22:18.134476+0000","last_undegraded":"2024-04-25T19:22:18.134476+0000","last_fullsized":"2024-04-25T19:22:18.134476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:05.392241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138545+0000","last_change":"2024-04-25T19:22:17.096675+0000","last_active":"2024-04-25T19:22:18.138545+0000","last_peered":"2024-04-25T19:22:18.138545+0000","last_clean":"2024-04-25T19:22:18.138545+0000","last_became_active":"2024-04-25T19:22:17.096054+0000","last_became_peered":"2024-04-25T19:22:17.096054+0000","last_unstale":"2024-04-25T19:22:18.138545+0000","last_undegraded":"2024-04-25T19:22:18.138545+0000","last_fullsized":"2024-04-25T19:22:18.138545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:34.594467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.082280+0000","last_change":"2024-04-25T19:22:17.092042+0000","last_active":"2024-04-25T19:22:18.082280+0000","last_peered":"2024-04-25T19:22:18.082280+0000","last_clean":"2024-04-25T19:22:18.082280+0000","last_became_active":"2024-04-25T19:22:17.091661+0000","last_became_peered":"2024-04-25T19:22:17.091661+0000","last_unstale":"2024-04-25T19:22:18.082280+0000","last_undegraded":"2024-04-25T19:22:18.082280+0000","last_fullsized":"2024-04-25T19:22:18.082280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.514449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081825+0000","last_change":"2024-04-25T19:22:17.089728+0000","last_active":"2024-04-25T19:22:18.081825+0000","last_peered":"2024-04-25T19:22:18.081825+0000","last_clean":"2024-04-25T19:22:18.081825+0000","last_became_active":"2024-04-25T19:22:17.089366+0000","last_became_peered":"2024-04-25T19:22:17.089366+0000","last_unstale":"2024-04-25T19:22:18.081825+0000","last_undegraded":"2024-04-25T19:22:18.081825+0000","last_fullsized":"2024-04-25T19:22:18.081825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:59.050894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073574+0000","last_change":"2024-04-25T19:22:17.076934+0000","last_active":"2024-04-25T19:22:18.073574+0000","last_peered":"2024-04-25T19:22:18.073574+0000","last_clean":"2024-04-25T19:22:18.073574+0000","last_became_active":"2024-04-25T19:22:17.074228+0000","last_became_peered":"2024-04-25T19:22:17.074228+0000","last_unstale":"2024-04-25T19:22:18.073574+0000","last_undegraded":"2024-04-25T19:22:18.073574+0000","last_fullsized":"2024-04-25T19:22:18.073574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:45.772456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134905+0000","last_change":"2024-04-25T19:22:17.074643+0000","last_active":"2024-04-25T19:22:18.134905+0000","last_peered":"2024-04-25T19:22:18.134905+0000","last_clean":"2024-04-25T19:22:18.134905+0000","last_became_active":"2024-04-25T19:22:17.074222+0000","last_became_peered":"2024-04-25T19:22:17.074222+0000","last_unstale":"2024-04-25T19:22:18.134905+0000","last_undegraded":"2024-04-25T19:22:18.134905+0000","last_fullsized":"2024-04-25T19:22:18.134905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:42.370408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134334+0000","last_change":"2024-04-25T19:22:17.080879+0000","last_active":"2024-04-25T19:22:18.134334+0000","last_peered":"2024-04-25T19:22:18.134334+0000","last_clean":"2024-04-25T19:22:18.134334+0000","last_became_active":"2024-04-25T19:22:17.080532+0000","last_became_peered":"2024-04-25T19:22:17.080532+0000","last_unstale":"2024-04-25T19:22:18.134334+0000","last_undegraded":"2024-04-25T19:22:18.134334+0000","last_fullsized":"2024-04-25T19:22:18.134334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:02.635176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072556+0000","last_change":"2024-04-25T19:22:17.073160+0000","last_active":"2024-04-25T19:22:18.072556+0000","last_peered":"2024-04-25T19:22:18.072556+0000","last_clean":"2024-04-25T19:22:18.072556+0000","last_became_active":"2024-04-25T19:22:17.072815+0000","last_became_peered":"2024-04-25T19:22:17.072815+0000","last_unstale":"2024-04-25T19:22:18.072556+0000","last_undegraded":"2024-04-25T19:22:18.072556+0000","last_fullsized":"2024-04-25T19:22:18.072556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:59.050894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.075591+0000","last_change":"2024-04-25T19:22:17.071757+0000","last_active":"2024-04-25T19:22:18.075591+0000","last_peered":"2024-04-25T19:22:18.075591+0000","last_clean":"2024-04-25T19:22:18.075591+0000","last_became_active":"2024-04-25T19:22:17.071385+0000","last_became_peered":"2024-04-25T19:22:17.071385+0000","last_unstale":"2024-04-25T19:22:18.075591+0000","last_undegraded":"2024-04-25T19:22:18.075591+0000","last_fullsized":"2024-04-25T19:22:18.075591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:52.165740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.077244+0000","last_change":"2024-04-25T19:22:17.082098+0000","last_active":"2024-04-25T19:22:18.077244+0000","last_peered":"2024-04-25T19:22:18.077244+0000","last_clean":"2024-04-25T19:22:18.077244+0000","last_became_active":"2024-04-25T19:22:17.080035+0000","last_became_peered":"2024-04-25T19:22:17.080035+0000","last_unstale":"2024-04-25T19:22:18.077244+0000","last_undegraded":"2024-04-25T19:22:18.077244+0000","last_fullsized":"2024-04-25T19:22:18.077244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:49:42.415156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.133867+0000","last_change":"2024-04-25T19:22:17.071266+0000","last_active":"2024-04-25T19:22:18.133867+0000","last_peered":"2024-04-25T19:22:18.133867+0000","last_clean":"2024-04-25T19:22:18.133867+0000","last_became_active":"2024-04-25T19:22:17.070270+0000","last_became_peered":"2024-04-25T19:22:17.070270+0000","last_unstale":"2024-04-25T19:22:18.133867+0000","last_undegraded":"2024-04-25T19:22:18.133867+0000","last_fullsized":"2024-04-25T19:22:18.133867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:49:46.991384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138169+0000","last_change":"2024-04-25T19:22:17.089998+0000","last_active":"2024-04-25T19:22:18.138169+0000","last_peered":"2024-04-25T19:22:18.138169+0000","last_clean":"2024-04-25T19:22:18.138169+0000","last_became_active":"2024-04-25T19:22:17.087637+0000","last_became_peered":"2024-04-25T19:22:17.087637+0000","last_unstale":"2024-04-25T19:22:18.138169+0000","last_undegraded":"2024-04-25T19:22:18.138169+0000","last_fullsized":"2024-04-25T19:22:18.138169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:31.122370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081737+0000","last_change":"2024-04-25T19:22:17.085745+0000","last_active":"2024-04-25T19:22:18.081737+0000","last_peered":"2024-04-25T19:22:18.081737+0000","last_clean":"2024-04-25T19:22:18.081737+0000","last_became_active":"2024-04-25T19:22:17.084164+0000","last_became_peered":"2024-04-25T19:22:17.084164+0000","last_unstale":"2024-04-25T19:22:18.081737+0000","last_undegraded":"2024-04-25T19:22:18.081737+0000","last_fullsized":"2024-04-25T19:22:18.081737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:23.797191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134984+0000","last_change":"2024-04-25T19:22:17.071037+0000","last_active":"2024-04-25T19:22:18.134984+0000","last_peered":"2024-04-25T19:22:18.134984+0000","last_clean":"2024-04-25T19:22:18.134984+0000","last_became_active":"2024-04-25T19:22:17.070692+0000","last_became_peered":"2024-04-25T19:22:17.070692+0000","last_unstale":"2024-04-25T19:22:18.134984+0000","last_undegraded":"2024-04-25T19:22:18.134984+0000","last_fullsized":"2024-04-25T19:22:18.134984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:06.030063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.075876+0000","last_change":"2024-04-25T19:22:17.082746+0000","last_active":"2024-04-25T19:22:18.075876+0000","last_peered":"2024-04-25T19:22:18.075876+0000","last_clean":"2024-04-25T19:22:18.075876+0000","last_became_active":"2024-04-25T19:22:17.081725+0000","last_became_peered":"2024-04-25T19:22:17.081725+0000","last_unstale":"2024-04-25T19:22:18.075876+0000","last_undegraded":"2024-04-25T19:22:18.075876+0000","last_fullsized":"2024-04-25T19:22:18.075876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:42.285229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134792+0000","last_change":"2024-04-25T19:22:17.085784+0000","last_active":"2024-04-25T19:22:18.134792+0000","last_peered":"2024-04-25T19:22:18.134792+0000","last_clean":"2024-04-25T19:22:18.134792+0000","last_became_active":"2024-04-25T19:22:17.085388+0000","last_became_peered":"2024-04-25T19:22:17.085388+0000","last_unstale":"2024-04-25T19:22:18.134792+0000","last_undegraded":"2024-04-25T19:22:18.134792+0000","last_fullsized":"2024-04-25T19:22:18.134792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:59.050894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.075802+0000","last_change":"2024-04-25T19:22:17.083578+0000","last_active":"2024-04-25T19:22:18.075802+0000","last_peered":"2024-04-25T19:22:18.075802+0000","last_clean":"2024-04-25T19:22:18.075802+0000","last_became_active":"2024-04-25T19:22:17.082843+0000","last_became_peered":"2024-04-25T19:22:17.082843+0000","last_unstale":"2024-04-25T19:22:18.075802+0000","last_undegraded":"2024-04-25T19:22:18.075802+0000","last_fullsized":"2024-04-25T19:22:18.075802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.514449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135247+0000","last_change":"2024-04-25T19:22:17.086133+0000","last_active":"2024-04-25T19:22:18.135247+0000","last_peered":"2024-04-25T19:22:18.135247+0000","last_clean":"2024-04-25T19:22:18.135247+0000","last_became_active":"2024-04-25T19:22:17.084935+0000","last_became_peered":"2024-04-25T19:22:17.084935+0000","last_unstale":"2024-04-25T19:22:18.135247+0000","last_undegraded":"2024-04-25T19:22:18.135247+0000","last_fullsized":"2024-04-25T19:22:18.135247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.514449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.082077+0000","last_change":"2024-04-25T19:22:17.072128+0000","last_active":"2024-04-25T19:22:18.082077+0000","last_peered":"2024-04-25T19:22:18.082077+0000","last_clean":"2024-04-25T19:22:18.082077+0000","last_became_active":"2024-04-25T19:22:17.071637+0000","last_became_peered":"2024-04-25T19:22:17.071637+0000","last_unstale":"2024-04-25T19:22:18.082077+0000","last_undegraded":"2024-04-25T19:22:18.082077+0000","last_fullsized":"2024-04-25T19:22:18.082077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:52.165740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072909+0000","last_change":"2024-04-25T19:22:17.077813+0000","last_active":"2024-04-25T19:22:18.072909+0000","last_peered":"2024-04-25T19:22:18.072909+0000","last_clean":"2024-04-25T19:22:18.072909+0000","last_became_active":"2024-04-25T19:22:17.076972+0000","last_became_peered":"2024-04-25T19:22:17.076972+0000","last_unstale":"2024-04-25T19:22:18.072909+0000","last_undegraded":"2024-04-25T19:22:18.072909+0000","last_fullsized":"2024-04-25T19:22:18.072909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:27.385683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135131+0000","last_change":"2024-04-25T19:22:17.085634+0000","last_active":"2024-04-25T19:22:18.135131+0000","last_peered":"2024-04-25T19:22:18.135131+0000","last_clean":"2024-04-25T19:22:18.135131+0000","last_became_active":"2024-04-25T19:22:17.085069+0000","last_became_peered":"2024-04-25T19:22:17.085069+0000","last_unstale":"2024-04-25T19:22:18.135131+0000","last_undegraded":"2024-04-25T19:22:18.135131+0000","last_fullsized":"2024-04-25T19:22:18.135131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:27.385683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135179+0000","last_change":"2024-04-25T19:22:17.081785+0000","last_active":"2024-04-25T19:22:18.135179+0000","last_peered":"2024-04-25T19:22:18.135179+0000","last_clean":"2024-04-25T19:22:18.135179+0000","last_became_active":"2024-04-25T19:22:17.081478+0000","last_became_peered":"2024-04-25T19:22:17.081478+0000","last_unstale":"2024-04-25T19:22:18.135179+0000","last_undegraded":"2024-04-25T19:22:18.135179+0000","last_fullsized":"2024-04-25T19:22:18.135179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:23.797191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076049+0000","last_change":"2024-04-25T19:22:17.084665+0000","last_active":"2024-04-25T19:22:18.076049+0000","last_peered":"2024-04-25T19:22:18.076049+0000","last_clean":"2024-04-25T19:22:18.076049+0000","last_became_active":"2024-04-25T19:22:17.082107+0000","last_became_peered":"2024-04-25T19:22:17.082107+0000","last_unstale":"2024-04-25T19:22:18.076049+0000","last_undegraded":"2024-04-25T19:22:18.076049+0000","last_fullsized":"2024-04-25T19:22:18.076049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:15:59.386088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.133567+0000","last_change":"2024-04-25T19:22:17.082056+0000","last_active":"2024-04-25T19:22:18.133567+0000","last_peered":"2024-04-25T19:22:18.133567+0000","last_clean":"2024-04-25T19:22:18.133567+0000","last_became_active":"2024-04-25T19:22:17.079951+0000","last_became_peered":"2024-04-25T19:22:17.079951+0000","last_unstale":"2024-04-25T19:22:18.133567+0000","last_undegraded":"2024-04-25T19:22:18.133567+0000","last_fullsized":"2024-04-25T19:22:18.133567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:19.060353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081500+0000","last_change":"2024-04-25T19:22:17.082235+0000","last_active":"2024-04-25T19:22:18.081500+0000","last_peered":"2024-04-25T19:22:18.081500+0000","last_clean":"2024-04-25T19:22:18.081500+0000","last_became_active":"2024-04-25T19:22:17.081806+0000","last_became_peered":"2024-04-25T19:22:17.081806+0000","last_unstale":"2024-04-25T19:22:18.081500+0000","last_undegraded":"2024-04-25T19:22:18.081500+0000","last_fullsized":"2024-04-25T19:22:18.081500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:06.030063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073096+0000","last_change":"2024-04-25T19:22:17.080063+0000","last_active":"2024-04-25T19:22:18.073096+0000","last_peered":"2024-04-25T19:22:18.073096+0000","last_clean":"2024-04-25T19:22:18.073096+0000","last_became_active":"2024-04-25T19:22:17.079696+0000","last_became_peered":"2024-04-25T19:22:17.079696+0000","last_unstale":"2024-04-25T19:22:18.073096+0000","last_undegraded":"2024-04-25T19:22:18.073096+0000","last_fullsized":"2024-04-25T19:22:18.073096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:26.080591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135311+0000","last_change":"2024-04-25T19:22:16.067625+0000","last_active":"2024-04-25T19:22:18.135311+0000","last_peered":"2024-04-25T19:22:18.135311+0000","last_clean":"2024-04-25T19:22:18.135311+0000","last_became_active":"2024-04-25T19:22:16.067277+0000","last_became_peered":"2024-04-25T19:22:16.067277+0000","last_unstale":"2024-04-25T19:22:18.135311+0000","last_undegraded":"2024-04-25T19:22:18.135311+0000","last_fullsized":"2024-04-25T19:22:18.135311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:38.378131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135442+0000","last_change":"2024-04-25T19:22:17.067796+0000","last_active":"2024-04-25T19:22:18.135442+0000","last_peered":"2024-04-25T19:22:18.135442+0000","last_clean":"2024-04-25T19:22:18.135442+0000","last_became_active":"2024-04-25T19:22:17.067488+0000","last_became_peered":"2024-04-25T19:22:17.067488+0000","last_unstale":"2024-04-25T19:22:18.135442+0000","last_undegraded":"2024-04-25T19:22:18.135442+0000","last_fullsized":"2024-04-25T19:22:18.135442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:42.370408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.082142+0000","last_change":"2024-04-25T19:22:16.073203+0000","last_active":"2024-04-25T19:22:18.082142+0000","last_peered":"2024-04-25T19:22:18.082142+0000","last_clean":"2024-04-25T19:22:18.082142+0000","last_became_active":"2024-04-25T19:22:16.072711+0000","last_became_peered":"2024-04-25T19:22:16.072711+0000","last_unstale":"2024-04-25T19:22:18.082142+0000","last_undegraded":"2024-04-25T19:22:18.082142+0000","last_fullsized":"2024-04-25T19:22:18.082142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:39:11.697383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134798+0000","last_change":"2024-04-25T19:22:16.066248+0000","last_active":"2024-04-25T19:22:18.134798+0000","last_peered":"2024-04-25T19:22:18.134798+0000","last_clean":"2024-04-25T19:22:18.134798+0000","last_became_active":"2024-04-25T19:22:16.065906+0000","last_became_peered":"2024-04-25T19:22:16.065906+0000","last_unstale":"2024-04-25T19:22:18.134798+0000","last_undegraded":"2024-04-25T19:22:18.134798+0000","last_fullsized":"2024-04-25T19:22:18.134798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:32:14.300239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134508+0000","last_change":"2024-04-25T19:22:17.076260+0000","last_active":"2024-04-25T19:22:18.134508+0000","last_peered":"2024-04-25T19:22:18.134508+0000","last_clean":"2024-04-25T19:22:18.134508+0000","last_became_active":"2024-04-25T19:22:17.075601+0000","last_became_peered":"2024-04-25T19:22:17.075601+0000","last_unstale":"2024-04-25T19:22:18.134508+0000","last_undegraded":"2024-04-25T19:22:18.134508+0000","last_fullsized":"2024-04-25T19:22:18.134508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:06.030063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.075730+0000","last_change":"2024-04-25T19:22:16.071937+0000","last_active":"2024-04-25T19:22:18.075730+0000","last_peered":"2024-04-25T19:22:18.075730+0000","last_clean":"2024-04-25T19:22:18.075730+0000","last_became_active":"2024-04-25T19:22:16.071520+0000","last_became_peered":"2024-04-25T19:22:16.071520+0000","last_unstale":"2024-04-25T19:22:18.075730+0000","last_undegraded":"2024-04-25T19:22:18.075730+0000","last_fullsized":"2024-04-25T19:22:18.075730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:44.758262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072358+0000","last_change":"2024-04-25T19:22:17.077394+0000","last_active":"2024-04-25T19:22:18.072358+0000","last_peered":"2024-04-25T19:22:18.072358+0000","last_clean":"2024-04-25T19:22:18.072358+0000","last_became_active":"2024-04-25T19:22:17.077051+0000","last_became_peered":"2024-04-25T19:22:17.077051+0000","last_unstale":"2024-04-25T19:22:18.072358+0000","last_undegraded":"2024-04-25T19:22:18.072358+0000","last_fullsized":"2024-04-25T19:22:18.072358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:06.030063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081976+0000","last_change":"2024-04-25T19:22:16.072385+0000","last_active":"2024-04-25T19:22:18.081976+0000","last_peered":"2024-04-25T19:22:18.081976+0000","last_clean":"2024-04-25T19:22:18.081976+0000","last_became_active":"2024-04-25T19:22:16.070426+0000","last_became_peered":"2024-04-25T19:22:16.070426+0000","last_unstale":"2024-04-25T19:22:18.081976+0000","last_undegraded":"2024-04-25T19:22:18.081976+0000","last_fullsized":"2024-04-25T19:22:18.081976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:44.758262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076712+0000","last_change":"2024-04-25T19:22:17.082646+0000","last_active":"2024-04-25T19:22:18.076712+0000","last_peered":"2024-04-25T19:22:18.076712+0000","last_clean":"2024-04-25T19:22:18.076712+0000","last_became_active":"2024-04-25T19:22:17.080730+0000","last_became_peered":"2024-04-25T19:22:17.080730+0000","last_unstale":"2024-04-25T19:22:18.076712+0000","last_undegraded":"2024-04-25T19:22:18.076712+0000","last_fullsized":"2024-04-25T19:22:18.076712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:31.122370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.077020+0000","last_change":"2024-04-25T19:22:16.074350+0000","last_active":"2024-04-25T19:22:18.077020+0000","last_peered":"2024-04-25T19:22:18.077020+0000","last_clean":"2024-04-25T19:22:18.077020+0000","last_became_active":"2024-04-25T19:22:16.074011+0000","last_became_peered":"2024-04-25T19:22:16.074011+0000","last_unstale":"2024-04-25T19:22:18.077020+0000","last_undegraded":"2024-04-25T19:22:18.077020+0000","last_fullsized":"2024-04-25T19:22:18.077020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:26.277490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135604+0000","last_change":"2024-04-25T19:22:17.064011+0000","last_active":"2024-04-25T19:22:18.135604+0000","last_peered":"2024-04-25T19:22:18.135604+0000","last_clean":"2024-04-25T19:22:18.135604+0000","last_became_active":"2024-04-25T19:22:17.062182+0000","last_became_peered":"2024-04-25T19:22:17.062182+0000","last_unstale":"2024-04-25T19:22:18.135604+0000","last_undegraded":"2024-04-25T19:22:18.135604+0000","last_fullsized":"2024-04-25T19:22:18.135604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:52.165740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073457+0000","last_change":"2024-04-25T19:22:16.071057+0000","last_active":"2024-04-25T19:22:18.073457+0000","last_peered":"2024-04-25T19:22:18.073457+0000","last_clean":"2024-04-25T19:22:18.073457+0000","last_became_active":"2024-04-25T19:22:16.070791+0000","last_became_peered":"2024-04-25T19:22:16.070791+0000","last_unstale":"2024-04-25T19:22:18.073457+0000","last_undegraded":"2024-04-25T19:22:18.073457+0000","last_fullsized":"2024-04-25T19:22:18.073457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:52.491459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073601+0000","last_change":"2024-04-25T19:22:17.077831+0000","last_active":"2024-04-25T19:22:18.073601+0000","last_peered":"2024-04-25T19:22:18.073601+0000","last_clean":"2024-04-25T19:22:18.073601+0000","last_became_active":"2024-04-25T19:22:17.077469+0000","last_became_peered":"2024-04-25T19:22:17.077469+0000","last_unstale":"2024-04-25T19:22:18.073601+0000","last_undegraded":"2024-04-25T19:22:18.073601+0000","last_fullsized":"2024-04-25T19:22:18.073601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:52:35.971335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081891+0000","last_change":"2024-04-25T19:22:16.071427+0000","last_active":"2024-04-25T19:22:18.081891+0000","last_peered":"2024-04-25T19:22:18.081891+0000","last_clean":"2024-04-25T19:22:18.081891+0000","last_became_active":"2024-04-25T19:22:16.070575+0000","last_became_peered":"2024-04-25T19:22:16.070575+0000","last_unstale":"2024-04-25T19:22:18.081891+0000","last_undegraded":"2024-04-25T19:22:18.081891+0000","last_fullsized":"2024-04-25T19:22:18.081891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:25.066396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.137428+0000","last_change":"2024-04-25T19:22:17.084347+0000","last_active":"2024-04-25T19:22:18.137428+0000","last_peered":"2024-04-25T19:22:18.137428+0000","last_clean":"2024-04-25T19:22:18.137428+0000","last_became_active":"2024-04-25T19:22:17.084024+0000","last_became_peered":"2024-04-25T19:22:17.084024+0000","last_unstale":"2024-04-25T19:22:18.137428+0000","last_undegraded":"2024-04-25T19:22:18.137428+0000","last_fullsized":"2024-04-25T19:22:18.137428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:58:50.378291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135604+0000","last_change":"2024-04-25T19:22:16.070227+0000","last_active":"2024-04-25T19:22:18.135604+0000","last_peered":"2024-04-25T19:22:18.135604+0000","last_clean":"2024-04-25T19:22:18.135604+0000","last_became_active":"2024-04-25T19:22:16.069762+0000","last_became_peered":"2024-04-25T19:22:16.069762+0000","last_unstale":"2024-04-25T19:22:18.135604+0000","last_undegraded":"2024-04-25T19:22:18.135604+0000","last_fullsized":"2024-04-25T19:22:18.135604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:32:14.300239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134514+0000","last_change":"2024-04-25T19:22:17.072239+0000","last_active":"2024-04-25T19:22:18.134514+0000","last_peered":"2024-04-25T19:22:18.134514+0000","last_clean":"2024-04-25T19:22:18.134514+0000","last_became_active":"2024-04-25T19:22:17.070501+0000","last_became_peered":"2024-04-25T19:22:17.070501+0000","last_unstale":"2024-04-25T19:22:18.134514+0000","last_undegraded":"2024-04-25T19:22:18.134514+0000","last_fullsized":"2024-04-25T19:22:18.134514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:02.462274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076023+0000","last_change":"2024-04-25T19:22:16.065013+0000","last_active":"2024-04-25T19:22:18.076023+0000","last_peered":"2024-04-25T19:22:18.076023+0000","last_clean":"2024-04-25T19:22:18.076023+0000","last_became_active":"2024-04-25T19:22:16.063969+0000","last_became_peered":"2024-04-25T19:22:16.063969+0000","last_unstale":"2024-04-25T19:22:18.076023+0000","last_undegraded":"2024-04-25T19:22:18.076023+0000","last_fullsized":"2024-04-25T19:22:18.076023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:39:11.697383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.137925+0000","last_change":"2024-04-25T19:22:17.100962+0000","last_active":"2024-04-25T19:22:18.137925+0000","last_peered":"2024-04-25T19:22:18.137925+0000","last_clean":"2024-04-25T19:22:18.137925+0000","last_became_active":"2024-04-25T19:22:17.099677+0000","last_became_peered":"2024-04-25T19:22:17.099677+0000","last_unstale":"2024-04-25T19:22:18.137925+0000","last_undegraded":"2024-04-25T19:22:18.137925+0000","last_fullsized":"2024-04-25T19:22:18.137925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:43.115713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081451+0000","last_change":"2024-04-25T19:22:16.073130+0000","last_active":"2024-04-25T19:22:18.081451+0000","last_peered":"2024-04-25T19:22:18.081451+0000","last_clean":"2024-04-25T19:22:18.081451+0000","last_became_active":"2024-04-25T19:22:16.070679+0000","last_became_peered":"2024-04-25T19:22:16.070679+0000","last_unstale":"2024-04-25T19:22:18.081451+0000","last_undegraded":"2024-04-25T19:22:18.081451+0000","last_fullsized":"2024-04-25T19:22:18.081451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:51.334418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081928+0000","last_change":"2024-04-25T19:22:17.081998+0000","last_active":"2024-04-25T19:22:18.081928+0000","last_peered":"2024-04-25T19:22:18.081928+0000","last_clean":"2024-04-25T19:22:18.081928+0000","last_became_active":"2024-04-25T19:22:17.081424+0000","last_became_peered":"2024-04-25T19:22:17.081424+0000","last_unstale":"2024-04-25T19:22:18.081928+0000","last_undegraded":"2024-04-25T19:22:18.081928+0000","last_fullsized":"2024-04-25T19:22:18.081928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:42.370408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.133344+0000","last_change":"2024-04-25T19:22:16.055538+0000","last_active":"2024-04-25T19:22:18.133344+0000","last_peered":"2024-04-25T19:22:18.133344+0000","last_clean":"2024-04-25T19:22:18.133344+0000","last_became_active":"2024-04-25T19:22:16.055142+0000","last_became_peered":"2024-04-25T19:22:16.055142+0000","last_unstale":"2024-04-25T19:22:18.133344+0000","last_undegraded":"2024-04-25T19:22:18.133344+0000","last_fullsized":"2024-04-25T19:22:18.133344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:51.334418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.136896+0000","last_change":"2024-04-25T19:22:17.085913+0000","last_active":"2024-04-25T19:22:18.136896+0000","last_peered":"2024-04-25T19:22:18.136896+0000","last_clean":"2024-04-25T19:22:18.136896+0000","last_became_active":"2024-04-25T19:22:17.081882+0000","last_became_peered":"2024-04-25T19:22:17.081882+0000","last_unstale":"2024-04-25T19:22:18.136896+0000","last_undegraded":"2024-04-25T19:22:18.136896+0000","last_fullsized":"2024-04-25T19:22:18.136896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:42.285229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.074059+0000","last_change":"2024-04-25T19:22:16.063433+0000","last_active":"2024-04-25T19:22:18.074059+0000","last_peered":"2024-04-25T19:22:18.074059+0000","last_clean":"2024-04-25T19:22:18.074059+0000","last_became_active":"2024-04-25T19:22:16.062287+0000","last_became_peered":"2024-04-25T19:22:16.062287+0000","last_unstale":"2024-04-25T19:22:18.074059+0000","last_undegraded":"2024-04-25T19:22:18.074059+0000","last_fullsized":"2024-04-25T19:22:18.074059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:03:07.738217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.137576+0000","last_change":"2024-04-25T19:22:17.075699+0000","last_active":"2024-04-25T19:22:18.137576+0000","last_peered":"2024-04-25T19:22:18.137576+0000","last_clean":"2024-04-25T19:22:18.137576+0000","last_became_active":"2024-04-25T19:22:17.075238+0000","last_became_peered":"2024-04-25T19:22:17.075238+0000","last_unstale":"2024-04-25T19:22:18.137576+0000","last_undegraded":"2024-04-25T19:22:18.137576+0000","last_fullsized":"2024-04-25T19:22:18.137576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:37.277654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.133800+0000","last_change":"2024-04-25T19:22:16.056199+0000","last_active":"2024-04-25T19:22:18.133800+0000","last_peered":"2024-04-25T19:22:18.133800+0000","last_clean":"2024-04-25T19:22:18.133800+0000","last_became_active":"2024-04-25T19:22:16.055898+0000","last_became_peered":"2024-04-25T19:22:16.055898+0000","last_unstale":"2024-04-25T19:22:18.133800+0000","last_undegraded":"2024-04-25T19:22:18.133800+0000","last_fullsized":"2024-04-25T19:22:18.133800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:25.066396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138688+0000","last_change":"2024-04-25T19:22:17.075542+0000","last_active":"2024-04-25T19:22:18.138688+0000","last_peered":"2024-04-25T19:22:18.138688+0000","last_clean":"2024-04-25T19:22:18.138688+0000","last_became_active":"2024-04-25T19:22:17.075208+0000","last_became_peered":"2024-04-25T19:22:17.075208+0000","last_unstale":"2024-04-25T19:22:18.138688+0000","last_undegraded":"2024-04-25T19:22:18.138688+0000","last_fullsized":"2024-04-25T19:22:18.138688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:07.456013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073013+0000","last_change":"2024-04-25T19:22:16.057412+0000","last_active":"2024-04-25T19:22:18.073013+0000","last_peered":"2024-04-25T19:22:18.073013+0000","last_clean":"2024-04-25T19:22:18.073013+0000","last_became_active":"2024-04-25T19:22:16.056998+0000","last_became_peered":"2024-04-25T19:22:16.056998+0000","last_unstale":"2024-04-25T19:22:18.073013+0000","last_undegraded":"2024-04-25T19:22:18.073013+0000","last_fullsized":"2024-04-25T19:22:18.073013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:49:45.977189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076474+0000","last_change":"2024-04-25T19:22:17.083087+0000","last_active":"2024-04-25T19:22:18.076474+0000","last_peered":"2024-04-25T19:22:18.076474+0000","last_clean":"2024-04-25T19:22:18.076474+0000","last_became_active":"2024-04-25T19:22:17.080584+0000","last_became_peered":"2024-04-25T19:22:17.080584+0000","last_unstale":"2024-04-25T19:22:18.076474+0000","last_undegraded":"2024-04-25T19:22:18.076474+0000","last_fullsized":"2024-04-25T19:22:18.076474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:43.115713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.133601+0000","last_change":"2024-04-25T19:22:16.064556+0000","last_active":"2024-04-25T19:22:18.133601+0000","last_peered":"2024-04-25T19:22:18.133601+0000","last_clean":"2024-04-25T19:22:18.133601+0000","last_became_active":"2024-04-25T19:22:16.063605+0000","last_became_peered":"2024-04-25T19:22:16.063605+0000","last_unstale":"2024-04-25T19:22:18.133601+0000","last_undegraded":"2024-04-25T19:22:18.133601+0000","last_fullsized":"2024-04-25T19:22:18.133601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:39:11.697383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.137672+0000","last_change":"2024-04-25T19:22:17.091739+0000","last_active":"2024-04-25T19:22:18.137672+0000","last_peered":"2024-04-25T19:22:18.137672+0000","last_clean":"2024-04-25T19:22:18.137672+0000","last_became_active":"2024-04-25T19:22:17.091329+0000","last_became_peered":"2024-04-25T19:22:17.091329+0000","last_unstale":"2024-04-25T19:22:18.137672+0000","last_undegraded":"2024-04-25T19:22:18.137672+0000","last_fullsized":"2024-04-25T19:22:18.137672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:25.008654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.136813+0000","last_change":"2024-04-25T19:22:06.081655+0000","last_active":"2024-04-25T19:22:18.136813+0000","last_peered":"2024-04-25T19:22:18.136813+0000","last_clean":"2024-04-25T19:22:18.136813+0000","last_became_active":"2024-04-25T19:22:06.078999+0000","last_became_peered":"2024-04-25T19:22:06.078999+0000","last_unstale":"2024-04-25T19:22:18.136813+0000","last_undegraded":"2024-04-25T19:22:18.136813+0000","last_fullsized":"2024-04-25T19:22:18.136813+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_clean_scrub_stamp":"2024-04-25T19:22:04.921147+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:30.543734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.075905+0000","last_change":"2024-04-25T19:22:16.058023+0000","last_active":"2024-04-25T19:22:18.075905+0000","last_peered":"2024-04-25T19:22:18.075905+0000","last_clean":"2024-04-25T19:22:18.075905+0000","last_became_active":"2024-04-25T19:22:16.057585+0000","last_became_peered":"2024-04-25T19:22:16.057585+0000","last_unstale":"2024-04-25T19:22:18.075905+0000","last_undegraded":"2024-04-25T19:22:18.075905+0000","last_fullsized":"2024-04-25T19:22:18.075905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:51.334418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135269+0000","last_change":"2024-04-25T19:22:17.080786+0000","last_active":"2024-04-25T19:22:18.135269+0000","last_peered":"2024-04-25T19:22:18.135269+0000","last_clean":"2024-04-25T19:22:18.135269+0000","last_became_active":"2024-04-25T19:22:17.080103+0000","last_became_peered":"2024-04-25T19:22:17.080103+0000","last_unstale":"2024-04-25T19:22:18.135269+0000","last_undegraded":"2024-04-25T19:22:18.135269+0000","last_fullsized":"2024-04-25T19:22:18.135269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:36:53.730051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.136579+0000","last_change":"2024-04-25T19:22:16.079452+0000","last_active":"2024-04-25T19:22:18.136579+0000","last_peered":"2024-04-25T19:22:18.136579+0000","last_clean":"2024-04-25T19:22:18.136579+0000","last_became_active":"2024-04-25T19:22:16.078988+0000","last_became_peered":"2024-04-25T19:22:16.078988+0000","last_unstale":"2024-04-25T19:22:18.136579+0000","last_undegraded":"2024-04-25T19:22:18.136579+0000","last_fullsized":"2024-04-25T19:22:18.136579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:52:34.957140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134617+0000","last_change":"2024-04-25T19:22:17.063481+0000","last_active":"2024-04-25T19:22:18.134617+0000","last_peered":"2024-04-25T19:22:18.134617+0000","last_clean":"2024-04-25T19:22:18.134617+0000","last_became_active":"2024-04-25T19:22:17.061000+0000","last_became_peered":"2024-04-25T19:22:17.061000+0000","last_unstale":"2024-04-25T19:22:18.134617+0000","last_undegraded":"2024-04-25T19:22:18.134617+0000","last_fullsized":"2024-04-25T19:22:18.134617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:05.392241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.133582+0000","last_change":"2024-04-25T19:22:16.060594+0000","last_active":"2024-04-25T19:22:18.133582+0000","last_peered":"2024-04-25T19:22:18.133582+0000","last_clean":"2024-04-25T19:22:18.133582+0000","last_became_active":"2024-04-25T19:22:16.060250+0000","last_became_peered":"2024-04-25T19:22:16.060250+0000","last_unstale":"2024-04-25T19:22:18.133582+0000","last_undegraded":"2024-04-25T19:22:18.133582+0000","last_fullsized":"2024-04-25T19:22:18.133582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:38.378131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072506+0000","last_change":"2024-04-25T19:22:17.068935+0000","last_active":"2024-04-25T19:22:18.072506+0000","last_peered":"2024-04-25T19:22:18.072506+0000","last_clean":"2024-04-25T19:22:18.072506+0000","last_became_active":"2024-04-25T19:22:17.068017+0000","last_became_peered":"2024-04-25T19:22:17.068017+0000","last_unstale":"2024-04-25T19:22:18.072506+0000","last_undegraded":"2024-04-25T19:22:18.072506+0000","last_fullsized":"2024-04-25T19:22:18.072506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:23.797191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076158+0000","last_change":"2024-04-25T19:22:16.064341+0000","last_active":"2024-04-25T19:22:18.076158+0000","last_peered":"2024-04-25T19:22:18.076158+0000","last_clean":"2024-04-25T19:22:18.076158+0000","last_became_active":"2024-04-25T19:22:16.063393+0000","last_became_peered":"2024-04-25T19:22:16.063393+0000","last_unstale":"2024-04-25T19:22:18.076158+0000","last_undegraded":"2024-04-25T19:22:18.076158+0000","last_fullsized":"2024-04-25T19:22:18.076158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:25.066396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073702+0000","last_change":"2024-04-25T19:22:17.085013+0000","last_active":"2024-04-25T19:22:18.073702+0000","last_peered":"2024-04-25T19:22:18.073702+0000","last_clean":"2024-04-25T19:22:18.073702+0000","last_became_active":"2024-04-25T19:22:17.084714+0000","last_became_peered":"2024-04-25T19:22:17.084714+0000","last_unstale":"2024-04-25T19:22:18.073702+0000","last_undegraded":"2024-04-25T19:22:18.073702+0000","last_fullsized":"2024-04-25T19:22:18.073702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:19.060353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072843+0000","last_change":"2024-04-25T19:22:16.055692+0000","last_active":"2024-04-25T19:22:18.072843+0000","last_peered":"2024-04-25T19:22:18.072843+0000","last_clean":"2024-04-25T19:22:18.072843+0000","last_became_active":"2024-04-25T19:22:16.054860+0000","last_became_peered":"2024-04-25T19:22:16.054860+0000","last_unstale":"2024-04-25T19:22:18.072843+0000","last_undegraded":"2024-04-25T19:22:18.072843+0000","last_fullsized":"2024-04-25T19:22:18.072843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:26.277490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076489+0000","last_change":"2024-04-25T19:22:17.085772+0000","last_active":"2024-04-25T19:22:18.076489+0000","last_peered":"2024-04-25T19:22:18.076489+0000","last_clean":"2024-04-25T19:22:18.076489+0000","last_became_active":"2024-04-25T19:22:17.085385+0000","last_became_peered":"2024-04-25T19:22:17.085385+0000","last_unstale":"2024-04-25T19:22:18.076489+0000","last_undegraded":"2024-04-25T19:22:18.076489+0000","last_fullsized":"2024-04-25T19:22:18.076489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:11.217132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138639+0000","last_change":"2024-04-25T19:22:16.081834+0000","last_active":"2024-04-25T19:22:18.138639+0000","last_peered":"2024-04-25T19:22:18.138639+0000","last_clean":"2024-04-25T19:22:18.138639+0000","last_became_active":"2024-04-25T19:22:16.081457+0000","last_became_peered":"2024-04-25T19:22:16.081457+0000","last_unstale":"2024-04-25T19:22:18.138639+0000","last_undegraded":"2024-04-25T19:22:18.138639+0000","last_fullsized":"2024-04-25T19:22:18.138639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:30.978869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072883+0000","last_change":"2024-04-25T19:22:17.077342+0000","last_active":"2024-04-25T19:22:18.072883+0000","last_peered":"2024-04-25T19:22:18.072883+0000","last_clean":"2024-04-25T19:22:18.072883+0000","last_became_active":"2024-04-25T19:22:17.076548+0000","last_became_peered":"2024-04-25T19:22:17.076548+0000","last_unstale":"2024-04-25T19:22:18.072883+0000","last_undegraded":"2024-04-25T19:22:18.072883+0000","last_fullsized":"2024-04-25T19:22:18.072883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:42.370408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.080648+0000","last_change":"2024-04-25T19:22:16.068620+0000","last_active":"2024-04-25T19:22:18.080648+0000","last_peered":"2024-04-25T19:22:18.080648+0000","last_clean":"2024-04-25T19:22:18.080648+0000","last_became_active":"2024-04-25T19:22:16.068220+0000","last_became_peered":"2024-04-25T19:22:16.068220+0000","last_unstale":"2024-04-25T19:22:18.080648+0000","last_undegraded":"2024-04-25T19:22:18.080648+0000","last_fullsized":"2024-04-25T19:22:18.080648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:30.978869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135459+0000","last_change":"2024-04-25T19:22:17.075136+0000","last_active":"2024-04-25T19:22:18.135459+0000","last_peered":"2024-04-25T19:22:18.135459+0000","last_clean":"2024-04-25T19:22:18.135459+0000","last_became_active":"2024-04-25T19:22:17.074780+0000","last_became_peered":"2024-04-25T19:22:17.074780+0000","last_unstale":"2024-04-25T19:22:18.135459+0000","last_undegraded":"2024-04-25T19:22:18.135459+0000","last_fullsized":"2024-04-25T19:22:18.135459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:42.285229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.082026+0000","last_change":"2024-04-25T19:22:16.073857+0000","last_active":"2024-04-25T19:22:18.082026+0000","last_peered":"2024-04-25T19:22:18.082026+0000","last_clean":"2024-04-25T19:22:18.082026+0000","last_became_active":"2024-04-25T19:22:16.073078+0000","last_became_peered":"2024-04-25T19:22:16.073078+0000","last_unstale":"2024-04-25T19:22:18.082026+0000","last_undegraded":"2024-04-25T19:22:18.082026+0000","last_fullsized":"2024-04-25T19:22:18.082026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:26.277490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135943+0000","last_change":"2024-04-25T19:22:17.070172+0000","last_active":"2024-04-25T19:22:18.135943+0000","last_peered":"2024-04-25T19:22:18.135943+0000","last_clean":"2024-04-25T19:22:18.135943+0000","last_became_active":"2024-04-25T19:22:17.069803+0000","last_became_peered":"2024-04-25T19:22:17.069803+0000","last_unstale":"2024-04-25T19:22:18.135943+0000","last_undegraded":"2024-04-25T19:22:18.135943+0000","last_fullsized":"2024-04-25T19:22:18.135943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.514449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.136579+0000","last_change":"2024-04-25T19:22:16.078887+0000","last_active":"2024-04-25T19:22:18.136579+0000","last_peered":"2024-04-25T19:22:18.136579+0000","last_clean":"2024-04-25T19:22:18.136579+0000","last_became_active":"2024-04-25T19:22:16.078375+0000","last_became_peered":"2024-04-25T19:22:16.078375+0000","last_unstale":"2024-04-25T19:22:18.136579+0000","last_undegraded":"2024-04-25T19:22:18.136579+0000","last_fullsized":"2024-04-25T19:22:18.136579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:44.758262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.073176+0000","last_change":"2024-04-25T19:22:17.076840+0000","last_active":"2024-04-25T19:22:18.073176+0000","last_peered":"2024-04-25T19:22:18.073176+0000","last_clean":"2024-04-25T19:22:18.073176+0000","last_became_active":"2024-04-25T19:22:17.071951+0000","last_became_peered":"2024-04-25T19:22:17.071951+0000","last_unstale":"2024-04-25T19:22:18.073176+0000","last_undegraded":"2024-04-25T19:22:18.073176+0000","last_fullsized":"2024-04-25T19:22:18.073176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:27.291685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072526+0000","last_change":"2024-04-25T19:22:16.068098+0000","last_active":"2024-04-25T19:22:18.072526+0000","last_peered":"2024-04-25T19:22:18.072526+0000","last_clean":"2024-04-25T19:22:18.072526+0000","last_became_active":"2024-04-25T19:22:16.067726+0000","last_became_peered":"2024-04-25T19:22:16.067726+0000","last_unstale":"2024-04-25T19:22:18.072526+0000","last_undegraded":"2024-04-25T19:22:18.072526+0000","last_fullsized":"2024-04-25T19:22:18.072526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:44.758262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.134620+0000","last_change":"2024-04-25T19:22:17.075489+0000","last_active":"2024-04-25T19:22:18.134620+0000","last_peered":"2024-04-25T19:22:18.134620+0000","last_clean":"2024-04-25T19:22:18.134620+0000","last_became_active":"2024-04-25T19:22:17.075103+0000","last_became_peered":"2024-04-25T19:22:17.075103+0000","last_unstale":"2024-04-25T19:22:18.134620+0000","last_undegraded":"2024-04-25T19:22:18.134620+0000","last_fullsized":"2024-04-25T19:22:18.134620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:23.797191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.072600+0000","last_change":"2024-04-25T19:22:16.062470+0000","last_active":"2024-04-25T19:22:18.072600+0000","last_peered":"2024-04-25T19:22:18.072600+0000","last_clean":"2024-04-25T19:22:18.072600+0000","last_became_active":"2024-04-25T19:22:16.062069+0000","last_became_peered":"2024-04-25T19:22:16.062069+0000","last_unstale":"2024-04-25T19:22:18.072600+0000","last_undegraded":"2024-04-25T19:22:18.072600+0000","last_fullsized":"2024-04-25T19:22:18.072600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:52:34.957140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135155+0000","last_change":"2024-04-25T19:22:17.074489+0000","last_active":"2024-04-25T19:22:18.135155+0000","last_peered":"2024-04-25T19:22:18.135155+0000","last_clean":"2024-04-25T19:22:18.135155+0000","last_became_active":"2024-04-25T19:22:17.073799+0000","last_became_peered":"2024-04-25T19:22:17.073799+0000","last_unstale":"2024-04-25T19:22:18.135155+0000","last_undegraded":"2024-04-25T19:22:18.135155+0000","last_fullsized":"2024-04-25T19:22:18.135155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:52.165740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138381+0000","last_change":"2024-04-25T19:22:16.080827+0000","last_active":"2024-04-25T19:22:18.138381+0000","last_peered":"2024-04-25T19:22:18.138381+0000","last_clean":"2024-04-25T19:22:18.138381+0000","last_became_active":"2024-04-25T19:22:16.080356+0000","last_became_peered":"2024-04-25T19:22:16.080356+0000","last_unstale":"2024-04-25T19:22:18.138381+0000","last_undegraded":"2024-04-25T19:22:18.138381+0000","last_fullsized":"2024-04-25T19:22:18.138381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:18.046159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.081947+0000","last_change":"2024-04-25T19:22:17.077563+0000","last_active":"2024-04-25T19:22:18.081947+0000","last_peered":"2024-04-25T19:22:18.081947+0000","last_clean":"2024-04-25T19:22:18.081947+0000","last_became_active":"2024-04-25T19:22:17.073123+0000","last_became_peered":"2024-04-25T19:22:17.073123+0000","last_unstale":"2024-04-25T19:22:18.081947+0000","last_undegraded":"2024-04-25T19:22:18.081947+0000","last_fullsized":"2024-04-25T19:22:18.081947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:27.385683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076484+0000","last_change":"2024-04-25T19:22:17.079364+0000","last_active":"2024-04-25T19:22:18.076484+0000","last_peered":"2024-04-25T19:22:18.076484+0000","last_clean":"2024-04-25T19:22:18.076484+0000","last_became_active":"2024-04-25T19:22:17.079025+0000","last_became_peered":"2024-04-25T19:22:17.079025+0000","last_unstale":"2024-04-25T19:22:18.076484+0000","last_undegraded":"2024-04-25T19:22:18.076484+0000","last_fullsized":"2024-04-25T19:22:18.076484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:25.008654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.137489+0000","last_change":"2024-04-25T19:22:16.081730+0000","last_active":"2024-04-25T19:22:18.137489+0000","last_peered":"2024-04-25T19:22:18.137489+0000","last_clean":"2024-04-25T19:22:18.137489+0000","last_became_active":"2024-04-25T19:22:16.081421+0000","last_became_peered":"2024-04-25T19:22:16.081421+0000","last_unstale":"2024-04-25T19:22:18.137489+0000","last_undegraded":"2024-04-25T19:22:18.137489+0000","last_fullsized":"2024-04-25T19:22:18.137489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:49:45.977189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.076421+0000","last_change":"2024-04-25T19:22:17.080305+0000","last_active":"2024-04-25T19:22:18.076421+0000","last_peered":"2024-04-25T19:22:18.076421+0000","last_clean":"2024-04-25T19:22:18.076421+0000","last_became_active":"2024-04-25T19:22:17.079799+0000","last_became_peered":"2024-04-25T19:22:17.079799+0000","last_unstale":"2024-04-25T19:22:18.076421+0000","last_undegraded":"2024-04-25T19:22:18.076421+0000","last_fullsized":"2024-04-25T19:22:18.076421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:37.277654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.138286+0000","last_change":"2024-04-25T19:22:16.081114+0000","last_active":"2024-04-25T19:22:18.138286+0000","last_peered":"2024-04-25T19:22:18.138286+0000","last_clean":"2024-04-25T19:22:18.138286+0000","last_became_active":"2024-04-25T19:22:16.080449+0000","last_became_peered":"2024-04-25T19:22:16.080449+0000","last_unstale":"2024-04-25T19:22:18.138286+0000","last_undegraded":"2024-04-25T19:22:18.138286+0000","last_fullsized":"2024-04-25T19:22:18.138286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:52.491459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135509+0000","last_change":"2024-04-25T19:22:17.065056+0000","last_active":"2024-04-25T19:22:18.135509+0000","last_peered":"2024-04-25T19:22:18.135509+0000","last_clean":"2024-04-25T19:22:18.135509+0000","last_became_active":"2024-04-25T19:22:17.062680+0000","last_became_peered":"2024-04-25T19:22:17.062680+0000","last_unstale":"2024-04-25T19:22:18.135509+0000","last_undegraded":"2024-04-25T19:22:18.135509+0000","last_fullsized":"2024-04-25T19:22:18.135509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:27.385683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135590+0000","last_change":"2024-04-25T19:22:16.056898+0000","last_active":"2024-04-25T19:22:18.135590+0000","last_peered":"2024-04-25T19:22:18.135590+0000","last_clean":"2024-04-25T19:22:18.135590+0000","last_became_active":"2024-04-25T19:22:16.056528+0000","last_became_peered":"2024-04-25T19:22:16.056528+0000","last_unstale":"2024-04-25T19:22:18.135590+0000","last_undegraded":"2024-04-25T19:22:18.135590+0000","last_fullsized":"2024-04-25T19:22:18.135590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:51.334418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135596+0000","last_change":"2024-04-25T19:22:17.075549+0000","last_active":"2024-04-25T19:22:18.135596+0000","last_peered":"2024-04-25T19:22:18.135596+0000","last_clean":"2024-04-25T19:22:18.135596+0000","last_became_active":"2024-04-25T19:22:17.075224+0000","last_became_peered":"2024-04-25T19:22:17.075224+0000","last_unstale":"2024-04-25T19:22:18.135596+0000","last_undegraded":"2024-04-25T19:22:18.135596+0000","last_fullsized":"2024-04-25T19:22:18.135596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:16.014990+0000","last_clean_scrub_stamp":"2024-04-25T19:22:16.014990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:15:59.386088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T19:22:18.135671+0000","last_change":"2024-04-25T19:22:16.073541+0000","last_active":"2024-04-25T19:22:18.135671+0000","last_peered":"2024-04-25T19:22:18.135671+0000","last_clean":"2024-04-25T19:22:18.135671+0000","last_became_active":"2024-04-25T19:22:16.073195+0000","last_became_peered":"2024-04-25T19:22:16.073195+0000","last_unstale":"2024-04-25T19:22:18.135671+0000","last_undegraded":"2024-04-25T19:22:18.135671+0000","last_fullsized":"2024-04-25T19:22:18.135671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:15.000795+0000","last_clean_scrub_stamp":"2024-04-25T19:22:15.000795+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:21.114512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T19:22:28.544 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T19:22:28.544 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T19:22:28.544 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T19:22:28.545 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T19:22:28.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.844+0000 7f8c74e00640 1 Processor -- start 2024-04-25T19:22:28.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.844+0000 7f8c74e00640 1 -- start start 2024-04-25T19:22:28.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.846+0000 7f8c74e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8c7006dce0 0x7f8c70142730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:28.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.846+0000 7f8c74e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c7015d5e0 con 0x7f8c70142c70 2024-04-25T19:22:28.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.846+0000 7f8c74e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c7015d8c0 con 0x7f8c7013fe10 2024-04-25T19:22:28.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.846+0000 7f8c74e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f8c7015dba0 con 0x7f8c7006dce0 2024-04-25T19:22:28.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.846+0000 7f8c66a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8c7006dce0 0x7f8c70142730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:28.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.847+0000 7f8c66a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8c7006dce0 0x7f8c70142730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:60874/0 (socket says 172.21.15.131:60874) 2024-04-25T19:22:28.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.847+0000 7f8c66a00640 1 -- 172.21.15.131:0/298106325 learned_addr learned my addr 172.21.15.131:0/298106325 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:28.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.847+0000 7f8c66a00640 1 -- 172.21.15.131:0/298106325 >> v1:172.21.15.195:6789/0 conn(0x7f8c7013fe10 legacy=0x7f8c7006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:28.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.847+0000 7f8c6ea00640 1 -- 172.21.15.131:0/298106325 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 761635956 0 0) 0x7f8c7015d5e0 con 0x7f8c70142c70 2024-04-25T19:22:28.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.847+0000 7f8c66a00640 1 -- 172.21.15.131:0/298106325 >> v1:172.21.15.131:6789/0 conn(0x7f8c70142c70 legacy=0x7f8c700d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:28.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.847+0000 7f8c66a00640 1 -- 172.21.15.131:0/298106325 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c7015de80 con 0x7f8c7006dce0 2024-04-25T19:22:28.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.848+0000 7f8c66a00640 1 --2- 172.21.15.131:0/298106325 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c7006dce0 0x7f8c70142730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009870 tx=0x7f8c5802c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1468d76c0c8adfce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:28.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.848+0000 7f8c6ea00640 1 -- 172.21.15.131:0/298106325 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58038070 con 0x7f8c7006dce0 2024-04-25T19:22:28.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.848+0000 7f8c6ea00640 1 -- 172.21.15.131:0/298106325 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c58031710 con 0x7f8c7006dce0 2024-04-25T19:22:28.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.848+0000 7f8c6ea00640 1 -- 172.21.15.131:0/298106325 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58031ae0 con 0x7f8c7006dce0 2024-04-25T19:22:28.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.849+0000 7f8c74e00640 1 -- 172.21.15.131:0/298106325 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c7006dce0 msgr2=0x7f8c70142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:28.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.849+0000 7f8c74e00640 1 --2- 172.21.15.131:0/298106325 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c7006dce0 0x7f8c70142730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009870 tx=0x7f8c5802c480 comp rx=0 tx=0).stop 2024-04-25T19:22:28.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.849+0000 7f8c74e00640 1 -- 172.21.15.131:0/298106325 shutdown_connections 2024-04-25T19:22:28.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.849+0000 7f8c74e00640 1 --2- 172.21.15.131:0/298106325 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c7006dce0 0x7f8c70142730 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:28.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.849+0000 7f8c74e00640 1 -- 172.21.15.131:0/298106325 >> 172.21.15.131:0/298106325 conn(0x7f8c70072ee0 msgr2=0x7f8c700732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:28.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.849+0000 7f8c74e00640 1 -- 172.21.15.131:0/298106325 shutdown_connections 2024-04-25T19:22:28.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.849+0000 7f8c74e00640 1 -- 172.21.15.131:0/298106325 wait complete. 2024-04-25T19:22:28.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.851+0000 7f8c74e00640 1 Processor -- start 2024-04-25T19:22:28.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.851+0000 7f8c74e00640 1 -- start start 2024-04-25T19:22:28.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.853+0000 7f8c74e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c7013fe10 0x7f8c70141270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:28.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.853+0000 7f8c74e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c70142c70 0x7f8c701417b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:28.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.853+0000 7f8c74e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c7013e050 0x7f8c701579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:28.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.853+0000 7f8c74e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8c70143200 con 0x7f8c70142c70 2024-04-25T19:22:28.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.853+0000 7f8c74e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8c70143080 con 0x7f8c7013e050 2024-04-25T19:22:28.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.853+0000 7f8c74e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8c700d0740 con 0x7f8c7013fe10 2024-04-25T19:22:28.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.853+0000 7f8c66a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c70142c70 0x7f8c701417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:28.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.853+0000 7f8c66a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c70142c70 0x7f8c701417b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:60880/0 (socket says 172.21.15.131:60880) 2024-04-25T19:22:28.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.853+0000 7f8c66a00640 1 -- 172.21.15.131:0/4186636185 learned_addr learned my addr 172.21.15.131:0/4186636185 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:28.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.853+0000 7f8c66a00640 1 -- 172.21.15.131:0/4186636185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c7013fe10 msgr2=0x7f8c70141270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:28.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.853+0000 7f8c66a00640 1 --2- 172.21.15.131:0/4186636185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c7013fe10 0x7f8c70141270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:28.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.853+0000 7f8c6fe00640 1 --2- 172.21.15.131:0/4186636185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c7013e050 0x7f8c701579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:28.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.854+0000 7f8c66a00640 1 -- 172.21.15.131:0/4186636185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c7013e050 msgr2=0x7f8c701579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:28.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.854+0000 7f8c66a00640 1 --2- 172.21.15.131:0/4186636185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c7013e050 0x7f8c701579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:28.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.854+0000 7f8c66a00640 1 -- 172.21.15.131:0/4186636185 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c7015a030 con 0x7f8c70142c70 2024-04-25T19:22:28.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.854+0000 7f8c6fe00640 1 --2- 172.21.15.131:0/4186636185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c7013e050 0x7f8c701579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:28.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.854+0000 7f8c66a00640 1 --2- 172.21.15.131:0/4186636185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c70142c70 0x7f8c701417b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8c58000c00 tx=0x7f8c580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:28.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.854+0000 7f8c67e00640 1 -- 172.21.15.131:0/4186636185 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58042020 con 0x7f8c70142c70 2024-04-25T19:22:28.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.854+0000 7f8c67e00640 1 -- 172.21.15.131:0/4186636185 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c58033910 con 0x7f8c70142c70 2024-04-25T19:22:28.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.854+0000 7f8c67e00640 1 -- 172.21.15.131:0/4186636185 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58038040 con 0x7f8c70142c70 2024-04-25T19:22:28.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.854+0000 7f8c74e00640 1 -- 172.21.15.131:0/4186636185 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c7015ab00 con 0x7f8c70142c70 2024-04-25T19:22:28.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.854+0000 7f8c74e00640 1 -- 172.21.15.131:0/4186636185 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c7015a540 con 0x7f8c70142c70 2024-04-25T19:22:28.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.855+0000 7f8c74e00640 1 -- 172.21.15.131:0/4186636185 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c70154e80 con 0x7f8c70142c70 2024-04-25T19:22:28.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.857+0000 7f8c67e00640 1 -- 172.21.15.131:0/4186636185 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8c58045020 con 0x7f8c70142c70 2024-04-25T19:22:28.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.857+0000 7f8c67e00640 1 --2- 172.21.15.131:0/4186636185 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8c4c0744b0 0x7f8c4c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:28.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.857+0000 7f8c67e00640 1 -- 172.21.15.131:0/4186636185 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8c580b7f50 con 0x7f8c70142c70 2024-04-25T19:22:28.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.858+0000 7f8c6f400640 1 --2- 172.21.15.131:0/4186636185 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8c4c0744b0 0x7f8c4c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:28.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.859+0000 7f8c6f400640 1 --2- 172.21.15.131:0/4186636185 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8c4c0744b0 0x7f8c4c0769c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8c60000f60 tx=0x7f8c600079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:28.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:28.862+0000 7f8c67e00640 1 -- 172.21.15.131:0/4186636185 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8c5804c030 con 0x7f8c70142c70 2024-04-25T19:22:29.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.084+0000 7f8c74e00640 1 -- 172.21.15.131:0/4186636185 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8c70050740 con 0x7f8c70142c70 2024-04-25T19:22:29.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.085+0000 7f8c67e00640 1 -- 172.21.15.131:0/4186636185 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f8c580826d0 con 0x7f8c70142c70 2024-04-25T19:22:29.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:29.086 INFO:teuthology.orchestra.run.smithi131.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T19:22:29.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.087+0000 7f8c74e00640 1 -- 172.21.15.131:0/4186636185 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8c4c0744b0 msgr2=0x7f8c4c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:29.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.087+0000 7f8c74e00640 1 --2- 172.21.15.131:0/4186636185 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8c4c0744b0 0x7f8c4c0769c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8c60000f60 tx=0x7f8c600079b0 comp rx=0 tx=0).stop 2024-04-25T19:22:29.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.087+0000 7f8c74e00640 1 -- 172.21.15.131:0/4186636185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c70142c70 msgr2=0x7f8c701417b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:29.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.087+0000 7f8c74e00640 1 --2- 172.21.15.131:0/4186636185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c70142c70 0x7f8c701417b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8c58000c00 tx=0x7f8c580046c0 comp rx=0 tx=0).stop 2024-04-25T19:22:29.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.087+0000 7f8c74e00640 1 -- 172.21.15.131:0/4186636185 shutdown_connections 2024-04-25T19:22:29.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.087+0000 7f8c74e00640 1 --2- 172.21.15.131:0/4186636185 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8c4c0744b0 0x7f8c4c0769c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:29.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.087+0000 7f8c74e00640 1 --2- 172.21.15.131:0/4186636185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c7013e050 0x7f8c701579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:29.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.087+0000 7f8c74e00640 1 --2- 172.21.15.131:0/4186636185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c70142c70 0x7f8c701417b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:29.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.087+0000 7f8c74e00640 1 --2- 172.21.15.131:0/4186636185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c7013fe10 0x7f8c70141270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:29.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.087+0000 7f8c74e00640 1 -- 172.21.15.131:0/4186636185 >> 172.21.15.131:0/4186636185 conn(0x7f8c70072ee0 msgr2=0x7f8c7006f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:29.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.087+0000 7f8c74e00640 1 -- 172.21.15.131:0/4186636185 shutdown_connections 2024-04-25T19:22:29.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.087+0000 7f8c74e00640 1 -- 172.21.15.131:0/4186636185 wait complete. 2024-04-25T19:22:29.110 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T19:22:29.110 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:22:29.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.375+0000 7f23b5000640 1 Processor -- start 2024-04-25T19:22:29.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.375+0000 7f23b5000640 1 -- start start 2024-04-25T19:22:29.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.377+0000 7f23b5000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f23b00b6a00 0x7f23b015d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:29.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.378+0000 7f23b5000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f23b006d560 0x7f23b00b4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:29.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.378+0000 7f23b5000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23b01611e0 con 0x7f23b015a2f0 2024-04-25T19:22:29.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.378+0000 7f23b5000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f23b0160d50 con 0x7f23b00b6a00 2024-04-25T19:22:29.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.378+0000 7f23b5000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f23b015a700 con 0x7f23b006d560 2024-04-25T19:22:29.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.378+0000 7f23ade00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f23b00b6a00 0x7f23b015d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:29.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.378+0000 7f23a7e00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f23b015a2f0 0x7f23b006ce50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:42244/0 (socket says 172.21.15.131:42244) 2024-04-25T19:22:29.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.378+0000 7f23a7e00640 1 -- 172.21.15.131:0/2859978989 learned_addr learned my addr 172.21.15.131:0/2859978989 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:29.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.378+0000 7f23ae800640 1 --2- 172.21.15.131:0/2859978989 >> v2:172.21.15.195:3300/0 conn(0x7f23b006d560 0x7f23b00b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:29.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.378+0000 7f23ade00640 1 -- 172.21.15.131:0/2859978989 >> v2:172.21.15.195:3300/0 conn(0x7f23b006d560 msgr2=0x7f23b00b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:29.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.378+0000 7f23ade00640 1 --2- 172.21.15.131:0/2859978989 >> v2:172.21.15.195:3300/0 conn(0x7f23b006d560 0x7f23b00b4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:29.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.378+0000 7f23ade00640 1 -- 172.21.15.131:0/2859978989 >> v1:172.21.15.131:6789/0 conn(0x7f23b015a2f0 legacy=0x7f23b006ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:29.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.378+0000 7f23ad400640 1 -- 172.21.15.131:0/2859978989 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4035148289 0 0) 0x7f23b01611e0 con 0x7f23b015a2f0 2024-04-25T19:22:29.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.378+0000 7f23ade00640 1 -- 172.21.15.131:0/2859978989 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b0160420 con 0x7f23b00b6a00 2024-04-25T19:22:29.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.379+0000 7f23ae800640 1 --2- 172.21.15.131:0/2859978989 >> v2:172.21.15.195:3300/0 conn(0x7f23b006d560 0x7f23b00b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:29.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.379+0000 7f23ade00640 1 --2- 172.21.15.131:0/2859978989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23b00b6a00 0x7f23b015d6c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f23b0160cc0 tx=0x7f23a002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a759fef36dd372 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:29.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.380+0000 7f23ad400640 1 -- 172.21.15.131:0/2859978989 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a0037070 con 0x7f23b00b6a00 2024-04-25T19:22:29.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.380+0000 7f23ad400640 1 -- 172.21.15.131:0/2859978989 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23a0032440 con 0x7f23b00b6a00 2024-04-25T19:22:29.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.380+0000 7f23ad400640 1 -- 172.21.15.131:0/2859978989 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a0032810 con 0x7f23b00b6a00 2024-04-25T19:22:29.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.380+0000 7f23b5000640 1 -- 172.21.15.131:0/2859978989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23b00b6a00 msgr2=0x7f23b015d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:29.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.380+0000 7f23b5000640 1 --2- 172.21.15.131:0/2859978989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23b00b6a00 0x7f23b015d6c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f23b0160cc0 tx=0x7f23a002a1a0 comp rx=0 tx=0).stop 2024-04-25T19:22:29.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.381+0000 7f23b5000640 1 -- 172.21.15.131:0/2859978989 shutdown_connections 2024-04-25T19:22:29.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.381+0000 7f23b5000640 1 --2- 172.21.15.131:0/2859978989 >> v2:172.21.15.195:3300/0 conn(0x7f23b006d560 0x7f23b00b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:29.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.381+0000 7f23b5000640 1 --2- 172.21.15.131:0/2859978989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23b00b6a00 0x7f23b015d6c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:29.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.381+0000 7f23b5000640 1 -- 172.21.15.131:0/2859978989 >> 172.21.15.131:0/2859978989 conn(0x7f23b00d1ae0 msgr2=0x7f23b00d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:29.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.381+0000 7f23b5000640 1 -- 172.21.15.131:0/2859978989 shutdown_connections 2024-04-25T19:22:29.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.381+0000 7f23b5000640 1 -- 172.21.15.131:0/2859978989 wait complete. 2024-04-25T19:22:29.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.383+0000 7f23b5000640 1 Processor -- start 2024-04-25T19:22:29.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.383+0000 7f23b5000640 1 -- start start 2024-04-25T19:22:29.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.385+0000 7f23b5000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23b006d560 0x7f23b015dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:29.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.385+0000 7f23b5000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23b00b6a00 0x7f23b01559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:29.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.385+0000 7f23b5000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23b015a2f0 0x7f23b0155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:29.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.385+0000 7f23b5000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f23b00ce580 con 0x7f23b006d560 2024-04-25T19:22:29.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.385+0000 7f23b5000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f23b01609e0 con 0x7f23b015a2f0 2024-04-25T19:22:29.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.385+0000 7f23b5000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f23b00ce700 con 0x7f23b00b6a00 2024-04-25T19:22:29.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.385+0000 7f23ade00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23b006d560 0x7f23b015dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:29.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.385+0000 7f23ade00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23b006d560 0x7f23b015dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:60890/0 (socket says 172.21.15.131:60890) 2024-04-25T19:22:29.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.385+0000 7f23ade00640 1 -- 172.21.15.131:0/458122259 learned_addr learned my addr 172.21.15.131:0/458122259 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:29.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.385+0000 7f23ade00640 1 -- 172.21.15.131:0/458122259 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23b00b6a00 msgr2=0x7f23b01559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:29.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.385+0000 7f23ade00640 1 --2- 172.21.15.131:0/458122259 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23b00b6a00 0x7f23b01559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:29.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.385+0000 7f23ade00640 1 -- 172.21.15.131:0/458122259 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23b015a2f0 msgr2=0x7f23b0155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:29.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.385+0000 7f23ade00640 1 --2- 172.21.15.131:0/458122259 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23b015a2f0 0x7f23b0155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:29.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.385+0000 7f23ade00640 1 -- 172.21.15.131:0/458122259 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b015eab0 con 0x7f23b006d560 2024-04-25T19:22:29.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.385+0000 7f23ade00640 1 --2- 172.21.15.131:0/458122259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23b006d560 0x7f23b015dd80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f23a0000c00 tx=0x7f23a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:29.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.386+0000 7f23a6000640 1 -- 172.21.15.131:0/458122259 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a0037040 con 0x7f23b006d560 2024-04-25T19:22:29.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.386+0000 7f23a6000640 1 -- 172.21.15.131:0/458122259 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23a0042070 con 0x7f23b006d560 2024-04-25T19:22:29.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.386+0000 7f23a6000640 1 -- 172.21.15.131:0/458122259 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a0030bd0 con 0x7f23b006d560 2024-04-25T19:22:29.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.386+0000 7f23b5000640 1 -- 172.21.15.131:0/458122259 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23b015ed90 con 0x7f23b006d560 2024-04-25T19:22:29.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.386+0000 7f23b5000640 1 -- 172.21.15.131:0/458122259 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23b015f350 con 0x7f23b006d560 2024-04-25T19:22:29.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.387+0000 7f23b5000640 1 -- 172.21.15.131:0/458122259 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23b00ce130 con 0x7f23b006d560 2024-04-25T19:22:29.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.388+0000 7f23a6000640 1 -- 172.21.15.131:0/458122259 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f23a0047460 con 0x7f23b006d560 2024-04-25T19:22:29.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.390+0000 7f23a6000640 1 --2- 172.21.15.131:0/458122259 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f238c0744b0 0x7f238c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:29.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.390+0000 7f23a6000640 1 -- 172.21.15.131:0/458122259 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f23a00b5e30 con 0x7f23b006d560 2024-04-25T19:22:29.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.390+0000 7f23a7e00640 1 --2- 172.21.15.131:0/458122259 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f238c0744b0 0x7f238c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:29.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.392+0000 7f23a7e00640 1 --2- 172.21.15.131:0/458122259 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f238c0744b0 0x7f238c0769c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2398007fd0 tx=0x7f2398007960 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:29.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.395+0000 7f23a6000640 1 -- 172.21.15.131:0/458122259 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f23a004c020 con 0x7f23b006d560 2024-04-25T19:22:29.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.593+0000 7f23b5000640 1 -- 172.21.15.131:0/458122259 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23b00705a0 con 0x7f23b006d560 2024-04-25T19:22:29.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.594+0000 7f23a6000640 1 -- 172.21.15.131:0/458122259 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16629 (secure 0 0 0) 0x7f23a0032e20 con 0x7f23b006d560 2024-04-25T19:22:29.596 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:29.597 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":20,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:22:18.057809+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:22:14.779716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T19:22:15.552027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:22:29.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.597+0000 7f23b5000640 1 -- 172.21.15.131:0/458122259 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f238c0744b0 msgr2=0x7f238c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:29.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.597+0000 7f23b5000640 1 --2- 172.21.15.131:0/458122259 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f238c0744b0 0x7f238c0769c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2398007fd0 tx=0x7f2398007960 comp rx=0 tx=0).stop 2024-04-25T19:22:29.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.597+0000 7f23b5000640 1 -- 172.21.15.131:0/458122259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23b006d560 msgr2=0x7f23b015dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:29.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.597+0000 7f23b5000640 1 --2- 172.21.15.131:0/458122259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23b006d560 0x7f23b015dd80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f23a0000c00 tx=0x7f23a00046c0 comp rx=0 tx=0).stop 2024-04-25T19:22:29.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.597+0000 7f23b5000640 1 -- 172.21.15.131:0/458122259 shutdown_connections 2024-04-25T19:22:29.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.597+0000 7f23b5000640 1 --2- 172.21.15.131:0/458122259 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f238c0744b0 0x7f238c0769c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:29.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.597+0000 7f23b5000640 1 --2- 172.21.15.131:0/458122259 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23b00b6a00 0x7f23b01559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:29.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.597+0000 7f23b5000640 1 --2- 172.21.15.131:0/458122259 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23b015a2f0 0x7f23b0155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:29.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.597+0000 7f23b5000640 1 --2- 172.21.15.131:0/458122259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23b006d560 0x7f23b015dd80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:29.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.597+0000 7f23b5000640 1 -- 172.21.15.131:0/458122259 >> 172.21.15.131:0/458122259 conn(0x7f23b00d1ae0 msgr2=0x7f23b0158240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:29.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.597+0000 7f23b5000640 1 -- 172.21.15.131:0/458122259 shutdown_connections 2024-04-25T19:22:29.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.597+0000 7f23b5000640 1 -- 172.21.15.131:0/458122259 wait complete. 2024-04-25T19:22:29.623 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T19:22:04.178847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T19:22:14.779716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T19:22:15.552027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T19:22:29.624 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T19:22:29.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.894+0000 7fc22b200640 1 Processor -- start 2024-04-25T19:22:29.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.894+0000 7fc22b200640 1 -- start start 2024-04-25T19:22:29.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.897+0000 7fc22b200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc22c06dce0 0x7fc22c15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:29.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.897+0000 7fc22b200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc22c070000 con 0x7fc22c144340 2024-04-25T19:22:29.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.897+0000 7fc22b200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc22c06f240 con 0x7fc22c15ec90 2024-04-25T19:22:29.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.897+0000 7fc22b200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fc22c144750 con 0x7fc22c06dce0 2024-04-25T19:22:29.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.897+0000 7fc229400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc22c06dce0 0x7fc22c15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:29.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.897+0000 7fc229400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc22c06dce0 0x7fc22c15e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:60900/0 (socket says 172.21.15.131:60900) 2024-04-25T19:22:29.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.897+0000 7fc229400640 1 -- 172.21.15.131:0/4212286290 learned_addr learned my addr 172.21.15.131:0/4212286290 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:29.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.897+0000 7fc229e00640 1 --1- 172.21.15.131:0/4212286290 >> v1:172.21.15.131:6789/0 conn(0x7fc22c144340 0x7fc22c06d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:42252/0 (socket says 172.21.15.131:42252) 2024-04-25T19:22:29.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.897+0000 7fc229400640 1 -- 172.21.15.131:0/4212286290 >> v1:172.21.15.195:6789/0 conn(0x7fc22c15ec90 legacy=0x7fc22c15f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:29.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.897+0000 7fc229400640 1 -- 172.21.15.131:0/4212286290 >> v1:172.21.15.131:6789/0 conn(0x7fc22c144340 legacy=0x7fc22c06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:29.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.897+0000 7fc228a00640 1 -- 172.21.15.131:0/4212286290 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2414878554 0 0) 0x7fc22c070000 con 0x7fc22c144340 2024-04-25T19:22:29.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.897+0000 7fc229400640 1 -- 172.21.15.131:0/4212286290 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22c06f520 con 0x7fc22c06dce0 2024-04-25T19:22:29.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.899+0000 7fc229400640 1 --2- 172.21.15.131:0/4212286290 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc22c06dce0 0x7fc22c15e750 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc218009e50 tx=0x7fc21802a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0513521e5ad3869 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:29.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.899+0000 7fc228a00640 1 -- 172.21.15.131:0/4212286290 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc218036070 con 0x7fc22c06dce0 2024-04-25T19:22:29.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.899+0000 7fc228a00640 1 -- 172.21.15.131:0/4212286290 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc218031600 con 0x7fc22c06dce0 2024-04-25T19:22:29.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.899+0000 7fc228a00640 1 -- 172.21.15.131:0/4212286290 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2180319d0 con 0x7fc22c06dce0 2024-04-25T19:22:29.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.899+0000 7fc22b200640 1 -- 172.21.15.131:0/4212286290 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc22c06dce0 msgr2=0x7fc22c15e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:29.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.899+0000 7fc22b200640 1 --2- 172.21.15.131:0/4212286290 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc22c06dce0 0x7fc22c15e750 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc218009e50 tx=0x7fc21802a760 comp rx=0 tx=0).stop 2024-04-25T19:22:29.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.900+0000 7fc22b200640 1 -- 172.21.15.131:0/4212286290 shutdown_connections 2024-04-25T19:22:29.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.900+0000 7fc22b200640 1 --2- 172.21.15.131:0/4212286290 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc22c06dce0 0x7fc22c15e750 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:29.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.900+0000 7fc22b200640 1 -- 172.21.15.131:0/4212286290 >> 172.21.15.131:0/4212286290 conn(0x7fc22c072f40 msgr2=0x7fc22c073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:29.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.900+0000 7fc22b200640 1 -- 172.21.15.131:0/4212286290 shutdown_connections 2024-04-25T19:22:29.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.900+0000 7fc22b200640 1 -- 172.21.15.131:0/4212286290 wait complete. 2024-04-25T19:22:29.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.902+0000 7fc22b200640 1 Processor -- start 2024-04-25T19:22:29.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.902+0000 7fc22b200640 1 -- start start 2024-04-25T19:22:29.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.904+0000 7fc22b200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc22c144340 0x7fc22c1f4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:29.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.904+0000 7fc22b200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc22c15ec90 0x7fc22c1620e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:29.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.904+0000 7fc22b200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc22c1470f0 0x7fc22c147500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:29.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.904+0000 7fc22b200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc22c15f0a0 con 0x7fc22c144340 2024-04-25T19:22:29.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.904+0000 7fc22b200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc22c06fae0 con 0x7fc22c15ec90 2024-04-25T19:22:29.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.904+0000 7fc22b200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc22c15f220 con 0x7fc22c1470f0 2024-04-25T19:22:29.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.904+0000 7fc229e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc22c144340 0x7fc22c1f4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:29.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.904+0000 7fc229e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc22c144340 0x7fc22c1f4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:60908/0 (socket says 172.21.15.131:60908) 2024-04-25T19:22:29.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.904+0000 7fc229e00640 1 -- 172.21.15.131:0/163335491 learned_addr learned my addr 172.21.15.131:0/163335491 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:29.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.904+0000 7fc229400640 1 --2- 172.21.15.131:0/163335491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc22c15ec90 0x7fc22c1620e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:29.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.904+0000 7fc229e00640 1 -- 172.21.15.131:0/163335491 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc22c1470f0 msgr2=0x7fc22c147500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:29.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.904+0000 7fc22a800640 1 --2- 172.21.15.131:0/163335491 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc22c1470f0 0x7fc22c147500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:29.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.904+0000 7fc229e00640 1 --2- 172.21.15.131:0/163335491 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc22c1470f0 0x7fc22c147500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:29.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.904+0000 7fc229e00640 1 -- 172.21.15.131:0/163335491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc22c15ec90 msgr2=0x7fc22c1620e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:29.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.904+0000 7fc229e00640 1 --2- 172.21.15.131:0/163335491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc22c15ec90 0x7fc22c1620e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:29.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.904+0000 7fc229e00640 1 -- 172.21.15.131:0/163335491 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22c1f4960 con 0x7fc22c144340 2024-04-25T19:22:29.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.905+0000 7fc229e00640 1 --2- 172.21.15.131:0/163335491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc22c144340 0x7fc22c1f4420 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00c430 tx=0x7fc21c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:29.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.905+0000 7fc222000640 1 -- 172.21.15.131:0/163335491 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21c0074e0 con 0x7fc22c144340 2024-04-25T19:22:29.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.905+0000 7fc222000640 1 -- 172.21.15.131:0/163335491 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc21c0047e0 con 0x7fc22c144340 2024-04-25T19:22:29.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.905+0000 7fc222000640 1 -- 172.21.15.131:0/163335491 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21c004bd0 con 0x7fc22c144340 2024-04-25T19:22:29.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.905+0000 7fc22b200640 1 -- 172.21.15.131:0/163335491 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc22c146050 con 0x7fc22c144340 2024-04-25T19:22:29.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.905+0000 7fc22b200640 1 -- 172.21.15.131:0/163335491 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc22c146610 con 0x7fc22c144340 2024-04-25T19:22:29.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.906+0000 7fc22b200640 1 -- 172.21.15.131:0/163335491 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc22c076c60 con 0x7fc22c144340 2024-04-25T19:22:29.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.907+0000 7fc222000640 1 -- 172.21.15.131:0/163335491 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc21c011070 con 0x7fc22c144340 2024-04-25T19:22:29.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.908+0000 7fc222000640 1 --2- 172.21.15.131:0/163335491 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc20c0744b0 0x7fc20c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:29.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.908+0000 7fc222000640 1 -- 172.21.15.131:0/163335491 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc21c094f20 con 0x7fc22c144340 2024-04-25T19:22:29.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.909+0000 7fc229400640 1 --2- 172.21.15.131:0/163335491 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc20c0744b0 0x7fc20c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:29.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.910+0000 7fc229400640 1 --2- 172.21.15.131:0/163335491 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc20c0744b0 0x7fc20c0769c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc218033000 tx=0x7fc218009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:29.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:29.913+0000 7fc222000640 1 -- 172.21.15.131:0/163335491 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc21c05f610 con 0x7fc22c144340 2024-04-25T19:22:30.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.105+0000 7fc22b200640 1 -- 172.21.15.131:0/163335491 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc22c0b7920 con 0x7fc22c144340 2024-04-25T19:22:30.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.106+0000 7fc222000640 1 -- 172.21.15.131:0/163335491 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fc21c05ef10 con 0x7fc22c144340 2024-04-25T19:22:30.108 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-25T19:22:30.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.108+0000 7fc22b200640 1 -- 172.21.15.131:0/163335491 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc20c0744b0 msgr2=0x7fc20c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:30.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.108+0000 7fc22b200640 1 --2- 172.21.15.131:0/163335491 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc20c0744b0 0x7fc20c0769c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc218033000 tx=0x7fc218009000 comp rx=0 tx=0).stop 2024-04-25T19:22:30.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.108+0000 7fc22b200640 1 -- 172.21.15.131:0/163335491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc22c144340 msgr2=0x7fc22c1f4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:30.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.108+0000 7fc22b200640 1 --2- 172.21.15.131:0/163335491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc22c144340 0x7fc22c1f4420 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00c430 tx=0x7fc21c00c8f0 comp rx=0 tx=0).stop 2024-04-25T19:22:30.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.108+0000 7fc22b200640 1 -- 172.21.15.131:0/163335491 shutdown_connections 2024-04-25T19:22:30.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.108+0000 7fc22b200640 1 --2- 172.21.15.131:0/163335491 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc20c0744b0 0x7fc20c0769c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:30.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.108+0000 7fc22b200640 1 --2- 172.21.15.131:0/163335491 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc22c1470f0 0x7fc22c147500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:30.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.108+0000 7fc22b200640 1 --2- 172.21.15.131:0/163335491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc22c15ec90 0x7fc22c1620e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:30.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.108+0000 7fc22b200640 1 --2- 172.21.15.131:0/163335491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc22c144340 0x7fc22c1f4420 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:30.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.108+0000 7fc22b200640 1 -- 172.21.15.131:0/163335491 >> 172.21.15.131:0/163335491 conn(0x7fc22c072f40 msgr2=0x7fc22c1405f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:30.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.108+0000 7fc22b200640 1 -- 172.21.15.131:0/163335491 shutdown_connections 2024-04-25T19:22:30.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.108+0000 7fc22b200640 1 -- 172.21.15.131:0/163335491 wait complete. 2024-04-25T19:22:30.136 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T19:22:30.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.402+0000 7f0793e00640 1 Processor -- start 2024-04-25T19:22:30.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.403+0000 7f0793e00640 1 -- start start 2024-04-25T19:22:30.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.405+0000 7f0793e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0794144340 0x7f079406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:30.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.405+0000 7f0793e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f079406db10 0x7f079415e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:30.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.405+0000 7f0793e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f079406df20 con 0x7f079415ec90 2024-04-25T19:22:30.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.405+0000 7f0793e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f0794144750 con 0x7f0794144340 2024-04-25T19:22:30.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.405+0000 7f0793e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0794070000 con 0x7f079406db10 2024-04-25T19:22:30.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.405+0000 7f0793400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f079415ec90 0x7f0794161aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:42260/0 (socket says 172.21.15.131:42260) 2024-04-25T19:22:30.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.405+0000 7f0793400640 1 -- 172.21.15.131:0/1504967997 learned_addr learned my addr 172.21.15.131:0/1504967997 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:30.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.405+0000 7f078a000640 1 --2- 172.21.15.131:0/1504967997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f079406db10 0x7f079415e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:30.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.406+0000 7f0792a00640 1 --2- 172.21.15.131:0/1504967997 >> v2:172.21.15.195:3300/0 conn(0x7f0794144340 0x7f079406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:30.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.406+0000 7f0792000640 1 -- 172.21.15.131:0/1504967997 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 907173948 0 0) 0x7f078c001490 con 0x7f079415ec90 2024-04-25T19:22:30.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.406+0000 7f0792000640 1 -- 172.21.15.131:0/1504967997 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0778003520 con 0x7f079415ec90 2024-04-25T19:22:30.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.406+0000 7f0792000640 1 -- 172.21.15.131:0/1504967997 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2648264084 0 0) 0x7f0778003520 con 0x7f079415ec90 2024-04-25T19:22:30.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.406+0000 7f0792000640 1 -- 172.21.15.131:0/1504967997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f079406db10 msgr2=0x7f079415e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:30.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.406+0000 7f0792000640 1 --2- 172.21.15.131:0/1504967997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f079406db10 0x7f079415e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:30.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.406+0000 7f0792000640 1 -- 172.21.15.131:0/1504967997 >> v2:172.21.15.195:3300/0 conn(0x7f0794144340 msgr2=0x7f079406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:30.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.406+0000 7f0792000640 1 --2- 172.21.15.131:0/1504967997 >> v2:172.21.15.195:3300/0 conn(0x7f0794144340 0x7f079406d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:30.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.406+0000 7f0792000640 1 -- 172.21.15.131:0/1504967997 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f079406f240 con 0x7f079415ec90 2024-04-25T19:22:30.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.406+0000 7f0792000640 1 -- 172.21.15.131:0/1504967997 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f078c001bc0 con 0x7f079415ec90 2024-04-25T19:22:30.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.406+0000 7f0792000640 1 -- 172.21.15.131:0/1504967997 >> v1:172.21.15.131:6789/0 conn(0x7f079415ec90 legacy=0x7f0794161aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:30.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.406+0000 7f0792000640 1 --2- 172.21.15.131:0/1504967997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07780039b0 0x7f0778003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:30.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.406+0000 7f0792000640 1 --2- 172.21.15.131:0/1504967997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f079406db10 0x7f0778004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:30.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.406+0000 7f0792000640 1 --2- 172.21.15.131:0/1504967997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0778004d40 0x7f0778005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:30.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.406+0000 7f0792000640 1 -- 172.21.15.131:0/1504967997 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0794144750 con 0x7f0778004d40 2024-04-25T19:22:30.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.406+0000 7f0792000640 1 -- 172.21.15.131:0/1504967997 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0794070000 con 0x7f07780039b0 2024-04-25T19:22:30.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.406+0000 7f0792000640 1 -- 172.21.15.131:0/1504967997 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f077800ba70 con 0x7f079406db10 2024-04-25T19:22:30.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.407+0000 7f0793400640 1 --2- 172.21.15.131:0/1504967997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0778004d40 0x7f0778005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:30.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.407+0000 7f078a000640 1 --2- 172.21.15.131:0/1504967997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f079406db10 0x7f0778004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:30.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.407+0000 7f0793400640 1 -- 172.21.15.131:0/1504967997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f079406db10 msgr2=0x7f0778004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:30.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.407+0000 7f0793400640 1 --2- 172.21.15.131:0/1504967997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f079406db10 0x7f0778004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:30.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.407+0000 7f0793400640 1 -- 172.21.15.131:0/1504967997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07780039b0 msgr2=0x7f0778003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:30.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.407+0000 7f0792a00640 1 --2- 172.21.15.131:0/1504967997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07780039b0 0x7f0778003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:30.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.407+0000 7f0793400640 1 --2- 172.21.15.131:0/1504967997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07780039b0 0x7f0778003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:30.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.407+0000 7f0793400640 1 -- 172.21.15.131:0/1504967997 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0778003520 con 0x7f0778004d40 2024-04-25T19:22:30.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.407+0000 7f078a000640 1 --2- 172.21.15.131:0/1504967997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f079406db10 0x7f0778004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:30.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.407+0000 7f0792a00640 1 --2- 172.21.15.131:0/1504967997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07780039b0 0x7f0778003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:30.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.408+0000 7f0793400640 1 --2- 172.21.15.131:0/1504967997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0778004d40 0x7f0778005150 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f078c00aa70 tx=0x7f0778005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3163cbd1d82616aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:30.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.408+0000 7f0792000640 1 -- 172.21.15.131:0/1504967997 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078c00a690 con 0x7f0778004d40 2024-04-25T19:22:30.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.408+0000 7f0792000640 1 -- 172.21.15.131:0/1504967997 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f078c02f070 con 0x7f0778004d40 2024-04-25T19:22:30.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.408+0000 7f0792000640 1 -- 172.21.15.131:0/1504967997 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078c034470 con 0x7f0778004d40 2024-04-25T19:22:30.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.409+0000 7f0793e00640 1 -- 172.21.15.131:0/1504967997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0778004d40 msgr2=0x7f0778005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:30.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.409+0000 7f0793e00640 1 --2- 172.21.15.131:0/1504967997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0778004d40 0x7f0778005150 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f078c00aa70 tx=0x7f0778005830 comp rx=0 tx=0).stop 2024-04-25T19:22:30.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.409+0000 7f0793400640 1 -- 172.21.15.131:0/1504967997 reap_dead start 2024-04-25T19:22:30.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.409+0000 7f0793e00640 1 -- 172.21.15.131:0/1504967997 shutdown_connections 2024-04-25T19:22:30.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.409+0000 7f0793e00640 1 -- 172.21.15.131:0/1504967997 >> 172.21.15.131:0/1504967997 conn(0x7f0794072f40 msgr2=0x7f0794073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:30.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.409+0000 7f0793e00640 1 -- 172.21.15.131:0/1504967997 shutdown_connections 2024-04-25T19:22:30.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.409+0000 7f0793e00640 1 -- 172.21.15.131:0/1504967997 wait complete. 2024-04-25T19:22:30.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.412+0000 7f0793e00640 1 Processor -- start 2024-04-25T19:22:30.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.412+0000 7f0793e00640 1 -- start start 2024-04-25T19:22:30.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.413+0000 7f0793e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0778004d40 0x7f0794161b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:30.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.413+0000 7f0793e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07941e7b60 0x7f079415a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:30.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.413+0000 7f0793e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07940b45b0 0x7f07940b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:30.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.413+0000 7f0793e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f079406fae0 con 0x7f0778004d40 2024-04-25T19:22:30.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.413+0000 7f0793e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f079406f800 con 0x7f07940b45b0 2024-04-25T19:22:30.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.413+0000 7f0793e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f079415f0a0 con 0x7f07941e7b60 2024-04-25T19:22:30.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.413+0000 7f0792a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0778004d40 0x7f0794161b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:30.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.414+0000 7f0792a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0778004d40 0x7f0794161b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:60928/0 (socket says 172.21.15.131:60928) 2024-04-25T19:22:30.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.414+0000 7f0792a00640 1 -- 172.21.15.131:0/914924928 learned_addr learned my addr 172.21.15.131:0/914924928 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:30.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.414+0000 7f0793400640 1 --2- 172.21.15.131:0/914924928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07940b45b0 0x7f07940b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:30.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.414+0000 7f078a000640 1 --2- 172.21.15.131:0/914924928 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07941e7b60 0x7f079415a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:30.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.414+0000 7f0792a00640 1 -- 172.21.15.131:0/914924928 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07941e7b60 msgr2=0x7f079415a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:30.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.414+0000 7f0792a00640 1 --2- 172.21.15.131:0/914924928 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07941e7b60 0x7f079415a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:30.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.414+0000 7f0792a00640 1 -- 172.21.15.131:0/914924928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07940b45b0 msgr2=0x7f07940b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:30.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.414+0000 7f0792a00640 1 --2- 172.21.15.131:0/914924928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07940b45b0 0x7f07940b49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:30.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.414+0000 7f0792a00640 1 -- 172.21.15.131:0/914924928 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0794147300 con 0x7f0778004d40 2024-04-25T19:22:30.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.414+0000 7f0792a00640 1 --2- 172.21.15.131:0/914924928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0778004d40 0x7f0794161b10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f078400e810 tx=0x7f078400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:30.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.415+0000 7f078b400640 1 -- 172.21.15.131:0/914924928 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0784017070 con 0x7f0778004d40 2024-04-25T19:22:30.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.415+0000 7f078b400640 1 -- 172.21.15.131:0/914924928 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f078400c8d0 con 0x7f0778004d40 2024-04-25T19:22:30.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.415+0000 7f078b400640 1 -- 172.21.15.131:0/914924928 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078400f040 con 0x7f0778004d40 2024-04-25T19:22:30.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.415+0000 7f0793e00640 1 -- 172.21.15.131:0/914924928 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f079415acd0 con 0x7f0778004d40 2024-04-25T19:22:30.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.415+0000 7f0793e00640 1 -- 172.21.15.131:0/914924928 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0794146540 con 0x7f0778004d40 2024-04-25T19:22:30.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.416+0000 7f0793e00640 1 -- 172.21.15.131:0/914924928 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0794076c60 con 0x7f0778004d40 2024-04-25T19:22:30.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.417+0000 7f078b400640 1 -- 172.21.15.131:0/914924928 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f078401a070 con 0x7f0778004d40 2024-04-25T19:22:30.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.418+0000 7f078b400640 1 --2- 172.21.15.131:0/914924928 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f07700744b0 0x7f07700769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:30.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.418+0000 7f078b400640 1 -- 172.21.15.131:0/914924928 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0784094ee0 con 0x7f0778004d40 2024-04-25T19:22:30.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.419+0000 7f078a000640 1 --2- 172.21.15.131:0/914924928 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f07700744b0 0x7f07700769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:30.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.420+0000 7f078a000640 1 --2- 172.21.15.131:0/914924928 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f07700744b0 0x7f07700769c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0794147c30 tx=0x7f077c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:30.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.423+0000 7f078b400640 1 -- 172.21.15.131:0/914924928 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f079415acd0 con 0x7f0778004d40 2024-04-25T19:22:30.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.621+0000 7f0793e00640 1 -- 172.21.15.131:0/914924928 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f07940b7920 con 0x7f0778004d40 2024-04-25T19:22:30.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.622+0000 7f078b400640 1 -- 172.21.15.131:0/914924928 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f0794147300 con 0x7f0778004d40 2024-04-25T19:22:30.624 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-25T19:22:30.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.624+0000 7f0793e00640 1 -- 172.21.15.131:0/914924928 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f07700744b0 msgr2=0x7f07700769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:30.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.624+0000 7f0793e00640 1 --2- 172.21.15.131:0/914924928 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f07700744b0 0x7f07700769c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0794147c30 tx=0x7f077c008040 comp rx=0 tx=0).stop 2024-04-25T19:22:30.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.624+0000 7f0793e00640 1 -- 172.21.15.131:0/914924928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0778004d40 msgr2=0x7f0794161b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:30.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.624+0000 7f0793e00640 1 --2- 172.21.15.131:0/914924928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0778004d40 0x7f0794161b10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f078400e810 tx=0x7f078400ecd0 comp rx=0 tx=0).stop 2024-04-25T19:22:30.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.624+0000 7f0793e00640 1 -- 172.21.15.131:0/914924928 shutdown_connections 2024-04-25T19:22:30.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.624+0000 7f0793e00640 1 --2- 172.21.15.131:0/914924928 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f07700744b0 0x7f07700769c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:30.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.624+0000 7f0793e00640 1 --2- 172.21.15.131:0/914924928 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07941e7b60 0x7f079415a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:30.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.624+0000 7f0793e00640 1 --2- 172.21.15.131:0/914924928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07940b45b0 0x7f07940b49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:30.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.624+0000 7f0793e00640 1 --2- 172.21.15.131:0/914924928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0778004d40 0x7f0794161b10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:30.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.624+0000 7f0793e00640 1 -- 172.21.15.131:0/914924928 >> 172.21.15.131:0/914924928 conn(0x7f0794072f40 msgr2=0x7f079415de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:30.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.624+0000 7f0793e00640 1 -- 172.21.15.131:0/914924928 shutdown_connections 2024-04-25T19:22:30.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.624+0000 7f0793e00640 1 -- 172.21.15.131:0/914924928 wait complete. 2024-04-25T19:22:30.650 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T19:22:30.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.905+0000 7f2821c00640 1 Processor -- start 2024-04-25T19:22:30.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.905+0000 7f2821c00640 1 -- start start 2024-04-25T19:22:30.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.907+0000 7f2821c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f281c073c80 0x7f281c160180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:30.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.908+0000 7f2821c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f281c074090 0x7f281c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:30.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.908+0000 7f2821c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f281c160b60 con 0x7f281c15c680 2024-04-25T19:22:30.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.908+0000 7f2821c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f281c161120 con 0x7f281c073c80 2024-04-25T19:22:30.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.908+0000 7f2821c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f281c0b4df0 con 0x7f281c074090 2024-04-25T19:22:30.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.908+0000 7f2813400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f281c073c80 0x7f281c160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:30.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.908+0000 7f2821200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f281c074090 0x7f281c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:30.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.908+0000 7f281be00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f281c15c680 0x7f281c0afe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.131:33970/0 (socket says 172.21.15.131:33970) 2024-04-25T19:22:30.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.908+0000 7f281be00640 1 -- 172.21.15.131:0/2807439491 learned_addr learned my addr 172.21.15.131:0/2807439491 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:30.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.909+0000 7f2821200640 1 -- 172.21.15.131:0/2807439491 >> v2:172.21.15.195:3300/0 conn(0x7f281c073c80 msgr2=0x7f281c160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:30.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.909+0000 7f2821200640 1 --2- 172.21.15.131:0/2807439491 >> v2:172.21.15.195:3300/0 conn(0x7f281c073c80 0x7f281c160180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:30.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.909+0000 7f2821200640 1 -- 172.21.15.131:0/2807439491 >> v1:172.21.15.195:6789/0 conn(0x7f281c15c680 legacy=0x7f281c0afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:30.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.909+0000 7f2821200640 1 -- 172.21.15.131:0/2807439491 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f281c160e40 con 0x7f281c074090 2024-04-25T19:22:30.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.910+0000 7f2821200640 1 --2- 172.21.15.131:0/2807439491 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f281c074090 0x7f281c06d5d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2814009d90 tx=0x7f281402a530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac67e417ffc2f4f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:30.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.911+0000 7f281b400640 1 -- 172.21.15.131:0/2807439491 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2814007740 con 0x7f281c074090 2024-04-25T19:22:30.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.911+0000 7f281b400640 1 -- 172.21.15.131:0/2807439491 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28140078e0 con 0x7f281c074090 2024-04-25T19:22:30.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.911+0000 7f281b400640 1 -- 172.21.15.131:0/2807439491 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2814007cb0 con 0x7f281c074090 2024-04-25T19:22:30.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.911+0000 7f2821c00640 1 -- 172.21.15.131:0/2807439491 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f281c074090 msgr2=0x7f281c06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:30.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.911+0000 7f2821c00640 1 --2- 172.21.15.131:0/2807439491 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f281c074090 0x7f281c06d5d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2814009d90 tx=0x7f281402a530 comp rx=0 tx=0).stop 2024-04-25T19:22:30.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.911+0000 7f2821c00640 1 -- 172.21.15.131:0/2807439491 shutdown_connections 2024-04-25T19:22:30.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.911+0000 7f2821c00640 1 --2- 172.21.15.131:0/2807439491 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f281c074090 0x7f281c06d5d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:30.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.911+0000 7f2821c00640 1 --2- 172.21.15.131:0/2807439491 >> v2:172.21.15.195:3300/0 conn(0x7f281c073c80 0x7f281c160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:30.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.911+0000 7f2821c00640 1 -- 172.21.15.131:0/2807439491 >> 172.21.15.131:0/2807439491 conn(0x7f281c073160 msgr2=0x7f281c073570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:30.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.912+0000 7f2821c00640 1 -- 172.21.15.131:0/2807439491 shutdown_connections 2024-04-25T19:22:30.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.912+0000 7f2821c00640 1 -- 172.21.15.131:0/2807439491 wait complete. 2024-04-25T19:22:30.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.914+0000 7f2821c00640 1 Processor -- start 2024-04-25T19:22:30.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.914+0000 7f2821c00640 1 -- start start 2024-04-25T19:22:30.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.915+0000 7f2821c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f281c073c80 0x7f281c15d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:30.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.915+0000 7f2821c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f281c074090 0x7f281c14a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:30.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.915+0000 7f2821c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f281c15c680 0x7f281c15f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:30.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.915+0000 7f2821c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f281c070e60 con 0x7f281c073c80 2024-04-25T19:22:30.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.915+0000 7f2821c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f281c070ce0 con 0x7f281c15c680 2024-04-25T19:22:30.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.915+0000 7f2821c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f281c1606c0 con 0x7f281c074090 2024-04-25T19:22:30.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.916+0000 7f281be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f281c073c80 0x7f281c15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:30.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.916+0000 7f281be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f281c073c80 0x7f281c15d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:60932/0 (socket says 172.21.15.131:60932) 2024-04-25T19:22:30.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.916+0000 7f281be00640 1 -- 172.21.15.131:0/1827246229 learned_addr learned my addr 172.21.15.131:0/1827246229 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:30.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.916+0000 7f2813400640 1 --2- 172.21.15.131:0/1827246229 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f281c074090 0x7f281c14a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:30.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.916+0000 7f281be00640 1 -- 172.21.15.131:0/1827246229 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f281c074090 msgr2=0x7f281c14a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:30.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.916+0000 7f281be00640 1 --2- 172.21.15.131:0/1827246229 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f281c074090 0x7f281c14a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:30.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.916+0000 7f281be00640 1 -- 172.21.15.131:0/1827246229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f281c15c680 msgr2=0x7f281c15f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:30.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.916+0000 7f2821200640 1 --2- 172.21.15.131:0/1827246229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f281c15c680 0x7f281c15f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:30.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.916+0000 7f281be00640 1 --2- 172.21.15.131:0/1827246229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f281c15c680 0x7f281c15f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:30.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.916+0000 7f281be00640 1 -- 172.21.15.131:0/1827246229 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f281c0ced60 con 0x7f281c073c80 2024-04-25T19:22:30.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.916+0000 7f281be00640 1 --2- 172.21.15.131:0/1827246229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f281c073c80 0x7f281c15d460 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f280c00c480 tx=0x7f280c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:30.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.917+0000 7f2818c00640 1 -- 172.21.15.131:0/1827246229 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c017070 con 0x7f281c073c80 2024-04-25T19:22:30.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.917+0000 7f2818c00640 1 -- 172.21.15.131:0/1827246229 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f280c005ce0 con 0x7f281c073c80 2024-04-25T19:22:30.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.917+0000 7f2818c00640 1 -- 172.21.15.131:0/1827246229 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c0072f0 con 0x7f281c073c80 2024-04-25T19:22:30.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.917+0000 7f2821c00640 1 -- 172.21.15.131:0/1827246229 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f281c0cf040 con 0x7f281c073c80 2024-04-25T19:22:30.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.917+0000 7f2821c00640 1 -- 172.21.15.131:0/1827246229 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f281c0cf600 con 0x7f281c073c80 2024-04-25T19:22:30.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.918+0000 7f2821c00640 1 -- 172.21.15.131:0/1827246229 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f281c076c60 con 0x7f281c073c80 2024-04-25T19:22:30.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.919+0000 7f2818c00640 1 -- 172.21.15.131:0/1827246229 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f280c01a070 con 0x7f281c073c80 2024-04-25T19:22:30.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.920+0000 7f2818c00640 1 --2- 172.21.15.131:0/1827246229 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f27f80744b0 0x7f27f80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:30.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.920+0000 7f2818c00640 1 -- 172.21.15.131:0/1827246229 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f280c0944b0 con 0x7f281c073c80 2024-04-25T19:22:30.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.921+0000 7f2813400640 1 --2- 172.21.15.131:0/1827246229 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f27f80744b0 0x7f27f80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:30.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.922+0000 7f2813400640 1 --2- 172.21.15.131:0/1827246229 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f27f80744b0 0x7f27f80769c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f281c0b3480 tx=0x7f2804008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:30.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:30.925+0000 7f2818c00640 1 -- 172.21.15.131:0/1827246229 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f280c05e670 con 0x7f281c073c80 2024-04-25T19:22:31.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.127+0000 7f2821c00640 1 -- 172.21.15.131:0/1827246229 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f281c0d11f0 con 0x7f281c073c80 2024-04-25T19:22:31.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.128+0000 7f2818c00640 1 -- 172.21.15.131:0/1827246229 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f280c062970 con 0x7f281c073c80 2024-04-25T19:22:31.130 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 64 2024-04-25T19:22:31.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.131+0000 7f2821c00640 1 -- 172.21.15.131:0/1827246229 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f27f80744b0 msgr2=0x7f27f80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:31.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.131+0000 7f2821c00640 1 --2- 172.21.15.131:0/1827246229 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f27f80744b0 0x7f27f80769c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f281c0b3480 tx=0x7f2804008040 comp rx=0 tx=0).stop 2024-04-25T19:22:31.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.131+0000 7f2821c00640 1 -- 172.21.15.131:0/1827246229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f281c073c80 msgr2=0x7f281c15d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:31.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.131+0000 7f2821c00640 1 --2- 172.21.15.131:0/1827246229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f281c073c80 0x7f281c15d460 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f280c00c480 tx=0x7f280c00c940 comp rx=0 tx=0).stop 2024-04-25T19:22:31.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.131+0000 7f2821c00640 1 -- 172.21.15.131:0/1827246229 shutdown_connections 2024-04-25T19:22:31.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.131+0000 7f2821c00640 1 --2- 172.21.15.131:0/1827246229 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f27f80744b0 0x7f27f80769c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:31.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.131+0000 7f2821c00640 1 --2- 172.21.15.131:0/1827246229 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f281c074090 0x7f281c14a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:31.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.131+0000 7f2821c00640 1 --2- 172.21.15.131:0/1827246229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f281c15c680 0x7f281c15f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:31.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.131+0000 7f2821c00640 1 --2- 172.21.15.131:0/1827246229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f281c073c80 0x7f281c15d460 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:31.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.131+0000 7f2821c00640 1 -- 172.21.15.131:0/1827246229 >> 172.21.15.131:0/1827246229 conn(0x7f281c073160 msgr2=0x7f281c15ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:31.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.132+0000 7f2821c00640 1 -- 172.21.15.131:0/1827246229 shutdown_connections 2024-04-25T19:22:31.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.132+0000 7f2821c00640 1 -- 172.21.15.131:0/1827246229 wait complete. 2024-04-25T19:22:31.161 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:22:31.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.427+0000 7f2233600640 1 Processor -- start 2024-04-25T19:22:31.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.427+0000 7f2233600640 1 -- start start 2024-04-25T19:22:31.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.429+0000 7f2233600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f222c06d5d0 0x7f222c168f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:31.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.429+0000 7f2233600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f222c0d2220 con 0x7f222c15f420 2024-04-25T19:22:31.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.429+0000 7f2233600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f222c0d24c0 con 0x7f222c15e800 2024-04-25T19:22:31.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.429+0000 7f2233600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f222c0b3b40 con 0x7f222c06d5d0 2024-04-25T19:22:31.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.429+0000 7f2230c00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f222c15f420 0x7f222c0b2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:42268/0 (socket says 172.21.15.131:42268) 2024-04-25T19:22:31.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.429+0000 7f2230c00640 1 -- 172.21.15.131:0/460857981 learned_addr learned my addr 172.21.15.131:0/460857981 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:31.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.430+0000 7f2231600640 1 --2- 172.21.15.131:0/460857981 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f222c06d5d0 0x7f222c168f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:31.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.430+0000 7f222b400640 1 -- 172.21.15.131:0/460857981 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1569254670 0 0) 0x7f222c0d2220 con 0x7f222c15f420 2024-04-25T19:22:31.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.430+0000 7f222b400640 1 -- 172.21.15.131:0/460857981 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2210003520 con 0x7f222c15f420 2024-04-25T19:22:31.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.430+0000 7f222b400640 1 -- 172.21.15.131:0/460857981 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3332315601 0 0) 0x7f2210003520 con 0x7f222c15f420 2024-04-25T19:22:31.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.430+0000 7f222b400640 1 -- 172.21.15.131:0/460857981 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f222c06d5d0 msgr2=0x7f222c168f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:31.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.430+0000 7f222b400640 1 --2- 172.21.15.131:0/460857981 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f222c06d5d0 0x7f222c168f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:31.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.430+0000 7f222b400640 1 -- 172.21.15.131:0/460857981 >> v1:172.21.15.195:6789/0 conn(0x7f222c15e800 legacy=0x7f222c0b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:31.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.430+0000 7f222b400640 1 -- 172.21.15.131:0/460857981 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f222c0d27a0 con 0x7f222c15f420 2024-04-25T19:22:31.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.430+0000 7f222b400640 1 -- 172.21.15.131:0/460857981 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f2224001670 con 0x7f222c15f420 2024-04-25T19:22:31.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.430+0000 7f222b400640 1 -- 172.21.15.131:0/460857981 >> v1:172.21.15.131:6789/0 conn(0x7f222c15f420 legacy=0x7f222c0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:31.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.430+0000 7f222b400640 1 --2- 172.21.15.131:0/460857981 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22100039e0 0x7f2210003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:31.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.430+0000 7f222b400640 1 --2- 172.21.15.131:0/460857981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2210004370 0x7f22100048c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:31.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.431+0000 7f222b400640 1 --2- 172.21.15.131:0/460857981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22100050c0 0x7f221000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:31.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.431+0000 7f222b400640 1 -- 172.21.15.131:0/460857981 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f222c0b3b40 con 0x7f2210004370 2024-04-25T19:22:31.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.431+0000 7f222b400640 1 -- 172.21.15.131:0/460857981 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f221000bf60 con 0x7f22100050c0 2024-04-25T19:22:31.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.431+0000 7f222b400640 1 -- 172.21.15.131:0/460857981 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f221000c160 con 0x7f22100039e0 2024-04-25T19:22:31.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.431+0000 7f222be00640 1 --2- 172.21.15.131:0/460857981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2210004370 0x7f22100048c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:31.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.431+0000 7f2230c00640 1 --2- 172.21.15.131:0/460857981 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22100039e0 0x7f2210003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:31.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.431+0000 7f2231600640 1 --2- 172.21.15.131:0/460857981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22100050c0 0x7f221000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:31.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.431+0000 7f222be00640 1 -- 172.21.15.131:0/460857981 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22100039e0 msgr2=0x7f2210003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:31.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.431+0000 7f222be00640 1 --2- 172.21.15.131:0/460857981 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22100039e0 0x7f2210003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:31.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.431+0000 7f222be00640 1 -- 172.21.15.131:0/460857981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22100050c0 msgr2=0x7f221000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:31.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.431+0000 7f222be00640 1 --2- 172.21.15.131:0/460857981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22100050c0 0x7f221000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:31.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.431+0000 7f222be00640 1 -- 172.21.15.131:0/460857981 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2210003520 con 0x7f2210004370 2024-04-25T19:22:31.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.431+0000 7f2231600640 1 --2- 172.21.15.131:0/460857981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22100050c0 0x7f221000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:31.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.432+0000 7f222be00640 1 --2- 172.21.15.131:0/460857981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2210004370 0x7f22100048c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f222c0d2110 tx=0x7f2210005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ece4f05da1f481 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:31.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.432+0000 7f222b400640 1 -- 172.21.15.131:0/460857981 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2214001a70 con 0x7f2210004370 2024-04-25T19:22:31.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.433+0000 7f222b400640 1 -- 172.21.15.131:0/460857981 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f221402ae10 con 0x7f2210004370 2024-04-25T19:22:31.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.433+0000 7f222b400640 1 -- 172.21.15.131:0/460857981 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2214003bb0 con 0x7f2210004370 2024-04-25T19:22:31.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.433+0000 7f2233600640 1 -- 172.21.15.131:0/460857981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2210004370 msgr2=0x7f22100048c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:31.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.433+0000 7f2233600640 1 --2- 172.21.15.131:0/460857981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2210004370 0x7f22100048c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f222c0d2110 tx=0x7f2210005830 comp rx=0 tx=0).stop 2024-04-25T19:22:31.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.433+0000 7f2231600640 1 -- 172.21.15.131:0/460857981 reap_dead start 2024-04-25T19:22:31.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.433+0000 7f2233600640 1 -- 172.21.15.131:0/460857981 shutdown_connections 2024-04-25T19:22:31.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.433+0000 7f2233600640 1 -- 172.21.15.131:0/460857981 >> 172.21.15.131:0/460857981 conn(0x7f222c09b7d0 msgr2=0x7f222c0b7040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:31.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.433+0000 7f2233600640 1 -- 172.21.15.131:0/460857981 shutdown_connections 2024-04-25T19:22:31.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.433+0000 7f2233600640 1 -- 172.21.15.131:0/460857981 wait complete. 2024-04-25T19:22:31.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.436+0000 7f2233600640 1 Processor -- start 2024-04-25T19:22:31.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.436+0000 7f2233600640 1 -- start start 2024-04-25T19:22:31.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.437+0000 7f2233600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2210004370 0x7f222c09c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:31.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.437+0000 7f2233600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f222c09e630 0x7f222c0cab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:31.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.437+0000 7f2233600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f222c151440 0x7f222c151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:31.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.437+0000 7f2233600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f222c0b7750 con 0x7f222c151440 2024-04-25T19:22:31.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.437+0000 7f2233600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f222c0d2df0 con 0x7f222c09e630 2024-04-25T19:22:31.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.437+0000 7f2233600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f222c0b78d0 con 0x7f2210004370 2024-04-25T19:22:31.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.438+0000 7f2231600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f222c151440 0x7f222c151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:31.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.438+0000 7f2231600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f222c151440 0x7f222c151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:60952/0 (socket says 172.21.15.131:60952) 2024-04-25T19:22:31.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.438+0000 7f2231600640 1 -- 172.21.15.131:0/1473228699 learned_addr learned my addr 172.21.15.131:0/1473228699 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:31.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.438+0000 7f2230c00640 1 --2- 172.21.15.131:0/1473228699 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2210004370 0x7f222c09c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:31.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.438+0000 7f222be00640 1 --2- 172.21.15.131:0/1473228699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f222c09e630 0x7f222c0cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:31.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.438+0000 7f2231600640 1 -- 172.21.15.131:0/1473228699 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2210004370 msgr2=0x7f222c09c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:31.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.438+0000 7f2231600640 1 --2- 172.21.15.131:0/1473228699 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2210004370 0x7f222c09c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:31.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.438+0000 7f2231600640 1 -- 172.21.15.131:0/1473228699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f222c09e630 msgr2=0x7f222c0cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:31.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.438+0000 7f2231600640 1 --2- 172.21.15.131:0/1473228699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f222c09e630 0x7f222c0cab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:31.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.438+0000 7f2231600640 1 -- 172.21.15.131:0/1473228699 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f222c1503a0 con 0x7f222c151440 2024-04-25T19:22:31.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.439+0000 7f2231600640 1 --2- 172.21.15.131:0/1473228699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f222c151440 0x7f222c151850 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f222c06e370 tx=0x7f221c010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:31.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.439+0000 7f2228c00640 1 -- 172.21.15.131:0/1473228699 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221c00f040 con 0x7f222c151440 2024-04-25T19:22:31.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.439+0000 7f2228c00640 1 -- 172.21.15.131:0/1473228699 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f221c01c070 con 0x7f222c151440 2024-04-25T19:22:31.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.439+0000 7f2228c00640 1 -- 172.21.15.131:0/1473228699 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221c00eb00 con 0x7f222c151440 2024-04-25T19:22:31.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.439+0000 7f2233600640 1 -- 172.21.15.131:0/1473228699 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f222c150680 con 0x7f222c151440 2024-04-25T19:22:31.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.439+0000 7f2233600640 1 -- 172.21.15.131:0/1473228699 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f222c150c40 con 0x7f222c151440 2024-04-25T19:22:31.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.440+0000 7f2233600640 1 -- 172.21.15.131:0/1473228699 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f222c1500f0 con 0x7f222c151440 2024-04-25T19:22:31.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.442+0000 7f2228c00640 1 -- 172.21.15.131:0/1473228699 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f221c00eca0 con 0x7f222c151440 2024-04-25T19:22:31.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.443+0000 7f2228c00640 1 --2- 172.21.15.131:0/1473228699 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f22080744e0 0x7f22080769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:31.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.443+0000 7f2228c00640 1 -- 172.21.15.131:0/1473228699 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f221c0950b0 con 0x7f222c151440 2024-04-25T19:22:31.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.444+0000 7f2230c00640 1 --2- 172.21.15.131:0/1473228699 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f22080744e0 0x7f22080769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:31.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.445+0000 7f2230c00640 1 --2- 172.21.15.131:0/1473228699 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f22080744e0 0x7f22080769f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2224001cd0 tx=0x7f2224009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:31.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.449+0000 7f2228c00640 1 -- 172.21.15.131:0/1473228699 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f221c05f840 con 0x7f222c151440 2024-04-25T19:22:31.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.693+0000 7f2233600640 1 -- 172.21.15.131:0/1473228699 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f222c050740 con 0x7f222c151440 2024-04-25T19:22:31.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.695+0000 7f2228c00640 1 -- 172.21.15.131:0/1473228699 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5187 (secure 0 0 0) 0x7f221c05f140 con 0x7f222c151440 2024-04-25T19:22:31.697 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:31.697 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/1570319410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":1570319410},{"type":"v1","addr":"172.21.15.195:6837","nonce":1570319410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/4072860882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4072860882},{"type":"v1","addr":"172.21.15.131:6834","nonce":4072860882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2207155444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2207155444},{"type":"v1","addr":"172.21.15.131:6835","nonce":2207155444}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T19:22:16.578438+0000","modified":"2024-04-25T19:22:19.648009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6836/1898121552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1898121552},{"type":"v1","addr":"172.21.15.195:6836","nonce":1898121552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T19:22:31.697 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 8 2024-04-25T19:22:31.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.697+0000 7f2233600640 1 -- 172.21.15.131:0/1473228699 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f22080744e0 msgr2=0x7f22080769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:31.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.697+0000 7f2233600640 1 --2- 172.21.15.131:0/1473228699 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f22080744e0 0x7f22080769f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2224001cd0 tx=0x7f2224009040 comp rx=0 tx=0).stop 2024-04-25T19:22:31.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.697+0000 7f2233600640 1 -- 172.21.15.131:0/1473228699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f222c151440 msgr2=0x7f222c151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:31.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.697+0000 7f2233600640 1 --2- 172.21.15.131:0/1473228699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f222c151440 0x7f222c151850 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f222c06e370 tx=0x7f221c010c20 comp rx=0 tx=0).stop 2024-04-25T19:22:31.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.697+0000 7f2233600640 1 -- 172.21.15.131:0/1473228699 shutdown_connections 2024-04-25T19:22:31.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.697+0000 7f2233600640 1 --2- 172.21.15.131:0/1473228699 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f22080744e0 0x7f22080769f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:31.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.697+0000 7f2233600640 1 --2- 172.21.15.131:0/1473228699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f222c151440 0x7f222c151850 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:31.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.697+0000 7f2233600640 1 --2- 172.21.15.131:0/1473228699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f222c09e630 0x7f222c0cab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:31.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.697+0000 7f2233600640 1 --2- 172.21.15.131:0/1473228699 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2210004370 0x7f222c09c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:31.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.697+0000 7f2233600640 1 -- 172.21.15.131:0/1473228699 >> 172.21.15.131:0/1473228699 conn(0x7f222c09b7d0 msgr2=0x7f222c15e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:31.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.698+0000 7f2233600640 1 -- 172.21.15.131:0/1473228699 shutdown_connections 2024-04-25T19:22:31.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:31.698+0000 7f2233600640 1 -- 172.21.15.131:0/1473228699 wait complete. 2024-04-25T19:22:31.728 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:22:32.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.000+0000 7fa1afe00640 1 Processor -- start 2024-04-25T19:22:32.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.000+0000 7fa1afe00640 1 -- start start 2024-04-25T19:22:32.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.002+0000 7fa1afe00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa1b00cf9e0 0x7fa1b0161090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:32.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.002+0000 7fa1afe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa1b00b0800 0x7fa1b0070290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:32.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.002+0000 7fa1afe00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1b01615d0 con 0x7fa1b00707d0 2024-04-25T19:22:32.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.002+0000 7fa1afe00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fa1b0070be0 con 0x7fa1b00cf9e0 2024-04-25T19:22:32.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.002+0000 7fa1afe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa1b00cffc0 con 0x7fa1b00b0800 2024-04-25T19:22:32.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.003+0000 7fa1ae000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa1b00b0800 0x7fa1b0070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:32.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.003+0000 7fa1ae000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa1b00b0800 0x7fa1b0070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.131:59960/0 (socket says 172.21.15.131:59960) 2024-04-25T19:22:32.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.003+0000 7fa1ae000640 1 -- 172.21.15.131:0/364359693 learned_addr learned my addr 172.21.15.131:0/364359693 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:32.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.003+0000 7fa1aea00640 1 --2- 172.21.15.131:0/364359693 >> v2:172.21.15.195:3300/0 conn(0x7fa1b00cf9e0 0x7fa1b0161090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:32.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.004+0000 7fa1aea00640 1 -- 172.21.15.131:0/364359693 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa1b00b0800 msgr2=0x7fa1b0070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:32.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.004+0000 7fa1aea00640 1 --2- 172.21.15.131:0/364359693 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa1b00b0800 0x7fa1b0070290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:32.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.004+0000 7fa1aea00640 1 -- 172.21.15.131:0/364359693 >> v1:172.21.15.195:6789/0 conn(0x7fa1b00707d0 legacy=0x7fa1b01569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:32.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.004+0000 7fa1aea00640 1 -- 172.21.15.131:0/364359693 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b00d02a0 con 0x7fa1b00cf9e0 2024-04-25T19:22:32.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.004+0000 7fa1ae000640 1 --2- 172.21.15.131:0/364359693 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa1b00b0800 0x7fa1b0070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T19:22:32.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.005+0000 7fa1aea00640 1 --2- 172.21.15.131:0/364359693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1b00cf9e0 0x7fa1b0161090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa1a00097a0 tx=0x7fa1a002a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fea9770e54ecad0c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:32.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.006+0000 7fa1ad600640 1 -- 172.21.15.131:0/364359693 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0037070 con 0x7fa1b00cf9e0 2024-04-25T19:22:32.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.006+0000 7fa1ad600640 1 -- 172.21.15.131:0/364359693 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1a002ae40 con 0x7fa1b00cf9e0 2024-04-25T19:22:32.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.006+0000 7fa1ad600640 1 -- 172.21.15.131:0/364359693 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0032660 con 0x7fa1b00cf9e0 2024-04-25T19:22:32.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.006+0000 7fa1afe00640 1 -- 172.21.15.131:0/364359693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1b00cf9e0 msgr2=0x7fa1b0161090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:32.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.006+0000 7fa1afe00640 1 --2- 172.21.15.131:0/364359693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1b00cf9e0 0x7fa1b0161090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa1a00097a0 tx=0x7fa1a002a0f0 comp rx=0 tx=0).stop 2024-04-25T19:22:32.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.007+0000 7fa1afe00640 1 -- 172.21.15.131:0/364359693 shutdown_connections 2024-04-25T19:22:32.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.007+0000 7fa1afe00640 1 --2- 172.21.15.131:0/364359693 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa1b00b0800 0x7fa1b0070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:32.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.007+0000 7fa1afe00640 1 --2- 172.21.15.131:0/364359693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1b00cf9e0 0x7fa1b0161090 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:32.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.007+0000 7fa1afe00640 1 -- 172.21.15.131:0/364359693 >> 172.21.15.131:0/364359693 conn(0x7fa1b00d1720 msgr2=0x7fa1b00d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:32.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.007+0000 7fa1afe00640 1 -- 172.21.15.131:0/364359693 shutdown_connections 2024-04-25T19:22:32.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.007+0000 7fa1afe00640 1 -- 172.21.15.131:0/364359693 wait complete. 2024-04-25T19:22:32.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.009+0000 7fa1afe00640 1 Processor -- start 2024-04-25T19:22:32.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.010+0000 7fa1afe00640 1 -- start start 2024-04-25T19:22:32.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.011+0000 7fa1afe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa1b00707d0 0x7fa1b00b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:32.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.011+0000 7fa1afe00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1b00b0800 0x7fa1b0149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:32.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.011+0000 7fa1afe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1b00cf9e0 0x7fa1b00b2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:32.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.011+0000 7fa1afe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b00b0c10 con 0x7fa1b00cf9e0 2024-04-25T19:22:32.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.011+0000 7fa1afe00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b00d0860 con 0x7fa1b00b0800 2024-04-25T19:22:32.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.011+0000 7fa1afe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa1b00b0d90 con 0x7fa1b00707d0 2024-04-25T19:22:32.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.012+0000 7fa1af400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1b00cf9e0 0x7fa1b00b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:32.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.012+0000 7fa1af400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1b00cf9e0 0x7fa1b00b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:60958/0 (socket says 172.21.15.131:60958) 2024-04-25T19:22:32.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.012+0000 7fa1af400640 1 -- 172.21.15.131:0/3057373534 learned_addr learned my addr 172.21.15.131:0/3057373534 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:32.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.012+0000 7fa1aea00640 1 --2- 172.21.15.131:0/3057373534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa1b00707d0 0x7fa1b00b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:32.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.012+0000 7fa1ae000640 1 --2- 172.21.15.131:0/3057373534 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1b00b0800 0x7fa1b0149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:32.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.012+0000 7fa1af400640 1 -- 172.21.15.131:0/3057373534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa1b00707d0 msgr2=0x7fa1b00b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:32.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.012+0000 7fa1af400640 1 --2- 172.21.15.131:0/3057373534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa1b00707d0 0x7fa1b00b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:32.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.012+0000 7fa1af400640 1 -- 172.21.15.131:0/3057373534 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1b00b0800 msgr2=0x7fa1b0149230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:32.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.012+0000 7fa1af400640 1 --2- 172.21.15.131:0/3057373534 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1b00b0800 0x7fa1b0149230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:32.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.012+0000 7fa1af400640 1 -- 172.21.15.131:0/3057373534 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b01f6530 con 0x7fa1b00cf9e0 2024-04-25T19:22:32.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.013+0000 7fa1af400640 1 --2- 172.21.15.131:0/3057373534 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1b00cf9e0 0x7fa1b00b2450 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa1a800c760 tx=0x7fa1a800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:32.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.013+0000 7fa1a6a00640 1 -- 172.21.15.131:0/3057373534 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a8003b90 con 0x7fa1b00cf9e0 2024-04-25T19:22:32.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.013+0000 7fa1a6a00640 1 -- 172.21.15.131:0/3057373534 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1a8003d30 con 0x7fa1b00cf9e0 2024-04-25T19:22:32.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.013+0000 7fa1afe00640 1 -- 172.21.15.131:0/3057373534 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1b01567a0 con 0x7fa1b00cf9e0 2024-04-25T19:22:32.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.013+0000 7fa1a6a00640 1 -- 172.21.15.131:0/3057373534 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a800aa90 con 0x7fa1b00cf9e0 2024-04-25T19:22:32.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.013+0000 7fa1afe00640 1 -- 172.21.15.131:0/3057373534 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1b00b53d0 con 0x7fa1b00cf9e0 2024-04-25T19:22:32.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.014+0000 7fa1afe00640 1 -- 172.21.15.131:0/3057373534 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1b0050740 con 0x7fa1b00cf9e0 2024-04-25T19:22:32.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.016+0000 7fa1a6a00640 1 -- 172.21.15.131:0/3057373534 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa1a800ac30 con 0x7fa1b00cf9e0 2024-04-25T19:22:32.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.016+0000 7fa1a6a00640 1 --2- 172.21.15.131:0/3057373534 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa1900744e0 0x7fa1900769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:32.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.017+0000 7fa1a6a00640 1 -- 172.21.15.131:0/3057373534 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa1a8095090 con 0x7fa1b00cf9e0 2024-04-25T19:22:32.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.017+0000 7fa1aea00640 1 --2- 172.21.15.131:0/3057373534 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa1900744e0 0x7fa1900769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:32.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.018+0000 7fa1aea00640 1 --2- 172.21.15.131:0/3057373534 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa1900744e0 0x7fa1900769f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0034000 tx=0x7fa1a002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:32.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.021+0000 7fa1a6a00640 1 -- 172.21.15.131:0/3057373534 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa1b01615d0 con 0x7fa1b00cf9e0 2024-04-25T19:22:32.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.225+0000 7fa1afe00640 1 -- 172.21.15.131:0/3057373534 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa1b00b4e60 con 0x7fa1b00cf9e0 2024-04-25T19:22:32.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.228+0000 7fa1a6a00640 1 -- 172.21.15.131:0/3057373534 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16629 (secure 0 0 0) 0x7fa1a805f810 con 0x7fa1b00cf9e0 2024-04-25T19:22:32.230 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:32.230 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":20,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:22:18.057809+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:22:14.779716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T19:22:15.552027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:22:32.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.230+0000 7fa1afe00640 1 -- 172.21.15.131:0/3057373534 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa1900744e0 msgr2=0x7fa1900769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:32.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.230+0000 7fa1afe00640 1 --2- 172.21.15.131:0/3057373534 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa1900744e0 0x7fa1900769f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0034000 tx=0x7fa1a002e000 comp rx=0 tx=0).stop 2024-04-25T19:22:32.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.230+0000 7fa1afe00640 1 -- 172.21.15.131:0/3057373534 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1b00cf9e0 msgr2=0x7fa1b00b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:32.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.230+0000 7fa1afe00640 1 --2- 172.21.15.131:0/3057373534 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1b00cf9e0 0x7fa1b00b2450 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa1a800c760 tx=0x7fa1a800cc20 comp rx=0 tx=0).stop 2024-04-25T19:22:32.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.231+0000 7fa1afe00640 1 -- 172.21.15.131:0/3057373534 shutdown_connections 2024-04-25T19:22:32.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.231+0000 7fa1afe00640 1 --2- 172.21.15.131:0/3057373534 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa1900744e0 0x7fa1900769f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:32.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.231+0000 7fa1afe00640 1 --2- 172.21.15.131:0/3057373534 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1b00cf9e0 0x7fa1b00b2450 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:32.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.231+0000 7fa1afe00640 1 --2- 172.21.15.131:0/3057373534 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1b00b0800 0x7fa1b0149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:32.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.231+0000 7fa1afe00640 1 --2- 172.21.15.131:0/3057373534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa1b00707d0 0x7fa1b00b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:32.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.231+0000 7fa1afe00640 1 -- 172.21.15.131:0/3057373534 >> 172.21.15.131:0/3057373534 conn(0x7fa1b00d1720 msgr2=0x7fa1b00d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:32.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.231+0000 7fa1afe00640 1 -- 172.21.15.131:0/3057373534 shutdown_connections 2024-04-25T19:22:32.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.231+0000 7fa1afe00640 1 -- 172.21.15.131:0/3057373534 wait complete. 2024-04-25T19:22:32.260 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T19:22:04.178847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T19:22:14.779716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T19:22:15.552027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T19:22:32.260 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T19:22:32.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.534+0000 7f3caa000640 1 Processor -- start 2024-04-25T19:22:32.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.535+0000 7f3caa000640 1 -- start start 2024-04-25T19:22:32.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.537+0000 7f3caa000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ca40cd9a0 0x7f3ca415f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:32.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.537+0000 7f3caa000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3ca406dce0 0x7f3ca415faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:32.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.537+0000 7f3caa000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ca40cdea0 con 0x7f3ca40b0af0 2024-04-25T19:22:32.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.537+0000 7f3caa000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3ca40ceab0 con 0x7f3ca406dce0 2024-04-25T19:22:32.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.537+0000 7f3caa000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3ca40ce180 con 0x7f3ca40cd9a0 2024-04-25T19:22:32.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.537+0000 7f3c9be00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f3ca40b0af0 0x7f3ca406d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:42276/0 (socket says 172.21.15.131:42276) 2024-04-25T19:22:32.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.537+0000 7f3c9be00640 1 -- 172.21.15.131:0/3168604618 learned_addr learned my addr 172.21.15.131:0/3168604618 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:32.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.537+0000 7f3ca3e00640 1 --2- 172.21.15.131:0/3168604618 >> v2:172.21.15.195:3300/0 conn(0x7f3ca406dce0 0x7f3ca415faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:32.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.538+0000 7f3ca3400640 1 --2- 172.21.15.131:0/3168604618 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ca40cd9a0 0x7f3ca415f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:32.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.538+0000 7f3ca2a00640 1 -- 172.21.15.131:0/3168604618 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4010819044 0 0) 0x7f3ca40cdea0 con 0x7f3ca40b0af0 2024-04-25T19:22:32.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.538+0000 7f3ca2a00640 1 -- 172.21.15.131:0/3168604618 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c88003520 con 0x7f3ca40b0af0 2024-04-25T19:22:32.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.538+0000 7f3ca2a00640 1 -- 172.21.15.131:0/3168604618 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3323772633 0 0) 0x7f3c88003520 con 0x7f3ca40b0af0 2024-04-25T19:22:32.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.538+0000 7f3ca2a00640 1 -- 172.21.15.131:0/3168604618 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ca40cd9a0 msgr2=0x7f3ca415f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:32.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.538+0000 7f3ca2a00640 1 --2- 172.21.15.131:0/3168604618 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ca40cd9a0 0x7f3ca415f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:32.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.538+0000 7f3ca2a00640 1 -- 172.21.15.131:0/3168604618 >> v2:172.21.15.195:3300/0 conn(0x7f3ca406dce0 msgr2=0x7f3ca415faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:32.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.538+0000 7f3ca2a00640 1 --2- 172.21.15.131:0/3168604618 >> v2:172.21.15.195:3300/0 conn(0x7f3ca406dce0 0x7f3ca415faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:32.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.538+0000 7f3ca2a00640 1 -- 172.21.15.131:0/3168604618 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca40ce460 con 0x7f3ca40b0af0 2024-04-25T19:22:32.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.538+0000 7f3ca2a00640 1 -- 172.21.15.131:0/3168604618 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f3c8c001670 con 0x7f3ca40b0af0 2024-04-25T19:22:32.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.538+0000 7f3ca2a00640 1 -- 172.21.15.131:0/3168604618 >> v1:172.21.15.131:6789/0 conn(0x7f3ca40b0af0 legacy=0x7f3ca406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:32.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.538+0000 7f3ca2a00640 1 --2- 172.21.15.131:0/3168604618 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c880039b0 0x7f3c88003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:32.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.538+0000 7f3ca2a00640 1 --2- 172.21.15.131:0/3168604618 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ca40cd9a0 0x7f3c88004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:32.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.538+0000 7f3ca2a00640 1 --2- 172.21.15.131:0/3168604618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c88004d40 0x7f3c88005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:32.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.538+0000 7f3ca2a00640 1 -- 172.21.15.131:0/3168604618 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca40ceab0 con 0x7f3c88004d40 2024-04-25T19:22:32.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.538+0000 7f3ca2a00640 1 -- 172.21.15.131:0/3168604618 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca40ce180 con 0x7f3c880039b0 2024-04-25T19:22:32.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.538+0000 7f3ca2a00640 1 -- 172.21.15.131:0/3168604618 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3c8800b9c0 con 0x7f3ca40cd9a0 2024-04-25T19:22:32.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.539+0000 7f3ca3e00640 1 --2- 172.21.15.131:0/3168604618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c88004d40 0x7f3c88005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:32.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.539+0000 7f3ca3400640 1 --2- 172.21.15.131:0/3168604618 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c880039b0 0x7f3c88003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:32.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.539+0000 7f3c9be00640 1 --2- 172.21.15.131:0/3168604618 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ca40cd9a0 0x7f3c88004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:32.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.539+0000 7f3ca3e00640 1 -- 172.21.15.131:0/3168604618 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ca40cd9a0 msgr2=0x7f3c88004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:32.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.539+0000 7f3ca3e00640 1 --2- 172.21.15.131:0/3168604618 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ca40cd9a0 0x7f3c88004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:32.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.539+0000 7f3ca3e00640 1 -- 172.21.15.131:0/3168604618 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c880039b0 msgr2=0x7f3c88003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:32.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.539+0000 7f3ca3e00640 1 --2- 172.21.15.131:0/3168604618 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c880039b0 0x7f3c88003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:32.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.539+0000 7f3ca3e00640 1 -- 172.21.15.131:0/3168604618 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c88003520 con 0x7f3c88004d40 2024-04-25T19:22:32.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.539+0000 7f3c9be00640 1 --2- 172.21.15.131:0/3168604618 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ca40cd9a0 0x7f3c88004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:32.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.540+0000 7f3ca3e00640 1 --2- 172.21.15.131:0/3168604618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c88004d40 0x7f3c88005150 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4148040 tx=0x7f3c88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22fd8ff0ddf45435 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:32.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.540+0000 7f3ca2a00640 1 -- 172.21.15.131:0/3168604618 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c009c10 con 0x7f3c88004d40 2024-04-25T19:22:32.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.540+0000 7f3ca2a00640 1 -- 172.21.15.131:0/3168604618 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c9c036070 con 0x7f3c88004d40 2024-04-25T19:22:32.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.540+0000 7f3ca2a00640 1 -- 172.21.15.131:0/3168604618 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c031850 con 0x7f3c88004d40 2024-04-25T19:22:32.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.541+0000 7f3caa000640 1 -- 172.21.15.131:0/3168604618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c88004d40 msgr2=0x7f3c88005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:32.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.541+0000 7f3caa000640 1 --2- 172.21.15.131:0/3168604618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c88004d40 0x7f3c88005150 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4148040 tx=0x7f3c88005830 comp rx=0 tx=0).stop 2024-04-25T19:22:32.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.541+0000 7f3ca3e00640 1 -- 172.21.15.131:0/3168604618 reap_dead start 2024-04-25T19:22:32.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.541+0000 7f3caa000640 1 -- 172.21.15.131:0/3168604618 shutdown_connections 2024-04-25T19:22:32.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.541+0000 7f3caa000640 1 -- 172.21.15.131:0/3168604618 >> 172.21.15.131:0/3168604618 conn(0x7f3ca4073090 msgr2=0x7f3ca40734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:32.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.541+0000 7f3caa000640 1 -- 172.21.15.131:0/3168604618 shutdown_connections 2024-04-25T19:22:32.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.541+0000 7f3caa000640 1 -- 172.21.15.131:0/3168604618 wait complete. 2024-04-25T19:22:32.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.544+0000 7f3caa000640 1 Processor -- start 2024-04-25T19:22:32.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.544+0000 7f3caa000640 1 -- start start 2024-04-25T19:22:32.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.545+0000 7f3caa000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c88004d40 0x7f3ca4157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:32.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.545+0000 7f3caa000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ca413c250 0x7f3ca40b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:32.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.545+0000 7f3caa000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ca413c660 0x7f3ca40b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:32.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.545+0000 7f3caa000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca40cef40 con 0x7f3c88004d40 2024-04-25T19:22:32.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.545+0000 7f3caa000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca40b0f00 con 0x7f3ca413c250 2024-04-25T19:22:32.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.545+0000 7f3caa000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3ca40cf0c0 con 0x7f3ca413c660 2024-04-25T19:22:32.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.545+0000 7f3ca3400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c88004d40 0x7f3ca4157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:32.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.546+0000 7f3ca3400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c88004d40 0x7f3ca4157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:60966/0 (socket says 172.21.15.131:60966) 2024-04-25T19:22:32.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.546+0000 7f3ca3400640 1 -- 172.21.15.131:0/55285288 learned_addr learned my addr 172.21.15.131:0/55285288 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:32.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.546+0000 7f3c9be00640 1 --2- 172.21.15.131:0/55285288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ca413c250 0x7f3ca40b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:32.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.546+0000 7f3ca3e00640 1 --2- 172.21.15.131:0/55285288 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ca413c660 0x7f3ca40b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:32.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.546+0000 7f3ca3400640 1 -- 172.21.15.131:0/55285288 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ca413c660 msgr2=0x7f3ca40b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:32.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.546+0000 7f3ca3400640 1 --2- 172.21.15.131:0/55285288 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ca413c660 0x7f3ca40b2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:32.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.546+0000 7f3ca3400640 1 -- 172.21.15.131:0/55285288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ca413c250 msgr2=0x7f3ca40b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:32.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.546+0000 7f3ca3400640 1 --2- 172.21.15.131:0/55285288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ca413c250 0x7f3ca40b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:32.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.546+0000 7f3ca3400640 1 -- 172.21.15.131:0/55285288 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca40b4640 con 0x7f3c88004d40 2024-04-25T19:22:32.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.546+0000 7f3c9be00640 1 --2- 172.21.15.131:0/55285288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ca413c250 0x7f3ca40b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:32.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.546+0000 7f3ca3400640 1 --2- 172.21.15.131:0/55285288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c88004d40 0x7f3ca4157b40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3c94011570 tx=0x7f3c94011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:32.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.546+0000 7f3c9b400640 1 -- 172.21.15.131:0/55285288 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c94015930 con 0x7f3c88004d40 2024-04-25T19:22:32.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.547+0000 7f3c9b400640 1 -- 172.21.15.131:0/55285288 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c94015ad0 con 0x7f3c88004d40 2024-04-25T19:22:32.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.547+0000 7f3c9b400640 1 -- 172.21.15.131:0/55285288 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9400f460 con 0x7f3c88004d40 2024-04-25T19:22:32.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.547+0000 7f3caa000640 1 -- 172.21.15.131:0/55285288 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ca413b570 con 0x7f3c88004d40 2024-04-25T19:22:32.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.547+0000 7f3caa000640 1 -- 172.21.15.131:0/55285288 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ca40b48e0 con 0x7f3c88004d40 2024-04-25T19:22:32.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.548+0000 7f3caa000640 1 -- 172.21.15.131:0/55285288 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ca4050740 con 0x7f3c88004d40 2024-04-25T19:22:32.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.549+0000 7f3c9b400640 1 -- 172.21.15.131:0/55285288 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3c9400f600 con 0x7f3c88004d40 2024-04-25T19:22:32.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.550+0000 7f3c9b400640 1 --2- 172.21.15.131:0/55285288 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3c800744e0 0x7f3c800769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:32.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.550+0000 7f3c9b400640 1 -- 172.21.15.131:0/55285288 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3c94095bf0 con 0x7f3c88004d40 2024-04-25T19:22:32.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.551+0000 7f3c9be00640 1 --2- 172.21.15.131:0/55285288 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3c800744e0 0x7f3c800769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:32.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.552+0000 7f3c9be00640 1 --2- 172.21.15.131:0/55285288 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3c800744e0 0x7f3c800769f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4158b90 tx=0x7f3c8c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:32.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.554+0000 7f3c9b400640 1 -- 172.21.15.131:0/55285288 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3c94019030 con 0x7f3c88004d40 2024-04-25T19:22:32.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.751+0000 7f3caa000640 1 -- 172.21.15.131:0/55285288 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3ca4142b80 con 0x7f3c88004d40 2024-04-25T19:22:32.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.751+0000 7f3c9b400640 1 -- 172.21.15.131:0/55285288 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f3c940602e0 con 0x7f3c88004d40 2024-04-25T19:22:32.753 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-25T19:22:32.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.754+0000 7f3caa000640 1 -- 172.21.15.131:0/55285288 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3c800744e0 msgr2=0x7f3c800769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:32.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.754+0000 7f3caa000640 1 --2- 172.21.15.131:0/55285288 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3c800744e0 0x7f3c800769f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4158b90 tx=0x7f3c8c009040 comp rx=0 tx=0).stop 2024-04-25T19:22:32.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.754+0000 7f3caa000640 1 -- 172.21.15.131:0/55285288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c88004d40 msgr2=0x7f3ca4157b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:32.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.754+0000 7f3caa000640 1 --2- 172.21.15.131:0/55285288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c88004d40 0x7f3ca4157b40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3c94011570 tx=0x7f3c94011a30 comp rx=0 tx=0).stop 2024-04-25T19:22:32.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.754+0000 7f3caa000640 1 -- 172.21.15.131:0/55285288 shutdown_connections 2024-04-25T19:22:32.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.754+0000 7f3caa000640 1 --2- 172.21.15.131:0/55285288 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3c800744e0 0x7f3c800769f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:32.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.754+0000 7f3caa000640 1 --2- 172.21.15.131:0/55285288 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ca413c660 0x7f3ca40b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:32.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.754+0000 7f3caa000640 1 --2- 172.21.15.131:0/55285288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ca413c250 0x7f3ca40b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:32.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.754+0000 7f3caa000640 1 --2- 172.21.15.131:0/55285288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c88004d40 0x7f3ca4157b40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:32.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.754+0000 7f3caa000640 1 -- 172.21.15.131:0/55285288 >> 172.21.15.131:0/55285288 conn(0x7f3ca4073090 msgr2=0x7f3ca406d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:32.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.754+0000 7f3caa000640 1 -- 172.21.15.131:0/55285288 shutdown_connections 2024-04-25T19:22:32.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:32.754+0000 7f3caa000640 1 -- 172.21.15.131:0/55285288 wait complete. 2024-04-25T19:22:32.783 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T19:22:33.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.051+0000 7f6b1dc00640 1 Processor -- start 2024-04-25T19:22:33.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.052+0000 7f6b1dc00640 1 -- start start 2024-04-25T19:22:33.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.054+0000 7f6b1dc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6b181460a0 0x7f6b180ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:33.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.054+0000 7f6b1dc00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6b18145710 0x7f6b18166a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:33.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.054+0000 7f6b1dc00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b18070190 con 0x7f6b180ce610 2024-04-25T19:22:33.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.054+0000 7f6b1dc00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f6b18070470 con 0x7f6b18145710 2024-04-25T19:22:33.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.054+0000 7f6b1dc00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6b18143c20 con 0x7f6b181460a0 2024-04-25T19:22:33.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.054+0000 7f6b0f400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f6b180ce610 0x7f6b180cea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:42282/0 (socket says 172.21.15.131:42282) 2024-04-25T19:22:33.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.054+0000 7f6b0f400640 1 -- 172.21.15.131:0/1470705403 learned_addr learned my addr 172.21.15.131:0/1470705403 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:33.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.055+0000 7f6b17e00640 1 --2- 172.21.15.131:0/1470705403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6b181460a0 0x7f6b180ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:33.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.055+0000 7f6b1d200640 1 --2- 172.21.15.131:0/1470705403 >> v2:172.21.15.195:3300/0 conn(0x7f6b18145710 0x7f6b18166a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:33.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.055+0000 7f6b17400640 1 -- 172.21.15.131:0/1470705403 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2839197001 0 0) 0x7f6b18070190 con 0x7f6b180ce610 2024-04-25T19:22:33.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.055+0000 7f6b17400640 1 -- 172.21.15.131:0/1470705403 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6afc003520 con 0x7f6b180ce610 2024-04-25T19:22:33.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.055+0000 7f6b17400640 1 -- 172.21.15.131:0/1470705403 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4018165321 0 0) 0x7f6afc003520 con 0x7f6b180ce610 2024-04-25T19:22:33.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.055+0000 7f6b17400640 1 -- 172.21.15.131:0/1470705403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6b181460a0 msgr2=0x7f6b180ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:33.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.055+0000 7f6b17400640 1 --2- 172.21.15.131:0/1470705403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6b181460a0 0x7f6b180ce0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:33.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.055+0000 7f6b17400640 1 -- 172.21.15.131:0/1470705403 >> v2:172.21.15.195:3300/0 conn(0x7f6b18145710 msgr2=0x7f6b18166a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:33.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.055+0000 7f6b17400640 1 --2- 172.21.15.131:0/1470705403 >> v2:172.21.15.195:3300/0 conn(0x7f6b18145710 0x7f6b18166a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:33.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.055+0000 7f6b17400640 1 -- 172.21.15.131:0/1470705403 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b18143f00 con 0x7f6b180ce610 2024-04-25T19:22:33.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.055+0000 7f6b17400640 1 -- 172.21.15.131:0/1470705403 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f6b00001670 con 0x7f6b180ce610 2024-04-25T19:22:33.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.055+0000 7f6b17400640 1 -- 172.21.15.131:0/1470705403 >> v1:172.21.15.131:6789/0 conn(0x7f6b180ce610 legacy=0x7f6b180cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:33.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.055+0000 7f6b17400640 1 --2- 172.21.15.131:0/1470705403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6b181460a0 0x7f6afc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:33.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.055+0000 7f6b17400640 1 --2- 172.21.15.131:0/1470705403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6afc003f80 0x7f6afc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:33.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.055+0000 7f6b17400640 1 --2- 172.21.15.131:0/1470705403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6afc004d40 0x7f6afc005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:33.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.055+0000 7f6b17400640 1 -- 172.21.15.131:0/1470705403 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6b18070470 con 0x7f6afc004d40 2024-04-25T19:22:33.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.055+0000 7f6b17400640 1 -- 172.21.15.131:0/1470705403 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6b18143c20 con 0x7f6afc003f80 2024-04-25T19:22:33.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.055+0000 7f6b17400640 1 -- 172.21.15.131:0/1470705403 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6afc00ba70 con 0x7f6b181460a0 2024-04-25T19:22:33.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.056+0000 7f6b1d200640 1 --2- 172.21.15.131:0/1470705403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6afc004d40 0x7f6afc005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:33.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.056+0000 7f6b0f400640 1 --2- 172.21.15.131:0/1470705403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6afc003f80 0x7f6afc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:33.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.056+0000 7f6b1d200640 1 -- 172.21.15.131:0/1470705403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6b181460a0 msgr2=0x7f6afc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:33.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.056+0000 7f6b1d200640 1 --2- 172.21.15.131:0/1470705403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6b181460a0 0x7f6afc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:33.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.056+0000 7f6b1d200640 1 -- 172.21.15.131:0/1470705403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6afc003f80 msgr2=0x7f6afc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:33.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.056+0000 7f6b1d200640 1 --2- 172.21.15.131:0/1470705403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6afc003f80 0x7f6afc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:33.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.056+0000 7f6b1d200640 1 -- 172.21.15.131:0/1470705403 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6afc003520 con 0x7f6afc004d40 2024-04-25T19:22:33.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.057+0000 7f6b1d200640 1 --2- 172.21.15.131:0/1470705403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6afc004d40 0x7f6afc005150 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6b10009f90 tx=0x7f6afc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0940bed4ce8bd78 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:33.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.057+0000 7f6b17400640 1 -- 172.21.15.131:0/1470705403 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b10009c10 con 0x7f6afc004d40 2024-04-25T19:22:33.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.057+0000 7f6b17400640 1 -- 172.21.15.131:0/1470705403 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b10036070 con 0x7f6afc004d40 2024-04-25T19:22:33.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.057+0000 7f6b17400640 1 -- 172.21.15.131:0/1470705403 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b10031840 con 0x7f6afc004d40 2024-04-25T19:22:33.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.058+0000 7f6b1dc00640 1 -- 172.21.15.131:0/1470705403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6afc004d40 msgr2=0x7f6afc005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:33.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.058+0000 7f6b1dc00640 1 --2- 172.21.15.131:0/1470705403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6afc004d40 0x7f6afc005150 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6b10009f90 tx=0x7f6afc005830 comp rx=0 tx=0).stop 2024-04-25T19:22:33.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.058+0000 7f6b1d200640 1 -- 172.21.15.131:0/1470705403 reap_dead start 2024-04-25T19:22:33.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.058+0000 7f6b1dc00640 1 -- 172.21.15.131:0/1470705403 shutdown_connections 2024-04-25T19:22:33.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.058+0000 7f6b1dc00640 1 -- 172.21.15.131:0/1470705403 >> 172.21.15.131:0/1470705403 conn(0x7f6b18072f40 msgr2=0x7f6b18073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:33.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.058+0000 7f6b1dc00640 1 -- 172.21.15.131:0/1470705403 shutdown_connections 2024-04-25T19:22:33.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.058+0000 7f6b1dc00640 1 -- 172.21.15.131:0/1470705403 wait complete. 2024-04-25T19:22:33.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.061+0000 7f6b1dc00640 1 Processor -- start 2024-04-25T19:22:33.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.061+0000 7f6b1dc00640 1 -- start start 2024-04-25T19:22:33.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.063+0000 7f6b1dc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6afc004d40 0x7f6b181f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:33.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.063+0000 7f6b1dc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b180cbcd0 0x7f6b180cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:33.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.063+0000 7f6b1dc00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b181e2f90 0x7f6b181e33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:33.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.063+0000 7f6b1dc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6b180cf2b0 con 0x7f6b180cbcd0 2024-04-25T19:22:33.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.063+0000 7f6b1dc00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6b180cf130 con 0x7f6b181e2f90 2024-04-25T19:22:33.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.063+0000 7f6b1dc00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6b180ce0d0 con 0x7f6afc004d40 2024-04-25T19:22:33.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.063+0000 7f6b0f400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b180cbcd0 0x7f6b180cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:33.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.063+0000 7f6b0f400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b180cbcd0 0x7f6b180cc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:60982/0 (socket says 172.21.15.131:60982) 2024-04-25T19:22:33.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.063+0000 7f6b0f400640 1 -- 172.21.15.131:0/592251589 learned_addr learned my addr 172.21.15.131:0/592251589 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:33.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.063+0000 7f6b1d200640 1 --2- 172.21.15.131:0/592251589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b181e2f90 0x7f6b181e33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:33.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.063+0000 7f6b0f400640 1 -- 172.21.15.131:0/592251589 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6afc004d40 msgr2=0x7f6b181f5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:33.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.063+0000 7f6b17e00640 1 --2- 172.21.15.131:0/592251589 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6afc004d40 0x7f6b181f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:33.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.063+0000 7f6b0f400640 1 --2- 172.21.15.131:0/592251589 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6afc004d40 0x7f6b181f5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:33.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.063+0000 7f6b0f400640 1 -- 172.21.15.131:0/592251589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b181e2f90 msgr2=0x7f6b181e33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:33.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.063+0000 7f6b0f400640 1 --2- 172.21.15.131:0/592251589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b181e2f90 0x7f6b181e33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:33.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.063+0000 7f6b0f400640 1 -- 172.21.15.131:0/592251589 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b181e38e0 con 0x7f6b180cbcd0 2024-04-25T19:22:33.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.063+0000 7f6b1d200640 1 --2- 172.21.15.131:0/592251589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b181e2f90 0x7f6b181e33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:33.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.064+0000 7f6b0f400640 1 --2- 172.21.15.131:0/592251589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b180cbcd0 0x7f6b180cc0e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000e800 tx=0x7f6b0000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:33.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.064+0000 7f6b14c00640 1 -- 172.21.15.131:0/592251589 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0000c8d0 con 0x7f6b180cbcd0 2024-04-25T19:22:33.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.064+0000 7f6b14c00640 1 -- 172.21.15.131:0/592251589 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b00018070 con 0x7f6b180cbcd0 2024-04-25T19:22:33.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.064+0000 7f6b14c00640 1 -- 172.21.15.131:0/592251589 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0000ccd0 con 0x7f6b180cbcd0 2024-04-25T19:22:33.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.064+0000 7f6b1dc00640 1 -- 172.21.15.131:0/592251589 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b180cc890 con 0x7f6b180cbcd0 2024-04-25T19:22:33.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.064+0000 7f6b1dc00640 1 -- 172.21.15.131:0/592251589 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b180cce50 con 0x7f6b180cbcd0 2024-04-25T19:22:33.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.065+0000 7f6b1dc00640 1 -- 172.21.15.131:0/592251589 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b18068f10 con 0x7f6b180cbcd0 2024-04-25T19:22:33.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.066+0000 7f6b14c00640 1 -- 172.21.15.131:0/592251589 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6b0001d460 con 0x7f6b180cbcd0 2024-04-25T19:22:33.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.068+0000 7f6b14c00640 1 --2- 172.21.15.131:0/592251589 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6af40744b0 0x7f6af40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:33.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.068+0000 7f6b14c00640 1 -- 172.21.15.131:0/592251589 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6b000950f0 con 0x7f6b180cbcd0 2024-04-25T19:22:33.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.068+0000 7f6b17e00640 1 --2- 172.21.15.131:0/592251589 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6af40744b0 0x7f6af40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:33.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.069+0000 7f6b17e00640 1 --2- 172.21.15.131:0/592251589 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6af40744b0 0x7f6af40769c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6b08004770 tx=0x7f6b08008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:33.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.073+0000 7f6b14c00640 1 -- 172.21.15.131:0/592251589 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6b18068f10 con 0x7f6b180cbcd0 2024-04-25T19:22:33.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.268+0000 7f6b1dc00640 1 -- 172.21.15.131:0/592251589 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6b180cc620 con 0x7f6b180cbcd0 2024-04-25T19:22:33.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.269+0000 7f6b14c00640 1 -- 172.21.15.131:0/592251589 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f6b181e38e0 con 0x7f6b180cbcd0 2024-04-25T19:22:33.270 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-25T19:22:33.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.271+0000 7f6b1dc00640 1 -- 172.21.15.131:0/592251589 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6af40744b0 msgr2=0x7f6af40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:33.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.271+0000 7f6b1dc00640 1 --2- 172.21.15.131:0/592251589 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6af40744b0 0x7f6af40769c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6b08004770 tx=0x7f6b08008040 comp rx=0 tx=0).stop 2024-04-25T19:22:33.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.271+0000 7f6b1dc00640 1 -- 172.21.15.131:0/592251589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b180cbcd0 msgr2=0x7f6b180cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:33.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.271+0000 7f6b1dc00640 1 --2- 172.21.15.131:0/592251589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b180cbcd0 0x7f6b180cc0e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000e800 tx=0x7f6b0000ecc0 comp rx=0 tx=0).stop 2024-04-25T19:22:33.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.271+0000 7f6b1dc00640 1 -- 172.21.15.131:0/592251589 shutdown_connections 2024-04-25T19:22:33.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.271+0000 7f6b1dc00640 1 --2- 172.21.15.131:0/592251589 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6af40744b0 0x7f6af40769c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:33.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.271+0000 7f6b1dc00640 1 --2- 172.21.15.131:0/592251589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b181e2f90 0x7f6b181e33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:33.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.271+0000 7f6b1dc00640 1 --2- 172.21.15.131:0/592251589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b180cbcd0 0x7f6b180cc0e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:33.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.271+0000 7f6b1dc00640 1 --2- 172.21.15.131:0/592251589 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6afc004d40 0x7f6b181f5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:33.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.271+0000 7f6b1dc00640 1 -- 172.21.15.131:0/592251589 >> 172.21.15.131:0/592251589 conn(0x7f6b18072f40 msgr2=0x7f6b1806c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:33.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.272+0000 7f6b1dc00640 1 -- 172.21.15.131:0/592251589 shutdown_connections 2024-04-25T19:22:33.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.272+0000 7f6b1dc00640 1 -- 172.21.15.131:0/592251589 wait complete. 2024-04-25T19:22:33.298 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T19:22:33.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.567+0000 7f73d1000640 1 Processor -- start 2024-04-25T19:22:33.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.567+0000 7f73d1000640 1 -- start start 2024-04-25T19:22:33.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.570+0000 7f73d1000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f73cc06dce0 0x7f73cc15f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:33.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.570+0000 7f73d1000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f73cc0b0af0 0x7f73cc15faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:33.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.570+0000 7f73d1000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73cc0cdea0 con 0x7f73cc0cd9a0 2024-04-25T19:22:33.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.570+0000 7f73d1000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f73cc0ceab0 con 0x7f73cc0b0af0 2024-04-25T19:22:33.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.570+0000 7f73d1000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f73cc0ce180 con 0x7f73cc06dce0 2024-04-25T19:22:33.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.570+0000 7f73ca800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f73cc0b0af0 0x7f73cc15faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:33.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.570+0000 7f73ca800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f73cc0b0af0 0x7f73cc15faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:60994/0 (socket says 172.21.15.131:60994) 2024-04-25T19:22:33.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.570+0000 7f73ca800640 1 -- 172.21.15.131:0/2014122191 learned_addr learned my addr 172.21.15.131:0/2014122191 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:33.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.571+0000 7f73c1400640 1 --2- 172.21.15.131:0/2014122191 >> v2:172.21.15.195:3300/0 conn(0x7f73cc06dce0 0x7f73cc15f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:33.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.571+0000 7f73ca800640 1 -- 172.21.15.131:0/2014122191 >> v2:172.21.15.195:3300/0 conn(0x7f73cc06dce0 msgr2=0x7f73cc15f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:33.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.571+0000 7f73ca800640 1 --2- 172.21.15.131:0/2014122191 >> v2:172.21.15.195:3300/0 conn(0x7f73cc06dce0 0x7f73cc15f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:33.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.571+0000 7f73ca800640 1 -- 172.21.15.131:0/2014122191 >> v1:172.21.15.195:6789/0 conn(0x7f73cc0cd9a0 legacy=0x7f73cc06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:33.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.571+0000 7f73ca800640 1 -- 172.21.15.131:0/2014122191 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73cc0ce460 con 0x7f73cc0b0af0 2024-04-25T19:22:33.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.572+0000 7f73ca800640 1 --2- 172.21.15.131:0/2014122191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73cc0b0af0 0x7f73cc15faa0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f73cc162f90 tx=0x7f73c402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18bbea014f10c3f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:33.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.572+0000 7f73c9400640 1 -- 172.21.15.131:0/2014122191 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c4036070 con 0x7f73cc0b0af0 2024-04-25T19:22:33.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.573+0000 7f73c9400640 1 -- 172.21.15.131:0/2014122191 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73c4031600 con 0x7f73cc0b0af0 2024-04-25T19:22:33.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.573+0000 7f73c9400640 1 -- 172.21.15.131:0/2014122191 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c40319d0 con 0x7f73cc0b0af0 2024-04-25T19:22:33.575 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.573+0000 7f73d1000640 1 -- 172.21.15.131:0/2014122191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73cc0b0af0 msgr2=0x7f73cc15faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:33.575 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.573+0000 7f73d1000640 1 --2- 172.21.15.131:0/2014122191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73cc0b0af0 0x7f73cc15faa0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f73cc162f90 tx=0x7f73c402a730 comp rx=0 tx=0).stop 2024-04-25T19:22:33.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.573+0000 7f73d1000640 1 -- 172.21.15.131:0/2014122191 shutdown_connections 2024-04-25T19:22:33.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.573+0000 7f73d1000640 1 --2- 172.21.15.131:0/2014122191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73cc0b0af0 0x7f73cc15faa0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:33.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.573+0000 7f73d1000640 1 --2- 172.21.15.131:0/2014122191 >> v2:172.21.15.195:3300/0 conn(0x7f73cc06dce0 0x7f73cc15f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:33.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.573+0000 7f73d1000640 1 -- 172.21.15.131:0/2014122191 >> 172.21.15.131:0/2014122191 conn(0x7f73cc073090 msgr2=0x7f73cc0734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:33.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.573+0000 7f73d1000640 1 -- 172.21.15.131:0/2014122191 shutdown_connections 2024-04-25T19:22:33.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.574+0000 7f73d1000640 1 -- 172.21.15.131:0/2014122191 wait complete. 2024-04-25T19:22:33.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.576+0000 7f73d1000640 1 Processor -- start 2024-04-25T19:22:33.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.576+0000 7f73d1000640 1 -- start start 2024-04-25T19:22:33.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.577+0000 7f73d1000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f73cc0b0af0 0x7f73cc1362f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:33.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.577+0000 7f73d1000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73cc0cd9a0 0x7f73cc137be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:33.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.577+0000 7f73d1000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73cc157ee0 0x7f73cc164870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:33.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.577+0000 7f73d1000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc0cef40 con 0x7f73cc157ee0 2024-04-25T19:22:33.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.577+0000 7f73d1000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc0b0f00 con 0x7f73cc0cd9a0 2024-04-25T19:22:33.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.577+0000 7f73d1000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f73cc0cf0c0 con 0x7f73cc0b0af0 2024-04-25T19:22:33.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.578+0000 7f73ca800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73cc157ee0 0x7f73cc164870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:33.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.578+0000 7f73ca800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73cc157ee0 0x7f73cc164870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:60996/0 (socket says 172.21.15.131:60996) 2024-04-25T19:22:33.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.578+0000 7f73ca800640 1 -- 172.21.15.131:0/3204575479 learned_addr learned my addr 172.21.15.131:0/3204575479 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:33.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.578+0000 7f73c1400640 1 --2- 172.21.15.131:0/3204575479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73cc0cd9a0 0x7f73cc137be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:33.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.578+0000 7f73c9e00640 1 --2- 172.21.15.131:0/3204575479 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f73cc0b0af0 0x7f73cc1362f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:33.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.578+0000 7f73ca800640 1 -- 172.21.15.131:0/3204575479 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f73cc0b0af0 msgr2=0x7f73cc1362f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:33.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.578+0000 7f73ca800640 1 --2- 172.21.15.131:0/3204575479 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f73cc0b0af0 0x7f73cc1362f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:33.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.578+0000 7f73ca800640 1 -- 172.21.15.131:0/3204575479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73cc0cd9a0 msgr2=0x7f73cc137be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:33.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.578+0000 7f73ca800640 1 --2- 172.21.15.131:0/3204575479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73cc0cd9a0 0x7f73cc137be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:33.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.578+0000 7f73ca800640 1 -- 172.21.15.131:0/3204575479 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73cc136e20 con 0x7f73cc157ee0 2024-04-25T19:22:33.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.578+0000 7f73c9e00640 1 --2- 172.21.15.131:0/3204575479 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f73cc0b0af0 0x7f73cc1362f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:33.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.579+0000 7f73ca800640 1 --2- 172.21.15.131:0/3204575479 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73cc157ee0 0x7f73cc164870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f73c402ad20 tx=0x7f73c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:33.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.579+0000 7f73c2a00640 1 -- 172.21.15.131:0/3204575479 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c4036050 con 0x7f73cc157ee0 2024-04-25T19:22:33.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.579+0000 7f73c2a00640 1 -- 172.21.15.131:0/3204575479 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73c4042070 con 0x7f73cc157ee0 2024-04-25T19:22:33.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.579+0000 7f73c2a00640 1 -- 172.21.15.131:0/3204575479 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c4009510 con 0x7f73cc157ee0 2024-04-25T19:22:33.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.579+0000 7f73d1000640 1 -- 172.21.15.131:0/3204575479 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73cc137100 con 0x7f73cc157ee0 2024-04-25T19:22:33.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.579+0000 7f73d1000640 1 -- 172.21.15.131:0/3204575479 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73cc1651f0 con 0x7f73cc157ee0 2024-04-25T19:22:33.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.580+0000 7f73d1000640 1 -- 172.21.15.131:0/3204575479 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73cc050740 con 0x7f73cc157ee0 2024-04-25T19:22:33.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.581+0000 7f73c2a00640 1 -- 172.21.15.131:0/3204575479 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f73c4007bf0 con 0x7f73cc157ee0 2024-04-25T19:22:33.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.583+0000 7f73c2a00640 1 --2- 172.21.15.131:0/3204575479 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f73a80744b0 0x7f73a80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:33.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.583+0000 7f73c2a00640 1 -- 172.21.15.131:0/3204575479 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f73c40b61b0 con 0x7f73cc157ee0 2024-04-25T19:22:33.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.583+0000 7f73c9e00640 1 --2- 172.21.15.131:0/3204575479 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f73a80744b0 0x7f73a80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:33.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.585+0000 7f73c9e00640 1 --2- 172.21.15.131:0/3204575479 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f73a80744b0 0x7f73a80769c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f73bc0015e0 tx=0x7f73bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:33.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.587+0000 7f73c2a00640 1 -- 172.21.15.131:0/3204575479 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f73c40808a0 con 0x7f73cc157ee0 2024-04-25T19:22:33.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.791+0000 7f73d1000640 1 -- 172.21.15.131:0/3204575479 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f73cc158780 con 0x7f73cc157ee0 2024-04-25T19:22:33.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.792+0000 7f73c2a00640 1 -- 172.21.15.131:0/3204575479 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f73c40801a0 con 0x7f73cc157ee0 2024-04-25T19:22:33.793 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 64 2024-04-25T19:22:33.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.794+0000 7f73d1000640 1 -- 172.21.15.131:0/3204575479 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f73a80744b0 msgr2=0x7f73a80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:33.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.794+0000 7f73d1000640 1 --2- 172.21.15.131:0/3204575479 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f73a80744b0 0x7f73a80769c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f73bc0015e0 tx=0x7f73bc009040 comp rx=0 tx=0).stop 2024-04-25T19:22:33.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.794+0000 7f73d1000640 1 -- 172.21.15.131:0/3204575479 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73cc157ee0 msgr2=0x7f73cc164870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:33.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.794+0000 7f73d1000640 1 --2- 172.21.15.131:0/3204575479 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73cc157ee0 0x7f73cc164870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f73c402ad20 tx=0x7f73c4004a40 comp rx=0 tx=0).stop 2024-04-25T19:22:33.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.794+0000 7f73d1000640 1 -- 172.21.15.131:0/3204575479 shutdown_connections 2024-04-25T19:22:33.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.794+0000 7f73d1000640 1 --2- 172.21.15.131:0/3204575479 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f73a80744b0 0x7f73a80769c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:33.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.794+0000 7f73d1000640 1 --2- 172.21.15.131:0/3204575479 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73cc157ee0 0x7f73cc164870 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:33.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.794+0000 7f73d1000640 1 --2- 172.21.15.131:0/3204575479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73cc0cd9a0 0x7f73cc137be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:33.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.794+0000 7f73d1000640 1 --2- 172.21.15.131:0/3204575479 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f73cc0b0af0 0x7f73cc1362f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:33.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.794+0000 7f73d1000640 1 -- 172.21.15.131:0/3204575479 >> 172.21.15.131:0/3204575479 conn(0x7f73cc073090 msgr2=0x7f73cc0b55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:33.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.795+0000 7f73d1000640 1 -- 172.21.15.131:0/3204575479 shutdown_connections 2024-04-25T19:22:33.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:33.795+0000 7f73d1000640 1 -- 172.21.15.131:0/3204575479 wait complete. 2024-04-25T19:22:33.825 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:22:34.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.081+0000 7f6a59e00640 1 Processor -- start 2024-04-25T19:22:34.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.081+0000 7f6a59e00640 1 -- start start 2024-04-25T19:22:34.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.084+0000 7f6a59e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6a5406c5c0 0x7f6a540cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:34.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.084+0000 7f6a59e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6a540b4ea0 0x7f6a5415e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:34.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.084+0000 7f6a59e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a540d1230 con 0x7f6a54144370 2024-04-25T19:22:34.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.084+0000 7f6a59e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f6a540d06b0 con 0x7f6a5406c5c0 2024-04-25T19:22:34.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.084+0000 7f6a59e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6a540d0990 con 0x7f6a540b4ea0 2024-04-25T19:22:34.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.084+0000 7f6a58a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6a5406c5c0 0x7f6a540cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:34.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.084+0000 7f6a58a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6a5406c5c0 0x7f6a540cfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:32772/0 (socket says 172.21.15.131:32772) 2024-04-25T19:22:34.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.084+0000 7f6a58a00640 1 -- 172.21.15.131:0/3502335843 learned_addr learned my addr 172.21.15.131:0/3502335843 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:34.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.084+0000 7f6a53e00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f6a54144370 0x7f6a540b4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:42296/0 (socket says 172.21.15.131:42296) 2024-04-25T19:22:34.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.085+0000 7f6a59400640 1 --2- 172.21.15.131:0/3502335843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6a540b4ea0 0x7f6a5415e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:34.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.085+0000 7f6a58a00640 1 -- 172.21.15.131:0/3502335843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6a540b4ea0 msgr2=0x7f6a5415e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:34.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.085+0000 7f6a58a00640 1 --2- 172.21.15.131:0/3502335843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6a540b4ea0 0x7f6a5415e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:34.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.085+0000 7f6a58a00640 1 -- 172.21.15.131:0/3502335843 >> v1:172.21.15.131:6789/0 conn(0x7f6a54144370 legacy=0x7f6a540b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:34.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.085+0000 7f6a58a00640 1 -- 172.21.15.131:0/3502335843 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a540d0c70 con 0x7f6a5406c5c0 2024-04-25T19:22:34.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.085+0000 7f6a53400640 1 -- 172.21.15.131:0/3502335843 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1364415875 0 0) 0x7f6a540d1230 con 0x7f6a54144370 2024-04-25T19:22:34.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.086+0000 7f6a58a00640 1 --2- 172.21.15.131:0/3502335843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a5406c5c0 0x7f6a540cfa70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6a44009870 tx=0x7f6a4402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5fc75a14b2e6d0c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:34.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.086+0000 7f6a53400640 1 -- 172.21.15.131:0/3502335843 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44037070 con 0x7f6a5406c5c0 2024-04-25T19:22:34.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.086+0000 7f6a53400640 1 -- 172.21.15.131:0/3502335843 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a44032440 con 0x7f6a5406c5c0 2024-04-25T19:22:34.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.086+0000 7f6a53400640 1 -- 172.21.15.131:0/3502335843 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44032810 con 0x7f6a5406c5c0 2024-04-25T19:22:34.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.087+0000 7f6a59e00640 1 -- 172.21.15.131:0/3502335843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a5406c5c0 msgr2=0x7f6a540cfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:34.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.087+0000 7f6a59e00640 1 --2- 172.21.15.131:0/3502335843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a5406c5c0 0x7f6a540cfa70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6a44009870 tx=0x7f6a4402a270 comp rx=0 tx=0).stop 2024-04-25T19:22:34.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.087+0000 7f6a59e00640 1 -- 172.21.15.131:0/3502335843 shutdown_connections 2024-04-25T19:22:34.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.087+0000 7f6a59e00640 1 --2- 172.21.15.131:0/3502335843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6a540b4ea0 0x7f6a5415e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:34.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.087+0000 7f6a59e00640 1 --2- 172.21.15.131:0/3502335843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a5406c5c0 0x7f6a540cfa70 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:34.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.087+0000 7f6a59e00640 1 -- 172.21.15.131:0/3502335843 >> 172.21.15.131:0/3502335843 conn(0x7f6a540d1720 msgr2=0x7f6a540d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:34.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.087+0000 7f6a59e00640 1 -- 172.21.15.131:0/3502335843 shutdown_connections 2024-04-25T19:22:34.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.087+0000 7f6a59e00640 1 -- 172.21.15.131:0/3502335843 wait complete. 2024-04-25T19:22:34.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.090+0000 7f6a59e00640 1 Processor -- start 2024-04-25T19:22:34.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.090+0000 7f6a59e00640 1 -- start start 2024-04-25T19:22:34.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.091+0000 7f6a59e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a5406c5c0 0x7f6a54140540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:34.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.091+0000 7f6a59e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6a54144370 0x7f6a5413e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:34.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.091+0000 7f6a59e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a540aefd0 0x7f6a540701b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:34.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.091+0000 7f6a59e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6a540d0450 con 0x7f6a540aefd0 2024-04-25T19:22:34.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.091+0000 7f6a59e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6a540d02d0 con 0x7f6a5406c5c0 2024-04-25T19:22:34.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.091+0000 7f6a59e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6a54147760 con 0x7f6a54144370 2024-04-25T19:22:34.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.092+0000 7f6a59400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a540aefd0 0x7f6a540701b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:34.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.092+0000 7f6a59400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a540aefd0 0x7f6a540701b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:32780/0 (socket says 172.21.15.131:32780) 2024-04-25T19:22:34.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.092+0000 7f6a59400640 1 -- 172.21.15.131:0/1230985445 learned_addr learned my addr 172.21.15.131:0/1230985445 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:34.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.092+0000 7f6a58a00640 1 --2- 172.21.15.131:0/1230985445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a5406c5c0 0x7f6a54140540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:34.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.092+0000 7f6a53e00640 1 --2- 172.21.15.131:0/1230985445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6a54144370 0x7f6a5413e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:34.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.092+0000 7f6a59400640 1 -- 172.21.15.131:0/1230985445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6a54144370 msgr2=0x7f6a5413e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:34.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.092+0000 7f6a59400640 1 --2- 172.21.15.131:0/1230985445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6a54144370 0x7f6a5413e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:34.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.092+0000 7f6a59400640 1 -- 172.21.15.131:0/1230985445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a5406c5c0 msgr2=0x7f6a54140540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:34.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.092+0000 7f6a59400640 1 --2- 172.21.15.131:0/1230985445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a5406c5c0 0x7f6a54140540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:34.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.092+0000 7f6a59400640 1 -- 172.21.15.131:0/1230985445 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a540af6e0 con 0x7f6a540aefd0 2024-04-25T19:22:34.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.092+0000 7f6a58a00640 1 --2- 172.21.15.131:0/1230985445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a5406c5c0 0x7f6a54140540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:34.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.092+0000 7f6a59400640 1 --2- 172.21.15.131:0/1230985445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a540aefd0 0x7f6a540701b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c007e90 tx=0x7f6a4c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:34.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.093+0000 7f6a50c00640 1 -- 172.21.15.131:0/1230985445 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c014420 con 0x7f6a540aefd0 2024-04-25T19:22:34.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.093+0000 7f6a50c00640 1 -- 172.21.15.131:0/1230985445 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a4c019070 con 0x7f6a540aefd0 2024-04-25T19:22:34.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.093+0000 7f6a50c00640 1 -- 172.21.15.131:0/1230985445 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c014800 con 0x7f6a540aefd0 2024-04-25T19:22:34.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.093+0000 7f6a59e00640 1 -- 172.21.15.131:0/1230985445 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a540af9c0 con 0x7f6a540aefd0 2024-04-25T19:22:34.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.093+0000 7f6a59e00640 1 -- 172.21.15.131:0/1230985445 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a540aff80 con 0x7f6a540aefd0 2024-04-25T19:22:34.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.094+0000 7f6a59e00640 1 -- 172.21.15.131:0/1230985445 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a54050740 con 0x7f6a540aefd0 2024-04-25T19:22:34.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.095+0000 7f6a50c00640 1 -- 172.21.15.131:0/1230985445 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6a4c0149a0 con 0x7f6a540aefd0 2024-04-25T19:22:34.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.096+0000 7f6a50c00640 1 --2- 172.21.15.131:0/1230985445 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6a340744e0 0x7f6a340769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:34.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.096+0000 7f6a50c00640 1 -- 172.21.15.131:0/1230985445 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6a4c095a40 con 0x7f6a540aefd0 2024-04-25T19:22:34.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.096+0000 7f6a58a00640 1 --2- 172.21.15.131:0/1230985445 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6a340744e0 0x7f6a340769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:34.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.098+0000 7f6a58a00640 1 --2- 172.21.15.131:0/1230985445 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6a340744e0 0x7f6a340769f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6a44034000 tx=0x7f6a4402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:34.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.100+0000 7f6a50c00640 1 -- 172.21.15.131:0/1230985445 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6a4c05fc10 con 0x7f6a540aefd0 2024-04-25T19:22:34.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.328+0000 7f6a59e00640 1 -- 172.21.15.131:0/1230985445 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a540b13e0 con 0x7f6a540aefd0 2024-04-25T19:22:34.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.329+0000 7f6a50c00640 1 -- 172.21.15.131:0/1230985445 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5187 (secure 0 0 0) 0x7f6a4c063f10 con 0x7f6a540aefd0 2024-04-25T19:22:34.331 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:34.331 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/1570319410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":1570319410},{"type":"v1","addr":"172.21.15.195:6837","nonce":1570319410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/4072860882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4072860882},{"type":"v1","addr":"172.21.15.131:6834","nonce":4072860882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2207155444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2207155444},{"type":"v1","addr":"172.21.15.131:6835","nonce":2207155444}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T19:22:16.578438+0000","modified":"2024-04-25T19:22:19.648009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6836/1898121552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1898121552},{"type":"v1","addr":"172.21.15.195:6836","nonce":1898121552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T19:22:34.331 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 8 2024-04-25T19:22:34.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.331+0000 7f6a59e00640 1 -- 172.21.15.131:0/1230985445 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6a340744e0 msgr2=0x7f6a340769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:34.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.331+0000 7f6a59e00640 1 --2- 172.21.15.131:0/1230985445 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6a340744e0 0x7f6a340769f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6a44034000 tx=0x7f6a4402e000 comp rx=0 tx=0).stop 2024-04-25T19:22:34.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.332+0000 7f6a59e00640 1 -- 172.21.15.131:0/1230985445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a540aefd0 msgr2=0x7f6a540701b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:34.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.332+0000 7f6a59e00640 1 --2- 172.21.15.131:0/1230985445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a540aefd0 0x7f6a540701b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c007e90 tx=0x7f6a4c00e4b0 comp rx=0 tx=0).stop 2024-04-25T19:22:34.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.332+0000 7f6a59e00640 1 -- 172.21.15.131:0/1230985445 shutdown_connections 2024-04-25T19:22:34.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.332+0000 7f6a59e00640 1 --2- 172.21.15.131:0/1230985445 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6a340744e0 0x7f6a340769f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:34.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.332+0000 7f6a59e00640 1 --2- 172.21.15.131:0/1230985445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6a54144370 0x7f6a5413e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:34.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.332+0000 7f6a59e00640 1 --2- 172.21.15.131:0/1230985445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a540aefd0 0x7f6a540701b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:34.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.332+0000 7f6a59e00640 1 --2- 172.21.15.131:0/1230985445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a5406c5c0 0x7f6a54140540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:34.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.332+0000 7f6a59e00640 1 -- 172.21.15.131:0/1230985445 >> 172.21.15.131:0/1230985445 conn(0x7f6a540d1720 msgr2=0x7f6a5415e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:34.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.332+0000 7f6a59e00640 1 -- 172.21.15.131:0/1230985445 shutdown_connections 2024-04-25T19:22:34.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.332+0000 7f6a59e00640 1 -- 172.21.15.131:0/1230985445 wait complete. 2024-04-25T19:22:34.358 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:22:34.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.624+0000 7f1d21a00640 1 Processor -- start 2024-04-25T19:22:34.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.625+0000 7f1d21a00640 1 -- start start 2024-04-25T19:22:34.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.627+0000 7f1d21a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d1c06c5c0 0x7f1d1c0cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:34.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.627+0000 7f1d21a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1d1c144370 0x7f1d1c0b4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:34.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.627+0000 7f1d21a00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d1c0b50e0 con 0x7f1d1c0b4cd0 2024-04-25T19:22:34.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.627+0000 7f1d21a00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f1d1c0d1230 con 0x7f1d1c144370 2024-04-25T19:22:34.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.627+0000 7f1d21a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1d1c0d06b0 con 0x7f1d1c06c5c0 2024-04-25T19:22:34.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.627+0000 7f1d13e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1d1c144370 0x7f1d1c0b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:34.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.627+0000 7f1d13e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1d1c144370 0x7f1d1c0b4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:32788/0 (socket says 172.21.15.131:32788) 2024-04-25T19:22:34.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.627+0000 7f1d13e00640 1 -- 172.21.15.131:0/3750586077 learned_addr learned my addr 172.21.15.131:0/3750586077 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:34.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.627+0000 7f1d21000640 1 --1- 172.21.15.131:0/3750586077 >> v1:172.21.15.131:6789/0 conn(0x7f1d1c0b4cd0 0x7f1d1c161a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:42300/0 (socket says 172.21.15.131:42300) 2024-04-25T19:22:34.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.628+0000 7f1d1be00640 1 --2- 172.21.15.131:0/3750586077 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d1c06c5c0 0x7f1d1c0cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:34.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.628+0000 7f1d13e00640 1 -- 172.21.15.131:0/3750586077 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d1c06c5c0 msgr2=0x7f1d1c0cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:34.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.628+0000 7f1d13e00640 1 --2- 172.21.15.131:0/3750586077 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d1c06c5c0 0x7f1d1c0cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:34.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.628+0000 7f1d13e00640 1 -- 172.21.15.131:0/3750586077 >> v1:172.21.15.131:6789/0 conn(0x7f1d1c0b4cd0 legacy=0x7f1d1c161a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:34.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.628+0000 7f1d13e00640 1 -- 172.21.15.131:0/3750586077 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1c0d0990 con 0x7f1d1c144370 2024-04-25T19:22:34.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.629+0000 7f1d13e00640 1 --2- 172.21.15.131:0/3750586077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d1c144370 0x7f1d1c0b4790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1d04009870 tx=0x7f1d0402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f4edd8ee848cf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:34.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.629+0000 7f1d1b400640 1 -- 172.21.15.131:0/3750586077 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d04037070 con 0x7f1d1c144370 2024-04-25T19:22:34.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.629+0000 7f1d1b400640 1 -- 172.21.15.131:0/3750586077 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d04032440 con 0x7f1d1c144370 2024-04-25T19:22:34.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.629+0000 7f1d1b400640 1 -- 172.21.15.131:0/3750586077 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d04032810 con 0x7f1d1c144370 2024-04-25T19:22:34.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.630+0000 7f1d21a00640 1 -- 172.21.15.131:0/3750586077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d1c144370 msgr2=0x7f1d1c0b4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:34.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.630+0000 7f1d21a00640 1 --2- 172.21.15.131:0/3750586077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d1c144370 0x7f1d1c0b4790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1d04009870 tx=0x7f1d0402a250 comp rx=0 tx=0).stop 2024-04-25T19:22:34.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.630+0000 7f1d21a00640 1 -- 172.21.15.131:0/3750586077 shutdown_connections 2024-04-25T19:22:34.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.630+0000 7f1d21a00640 1 --2- 172.21.15.131:0/3750586077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d1c144370 0x7f1d1c0b4790 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:34.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.630+0000 7f1d21a00640 1 --2- 172.21.15.131:0/3750586077 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d1c06c5c0 0x7f1d1c0cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:34.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.630+0000 7f1d21a00640 1 -- 172.21.15.131:0/3750586077 >> 172.21.15.131:0/3750586077 conn(0x7f1d1c0d1720 msgr2=0x7f1d1c0d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:34.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.630+0000 7f1d21a00640 1 -- 172.21.15.131:0/3750586077 shutdown_connections 2024-04-25T19:22:34.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.630+0000 7f1d21a00640 1 -- 172.21.15.131:0/3750586077 wait complete. 2024-04-25T19:22:34.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.632+0000 7f1d21a00640 1 Processor -- start 2024-04-25T19:22:34.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.633+0000 7f1d21a00640 1 -- start start 2024-04-25T19:22:34.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.634+0000 7f1d21a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d1c06c5c0 0x7f1d1c1581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:34.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.634+0000 7f1d21a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d1c0b4cd0 0x7f1d1c1596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:34.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.634+0000 7f1d21a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d1c144370 0x7f1d1c15ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:34.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.634+0000 7f1d21a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c0d02d0 con 0x7f1d1c144370 2024-04-25T19:22:34.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.634+0000 7f1d21a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c0d0f50 con 0x7f1d1c06c5c0 2024-04-25T19:22:34.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.634+0000 7f1d21a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1d1c0d0450 con 0x7f1d1c0b4cd0 2024-04-25T19:22:34.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.634+0000 7f1d21000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d1c144370 0x7f1d1c15ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:34.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.634+0000 7f1d21000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d1c144370 0x7f1d1c15ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:32800/0 (socket says 172.21.15.131:32800) 2024-04-25T19:22:34.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.634+0000 7f1d21000640 1 -- 172.21.15.131:0/1236386822 learned_addr learned my addr 172.21.15.131:0/1236386822 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:34.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.635+0000 7f1d13e00640 1 --2- 172.21.15.131:0/1236386822 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d1c0b4cd0 0x7f1d1c1596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:34.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.635+0000 7f1d1be00640 1 --2- 172.21.15.131:0/1236386822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d1c06c5c0 0x7f1d1c1581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:34.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.635+0000 7f1d21000640 1 -- 172.21.15.131:0/1236386822 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d1c0b4cd0 msgr2=0x7f1d1c1596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:34.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.635+0000 7f1d21000640 1 --2- 172.21.15.131:0/1236386822 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d1c0b4cd0 0x7f1d1c1596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:34.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.635+0000 7f1d21000640 1 -- 172.21.15.131:0/1236386822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d1c06c5c0 msgr2=0x7f1d1c1581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:34.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.635+0000 7f1d21000640 1 --2- 172.21.15.131:0/1236386822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d1c06c5c0 0x7f1d1c1581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:34.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.635+0000 7f1d21000640 1 -- 172.21.15.131:0/1236386822 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1c15a420 con 0x7f1d1c144370 2024-04-25T19:22:34.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.635+0000 7f1d21000640 1 --2- 172.21.15.131:0/1236386822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d1c144370 0x7f1d1c15ae20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1d1400c6f0 tx=0x7f1d1400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:34.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.635+0000 7f1d18c00640 1 -- 172.21.15.131:0/1236386822 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d14017070 con 0x7f1d1c144370 2024-04-25T19:22:34.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.635+0000 7f1d18c00640 1 -- 172.21.15.131:0/1236386822 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d14005da0 con 0x7f1d1c144370 2024-04-25T19:22:34.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.635+0000 7f1d21a00640 1 -- 172.21.15.131:0/1236386822 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d1c15a700 con 0x7f1d1c144370 2024-04-25T19:22:34.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.635+0000 7f1d18c00640 1 -- 172.21.15.131:0/1236386822 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d1400a840 con 0x7f1d1c144370 2024-04-25T19:22:34.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.636+0000 7f1d21a00640 1 -- 172.21.15.131:0/1236386822 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d1c0cae90 con 0x7f1d1c144370 2024-04-25T19:22:34.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.637+0000 7f1d21a00640 1 -- 172.21.15.131:0/1236386822 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d1c0cfdc0 con 0x7f1d1c144370 2024-04-25T19:22:34.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.638+0000 7f1d18c00640 1 -- 172.21.15.131:0/1236386822 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1d1401a070 con 0x7f1d1c144370 2024-04-25T19:22:34.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.639+0000 7f1d18c00640 1 --2- 172.21.15.131:0/1236386822 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1cf80744e0 0x7f1cf80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:34.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.639+0000 7f1d18c00640 1 -- 172.21.15.131:0/1236386822 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1d14094740 con 0x7f1d1c144370 2024-04-25T19:22:34.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.639+0000 7f1d1be00640 1 --2- 172.21.15.131:0/1236386822 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1cf80744e0 0x7f1cf80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:34.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.641+0000 7f1d1be00640 1 --2- 172.21.15.131:0/1236386822 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1cf80744e0 0x7f1cf80769f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c006fd0 tx=0x7f1d0c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:34.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.644+0000 7f1d18c00640 1 -- 172.21.15.131:0/1236386822 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1d1c0b50e0 con 0x7f1d1c144370 2024-04-25T19:22:34.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.843+0000 7f1d21a00640 1 -- 172.21.15.131:0/1236386822 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d1c050740 con 0x7f1d1c144370 2024-04-25T19:22:34.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.846+0000 7f1d18c00640 1 -- 172.21.15.131:0/1236386822 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16629 (secure 0 0 0) 0x7f1d1405e880 con 0x7f1d1c144370 2024-04-25T19:22:34.848 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:34.848 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":20,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:22:18.057809+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:22:14.779716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T19:22:15.552027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:22:34.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.849+0000 7f1d21a00640 1 -- 172.21.15.131:0/1236386822 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1cf80744e0 msgr2=0x7f1cf80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:34.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.849+0000 7f1d21a00640 1 --2- 172.21.15.131:0/1236386822 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1cf80744e0 0x7f1cf80769f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c006fd0 tx=0x7f1d0c008040 comp rx=0 tx=0).stop 2024-04-25T19:22:34.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.849+0000 7f1d21a00640 1 -- 172.21.15.131:0/1236386822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d1c144370 msgr2=0x7f1d1c15ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:34.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.849+0000 7f1d21a00640 1 --2- 172.21.15.131:0/1236386822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d1c144370 0x7f1d1c15ae20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1d1400c6f0 tx=0x7f1d1400cbb0 comp rx=0 tx=0).stop 2024-04-25T19:22:34.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.849+0000 7f1d21a00640 1 -- 172.21.15.131:0/1236386822 shutdown_connections 2024-04-25T19:22:34.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.849+0000 7f1d21a00640 1 --2- 172.21.15.131:0/1236386822 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1cf80744e0 0x7f1cf80769f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:34.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.849+0000 7f1d21a00640 1 --2- 172.21.15.131:0/1236386822 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d1c0b4cd0 0x7f1d1c1596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:34.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.849+0000 7f1d21a00640 1 --2- 172.21.15.131:0/1236386822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d1c144370 0x7f1d1c15ae20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:34.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.849+0000 7f1d21a00640 1 --2- 172.21.15.131:0/1236386822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d1c06c5c0 0x7f1d1c1581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:34.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.849+0000 7f1d21a00640 1 -- 172.21.15.131:0/1236386822 >> 172.21.15.131:0/1236386822 conn(0x7f1d1c0d1720 msgr2=0x7f1d1c06c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:34.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.849+0000 7f1d21a00640 1 -- 172.21.15.131:0/1236386822 shutdown_connections 2024-04-25T19:22:34.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:34.849+0000 7f1d21a00640 1 -- 172.21.15.131:0/1236386822 wait complete. 2024-04-25T19:22:34.878 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:22:35.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.140+0000 7fa507200640 1 Processor -- start 2024-04-25T19:22:35.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.140+0000 7fa507200640 1 -- start start 2024-04-25T19:22:35.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.142+0000 7fa507200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa5000d50e0 0x7fa5000d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:35.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.142+0000 7fa507200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa500160d60 0x7fa500161810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:35.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.142+0000 7fa507200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5000b7940 con 0x7fa5000d2ae0 2024-04-25T19:22:35.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.142+0000 7fa507200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa5000d2ef0 con 0x7fa500160d60 2024-04-25T19:22:35.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.142+0000 7fa507200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fa500161280 con 0x7fa5000d50e0 2024-04-25T19:22:35.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.142+0000 7fa506800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa500160d60 0x7fa500161810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:35.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.142+0000 7fa505400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fa5000d2ae0 0x7fa500160650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:42308/0 (socket says 172.21.15.131:42308) 2024-04-25T19:22:35.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.142+0000 7fa505400640 1 -- 172.21.15.131:0/2181470430 learned_addr learned my addr 172.21.15.131:0/2181470430 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:35.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.142+0000 7fa505e00640 1 --2- 172.21.15.131:0/2181470430 >> v2:172.21.15.195:3300/0 conn(0x7fa5000d50e0 0x7fa5000d25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:35.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.143+0000 7fa506800640 1 -- 172.21.15.131:0/2181470430 >> v2:172.21.15.195:3300/0 conn(0x7fa5000d50e0 msgr2=0x7fa5000d25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:35.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.143+0000 7fa506800640 1 --2- 172.21.15.131:0/2181470430 >> v2:172.21.15.195:3300/0 conn(0x7fa5000d50e0 0x7fa5000d25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:35.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.143+0000 7fa506800640 1 -- 172.21.15.131:0/2181470430 >> v1:172.21.15.131:6789/0 conn(0x7fa5000d2ae0 legacy=0x7fa500160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:35.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.143+0000 7fa506800640 1 -- 172.21.15.131:0/2181470430 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5000d4600 con 0x7fa500160d60 2024-04-25T19:22:35.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.143+0000 7fa505e00640 1 --2- 172.21.15.131:0/2181470430 >> v2:172.21.15.195:3300/0 conn(0x7fa5000d50e0 0x7fa5000d25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T19:22:35.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.144+0000 7fa506800640 1 --2- 172.21.15.131:0/2181470430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa500160d60 0x7fa500161810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa5000d6cc0 tx=0x7fa4fc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f766146d3ff9c00f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:35.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.144+0000 7fa504a00640 1 -- 172.21.15.131:0/2181470430 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc007740 con 0x7fa500160d60 2024-04-25T19:22:35.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.144+0000 7fa504a00640 1 -- 172.21.15.131:0/2181470430 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4fc0078e0 con 0x7fa500160d60 2024-04-25T19:22:35.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.144+0000 7fa504a00640 1 -- 172.21.15.131:0/2181470430 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc007cb0 con 0x7fa500160d60 2024-04-25T19:22:35.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.145+0000 7fa507200640 1 -- 172.21.15.131:0/2181470430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa500160d60 msgr2=0x7fa500161810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:35.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.145+0000 7fa507200640 1 --2- 172.21.15.131:0/2181470430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa500160d60 0x7fa500161810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa5000d6cc0 tx=0x7fa4fc02a680 comp rx=0 tx=0).stop 2024-04-25T19:22:35.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.145+0000 7fa507200640 1 -- 172.21.15.131:0/2181470430 shutdown_connections 2024-04-25T19:22:35.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.145+0000 7fa507200640 1 --2- 172.21.15.131:0/2181470430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa500160d60 0x7fa500161810 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:35.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.145+0000 7fa507200640 1 --2- 172.21.15.131:0/2181470430 >> v2:172.21.15.195:3300/0 conn(0x7fa5000d50e0 0x7fa5000d25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:35.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.145+0000 7fa507200640 1 -- 172.21.15.131:0/2181470430 >> 172.21.15.131:0/2181470430 conn(0x7fa50006c5c0 msgr2=0x7fa50006c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:35.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.145+0000 7fa507200640 1 -- 172.21.15.131:0/2181470430 shutdown_connections 2024-04-25T19:22:35.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.145+0000 7fa507200640 1 -- 172.21.15.131:0/2181470430 wait complete. 2024-04-25T19:22:35.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.147+0000 7fa507200640 1 Processor -- start 2024-04-25T19:22:35.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.147+0000 7fa507200640 1 -- start start 2024-04-25T19:22:35.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.149+0000 7fa507200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5000d2ae0 0x7fa500159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:35.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.149+0000 7fa507200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5000d50e0 0x7fa5001f9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:35.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.149+0000 7fa507200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa500160d60 0x7fa5001fa530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:35.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.149+0000 7fa507200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa500161560 con 0x7fa500160d60 2024-04-25T19:22:35.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.149+0000 7fa507200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa5000d4bc0 con 0x7fa5000d50e0 2024-04-25T19:22:35.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.149+0000 7fa507200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa5000d54f0 con 0x7fa5000d2ae0 2024-04-25T19:22:35.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.149+0000 7fa506800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa500160d60 0x7fa5001fa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:35.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.149+0000 7fa506800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa500160d60 0x7fa5001fa530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:32818/0 (socket says 172.21.15.131:32818) 2024-04-25T19:22:35.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.149+0000 7fa506800640 1 -- 172.21.15.131:0/1257256643 learned_addr learned my addr 172.21.15.131:0/1257256643 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:35.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.149+0000 7fa505400640 1 --2- 172.21.15.131:0/1257256643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5000d50e0 0x7fa5001f9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:35.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.149+0000 7fa505e00640 1 --2- 172.21.15.131:0/1257256643 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5000d2ae0 0x7fa500159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:35.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.150+0000 7fa506800640 1 -- 172.21.15.131:0/1257256643 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5000d2ae0 msgr2=0x7fa500159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:35.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.150+0000 7fa506800640 1 --2- 172.21.15.131:0/1257256643 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5000d2ae0 0x7fa500159e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:35.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.150+0000 7fa506800640 1 -- 172.21.15.131:0/1257256643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5000d50e0 msgr2=0x7fa5001f9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:35.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.150+0000 7fa506800640 1 --2- 172.21.15.131:0/1257256643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5000d50e0 0x7fa5001f9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:35.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.150+0000 7fa506800640 1 -- 172.21.15.131:0/1257256643 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5001e8ad0 con 0x7fa500160d60 2024-04-25T19:22:35.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.150+0000 7fa505400640 1 --2- 172.21.15.131:0/1257256643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5000d50e0 0x7fa5001f9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:35.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.150+0000 7fa506800640 1 --2- 172.21.15.131:0/1257256643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa500160d60 0x7fa5001fa530 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc009e50 tx=0x7fa4fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:35.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.150+0000 7fa4fa000640 1 -- 172.21.15.131:0/1257256643 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc03f070 con 0x7fa500160d60 2024-04-25T19:22:35.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.150+0000 7fa4fa000640 1 -- 172.21.15.131:0/1257256643 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4fc031c90 con 0x7fa500160d60 2024-04-25T19:22:35.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.150+0000 7fa4fa000640 1 -- 172.21.15.131:0/1257256643 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc043650 con 0x7fa500160d60 2024-04-25T19:22:35.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.150+0000 7fa507200640 1 -- 172.21.15.131:0/1257256643 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5001e8db0 con 0x7fa500160d60 2024-04-25T19:22:35.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.150+0000 7fa507200640 1 -- 172.21.15.131:0/1257256643 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5001e9370 con 0x7fa500160d60 2024-04-25T19:22:35.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.151+0000 7fa507200640 1 -- 172.21.15.131:0/1257256643 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa500050740 con 0x7fa500160d60 2024-04-25T19:22:35.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.153+0000 7fa4fa000640 1 -- 172.21.15.131:0/1257256643 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa4fc03b410 con 0x7fa500160d60 2024-04-25T19:22:35.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.153+0000 7fa4fa000640 1 --2- 172.21.15.131:0/1257256643 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa4e40744e0 0x7fa4e40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:35.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.154+0000 7fa4fa000640 1 -- 172.21.15.131:0/1257256643 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa4fc0b6240 con 0x7fa500160d60 2024-04-25T19:22:35.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.154+0000 7fa505e00640 1 --2- 172.21.15.131:0/1257256643 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa4e40744e0 0x7fa4e40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:35.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.155+0000 7fa505e00640 1 --2- 172.21.15.131:0/1257256643 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa4e40744e0 0x7fa4e40769f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa4f40096d0 tx=0x7fa4f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:35.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.158+0000 7fa4fa000640 1 -- 172.21.15.131:0/1257256643 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa4fc080a60 con 0x7fa500160d60 2024-04-25T19:22:35.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.393+0000 7fa507200640 1 -- 172.21.15.131:0/1257256643 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5001fab50 con 0x7fa500160d60 2024-04-25T19:22:35.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.395+0000 7fa4fa000640 1 -- 172.21.15.131:0/1257256643 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5187 (secure 0 0 0) 0x7fa4fc080360 con 0x7fa500160d60 2024-04-25T19:22:35.397 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:35.397 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/1570319410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":1570319410},{"type":"v1","addr":"172.21.15.195:6837","nonce":1570319410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/4072860882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4072860882},{"type":"v1","addr":"172.21.15.131:6834","nonce":4072860882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2207155444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2207155444},{"type":"v1","addr":"172.21.15.131:6835","nonce":2207155444}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T19:22:16.578438+0000","modified":"2024-04-25T19:22:19.648009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6836/1898121552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1898121552},{"type":"v1","addr":"172.21.15.195:6836","nonce":1898121552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T19:22:35.397 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 8 2024-04-25T19:22:35.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.397+0000 7fa507200640 1 -- 172.21.15.131:0/1257256643 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa4e40744e0 msgr2=0x7fa4e40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:35.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.397+0000 7fa507200640 1 --2- 172.21.15.131:0/1257256643 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa4e40744e0 0x7fa4e40769f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa4f40096d0 tx=0x7fa4f4008040 comp rx=0 tx=0).stop 2024-04-25T19:22:35.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.397+0000 7fa507200640 1 -- 172.21.15.131:0/1257256643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa500160d60 msgr2=0x7fa5001fa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:35.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.397+0000 7fa507200640 1 --2- 172.21.15.131:0/1257256643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa500160d60 0x7fa5001fa530 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc009e50 tx=0x7fa4fc004a40 comp rx=0 tx=0).stop 2024-04-25T19:22:35.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.397+0000 7fa507200640 1 -- 172.21.15.131:0/1257256643 shutdown_connections 2024-04-25T19:22:35.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.397+0000 7fa507200640 1 --2- 172.21.15.131:0/1257256643 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa4e40744e0 0x7fa4e40769f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:35.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.397+0000 7fa507200640 1 --2- 172.21.15.131:0/1257256643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa500160d60 0x7fa5001fa530 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:35.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.397+0000 7fa507200640 1 --2- 172.21.15.131:0/1257256643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5000d50e0 0x7fa5001f9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:35.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.397+0000 7fa507200640 1 --2- 172.21.15.131:0/1257256643 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5000d2ae0 0x7fa500159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:35.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.397+0000 7fa507200640 1 -- 172.21.15.131:0/1257256643 >> 172.21.15.131:0/1257256643 conn(0x7fa50006c5c0 msgr2=0x7fa50015f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:35.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.398+0000 7fa507200640 1 -- 172.21.15.131:0/1257256643 shutdown_connections 2024-04-25T19:22:35.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:35.398+0000 7fa507200640 1 -- 172.21.15.131:0/1257256643 wait complete. 2024-04-25T19:22:35.783 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:22:35.790 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:22:35.825 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T19:22:16.578438+0000', 'modified': '2024-04-25T19:22:19.648009+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.195:6836/1898121552', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6834', 'nonce': 1898121552}, {'type': 'v1', 'addr': '172.21.15.195:6836', 'nonce': 1898121552}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4285, 'qdb_cluster': [4285]} 2024-04-25T19:22:35.825 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T19:22:35.825 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T19:22:36.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.098+0000 7fdc41c00640 1 Processor -- start 2024-04-25T19:22:36.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.098+0000 7fdc41c00640 1 -- start start 2024-04-25T19:22:36.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.100+0000 7fdc41c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdc3c06c5c0 0x7fdc3c0cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:36.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.100+0000 7fdc41c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdc3c0b4ea0 0x7fdc3c15e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:36.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.100+0000 7fdc41c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc3c0d1230 con 0x7fdc3c144370 2024-04-25T19:22:36.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.100+0000 7fdc41c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fdc3c0d06b0 con 0x7fdc3c06c5c0 2024-04-25T19:22:36.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.100+0000 7fdc41c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdc3c0d0990 con 0x7fdc3c0b4ea0 2024-04-25T19:22:36.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.100+0000 7fdc3be00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdc3c06c5c0 0x7fdc3c0cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:36.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.101+0000 7fdc3be00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdc3c06c5c0 0x7fdc3c0cfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:32824/0 (socket says 172.21.15.131:32824) 2024-04-25T19:22:36.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.101+0000 7fdc3be00640 1 -- 172.21.15.131:0/4021526080 learned_addr learned my addr 172.21.15.131:0/4021526080 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:36.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.101+0000 7fdc41200640 1 --2- 172.21.15.131:0/4021526080 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdc3c0b4ea0 0x7fdc3c15e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:36.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.101+0000 7fdc3be00640 1 -- 172.21.15.131:0/4021526080 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdc3c0b4ea0 msgr2=0x7fdc3c15e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:36.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.101+0000 7fdc3be00640 1 --2- 172.21.15.131:0/4021526080 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdc3c0b4ea0 0x7fdc3c15e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.101+0000 7fdc3be00640 1 -- 172.21.15.131:0/4021526080 >> v1:172.21.15.195:6789/0 conn(0x7fdc3c144370 legacy=0x7fdc3c0b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:36.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.101+0000 7fdc3be00640 1 -- 172.21.15.131:0/4021526080 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc3c0d0c70 con 0x7fdc3c06c5c0 2024-04-25T19:22:36.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.102+0000 7fdc3be00640 1 --2- 172.21.15.131:0/4021526080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc3c06c5c0 0x7fdc3c0cfa70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c009870 tx=0x7fdc2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a17efcd6aa198c59 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:36.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.103+0000 7fdc3aa00640 1 -- 172.21.15.131:0/4021526080 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c037070 con 0x7fdc3c06c5c0 2024-04-25T19:22:36.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.103+0000 7fdc3aa00640 1 -- 172.21.15.131:0/4021526080 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc2c032440 con 0x7fdc3c06c5c0 2024-04-25T19:22:36.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.103+0000 7fdc3aa00640 1 -- 172.21.15.131:0/4021526080 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c032810 con 0x7fdc3c06c5c0 2024-04-25T19:22:36.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.104+0000 7fdc41c00640 1 -- 172.21.15.131:0/4021526080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc3c06c5c0 msgr2=0x7fdc3c0cfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:36.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.104+0000 7fdc41c00640 1 --2- 172.21.15.131:0/4021526080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc3c06c5c0 0x7fdc3c0cfa70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c009870 tx=0x7fdc2c02a270 comp rx=0 tx=0).stop 2024-04-25T19:22:36.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.104+0000 7fdc41c00640 1 -- 172.21.15.131:0/4021526080 shutdown_connections 2024-04-25T19:22:36.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.104+0000 7fdc41c00640 1 --2- 172.21.15.131:0/4021526080 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdc3c0b4ea0 0x7fdc3c15e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.104+0000 7fdc41c00640 1 --2- 172.21.15.131:0/4021526080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc3c06c5c0 0x7fdc3c0cfa70 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.104+0000 7fdc41c00640 1 -- 172.21.15.131:0/4021526080 >> 172.21.15.131:0/4021526080 conn(0x7fdc3c0d1720 msgr2=0x7fdc3c0d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:36.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.104+0000 7fdc41c00640 1 -- 172.21.15.131:0/4021526080 shutdown_connections 2024-04-25T19:22:36.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.104+0000 7fdc41c00640 1 -- 172.21.15.131:0/4021526080 wait complete. 2024-04-25T19:22:36.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.106+0000 7fdc41c00640 1 Processor -- start 2024-04-25T19:22:36.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.106+0000 7fdc41c00640 1 -- start start 2024-04-25T19:22:36.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.108+0000 7fdc41c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc3c06c5c0 0x7fdc3c13fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:36.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.108+0000 7fdc41c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdc3c144370 0x7fdc3c145ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:36.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.108+0000 7fdc41c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc3c158330 0x7fdc3c144d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:36.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.108+0000 7fdc41c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3c0d0450 con 0x7fdc3c158330 2024-04-25T19:22:36.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.108+0000 7fdc41c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3c0d02d0 con 0x7fdc3c06c5c0 2024-04-25T19:22:36.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.108+0000 7fdc41c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdc3c147760 con 0x7fdc3c144370 2024-04-25T19:22:36.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.108+0000 7fdc41200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc3c158330 0x7fdc3c144d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:36.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.108+0000 7fdc41200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc3c158330 0x7fdc3c144d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:32830/0 (socket says 172.21.15.131:32830) 2024-04-25T19:22:36.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.108+0000 7fdc41200640 1 -- 172.21.15.131:0/1625764869 learned_addr learned my addr 172.21.15.131:0/1625764869 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:36.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.108+0000 7fdc3be00640 1 --2- 172.21.15.131:0/1625764869 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc3c06c5c0 0x7fdc3c13fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:36.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.108+0000 7fdc3b400640 1 --2- 172.21.15.131:0/1625764869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdc3c144370 0x7fdc3c145ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:36.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.108+0000 7fdc41200640 1 -- 172.21.15.131:0/1625764869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdc3c144370 msgr2=0x7fdc3c145ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:36.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.109+0000 7fdc41200640 1 --2- 172.21.15.131:0/1625764869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdc3c144370 0x7fdc3c145ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.109+0000 7fdc41200640 1 -- 172.21.15.131:0/1625764869 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc3c06c5c0 msgr2=0x7fdc3c13fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:36.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.109+0000 7fdc41200640 1 --2- 172.21.15.131:0/1625764869 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc3c06c5c0 0x7fdc3c13fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.109+0000 7fdc41200640 1 -- 172.21.15.131:0/1625764869 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc3c158740 con 0x7fdc3c158330 2024-04-25T19:22:36.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.109+0000 7fdc3be00640 1 --2- 172.21.15.131:0/1625764869 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc3c06c5c0 0x7fdc3c13fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:36.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.109+0000 7fdc41200640 1 --2- 172.21.15.131:0/1625764869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc3c158330 0x7fdc3c144d50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdc34007e90 tx=0x7fdc3400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:36.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.109+0000 7fdc33e00640 1 -- 172.21.15.131:0/1625764869 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc34014420 con 0x7fdc3c158330 2024-04-25T19:22:36.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.109+0000 7fdc33e00640 1 -- 172.21.15.131:0/1625764869 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc34019070 con 0x7fdc3c158330 2024-04-25T19:22:36.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.109+0000 7fdc33e00640 1 -- 172.21.15.131:0/1625764869 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc34014800 con 0x7fdc3c158330 2024-04-25T19:22:36.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.109+0000 7fdc41c00640 1 -- 172.21.15.131:0/1625764869 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc3c158ba0 con 0x7fdc3c158330 2024-04-25T19:22:36.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.109+0000 7fdc41c00640 1 -- 172.21.15.131:0/1625764869 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc3c159160 con 0x7fdc3c158330 2024-04-25T19:22:36.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.112+0000 7fdc33e00640 1 -- 172.21.15.131:0/1625764869 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fdc340149a0 con 0x7fdc3c158330 2024-04-25T19:22:36.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.113+0000 7fdc33e00640 1 --2- 172.21.15.131:0/1625764869 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdc1c0744e0 0x7fdc1c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:36.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.113+0000 7fdc33e00640 1 -- 172.21.15.131:0/1625764869 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdc34095b10 con 0x7fdc3c158330 2024-04-25T19:22:36.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.113+0000 7fdc4a22f740 1 Processor -- start 2024-04-25T19:22:36.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.113+0000 7fdc3be00640 1 --2- 172.21.15.131:0/1625764869 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdc1c0744e0 0x7fdc1c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:36.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.113+0000 7fdc4a22f740 1 -- start start 2024-04-25T19:22:36.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.115+0000 7fdc3be00640 1 --2- 172.21.15.131:0/1625764869 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdc1c0744e0 0x7fdc1c0769f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c034000 tx=0x7fdc2c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:36.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.115+0000 7fdc4a22f740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb3364f270 0x55fb33a1c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:36.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.115+0000 7fdc4a22f740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55fb336263b0 0x55fb33a36f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:36.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.115+0000 7fdc4a22f740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fb3362e590 0x55fb33a37480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:36.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.115+0000 7fdc4a22f740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55fb33955600 con 0x55fb3364f270 2024-04-25T19:22:36.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.115+0000 7fdc4a22f740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55fb338f2100 con 0x55fb3362e590 2024-04-25T19:22:36.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.115+0000 7fdc4a22f740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x55fb339515c0 con 0x55fb336263b0 2024-04-25T19:22:36.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.115+0000 7fdc3be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb3364f270 0x55fb33a1c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:36.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.115+0000 7fdc3be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb3364f270 0x55fb33a1c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:32834/0 (socket says 172.21.15.131:32834) 2024-04-25T19:22:36.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.115+0000 7fdc3be00640 1 -- 172.21.15.131:0/3776160973 learned_addr learned my addr 172.21.15.131:0/3776160973 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:36.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.115+0000 7fdc41200640 1 --2- 172.21.15.131:0/3776160973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fb3362e590 0x55fb33a37480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:36.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.115+0000 7fdc3b400640 1 --2- 172.21.15.131:0/3776160973 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55fb336263b0 0x55fb33a36f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:36.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.116+0000 7fdc3be00640 1 -- 172.21.15.131:0/3776160973 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55fb336263b0 msgr2=0x55fb33a36f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:36.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.116+0000 7fdc3be00640 1 --2- 172.21.15.131:0/3776160973 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55fb336263b0 0x55fb33a36f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.116+0000 7fdc3be00640 1 -- 172.21.15.131:0/3776160973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fb3362e590 msgr2=0x55fb33a37480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:36.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.116+0000 7fdc3be00640 1 --2- 172.21.15.131:0/3776160973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fb3362e590 0x55fb33a37480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.116+0000 7fdc3be00640 1 -- 172.21.15.131:0/3776160973 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb336672d0 con 0x55fb3364f270 2024-04-25T19:22:36.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.116+0000 7fdc3b400640 1 --2- 172.21.15.131:0/3776160973 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55fb336263b0 0x55fb33a36f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:36.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.116+0000 7fdc3be00640 1 --2- 172.21.15.131:0/3776160973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb3364f270 0x55fb33a1c210 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c009960 tx=0x7fdc2c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450308fe007be0cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:36.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.116+0000 7fdc30c00640 1 -- 172.21.15.131:0/3776160973 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c037040 con 0x55fb3364f270 2024-04-25T19:22:36.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.116+0000 7fdc30c00640 1 -- 172.21.15.131:0/3776160973 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc2c04c070 con 0x55fb3364f270 2024-04-25T19:22:36.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.116+0000 7fdc30c00640 1 -- 172.21.15.131:0/3776160973 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c03d440 con 0x55fb3364f270 2024-04-25T19:22:36.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.117+0000 7fdc4a22f740 1 -- 172.21.15.131:0/3776160973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb3364f270 msgr2=0x55fb33a1c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:36.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.117+0000 7fdc4a22f740 1 --2- 172.21.15.131:0/3776160973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb3364f270 0x55fb33a1c210 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c009960 tx=0x7fdc2c02c000 comp rx=0 tx=0).stop 2024-04-25T19:22:36.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.117+0000 7fdc4a22f740 1 -- 172.21.15.131:0/3776160973 shutdown_connections 2024-04-25T19:22:36.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.117+0000 7fdc4a22f740 1 --2- 172.21.15.131:0/3776160973 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55fb336263b0 0x55fb33a36f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.117+0000 7fdc4a22f740 1 --2- 172.21.15.131:0/3776160973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fb3362e590 0x55fb33a37480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.117+0000 7fdc4a22f740 1 --2- 172.21.15.131:0/3776160973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb3364f270 0x55fb33a1c210 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.117+0000 7fdc4a22f740 1 -- 172.21.15.131:0/3776160973 >> 172.21.15.131:0/3776160973 conn(0x55fb336433c0 msgr2=0x55fb339f1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:36.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.117+0000 7fdc4a22f740 1 -- 172.21.15.131:0/3776160973 shutdown_connections 2024-04-25T19:22:36.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.117+0000 7fdc4a22f740 1 -- 172.21.15.131:0/3776160973 wait complete. 2024-04-25T19:22:36.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.118+0000 7fdc4a22f740 1 -- start start 2024-04-25T19:22:36.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.118+0000 7fdc4a22f740 1 Processor -- start 2024-04-25T19:22:36.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.120+0000 7fdc4a22f740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fb336263b0 0x55fb33a05160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:36.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.120+0000 7fdc4a22f740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb3362e590 0x55fb33a314d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:36.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.120+0000 7fdc4a22f740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55fb3364f270 0x55fb33a17940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:36.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.120+0000 7fdc4a22f740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55fb338dcf70 con 0x55fb3362e590 2024-04-25T19:22:36.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.120+0000 7fdc4a22f740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55fb33a074d0 con 0x55fb336263b0 2024-04-25T19:22:36.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.120+0000 7fdc4a22f740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x55fb33a31e90 con 0x55fb3364f270 2024-04-25T19:22:36.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.120+0000 7fdc4a22f740 10 client.0 _ll_register_callbacks cb 0x55fb3394b480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T19:22:36.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.120+0000 7fdc3b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb3362e590 0x55fb33a314d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:36.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.120+0000 7fdc3b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb3362e590 0x55fb33a314d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:32840/0 (socket says 172.21.15.131:32840) 2024-04-25T19:22:36.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.120+0000 7fdc3b400640 1 -- 172.21.15.131:0/1281427770 learned_addr learned my addr 172.21.15.131:0/1281427770 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:36.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.121+0000 7fdc41200640 1 --2- 172.21.15.131:0/1281427770 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55fb3364f270 0x55fb33a17940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:36.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.121+0000 7fdc3be00640 1 --2- 172.21.15.131:0/1281427770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fb336263b0 0x55fb33a05160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:36.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.121+0000 7fdc3b400640 1 -- 172.21.15.131:0/1281427770 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55fb3364f270 msgr2=0x55fb33a17940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:36.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.121+0000 7fdc3b400640 1 --2- 172.21.15.131:0/1281427770 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55fb3364f270 0x55fb33a17940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.121+0000 7fdc3b400640 1 -- 172.21.15.131:0/1281427770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fb336263b0 msgr2=0x55fb33a05160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:36.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.121+0000 7fdc3b400640 1 --2- 172.21.15.131:0/1281427770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fb336263b0 0x55fb33a05160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.121+0000 7fdc3b400640 1 -- 172.21.15.131:0/1281427770 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb337316b0 con 0x55fb3362e590 2024-04-25T19:22:36.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.121+0000 7fdc3b400640 1 --2- 172.21.15.131:0/1281427770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb3362e590 0x55fb33a314d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdc2800ed50 tx=0x7fdc28001450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4296225e16d1f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:36.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.121+0000 7fdc25600640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-04-25T19:22:36.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.121+0000 7fdc25600640 1 -- 172.21.15.131:0/1281427770 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc28013680 con 0x55fb3362e590 2024-04-25T19:22:36.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.121+0000 7fdc25600640 1 -- 172.21.15.131:0/1281427770 <== mon.0 v2:172.21.15.131:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdc28013820 con 0x55fb3362e590 2024-04-25T19:22:36.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.121+0000 7fdc4a22f740 1 -- 172.21.15.131:0/1281427770 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc2c04c070 con 0x55fb3362e590 2024-04-25T19:22:36.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.121+0000 7fdc25600640 1 -- 172.21.15.131:0/1281427770 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fdc28020050 con 0x55fb3362e590 2024-04-25T19:22:36.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.121+0000 7fdc4a22f740 10 client.4647 fetch_fsmap learned FSMap version 8 2024-04-25T19:22:36.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.121+0000 7fdc4a22f740 1 -- 172.21.15.131:0/1281427770 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55fb33a07210 con 0x55fb3362e590 2024-04-25T19:22:36.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.122+0000 7fdc25600640 1 -- 172.21.15.131:0/1281427770 <== mon.0 v2:172.21.15.131:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc2c04c070 con 0x55fb3362e590 2024-04-25T19:22:36.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.122+0000 7fdc25600640 1 -- 172.21.15.131:0/1281427770 <== mon.0 v2:172.21.15.131:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7fdc28023020 con 0x55fb3362e590 2024-04-25T19:22:36.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.122+0000 7fdc4a22f740 10 client.4647 fetch_fsmap finished waiting for FSMap version 8 2024-04-25T19:22:36.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.122+0000 7fdc4a22f740 10 client.4647 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T19:22:36.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.122+0000 7fdc4a22f740 20 client.4647 populate_metadata read hostname 'smithi131' 2024-04-25T19:22:36.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.122+0000 7fdc4a22f740 1 --2- 172.21.15.131:0/1281427770 >> [v2:172.21.15.195:6834/1898121552,v1:172.21.15.195:6836/1898121552] conn(0x55fb3360de40 0x55fb33a06540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:36.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.122+0000 7fdc4a22f740 4 client.4647 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T19:22:36.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.122+0000 7fdc4a22f740 1 -- 172.21.15.131:0/1281427770 --> [v2:172.21.15.195:6834/1898121552,v1:172.21.15.195:6836/1898121552] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb33963210 con 0x55fb3360de40 2024-04-25T19:22:36.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.123+0000 7fdc3be00640 1 --2- 172.21.15.131:0/1281427770 >> [v2:172.21.15.195:6834/1898121552,v1:172.21.15.195:6836/1898121552] conn(0x55fb3360de40 0x55fb33a06540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:36.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.124+0000 7fdc3be00640 1 --2- 172.21.15.131:0/1281427770 >> [v2:172.21.15.195:6834/1898121552,v1:172.21.15.195:6836/1898121552] conn(0x55fb3360de40 0x55fb33a06540 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19ccbb8d3927fb85 server_cookie=6d9b8b7d475901ce in_seq=0 out_seq=0 2024-04-25T19:22:36.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.124+0000 7fdc25600640 10 client.4647 ms_handle_connect on v2:172.21.15.195:6834/1898121552 2024-04-25T19:22:36.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.125+0000 7fdc25600640 1 -- 172.21.15.131:0/1281427770 <== mds.0 v2:172.21.15.195:6834/1898121552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fb33963210 con 0x55fb3360de40 2024-04-25T19:22:36.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.125+0000 7fdc25600640 10 client.4647 handle_command_reply: tid=0 2024-04-25T19:22:36.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.125+0000 7fdc4a22f740 1 client.4647 shutdown 2024-04-25T19:22:36.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.125+0000 7fdc4a22f740 1 -- 172.21.15.131:0/1281427770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb3362e590 msgr2=0x55fb33a314d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:36.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.125+0000 7fdc4a22f740 1 --2- 172.21.15.131:0/1281427770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb3362e590 0x55fb33a314d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdc2800ed50 tx=0x7fdc28001450 comp rx=0 tx=0).stop 2024-04-25T19:22:36.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.126+0000 7fdc4a22f740 1 -- 172.21.15.131:0/1281427770 shutdown_connections 2024-04-25T19:22:36.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.126+0000 7fdc4a22f740 1 --2- 172.21.15.131:0/1281427770 >> [v2:172.21.15.195:6834/1898121552,v1:172.21.15.195:6836/1898121552] conn(0x55fb3360de40 0x55fb33a06540 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.126+0000 7fdc4a22f740 1 --2- 172.21.15.131:0/1281427770 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55fb3364f270 0x55fb33a17940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.126+0000 7fdc4a22f740 1 --2- 172.21.15.131:0/1281427770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb3362e590 0x55fb33a314d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.126+0000 7fdc25600640 0 client.4647 ms_handle_reset on v2:172.21.15.195:6834/1898121552 2024-04-25T19:22:36.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.126+0000 7fdc4a22f740 1 --2- 172.21.15.131:0/1281427770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fb336263b0 0x55fb33a05160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.126+0000 7fdc4a22f740 1 -- 172.21.15.131:0/1281427770 >> 172.21.15.131:0/1281427770 conn(0x55fb336433c0 msgr2=0x55fb339f1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:36.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.126+0000 7fdc4a22f740 1 -- 172.21.15.131:0/1281427770 shutdown_connections 2024-04-25T19:22:36.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.126+0000 7fdc4a22f740 1 -- 172.21.15.131:0/1281427770 wait complete. 2024-04-25T19:22:36.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.126+0000 7fdc4a22f740 20 client.4647 trim_cache size 0 max 16384 2024-04-25T19:22:36.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.147+0000 7fdc4a22f740 1 Processor -- start 2024-04-25T19:22:36.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.147+0000 7fdc4a22f740 1 -- start start 2024-04-25T19:22:36.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.148+0000 7fdc4a22f740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb336263b0 0x55fb33a06540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:36.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.148+0000 7fdc4a22f740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55fb3362e590 0x55fb33a06a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:36.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.148+0000 7fdc4a22f740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fb3364f270 0x55fb33a59ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:36.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.148+0000 7fdc4a22f740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3c143ab0 con 0x55fb336263b0 2024-04-25T19:22:36.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.148+0000 7fdc4a22f740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3c140d80 con 0x55fb3364f270 2024-04-25T19:22:36.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.148+0000 7fdc4a22f740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdc3c143460 con 0x55fb3362e590 2024-04-25T19:22:36.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.149+0000 7fdc3be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb336263b0 0x55fb33a06540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:36.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.149+0000 7fdc3be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb336263b0 0x55fb33a06540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:32842/0 (socket says 172.21.15.131:32842) 2024-04-25T19:22:36.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.149+0000 7fdc3be00640 1 -- 172.21.15.131:0/1371091438 learned_addr learned my addr 172.21.15.131:0/1371091438 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:36.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.149+0000 7fdc3b400640 1 --2- 172.21.15.131:0/1371091438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55fb3362e590 0x55fb33a06a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:36.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.149+0000 7fdc41200640 1 --2- 172.21.15.131:0/1371091438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fb3364f270 0x55fb33a59ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:36.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.149+0000 7fdc3be00640 1 -- 172.21.15.131:0/1371091438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55fb3362e590 msgr2=0x55fb33a06a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:36.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.149+0000 7fdc3be00640 1 --2- 172.21.15.131:0/1371091438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55fb3362e590 0x55fb33a06a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.149+0000 7fdc3be00640 1 -- 172.21.15.131:0/1371091438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fb3364f270 msgr2=0x55fb33a59ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:36.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.149+0000 7fdc3be00640 1 --2- 172.21.15.131:0/1371091438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fb3364f270 0x55fb33a59ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.149+0000 7fdc3be00640 1 -- 172.21.15.131:0/1371091438 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb33a31840 con 0x55fb336263b0 2024-04-25T19:22:36.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.149+0000 7fdc3b400640 1 --2- 172.21.15.131:0/1371091438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55fb3362e590 0x55fb33a06a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:36.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.149+0000 7fdc3be00640 1 --2- 172.21.15.131:0/1371091438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb336263b0 0x55fb33a06540 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c009630 tx=0x7fdc2c039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a39da35cf90031 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:36.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.150+0000 7fdc27e00640 1 -- 172.21.15.131:0/1371091438 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c037040 con 0x55fb336263b0 2024-04-25T19:22:36.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.150+0000 7fdc27e00640 1 -- 172.21.15.131:0/1371091438 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc2c059070 con 0x55fb336263b0 2024-04-25T19:22:36.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.150+0000 7fdc27e00640 1 -- 172.21.15.131:0/1371091438 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c003850 con 0x55fb336263b0 2024-04-25T19:22:36.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.151+0000 7fdc4a22f740 1 -- 172.21.15.131:0/1371091438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb336263b0 msgr2=0x55fb33a06540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:36.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.151+0000 7fdc4a22f740 1 --2- 172.21.15.131:0/1371091438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb336263b0 0x55fb33a06540 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c009630 tx=0x7fdc2c039000 comp rx=0 tx=0).stop 2024-04-25T19:22:36.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.151+0000 7fdc4a22f740 1 -- 172.21.15.131:0/1371091438 shutdown_connections 2024-04-25T19:22:36.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.151+0000 7fdc4a22f740 1 --2- 172.21.15.131:0/1371091438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55fb3362e590 0x55fb33a06a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.151+0000 7fdc4a22f740 1 --2- 172.21.15.131:0/1371091438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fb3364f270 0x55fb33a59ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.151+0000 7fdc4a22f740 1 --2- 172.21.15.131:0/1371091438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb336263b0 0x55fb33a06540 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.151+0000 7fdc4a22f740 1 -- 172.21.15.131:0/1371091438 >> 172.21.15.131:0/1371091438 conn(0x55fb336433c0 msgr2=0x55fb33a458b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:36.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.151+0000 7fdc4a22f740 1 -- 172.21.15.131:0/1371091438 shutdown_connections 2024-04-25T19:22:36.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.151+0000 7fdc4a22f740 1 -- 172.21.15.131:0/1371091438 wait complete. 2024-04-25T19:22:36.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.152+0000 7fdc4a22f740 1 -- start start 2024-04-25T19:22:36.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.152+0000 7fdc4a22f740 1 Processor -- start 2024-04-25T19:22:36.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.153+0000 7fdc4a22f740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb336263b0 0x55fb33a9d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:36.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.153+0000 7fdc4a22f740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55fb3362e590 0x55fb33ab4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:36.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.153+0000 7fdc4a22f740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fb3364f270 0x55fb33a064a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:36.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.153+0000 7fdc4a22f740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55fb33a07920 con 0x55fb336263b0 2024-04-25T19:22:36.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.153+0000 7fdc4a22f740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55fb33a31a10 con 0x55fb3364f270 2024-04-25T19:22:36.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.153+0000 7fdc4a22f740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x55fb33a07f70 con 0x55fb3362e590 2024-04-25T19:22:36.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.154+0000 7fdc4a22f740 10 client.0 _ll_register_callbacks cb 0x7fdc28007c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T19:22:36.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.154+0000 7fdc3be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb336263b0 0x55fb33a9d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:36.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.154+0000 7fdc3be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb336263b0 0x55fb33a9d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:32846/0 (socket says 172.21.15.131:32846) 2024-04-25T19:22:36.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.154+0000 7fdc3be00640 1 -- 172.21.15.131:0/3177425766 learned_addr learned my addr 172.21.15.131:0/3177425766 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:36.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.154+0000 7fdc41200640 1 --2- 172.21.15.131:0/3177425766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fb3364f270 0x55fb33a064a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:36.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.154+0000 7fdc3b400640 1 --2- 172.21.15.131:0/3177425766 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55fb3362e590 0x55fb33ab4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:36.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.154+0000 7fdc3be00640 1 -- 172.21.15.131:0/3177425766 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55fb3362e590 msgr2=0x55fb33ab4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:36.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.154+0000 7fdc3be00640 1 --2- 172.21.15.131:0/3177425766 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55fb3362e590 0x55fb33ab4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.154+0000 7fdc3be00640 1 -- 172.21.15.131:0/3177425766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fb3364f270 msgr2=0x55fb33a064a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:36.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.154+0000 7fdc3be00640 1 --2- 172.21.15.131:0/3177425766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fb3364f270 0x55fb33a064a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.154+0000 7fdc3be00640 1 -- 172.21.15.131:0/3177425766 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb339ef8c0 con 0x55fb336263b0 2024-04-25T19:22:36.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.154+0000 7fdc3be00640 1 --2- 172.21.15.131:0/3177425766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb336263b0 0x55fb33a9d160 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c056040 tx=0x7fdc2c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc64484e461a8d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:36.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.154+0000 7fdc25600640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-04-25T19:22:36.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.155+0000 7fdc25600640 1 -- 172.21.15.131:0/3177425766 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c037040 con 0x55fb336263b0 2024-04-25T19:22:36.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.155+0000 7fdc25600640 1 -- 172.21.15.131:0/3177425766 <== mon.0 v2:172.21.15.131:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdc2c054100 con 0x55fb336263b0 2024-04-25T19:22:36.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.155+0000 7fdc4a22f740 1 -- 172.21.15.131:0/3177425766 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc2c059070 con 0x55fb336263b0 2024-04-25T19:22:36.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.155+0000 7fdc25600640 1 -- 172.21.15.131:0/3177425766 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fdc2c069050 con 0x55fb336263b0 2024-04-25T19:22:36.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.155+0000 7fdc4a22f740 10 client.4653 fetch_fsmap learned FSMap version 8 2024-04-25T19:22:36.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.155+0000 7fdc4a22f740 1 -- 172.21.15.131:0/3177425766 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55fb33a05850 con 0x55fb336263b0 2024-04-25T19:22:36.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.155+0000 7fdc25600640 1 -- 172.21.15.131:0/3177425766 <== mon.0 v2:172.21.15.131:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc2c059070 con 0x55fb336263b0 2024-04-25T19:22:36.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.155+0000 7fdc25600640 1 -- 172.21.15.131:0/3177425766 <== mon.0 v2:172.21.15.131:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7fdc2c06c020 con 0x55fb336263b0 2024-04-25T19:22:36.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.155+0000 7fdc4a22f740 10 client.4653 fetch_fsmap finished waiting for FSMap version 8 2024-04-25T19:22:36.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.155+0000 7fdc4a22f740 10 client.4653 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T19:22:36.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.155+0000 7fdc4a22f740 20 client.4653 populate_metadata read hostname 'smithi131' 2024-04-25T19:22:36.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.155+0000 7fdc4a22f740 1 --2- 172.21.15.131:0/3177425766 >> [v2:172.21.15.195:6834/1898121552,v1:172.21.15.195:6836/1898121552] conn(0x55fb339ec3d0 0x55fb339ec7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:36.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.156+0000 7fdc4a22f740 4 client.4653 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T19:22:36.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.156+0000 7fdc4a22f740 1 -- 172.21.15.131:0/3177425766 --> [v2:172.21.15.195:6834/1898121552,v1:172.21.15.195:6836/1898121552] -- command(tid 0: {"prefix": "status"}) -- 0x55fb33a34280 con 0x55fb339ec3d0 2024-04-25T19:22:36.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.156+0000 7fdc3b400640 1 --2- 172.21.15.131:0/3177425766 >> [v2:172.21.15.195:6834/1898121552,v1:172.21.15.195:6836/1898121552] conn(0x55fb339ec3d0 0x55fb339ec7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:36.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.157+0000 7fdc25600640 10 client.4653 ms_handle_connect on v2:172.21.15.195:6834/1898121552 2024-04-25T19:22:36.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.157+0000 7fdc3b400640 1 --2- 172.21.15.131:0/3177425766 >> [v2:172.21.15.195:6834/1898121552,v1:172.21.15.195:6836/1898121552] conn(0x55fb339ec3d0 0x55fb339ec7e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a711ebf67713b68 server_cookie=45895a15e2ce58a3 in_seq=0 out_seq=0 2024-04-25T19:22:36.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.158+0000 7fdc25600640 1 -- 172.21.15.131:0/3177425766 <== mds.0 v2:172.21.15.195:6834/1898121552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x55fb33a34280 con 0x55fb339ec3d0 2024-04-25T19:22:36.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.158+0000 7fdc25600640 10 client.4653 handle_command_reply: tid=0 2024-04-25T19:22:36.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.158+0000 7fdc4a22f740 1 client.4653 shutdown 2024-04-25T19:22:36.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.158+0000 7fdc4a22f740 1 -- 172.21.15.131:0/3177425766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb336263b0 msgr2=0x55fb33a9d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:36.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.158+0000 7fdc4a22f740 1 --2- 172.21.15.131:0/3177425766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb336263b0 0x55fb33a9d160 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c056040 tx=0x7fdc2c004730 comp rx=0 tx=0).stop 2024-04-25T19:22:36.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.158+0000 7fdc4a22f740 1 -- 172.21.15.131:0/3177425766 shutdown_connections 2024-04-25T19:22:36.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.158+0000 7fdc4a22f740 1 --2- 172.21.15.131:0/3177425766 >> [v2:172.21.15.195:6834/1898121552,v1:172.21.15.195:6836/1898121552] conn(0x55fb339ec3d0 0x55fb339ec7e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.158+0000 7fdc4a22f740 1 --2- 172.21.15.131:0/3177425766 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55fb3362e590 0x55fb33ab4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.158+0000 7fdc4a22f740 1 --2- 172.21.15.131:0/3177425766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fb3364f270 0x55fb33a064a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.158+0000 7fdc25600640 0 client.4653 ms_handle_reset on v2:172.21.15.195:6834/1898121552 2024-04-25T19:22:36.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.158+0000 7fdc4a22f740 1 --2- 172.21.15.131:0/3177425766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb336263b0 0x55fb33a9d160 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.158+0000 7fdc4a22f740 1 -- 172.21.15.131:0/3177425766 >> 172.21.15.131:0/3177425766 conn(0x55fb336433c0 msgr2=0x55fb33a458b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:36.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.158+0000 7fdc4a22f740 1 -- 172.21.15.131:0/3177425766 shutdown_connections 2024-04-25T19:22:36.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.158+0000 7fdc4a22f740 1 -- 172.21.15.131:0/3177425766 wait complete. 2024-04-25T19:22:36.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.158+0000 7fdc4a22f740 20 client.4653 trim_cache size 0 max 16384 2024-04-25T19:22:36.163 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-25T19:22:36.163 INFO:teuthology.orchestra.run.smithi131.stdout: "cluster_fsid": "4ba607f8-c2c3-4d8d-85a8-7800763c470f", 2024-04-25T19:22:36.163 INFO:teuthology.orchestra.run.smithi131.stdout: "whoami": 0, 2024-04-25T19:22:36.163 INFO:teuthology.orchestra.run.smithi131.stdout: "id": 4285, 2024-04-25T19:22:36.163 INFO:teuthology.orchestra.run.smithi131.stdout: "want_state": "up:active", 2024-04-25T19:22:36.163 INFO:teuthology.orchestra.run.smithi131.stdout: "state": "up:active", 2024-04-25T19:22:36.163 INFO:teuthology.orchestra.run.smithi131.stdout: "fs_name": "cephfs", 2024-04-25T19:22:36.163 INFO:teuthology.orchestra.run.smithi131.stdout: "rank_uptime": 19.089484363, 2024-04-25T19:22:36.163 INFO:teuthology.orchestra.run.smithi131.stdout: "mdsmap_epoch": 8, 2024-04-25T19:22:36.163 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_epoch": 20, 2024-04-25T19:22:36.163 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_epoch_barrier": 20, 2024-04-25T19:22:36.164 INFO:teuthology.orchestra.run.smithi131.stdout: "uptime": 24.708457136 2024-04-25T19:22:36.164 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-25T19:22:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.159+0000 7fdc41c00640 1 -- 172.21.15.131:0/1625764869 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdc1c0744e0 msgr2=0x7fdc1c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.159+0000 7fdc41c00640 1 --2- 172.21.15.131:0/1625764869 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdc1c0744e0 0x7fdc1c0769f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c034000 tx=0x7fdc2c02e000 comp rx=0 tx=0).stop 2024-04-25T19:22:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.159+0000 7fdc41c00640 1 -- 172.21.15.131:0/1625764869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc3c158330 msgr2=0x7fdc3c144d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.159+0000 7fdc41c00640 1 --2- 172.21.15.131:0/1625764869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc3c158330 0x7fdc3c144d50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdc34007e90 tx=0x7fdc3400e4b0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.159+0000 7fdc41c00640 1 -- 172.21.15.131:0/1625764869 shutdown_connections 2024-04-25T19:22:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.159+0000 7fdc41c00640 1 --2- 172.21.15.131:0/1625764869 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdc1c0744e0 0x7fdc1c0769f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.159+0000 7fdc41c00640 1 --2- 172.21.15.131:0/1625764869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdc3c144370 0x7fdc3c145ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.159+0000 7fdc41c00640 1 --2- 172.21.15.131:0/1625764869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc3c158330 0x7fdc3c144d50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.159+0000 7fdc41c00640 1 --2- 172.21.15.131:0/1625764869 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc3c06c5c0 0x7fdc3c13fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:36.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.159+0000 7fdc41c00640 1 -- 172.21.15.131:0/1625764869 >> 172.21.15.131:0/1625764869 conn(0x7fdc3c0d1720 msgr2=0x7fdc3c06cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:36.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.159+0000 7fdc41c00640 1 -- 172.21.15.131:0/1625764869 shutdown_connections 2024-04-25T19:22:36.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:36.159+0000 7fdc41c00640 1 -- 172.21.15.131:0/1625764869 wait complete. 2024-04-25T19:22:36.184 INFO:teuthology.run_tasks:Running task sequential... 2024-04-25T19:22:36.195 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-25T19:22:36.195 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-25T19:22:36.196 INFO:teuthology.task.print:Enabling mgr modules 2024-04-25T19:22:36.196 INFO:teuthology.run_tasks:Running task kclient... 2024-04-25T19:22:36.251 INFO:tasks.kclient:Mounting kernel clients... 2024-04-25T19:22:36.251 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-25T19:22:36.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:36.251 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-04-25T19:22:36.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:36.307 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link delete ceph-brx 2024-04-25T19:22:36.388 INFO:teuthology.orchestra.run.smithi131.stderr:Cannot find device "ceph-brx" 2024-04-25T19:22:36.392 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T19:22:36.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:36.393 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-04-25T19:22:36.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:36.445 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link delete ceph-brx 2024-04-25T19:22:36.523 INFO:teuthology.orchestra.run.smithi131.stderr:Cannot find device "ceph-brx" 2024-04-25T19:22:36.526 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T19:22:36.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:36.527 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T19:22:36.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:36.586 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-04-25T19:22:36.675 INFO:teuthology.orchestra.run.smithi195.stderr:Cannot find device "ceph-brx" 2024-04-25T19:22:36.678 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T19:22:36.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:36.679 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T19:22:36.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:36.731 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-04-25T19:22:36.815 INFO:teuthology.orchestra.run.smithi195.stderr:Cannot find device "ceph-brx" 2024-04-25T19:22:36.819 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T19:22:36.819 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-25T19:22:36.820 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T19:22:36.820 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T19:22:36.820 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T19:22:37.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.100+0000 7f5411600640 1 Processor -- start 2024-04-25T19:22:37.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.100+0000 7f5411600640 1 -- start start 2024-04-25T19:22:37.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.103+0000 7f5411600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f540c0cf5e0 0x7f540c0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:37.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.103+0000 7f5411600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f540c06c5c0 0x7f540c06c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:37.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.103+0000 7f5411600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f540c0cff30 con 0x7f540c1443c0 2024-04-25T19:22:37.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.103+0000 7f5411600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f540c0708d0 con 0x7f540c06c5c0 2024-04-25T19:22:37.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.103+0000 7f5411600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f540c15f160 con 0x7f540c0cf5e0 2024-04-25T19:22:37.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.103+0000 7f540b400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f540c06c5c0 0x7f540c06c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:37.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.103+0000 7f540b400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f540c06c5c0 0x7f540c06c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:32856/0 (socket says 172.21.15.131:32856) 2024-04-25T19:22:37.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.103+0000 7f540b400640 1 -- 172.21.15.131:0/913849130 learned_addr learned my addr 172.21.15.131:0/913849130 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:37.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.103+0000 7f5403e00640 1 --2- 172.21.15.131:0/913849130 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f540c0cf5e0 0x7f540c0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:37.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.104+0000 7f540b400640 1 -- 172.21.15.131:0/913849130 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f540c0cf5e0 msgr2=0x7f540c0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:37.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.104+0000 7f540b400640 1 --2- 172.21.15.131:0/913849130 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f540c0cf5e0 0x7f540c0cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:37.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.104+0000 7f540b400640 1 -- 172.21.15.131:0/913849130 >> v1:172.21.15.195:6789/0 conn(0x7f540c1443c0 legacy=0x7f540c06fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:37.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.104+0000 7f540b400640 1 -- 172.21.15.131:0/913849130 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f540c15f5f0 con 0x7f540c06c5c0 2024-04-25T19:22:37.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.105+0000 7f540b400640 1 --2- 172.21.15.131:0/913849130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f540c06c5c0 0x7f540c06c9d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5404009e50 tx=0x7f540402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707e54ce29eba92e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:37.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.105+0000 7f540a000640 1 -- 172.21.15.131:0/913849130 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5404036070 con 0x7f540c06c5c0 2024-04-25T19:22:37.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.105+0000 7f540a000640 1 -- 172.21.15.131:0/913849130 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5404031600 con 0x7f540c06c5c0 2024-04-25T19:22:37.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.105+0000 7f540a000640 1 -- 172.21.15.131:0/913849130 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54040319d0 con 0x7f540c06c5c0 2024-04-25T19:22:37.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.106+0000 7f5411600640 1 -- 172.21.15.131:0/913849130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f540c06c5c0 msgr2=0x7f540c06c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:37.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.106+0000 7f5411600640 1 --2- 172.21.15.131:0/913849130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f540c06c5c0 0x7f540c06c9d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5404009e50 tx=0x7f540402a710 comp rx=0 tx=0).stop 2024-04-25T19:22:37.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.106+0000 7f5411600640 1 -- 172.21.15.131:0/913849130 shutdown_connections 2024-04-25T19:22:37.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.106+0000 7f5411600640 1 --2- 172.21.15.131:0/913849130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f540c06c5c0 0x7f540c06c9d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:37.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.106+0000 7f5411600640 1 --2- 172.21.15.131:0/913849130 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f540c0cf5e0 0x7f540c0cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:37.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.106+0000 7f5411600640 1 -- 172.21.15.131:0/913849130 >> 172.21.15.131:0/913849130 conn(0x7f540c0d1ae0 msgr2=0x7f540c0d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:37.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.106+0000 7f5411600640 1 -- 172.21.15.131:0/913849130 shutdown_connections 2024-04-25T19:22:37.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.106+0000 7f5411600640 1 -- 172.21.15.131:0/913849130 wait complete. 2024-04-25T19:22:37.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.108+0000 7f5411600640 1 Processor -- start 2024-04-25T19:22:37.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.109+0000 7f5411600640 1 -- start start 2024-04-25T19:22:37.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.110+0000 7f5411600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f540c06c5c0 0x7f540c1433b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:37.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.110+0000 7f5411600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f540c0cf5e0 0x7f540c0ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:37.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.110+0000 7f5411600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f540c1443c0 0x7f540c0afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:37.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.110+0000 7f5411600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f540c15edf0 con 0x7f540c0cf5e0 2024-04-25T19:22:37.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.110+0000 7f5411600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f540c15eb10 con 0x7f540c06c5c0 2024-04-25T19:22:37.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.110+0000 7f5411600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f540c1447d0 con 0x7f540c1443c0 2024-04-25T19:22:37.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.110+0000 7f5403e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f540c0cf5e0 0x7f540c0ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:37.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.110+0000 7f5403e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f540c0cf5e0 0x7f540c0ceaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:32864/0 (socket says 172.21.15.131:32864) 2024-04-25T19:22:37.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.110+0000 7f5403e00640 1 -- 172.21.15.131:0/3721216146 learned_addr learned my addr 172.21.15.131:0/3721216146 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:37.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.111+0000 7f540b400640 1 --2- 172.21.15.131:0/3721216146 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f540c1443c0 0x7f540c0afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:37.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.111+0000 7f540aa00640 1 --2- 172.21.15.131:0/3721216146 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f540c06c5c0 0x7f540c1433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:37.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.111+0000 7f5403e00640 1 -- 172.21.15.131:0/3721216146 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f540c1443c0 msgr2=0x7f540c0afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:37.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.111+0000 7f5403e00640 1 --2- 172.21.15.131:0/3721216146 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f540c1443c0 0x7f540c0afa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:37.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.111+0000 7f5403e00640 1 -- 172.21.15.131:0/3721216146 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f540c06c5c0 msgr2=0x7f540c1433b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:37.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.111+0000 7f5403e00640 1 --2- 172.21.15.131:0/3721216146 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f540c06c5c0 0x7f540c1433b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:37.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.111+0000 7f5403e00640 1 -- 172.21.15.131:0/3721216146 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f540c1438f0 con 0x7f540c0cf5e0 2024-04-25T19:22:37.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.111+0000 7f540b400640 1 --2- 172.21.15.131:0/3721216146 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f540c1443c0 0x7f540c0afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:37.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.111+0000 7f5403e00640 1 --2- 172.21.15.131:0/3721216146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f540c0cf5e0 0x7f540c0ceaf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f53f400d5d0 tx=0x7f53f400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:37.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.111+0000 7f5402a00640 1 -- 172.21.15.131:0/3721216146 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f40125f0 con 0x7f540c0cf5e0 2024-04-25T19:22:37.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.111+0000 7f5402a00640 1 -- 172.21.15.131:0/3721216146 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f4019070 con 0x7f540c0cf5e0 2024-04-25T19:22:37.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.111+0000 7f5402a00640 1 -- 172.21.15.131:0/3721216146 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f40129d0 con 0x7f540c0cf5e0 2024-04-25T19:22:37.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.111+0000 7f5411600640 1 -- 172.21.15.131:0/3721216146 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f540c0ae9b0 con 0x7f540c0cf5e0 2024-04-25T19:22:37.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.112+0000 7f5411600640 1 -- 172.21.15.131:0/3721216146 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f540c0aef70 con 0x7f540c0cf5e0 2024-04-25T19:22:37.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.113+0000 7f5411600640 1 -- 172.21.15.131:0/3721216146 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f540c0d04b0 con 0x7f540c0cf5e0 2024-04-25T19:22:37.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.114+0000 7f5402a00640 1 -- 172.21.15.131:0/3721216146 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f53f4012b70 con 0x7f540c0cf5e0 2024-04-25T19:22:37.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.115+0000 7f5402a00640 1 --2- 172.21.15.131:0/3721216146 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f53e80744b0 0x7f53e80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:37.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.115+0000 7f5402a00640 1 -- 172.21.15.131:0/3721216146 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f53f4095730 con 0x7f540c0cf5e0 2024-04-25T19:22:37.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.116+0000 7f540aa00640 1 --2- 172.21.15.131:0/3721216146 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f53e80744b0 0x7f53e80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:37.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.117+0000 7f540aa00640 1 --2- 172.21.15.131:0/3721216146 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f53e80744b0 0x7f53e80769c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f53fc007fd0 tx=0x7f53fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:37.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.120+0000 7f5402a00640 1 -- 172.21.15.131:0/3721216146 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f540c0d04b0 con 0x7f540c0cf5e0 2024-04-25T19:22:37.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.362+0000 7f5411600640 1 -- 172.21.15.131:0/3721216146 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f540c068f70 con 0x7f540c0cf5e0 2024-04-25T19:22:37.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.362+0000 7f5402a00640 1 -- 172.21.15.131:0/3721216146 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f540c068f70 con 0x7f540c0cf5e0 2024-04-25T19:22:37.364 INFO:teuthology.orchestra.run.smithi131.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T19:22:37.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.365+0000 7f5411600640 1 -- 172.21.15.131:0/3721216146 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f53e80744b0 msgr2=0x7f53e80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:37.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.365+0000 7f5411600640 1 --2- 172.21.15.131:0/3721216146 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f53e80744b0 0x7f53e80769c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f53fc007fd0 tx=0x7f53fc009040 comp rx=0 tx=0).stop 2024-04-25T19:22:37.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.365+0000 7f5411600640 1 -- 172.21.15.131:0/3721216146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f540c0cf5e0 msgr2=0x7f540c0ceaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:37.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.365+0000 7f5411600640 1 --2- 172.21.15.131:0/3721216146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f540c0cf5e0 0x7f540c0ceaf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f53f400d5d0 tx=0x7f53f400da90 comp rx=0 tx=0).stop 2024-04-25T19:22:37.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.365+0000 7f5411600640 1 -- 172.21.15.131:0/3721216146 shutdown_connections 2024-04-25T19:22:37.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.365+0000 7f5411600640 1 --2- 172.21.15.131:0/3721216146 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f53e80744b0 0x7f53e80769c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:37.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.365+0000 7f5411600640 1 --2- 172.21.15.131:0/3721216146 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f540c1443c0 0x7f540c0afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:37.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.365+0000 7f5411600640 1 --2- 172.21.15.131:0/3721216146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f540c0cf5e0 0x7f540c0ceaf0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:37.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.365+0000 7f5411600640 1 --2- 172.21.15.131:0/3721216146 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f540c06c5c0 0x7f540c1433b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:37.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.365+0000 7f5411600640 1 -- 172.21.15.131:0/3721216146 >> 172.21.15.131:0/3721216146 conn(0x7f540c0d1ae0 msgr2=0x7f540c1602f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:37.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.365+0000 7f5411600640 1 -- 172.21.15.131:0/3721216146 shutdown_connections 2024-04-25T19:22:37.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37.365+0000 7f5411600640 1 -- 172.21.15.131:0/3721216146 wait complete. 2024-04-25T19:22:37.391 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T19:22:37.391 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T19:22:37.391 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2024-04-25T19:22:37.391 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T19:22:37.392 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T19:22:37.392 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T19:22:37.392 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T19:22:37.392 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T19:22:37.392 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T19:22:37.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:37.392 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2024-04-25T19:22:37.442 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T19:22:37.442 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T19:22:37.442 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T19:22:37.442 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:37.442 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2024-04-25T19:22:37.442 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:37.443 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T19:22:37.443 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:22:37.443 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2024-04-25T19:22:37.443 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T19:22:37.443 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:22:37.443 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2024-04-25T19:22:37.443 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T19:22:37.443 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:22:37.443 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T19:22:37.443 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:22:37.443 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T19:22:37.443 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42652sec preferred_lft 42652sec 2024-04-25T19:22:37.443 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2024-04-25T19:22:37.443 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:37.445 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T19:22:37.445 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T19:22:37.445 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-04-25T19:22:37.445 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add name ceph-brx type bridge 2024-04-25T19:22:37.445 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip addr flush dev ceph-brx 2024-04-25T19:22:37.445 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set ceph-brx up 2024-04-25T19:22:37.445 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T19:22:37.445 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-04-25T19:22:37.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T19:22:37.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:37.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:37.917 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T19:22:37.985 INFO:teuthology.orchestra.run.smithi131.stdout:1 2024-04-25T19:22:37.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:37.989 DEBUG:teuthology.orchestra.run.smithi131:> route 2024-04-25T19:22:38.033 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2024-04-25T19:22:38.033 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T19:22:38.033 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T19:22:38.033 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T19:22:38.033 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T19:22:38.034 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T19:22:38.034 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-04-25T19:22:38.034 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T19:22:38.034 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T19:22:38.034 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T19:22:38.034 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-04-25T19:22:38.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T19:22:38.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:38.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:38.842 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-04-25T19:22:38.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:38.889 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list-id 2024-04-25T19:22:38.978 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T19:22:38.978 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-04-25T19:22:38.978 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T19:22:38.978 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T19:22:38.978 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-04-25T19:22:39.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T19:22:39.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:39.140 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T19:22:39.140 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T19:22:39.141 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-04-25T19:22:39.141 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T19:22:39.141 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T19:22:39.141 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T19:22:39.141 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T19:22:39.141 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T19:22:39.141 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-04-25T19:22:39.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T19:22:39.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:39.415 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T19:22:39.415 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-04-25T19:22:39.415 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.0 up 2024-04-25T19:22:39.415 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T19:22:39.415 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-04-25T19:22:39.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T19:22:39.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:39.606 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T19:22:39.607 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T19:22:39.648 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T19:22:39.648 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T19:22:39.648 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T19:22:39.738 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T19:22:39.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:39.739 DEBUG:teuthology.orchestra.run.smithi131:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T19:22:39.940 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T19:22:39.940 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T19:22:39.940 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2024-04-25T19:22:40.742 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T19:22:40.743 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T19:22:40.743 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2024-04-25T19:22:40.743 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.131:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T19:22:40.743 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T19:22:40.787 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T19:22:40.788 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T19:22:40.788 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2024-04-25T19:22:40.788 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.131:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T19:22:40.788 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T19:22:40.788 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.131:6789,172.21.15.195:6789,172.21.15.195:6790" 2024-04-25T19:22:40.788 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.131:6789,172.21.15.195:6789,172.21.15.195:6790:/ 2024-04-25T19:22:40.788 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=4ba607f8-c2c3-4d8d-85a8-7800763c470f" will pass to kernel 2024-04-25T19:22:40.790 INFO:teuthology.orchestra.run.smithi131.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T19:22:40.790 INFO:teuthology.orchestra.run.smithi131.stdout: You just mounted a file system that supports labels which does not 2024-04-25T19:22:40.790 INFO:teuthology.orchestra.run.smithi131.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T19:22:40.790 INFO:teuthology.orchestra.run.smithi131.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T19:22:40.791 INFO:teuthology.orchestra.run.smithi131.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T19:22:40.795 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T19:22:40.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:40.796 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T19:22:40.879 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T19:22:40.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T19:22:41.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:41.022 INFO:teuthology.orchestra.run.smithi131.stdout:client4662 2024-04-25T19:22:41.023 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:22:41.023 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:22:41.075 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T19:22:41.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T19:22:41.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:41.210 INFO:teuthology.orchestra.run.smithi131.stdout:client4662 2024-04-25T19:22:41.210 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T19:22:41.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T19:22:41.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:41.353 INFO:teuthology.orchestra.run.smithi131.stdout:client4662 2024-04-25T19:22:41.353 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4ba607f8-c2c3-4d8d-85a8-7800763c470f.client4662/status') 2024-04-25T19:22:41.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T19:22:41.497 INFO:teuthology.orchestra.run.smithi131.stdout:instance: client.4662 (3)192.168.0.1:0/2079235902 2024-04-25T19:22:41.498 INFO:teuthology.orchestra.run.smithi131.stdout:blocklisted: false 2024-04-25T19:22:41.498 INFO:teuthology.orchestra.run.smithi131.stderr:0+1 records in 2024-04-25T19:22:41.498 INFO:teuthology.orchestra.run.smithi131.stderr:0+1 records out 2024-04-25T19:22:41.498 INFO:teuthology.orchestra.run.smithi131.stderr:69 bytes copied, 0.000106683 s, 647 kB/s 2024-04-25T19:22:41.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:41.511 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-04-25T19:22:41.511 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T19:22:41.511 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T19:22:41.511 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T19:22:41.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.779+0000 7fcd81800640 1 Processor -- start 2024-04-25T19:22:41.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.780+0000 7fcd81800640 1 -- start start 2024-04-25T19:22:41.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.782+0000 7fcd81800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcd7c14ad60 0x7fcd7c070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:41.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.782+0000 7fcd81800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcd7c06c5c0 0x7fcd7c06c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:41.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.782+0000 7fcd81800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd7c0b4af0 con 0x7fcd7c0b5e40 2024-04-25T19:22:41.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.782+0000 7fcd81800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fcd7c0b4dd0 con 0x7fcd7c06c5c0 2024-04-25T19:22:41.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.782+0000 7fcd81800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fcd7c0b50b0 con 0x7fcd7c14ad60 2024-04-25T19:22:41.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.782+0000 7fcd7b400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcd7c06c5c0 0x7fcd7c06c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:41.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.783+0000 7fcd7b400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcd7c06c5c0 0x7fcd7c06c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:35448/0 (socket says 172.21.15.131:35448) 2024-04-25T19:22:41.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.783+0000 7fcd7b400640 1 -- 172.21.15.131:0/336098646 learned_addr learned my addr 172.21.15.131:0/336098646 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:41.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.783+0000 7fcd7aa00640 1 --2- 172.21.15.131:0/336098646 >> v2:172.21.15.195:3300/0 conn(0x7fcd7c14ad60 0x7fcd7c070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:41.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.783+0000 7fcd7b400640 1 -- 172.21.15.131:0/336098646 >> v2:172.21.15.195:3300/0 conn(0x7fcd7c14ad60 msgr2=0x7fcd7c070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:41.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.783+0000 7fcd7b400640 1 --2- 172.21.15.131:0/336098646 >> v2:172.21.15.195:3300/0 conn(0x7fcd7c14ad60 0x7fcd7c070010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:41.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.783+0000 7fcd7b400640 1 -- 172.21.15.131:0/336098646 >> v1:172.21.15.195:6789/0 conn(0x7fcd7c0b5e40 legacy=0x7fcd7c0b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:41.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.783+0000 7fcd7b400640 1 -- 172.21.15.131:0/336098646 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd7c0b5390 con 0x7fcd7c06c5c0 2024-04-25T19:22:41.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.784+0000 7fcd7b400640 1 --2- 172.21.15.131:0/336098646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd7c06c5c0 0x7fcd7c06c9d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0ce320 tx=0x7fcd7402a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264367908d7b8bd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:41.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.784+0000 7fcd79600640 1 -- 172.21.15.131:0/336098646 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd74036070 con 0x7fcd7c06c5c0 2024-04-25T19:22:41.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.784+0000 7fcd79600640 1 -- 172.21.15.131:0/336098646 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd74031600 con 0x7fcd7c06c5c0 2024-04-25T19:22:41.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.784+0000 7fcd79600640 1 -- 172.21.15.131:0/336098646 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd740319d0 con 0x7fcd7c06c5c0 2024-04-25T19:22:41.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.785+0000 7fcd81800640 1 -- 172.21.15.131:0/336098646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd7c06c5c0 msgr2=0x7fcd7c06c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:41.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.785+0000 7fcd81800640 1 --2- 172.21.15.131:0/336098646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd7c06c5c0 0x7fcd7c06c9d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0ce320 tx=0x7fcd7402a630 comp rx=0 tx=0).stop 2024-04-25T19:22:41.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.785+0000 7fcd81800640 1 -- 172.21.15.131:0/336098646 shutdown_connections 2024-04-25T19:22:41.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.785+0000 7fcd81800640 1 --2- 172.21.15.131:0/336098646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd7c06c5c0 0x7fcd7c06c9d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:41.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.785+0000 7fcd81800640 1 --2- 172.21.15.131:0/336098646 >> v2:172.21.15.195:3300/0 conn(0x7fcd7c14ad60 0x7fcd7c070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:41.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.785+0000 7fcd81800640 1 -- 172.21.15.131:0/336098646 >> 172.21.15.131:0/336098646 conn(0x7fcd7c0d1ae0 msgr2=0x7fcd7c0d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:41.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.785+0000 7fcd81800640 1 -- 172.21.15.131:0/336098646 shutdown_connections 2024-04-25T19:22:41.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.786+0000 7fcd81800640 1 -- 172.21.15.131:0/336098646 wait complete. 2024-04-25T19:22:41.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.788+0000 7fcd81800640 1 Processor -- start 2024-04-25T19:22:41.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.788+0000 7fcd81800640 1 -- start start 2024-04-25T19:22:41.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.789+0000 7fcd81800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd7c06c5c0 0x7fcd7c147400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:41.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.789+0000 7fcd81800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd7c0b5e40 0x7fcd7c1edcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:41.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.790+0000 7fcd81800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd7c14ad60 0x7fcd7c1fe050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:41.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.790+0000 7fcd81800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcd7c0706d0 con 0x7fcd7c06c5c0 2024-04-25T19:22:41.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.790+0000 7fcd81800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcd7c070550 con 0x7fcd7c0b5e40 2024-04-25T19:22:41.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.790+0000 7fcd81800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcd7c06fb80 con 0x7fcd7c14ad60 2024-04-25T19:22:41.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.790+0000 7fcd7aa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd7c06c5c0 0x7fcd7c147400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:41.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.790+0000 7fcd7aa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd7c06c5c0 0x7fcd7c147400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:35458/0 (socket says 172.21.15.131:35458) 2024-04-25T19:22:41.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.790+0000 7fcd7aa00640 1 -- 172.21.15.131:0/2456917132 learned_addr learned my addr 172.21.15.131:0/2456917132 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:41.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.790+0000 7fcd7aa00640 1 -- 172.21.15.131:0/2456917132 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd7c14ad60 msgr2=0x7fcd7c1fe050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:41.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.790+0000 7fcd7b400640 1 --2- 172.21.15.131:0/2456917132 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd7c14ad60 0x7fcd7c1fe050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:41.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.790+0000 7fcd7a000640 1 --2- 172.21.15.131:0/2456917132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd7c0b5e40 0x7fcd7c1edcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:41.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.790+0000 7fcd7aa00640 1 --2- 172.21.15.131:0/2456917132 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd7c14ad60 0x7fcd7c1fe050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:41.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.790+0000 7fcd7aa00640 1 -- 172.21.15.131:0/2456917132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd7c0b5e40 msgr2=0x7fcd7c1edcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:41.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.790+0000 7fcd7aa00640 1 --2- 172.21.15.131:0/2456917132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd7c0b5e40 0x7fcd7c1edcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:41.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.790+0000 7fcd7aa00640 1 -- 172.21.15.131:0/2456917132 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd7c165c70 con 0x7fcd7c06c5c0 2024-04-25T19:22:41.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.791+0000 7fcd7aa00640 1 --2- 172.21.15.131:0/2456917132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd7c06c5c0 0x7fcd7c147400 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00c820 tx=0x7fcd6c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:41.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.791+0000 7fcd72a00640 1 -- 172.21.15.131:0/2456917132 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c004030 con 0x7fcd7c06c5c0 2024-04-25T19:22:41.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.791+0000 7fcd72a00640 1 -- 172.21.15.131:0/2456917132 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd6c0041d0 con 0x7fcd7c06c5c0 2024-04-25T19:22:41.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.791+0000 7fcd81800640 1 -- 172.21.15.131:0/2456917132 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd7c1fa920 con 0x7fcd7c06c5c0 2024-04-25T19:22:41.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.791+0000 7fcd72a00640 1 -- 172.21.15.131:0/2456917132 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c007830 con 0x7fcd7c06c5c0 2024-04-25T19:22:41.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.791+0000 7fcd81800640 1 -- 172.21.15.131:0/2456917132 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd7c1eea40 con 0x7fcd7c06c5c0 2024-04-25T19:22:41.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.792+0000 7fcd81800640 1 -- 172.21.15.131:0/2456917132 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd7c050740 con 0x7fcd7c06c5c0 2024-04-25T19:22:41.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.794+0000 7fcd72a00640 1 -- 172.21.15.131:0/2456917132 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fcd6c0079d0 con 0x7fcd7c06c5c0 2024-04-25T19:22:41.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.795+0000 7fcd72a00640 1 --2- 172.21.15.131:0/2456917132 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fcd5c0744e0 0x7fcd5c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:41.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.796+0000 7fcd72a00640 1 -- 172.21.15.131:0/2456917132 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcd6c095190 con 0x7fcd7c06c5c0 2024-04-25T19:22:41.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.796+0000 7fcd7a000640 1 --2- 172.21.15.131:0/2456917132 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fcd5c0744e0 0x7fcd5c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:41.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.797+0000 7fcd7a000640 1 --2- 172.21.15.131:0/2456917132 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fcd5c0744e0 0x7fcd5c0769f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcd6800a750 tx=0x7fcd68008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:41.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:41.801+0000 7fcd72a00640 1 -- 172.21.15.131:0/2456917132 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcd6c015020 con 0x7fcd7c06c5c0 2024-04-25T19:22:42.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:42.045+0000 7fcd81800640 1 -- 172.21.15.131:0/2456917132 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcd7c0b2840 con 0x7fcd7c06c5c0 2024-04-25T19:22:42.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:42.046+0000 7fcd72a00640 1 -- 172.21.15.131:0/2456917132 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fcd6c05f880 con 0x7fcd7c06c5c0 2024-04-25T19:22:42.047 INFO:teuthology.orchestra.run.smithi131.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T19:22:42.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:42.049+0000 7fcd81800640 1 -- 172.21.15.131:0/2456917132 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fcd5c0744e0 msgr2=0x7fcd5c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:42.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:42.049+0000 7fcd81800640 1 --2- 172.21.15.131:0/2456917132 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fcd5c0744e0 0x7fcd5c0769f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcd6800a750 tx=0x7fcd68008040 comp rx=0 tx=0).stop 2024-04-25T19:22:42.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:42.049+0000 7fcd81800640 1 -- 172.21.15.131:0/2456917132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd7c06c5c0 msgr2=0x7fcd7c147400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:42.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:42.049+0000 7fcd81800640 1 --2- 172.21.15.131:0/2456917132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd7c06c5c0 0x7fcd7c147400 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00c820 tx=0x7fcd6c00cce0 comp rx=0 tx=0).stop 2024-04-25T19:22:42.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:42.049+0000 7fcd81800640 1 -- 172.21.15.131:0/2456917132 shutdown_connections 2024-04-25T19:22:42.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:42.049+0000 7fcd81800640 1 --2- 172.21.15.131:0/2456917132 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fcd5c0744e0 0x7fcd5c0769f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:42.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:42.049+0000 7fcd81800640 1 --2- 172.21.15.131:0/2456917132 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd7c14ad60 0x7fcd7c1fe050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:42.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:42.049+0000 7fcd81800640 1 --2- 172.21.15.131:0/2456917132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd7c0b5e40 0x7fcd7c1edcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:42.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:42.049+0000 7fcd81800640 1 --2- 172.21.15.131:0/2456917132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd7c06c5c0 0x7fcd7c147400 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:42.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:42.049+0000 7fcd81800640 1 -- 172.21.15.131:0/2456917132 >> 172.21.15.131:0/2456917132 conn(0x7fcd7c0d1ae0 msgr2=0x7fcd7c0b2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:42.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:42.050+0000 7fcd81800640 1 -- 172.21.15.131:0/2456917132 shutdown_connections 2024-04-25T19:22:42.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:42.050+0000 7fcd81800640 1 -- 172.21.15.131:0/2456917132 wait complete. 2024-04-25T19:22:42.080 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T19:22:42.080 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T19:22:42.080 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2024-04-25T19:22:42.080 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-25T19:22:42.080 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T19:22:42.080 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T19:22:42.080 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T19:22:42.080 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T19:22:42.080 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-25T19:22:42.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:42.081 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2024-04-25T19:22:42.130 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T19:22:42.131 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T19:22:42.131 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T19:22:42.131 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:42.131 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2024-04-25T19:22:42.131 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:42.131 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T19:22:42.131 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:22:42.131 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2024-04-25T19:22:42.131 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T19:22:42.131 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:22:42.131 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2024-04-25T19:22:42.131 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T19:22:42.131 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:22:42.131 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T19:22:42.132 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:22:42.132 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T19:22:42.132 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42647sec preferred_lft 42647sec 2024-04-25T19:22:42.132 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2024-04-25T19:22:42.132 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:42.132 INFO:teuthology.orchestra.run.smithi131.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T19:22:42.132 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 06:e0:b4:1f:52:82 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:22:42.132 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T19:22:42.132 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:42.132 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::d448:c8ff:fe91:466b/64 scope link 2024-04-25T19:22:42.132 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:42.132 INFO:teuthology.orchestra.run.smithi131.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T19:22:42.132 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 06:e0:b4:1f:52:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T19:22:42.133 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::4e0:b4ff:fe1f:5282/64 scope link 2024-04-25T19:22:42.133 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:42.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:42.133 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T19:22:42.207 INFO:teuthology.orchestra.run.smithi131.stdout:1 2024-04-25T19:22:42.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:42.211 DEBUG:teuthology.orchestra.run.smithi131:> route 2024-04-25T19:22:42.259 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2024-04-25T19:22:42.259 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T19:22:42.259 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T19:22:42.259 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T19:22:42.259 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T19:22:42.260 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T19:22:42.260 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-04-25T19:22:42.260 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T19:22:42.260 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T19:22:42.260 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T19:22:42.260 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-04-25T19:22:42.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T19:22:42.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:42.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:42.466 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-04-25T19:22:42.514 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T19:22:42.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:42.515 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list-id 2024-04-25T19:22:42.566 INFO:teuthology.orchestra.run.smithi131.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-25T19:22:42.568 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T19:22:42.568 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-04-25T19:22:42.569 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T19:22:42.569 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-25T19:22:42.569 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-04-25T19:22:42.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T19:22:42.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:42.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:42.753 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T19:22:42.829 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T19:22:42.829 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T19:22:42.829 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T19:22:42.829 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:42.829 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2024-04-25T19:22:42.830 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:42.830 INFO:teuthology.orchestra.run.smithi131.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T19:22:42.830 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 02:3c:44:5e:0b:a7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T19:22:42.830 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T19:22:42.830 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:42.830 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::3c:44ff:fe5e:ba7/64 scope link 2024-04-25T19:22:42.830 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:42.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:42.834 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T19:22:42.916 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T19:22:42.916 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T19:22:42.916 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T19:22:42.916 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:42.917 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2024-04-25T19:22:42.917 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:42.917 INFO:teuthology.orchestra.run.smithi131.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T19:22:42.917 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 02:3c:44:5e:0b:a7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T19:22:42.917 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T19:22:42.917 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:42.917 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::3c:44ff:fe5e:ba7/64 scope link 2024-04-25T19:22:42.917 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:42.920 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-25T19:22:42.920 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T19:22:42.920 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-04-25T19:22:42.921 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-25T19:22:42.921 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T19:22:42.921 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-25T19:22:42.921 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-25T19:22:42.921 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-25T19:22:42.921 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-04-25T19:22:43.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T19:22:43.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:43.200 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T19:22:43.200 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-04-25T19:22:43.200 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.1 up 2024-04-25T19:22:43.200 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T19:22:43.200 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-04-25T19:22:43.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T19:22:43.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:43.411 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T19:22:43.412 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-25T19:22:43.457 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-25T19:22:43.457 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T19:22:43.458 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-25T19:22:43.554 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T19:22:43.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:43.554 DEBUG:teuthology.orchestra.run.smithi131:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T19:22:43.761 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T19:22:43.761 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T19:22:43.761 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2024-04-25T19:22:43.788 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T19:22:43.789 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T19:22:43.789 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2024-04-25T19:22:43.789 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.131:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T19:22:43.789 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T19:22:43.826 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T19:22:43.827 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T19:22:43.827 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2024-04-25T19:22:43.827 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.131:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T19:22:43.827 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T19:22:43.827 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.131:6789,172.21.15.195:6789,172.21.15.195:6790" 2024-04-25T19:22:43.827 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.131:6789,172.21.15.195:6789,172.21.15.195:6790:/ 2024-04-25T19:22:43.827 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=4ba607f8-c2c3-4d8d-85a8-7800763c470f" will pass to kernel 2024-04-25T19:22:43.828 INFO:teuthology.orchestra.run.smithi131.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-04-25T19:22:43.828 INFO:teuthology.orchestra.run.smithi131.stdout: You just mounted a file system that supports labels which does not 2024-04-25T19:22:43.829 INFO:teuthology.orchestra.run.smithi131.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T19:22:43.829 INFO:teuthology.orchestra.run.smithi131.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T19:22:43.829 INFO:teuthology.orchestra.run.smithi131.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T19:22:43.834 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T19:22:43.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:43.834 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-25T19:22:43.910 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T19:22:44.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T19:22:44.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:44.027 INFO:teuthology.orchestra.run.smithi131.stdout:client4427 2024-04-25T19:22:44.027 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:22:44.028 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:22:44.076 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T19:22:44.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T19:22:44.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:44.239 INFO:teuthology.orchestra.run.smithi131.stdout:client4427 2024-04-25T19:22:44.239 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T19:22:44.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T19:22:44.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:44.357 INFO:teuthology.orchestra.run.smithi131.stdout:client4427 2024-04-25T19:22:44.357 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4ba607f8-c2c3-4d8d-85a8-7800763c470f.client4427/status') 2024-04-25T19:22:44.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T19:22:44.489 INFO:teuthology.orchestra.run.smithi131.stdout:instance: client.4427 (3)172.21.15.131:0/2770339 2024-04-25T19:22:44.489 INFO:teuthology.orchestra.run.smithi131.stdout:blocklisted: false 2024-04-25T19:22:44.490 INFO:teuthology.orchestra.run.smithi131.stderr:0+1 records in 2024-04-25T19:22:44.490 INFO:teuthology.orchestra.run.smithi131.stderr:0+1 records out 2024-04-25T19:22:44.490 INFO:teuthology.orchestra.run.smithi131.stderr:68 bytes copied, 8.4578e-05 s, 804 kB/s 2024-04-25T19:22:44.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:44.502 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-04-25T19:22:44.502 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T19:22:44.502 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T19:22:44.503 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T19:22:44.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.768+0000 7f2315e00640 1 Processor -- start 2024-04-25T19:22:44.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.768+0000 7f2315e00640 1 -- start start 2024-04-25T19:22:44.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.771+0000 7f2315e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f23101610f0 0x7f23100b0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:44.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.771+0000 7f2315e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2310164640 con 0x7f231006dce0 2024-04-25T19:22:44.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.771+0000 7f2315e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2310164920 con 0x7f2310163cd0 2024-04-25T19:22:44.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.771+0000 7f2315e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f2310160c60 con 0x7f23101610f0 2024-04-25T19:22:44.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.771+0000 7f2315400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f231006dce0 0x7f23101569e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:39012/0 (socket says 172.21.15.131:39012) 2024-04-25T19:22:44.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.771+0000 7f2315400640 1 -- 172.21.15.131:0/219755789 learned_addr learned my addr 172.21.15.131:0/219755789 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:44.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.772+0000 7f230f400640 1 -- 172.21.15.131:0/219755789 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2229229966 0 0) 0x7f2310164640 con 0x7f231006dce0 2024-04-25T19:22:44.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.772+0000 7f2314a00640 1 --2- 172.21.15.131:0/219755789 >> v2:172.21.15.195:3300/0 conn(0x7f23101610f0 0x7f23100b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:44.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.772+0000 7f230f400640 1 -- 172.21.15.131:0/219755789 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22f8003520 con 0x7f231006dce0 2024-04-25T19:22:44.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.772+0000 7f230f400640 1 -- 172.21.15.131:0/219755789 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 146474530 0 0) 0x7f22f8003520 con 0x7f231006dce0 2024-04-25T19:22:44.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.772+0000 7f230f400640 1 -- 172.21.15.131:0/219755789 >> v2:172.21.15.195:3300/0 conn(0x7f23101610f0 msgr2=0x7f23100b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:44.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.772+0000 7f230f400640 1 --2- 172.21.15.131:0/219755789 >> v2:172.21.15.195:3300/0 conn(0x7f23101610f0 0x7f23100b0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:44.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.772+0000 7f230f400640 1 -- 172.21.15.131:0/219755789 >> v1:172.21.15.195:6789/0 conn(0x7f2310163cd0 legacy=0x7f231006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:44.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.772+0000 7f230f400640 1 -- 172.21.15.131:0/219755789 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23101608f0 con 0x7f231006dce0 2024-04-25T19:22:44.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.772+0000 7f230f400640 1 -- 172.21.15.131:0/219755789 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f23080019f0 con 0x7f231006dce0 2024-04-25T19:22:44.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.772+0000 7f230f400640 1 -- 172.21.15.131:0/219755789 >> v1:172.21.15.131:6789/0 conn(0x7f231006dce0 legacy=0x7f23101569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:44.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.772+0000 7f230f400640 1 --2- 172.21.15.131:0/219755789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22f8003a00 0x7f22f8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:44.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.772+0000 7f230f400640 1 --2- 172.21.15.131:0/219755789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22f8004800 0x7f22f8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:44.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.772+0000 7f230f400640 1 --2- 172.21.15.131:0/219755789 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22f8005270 0x7f22f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:44.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.772+0000 7f230f400640 1 -- 172.21.15.131:0/219755789 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2310160c60 con 0x7f22f8003a00 2024-04-25T19:22:44.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.772+0000 7f230f400640 1 -- 172.21.15.131:0/219755789 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f22f800c190 con 0x7f22f8004800 2024-04-25T19:22:44.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.772+0000 7f230f400640 1 -- 172.21.15.131:0/219755789 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f22f800c390 con 0x7f22f8005270 2024-04-25T19:22:44.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.772+0000 7f2314a00640 1 --2- 172.21.15.131:0/219755789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22f8003a00 0x7f22f8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:44.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.773+0000 7f2314a00640 1 -- 172.21.15.131:0/219755789 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22f8005270 msgr2=0x7f22f800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:44.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.773+0000 7f2314a00640 1 --2- 172.21.15.131:0/219755789 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22f8005270 0x7f22f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:44.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.773+0000 7f2314a00640 1 -- 172.21.15.131:0/219755789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22f8004800 msgr2=0x7f22f8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:44.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.773+0000 7f2314a00640 1 --2- 172.21.15.131:0/219755789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22f8004800 0x7f22f8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:44.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.773+0000 7f2314a00640 1 -- 172.21.15.131:0/219755789 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f8003520 con 0x7f22f8003a00 2024-04-25T19:22:44.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.773+0000 7f2315400640 1 -- 172.21.15.131:0/219755789 reap_dead start 2024-04-25T19:22:44.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.774+0000 7f2314a00640 1 --2- 172.21.15.131:0/219755789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22f8003a00 0x7f22f8003e70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2304009ac0 tx=0x7f22f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=864cbef297e79ee6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:44.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.774+0000 7f230f400640 1 -- 172.21.15.131:0/219755789 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2304036070 con 0x7f22f8003a00 2024-04-25T19:22:44.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.774+0000 7f230f400640 1 -- 172.21.15.131:0/219755789 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2304031400 con 0x7f22f8003a00 2024-04-25T19:22:44.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.774+0000 7f230f400640 1 -- 172.21.15.131:0/219755789 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2304009690 con 0x7f22f8003a00 2024-04-25T19:22:44.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.775+0000 7f2315e00640 1 -- 172.21.15.131:0/219755789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22f8003a00 msgr2=0x7f22f8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:44.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.775+0000 7f2315e00640 1 --2- 172.21.15.131:0/219755789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22f8003a00 0x7f22f8003e70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2304009ac0 tx=0x7f22f8005830 comp rx=0 tx=0).stop 2024-04-25T19:22:44.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.775+0000 7f2315e00640 1 -- 172.21.15.131:0/219755789 shutdown_connections 2024-04-25T19:22:44.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.775+0000 7f2315e00640 1 --2- 172.21.15.131:0/219755789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22f8003a00 0x7f22f8003e70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:44.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.775+0000 7f2315e00640 1 -- 172.21.15.131:0/219755789 >> 172.21.15.131:0/219755789 conn(0x7f2310072ee0 msgr2=0x7f23100732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:44.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.775+0000 7f2315e00640 1 -- 172.21.15.131:0/219755789 shutdown_connections 2024-04-25T19:22:44.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.775+0000 7f2315e00640 1 -- 172.21.15.131:0/219755789 wait complete. 2024-04-25T19:22:44.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.778+0000 7f2315e00640 1 Processor -- start 2024-04-25T19:22:44.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.778+0000 7f2315e00640 1 -- start start 2024-04-25T19:22:44.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.779+0000 7f2315e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22f8003a00 0x7f23101436e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:44.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.779+0000 7f2315e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f231015bff0 0x7f231015c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:44.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.779+0000 7f2315e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f231015c940 0x7f231015acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:44.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.779+0000 7f2315e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f23100b7490 con 0x7f231015bff0 2024-04-25T19:22:44.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.779+0000 7f2315e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2310160690 con 0x7f22f8003a00 2024-04-25T19:22:44.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.779+0000 7f2315e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f23100b7610 con 0x7f231015c940 2024-04-25T19:22:44.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.780+0000 7f230fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f231015bff0 0x7f231015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:44.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.780+0000 7f230fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f231015bff0 0x7f231015c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:35482/0 (socket says 172.21.15.131:35482) 2024-04-25T19:22:44.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.780+0000 7f230fe00640 1 -- 172.21.15.131:0/944699950 learned_addr learned my addr 172.21.15.131:0/944699950 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:44.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.780+0000 7f2314a00640 1 --2- 172.21.15.131:0/944699950 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22f8003a00 0x7f23101436e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:44.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.780+0000 7f2315400640 1 --2- 172.21.15.131:0/944699950 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f231015c940 0x7f231015acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:44.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.780+0000 7f230fe00640 1 -- 172.21.15.131:0/944699950 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f231015c940 msgr2=0x7f231015acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:44.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.780+0000 7f230fe00640 1 --2- 172.21.15.131:0/944699950 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f231015c940 0x7f231015acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:44.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.780+0000 7f230fe00640 1 -- 172.21.15.131:0/944699950 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22f8003a00 msgr2=0x7f23101436e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:44.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.780+0000 7f230fe00640 1 --2- 172.21.15.131:0/944699950 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22f8003a00 0x7f23101436e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:44.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.780+0000 7f230fe00640 1 -- 172.21.15.131:0/944699950 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2310158600 con 0x7f231015bff0 2024-04-25T19:22:44.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.780+0000 7f2315400640 1 --2- 172.21.15.131:0/944699950 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f231015c940 0x7f231015acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T19:22:44.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.781+0000 7f230fe00640 1 --2- 172.21.15.131:0/944699950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f231015bff0 0x7f231015c400 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f22fc00c500 tx=0x7f22fc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:44.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.781+0000 7f230cc00640 1 -- 172.21.15.131:0/944699950 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22fc0052d0 con 0x7f231015bff0 2024-04-25T19:22:44.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.781+0000 7f230cc00640 1 -- 172.21.15.131:0/944699950 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22fc005470 con 0x7f231015bff0 2024-04-25T19:22:44.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.781+0000 7f2315e00640 1 -- 172.21.15.131:0/944699950 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f231015a1e0 con 0x7f231015bff0 2024-04-25T19:22:44.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.781+0000 7f230cc00640 1 -- 172.21.15.131:0/944699950 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22fc012870 con 0x7f231015bff0 2024-04-25T19:22:44.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.781+0000 7f2315e00640 1 -- 172.21.15.131:0/944699950 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f231015a7a0 con 0x7f231015bff0 2024-04-25T19:22:44.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.782+0000 7f2315e00640 1 -- 172.21.15.131:0/944699950 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2310158370 con 0x7f231015bff0 2024-04-25T19:22:44.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.783+0000 7f230cc00640 1 -- 172.21.15.131:0/944699950 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f22fc012a10 con 0x7f231015bff0 2024-04-25T19:22:44.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.784+0000 7f230cc00640 1 --2- 172.21.15.131:0/944699950 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f22f00744e0 0x7f22f00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:44.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.784+0000 7f230cc00640 1 -- 172.21.15.131:0/944699950 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f22fc094e00 con 0x7f231015bff0 2024-04-25T19:22:44.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.785+0000 7f2314a00640 1 --2- 172.21.15.131:0/944699950 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f22f00744e0 0x7f22f00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:44.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.786+0000 7f2314a00640 1 --2- 172.21.15.131:0/944699950 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f22f00744e0 0x7f22f00769f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2304033000 tx=0x7f2304008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:44.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:44.789+0000 7f230cc00640 1 -- 172.21.15.131:0/944699950 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f22fc05f610 con 0x7f231015bff0 2024-04-25T19:22:45.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:45.032+0000 7f2315e00640 1 -- 172.21.15.131:0/944699950 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2310050740 con 0x7f231015bff0 2024-04-25T19:22:45.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:45.033+0000 7f230cc00640 1 -- 172.21.15.131:0/944699950 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f22fc05ef10 con 0x7f231015bff0 2024-04-25T19:22:45.035 INFO:teuthology.orchestra.run.smithi131.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T19:22:45.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:45.036+0000 7f2315e00640 1 -- 172.21.15.131:0/944699950 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f22f00744e0 msgr2=0x7f22f00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:45.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:45.036+0000 7f2315e00640 1 --2- 172.21.15.131:0/944699950 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f22f00744e0 0x7f22f00769f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2304033000 tx=0x7f2304008030 comp rx=0 tx=0).stop 2024-04-25T19:22:45.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:45.036+0000 7f2315e00640 1 -- 172.21.15.131:0/944699950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f231015bff0 msgr2=0x7f231015c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:45.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:45.036+0000 7f2315e00640 1 --2- 172.21.15.131:0/944699950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f231015bff0 0x7f231015c400 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f22fc00c500 tx=0x7f22fc00c9c0 comp rx=0 tx=0).stop 2024-04-25T19:22:45.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:45.036+0000 7f2315e00640 1 -- 172.21.15.131:0/944699950 shutdown_connections 2024-04-25T19:22:45.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:45.036+0000 7f2315e00640 1 --2- 172.21.15.131:0/944699950 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f22f00744e0 0x7f22f00769f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:45.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:45.036+0000 7f2315e00640 1 --2- 172.21.15.131:0/944699950 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f231015c940 0x7f231015acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:45.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:45.036+0000 7f2315e00640 1 --2- 172.21.15.131:0/944699950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f231015bff0 0x7f231015c400 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:45.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:45.036+0000 7f2315e00640 1 --2- 172.21.15.131:0/944699950 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22f8003a00 0x7f23101436e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:45.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:45.036+0000 7f2315e00640 1 -- 172.21.15.131:0/944699950 >> 172.21.15.131:0/944699950 conn(0x7f2310072ee0 msgr2=0x7f2310154d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:45.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:45.036+0000 7f2315e00640 1 -- 172.21.15.131:0/944699950 shutdown_connections 2024-04-25T19:22:45.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:45.036+0000 7f2315e00640 1 -- 172.21.15.131:0/944699950 wait complete. 2024-04-25T19:22:45.063 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T19:22:45.063 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T19:22:45.063 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi195.front.sepia.ceph.com 2024-04-25T19:22:45.063 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T19:22:45.064 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T19:22:45.064 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T19:22:45.064 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T19:22:45.064 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T19:22:45.064 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T19:22:45.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:45.064 DEBUG:teuthology.orchestra.run.smithi195:> ip addr 2024-04-25T19:22:45.121 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T19:22:45.121 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T19:22:45.121 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T19:22:45.121 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:45.121 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-04-25T19:22:45.121 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:45.121 INFO:teuthology.orchestra.run.smithi195.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T19:22:45.121 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:22:45.121 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f0 2024-04-25T19:22:45.121 INFO:teuthology.orchestra.run.smithi195.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T19:22:45.122 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:22:45.122 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f1 2024-04-25T19:22:45.122 INFO:teuthology.orchestra.run.smithi195.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T19:22:45.122 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:80 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:22:45.122 INFO:teuthology.orchestra.run.smithi195.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T19:22:45.122 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:81 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:22:45.122 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.21.15.195/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T19:22:45.122 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft 42638sec preferred_lft 42638sec 2024-04-25T19:22:45.122 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::ec4:7aff:fe88:8081/64 scope link 2024-04-25T19:22:45.122 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:45.123 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T19:22:45.124 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T19:22:45.124 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T19:22:45.124 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add name ceph-brx type bridge 2024-04-25T19:22:45.124 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip addr flush dev ceph-brx 2024-04-25T19:22:45.124 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set ceph-brx up 2024-04-25T19:22:45.124 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T19:22:45.124 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T19:22:45.234 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T19:22:45.603 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:45.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:45.613 DEBUG:teuthology.orchestra.run.smithi195:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T19:22:45.686 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-04-25T19:22:45.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:45.690 DEBUG:teuthology.orchestra.run.smithi195:> route 2024-04-25T19:22:45.752 INFO:teuthology.orchestra.run.smithi195.stdout:Kernel IP routing table 2024-04-25T19:22:45.752 INFO:teuthology.orchestra.run.smithi195.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T19:22:45.752 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T19:22:45.752 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T19:22:45.752 INFO:teuthology.orchestra.run.smithi195.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T19:22:45.752 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T19:22:45.753 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T19:22:45.753 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T19:22:45.753 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T19:22:45.753 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T19:22:45.753 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T19:22:45.856 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T19:22:46.499 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:46.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:46.510 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T19:22:46.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:46.563 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list-id 2024-04-25T19:22:46.615 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T19:22:46.615 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T19:22:46.615 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T19:22:46.615 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-25T19:22:46.615 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T19:22:46.719 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T19:22:46.787 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:46.796 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-25T19:22:46.796 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T19:22:46.796 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T19:22:46.796 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-25T19:22:46.797 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T19:22:46.797 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-25T19:22:46.797 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-25T19:22:46.797 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-25T19:22:46.797 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T19:22:46.888 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T19:22:47.072 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:47.081 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T19:22:47.081 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T19:22:47.081 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set brx.0 up 2024-04-25T19:22:47.082 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T19:22:47.082 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T19:22:47.174 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T19:22:47.270 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:47.280 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T19:22:47.280 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T19:22:47.326 INFO:teuthology.orchestra.run.smithi195.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T19:22:47.327 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T19:22:47.327 DEBUG:teuthology.orchestra.run.smithi195:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T19:22:47.423 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T19:22:47.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:47.423 DEBUG:teuthology.orchestra.run.smithi195:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T19:22:47.632 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T19:22:47.632 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T19:22:47.632 INFO:teuthology.orchestra.run.smithi195.stdout:invalid new device string format 2024-04-25T19:22:48.317 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T19:22:48.318 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T19:22:48.318 INFO:teuthology.orchestra.run.smithi195.stdout:invalid new device string format 2024-04-25T19:22:48.318 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.131:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T19:22:48.318 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T19:22:48.378 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T19:22:48.378 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T19:22:48.378 INFO:teuthology.orchestra.run.smithi195.stdout:invalid new device string format 2024-04-25T19:22:48.378 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.131:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T19:22:48.378 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T19:22:48.378 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.131:6789,172.21.15.195:6789,172.21.15.195:6790" 2024-04-25T19:22:48.378 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.131:6789,172.21.15.195:6789,172.21.15.195:6790:/ 2024-04-25T19:22:48.378 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=4ba607f8-c2c3-4d8d-85a8-7800763c470f" will pass to kernel 2024-04-25T19:22:48.383 INFO:teuthology.orchestra.run.smithi195.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-25T19:22:48.383 INFO:teuthology.orchestra.run.smithi195.stdout: You just mounted a file system that supports labels which does not 2024-04-25T19:22:48.383 INFO:teuthology.orchestra.run.smithi195.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T19:22:48.383 INFO:teuthology.orchestra.run.smithi195.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T19:22:48.383 INFO:teuthology.orchestra.run.smithi195.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T19:22:48.388 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T19:22:48.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:48.388 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T19:22:48.465 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T19:22:48.568 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T19:22:48.574 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:48.583 INFO:teuthology.orchestra.run.smithi195.stdout:client4677 2024-04-25T19:22:48.583 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:22:48.583 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:22:48.634 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T19:22:48.739 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T19:22:48.745 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:48.754 INFO:teuthology.orchestra.run.smithi195.stdout:client4677 2024-04-25T19:22:48.755 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T19:22:48.849 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T19:22:48.854 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:48.863 INFO:teuthology.orchestra.run.smithi195.stdout:client4677 2024-04-25T19:22:48.863 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4ba607f8-c2c3-4d8d-85a8-7800763c470f.client4677/status') 2024-04-25T19:22:48.964 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T19:22:48.993 INFO:teuthology.orchestra.run.smithi195.stdout:instance: client.4677 (3)172.21.15.195:0/536350610 2024-04-25T19:22:48.993 INFO:teuthology.orchestra.run.smithi195.stdout:blocklisted: false 2024-04-25T19:22:48.993 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records in 2024-04-25T19:22:48.994 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records out 2024-04-25T19:22:48.994 INFO:teuthology.orchestra.run.smithi195.stderr:70 bytes copied, 8.2064e-05 s, 853 kB/s 2024-04-25T19:22:48.996 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:49.006 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-04-25T19:22:49.007 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T19:22:49.007 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T19:22:49.007 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T19:22:49.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.311+0000 7fbfc8e00640 1 Processor -- start 2024-04-25T19:22:49.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.312+0000 7fbfc8e00640 1 -- start start 2024-04-25T19:22:49.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.314+0000 7fbfc8e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbfc41443c0 0x7fbfc406fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:49.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.314+0000 7fbfc8e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbfc4070370 0x7fbfc40cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:49.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.314+0000 7fbfc8e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbfc40cfb20 0x7fbfc40ce330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:49.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.314+0000 7fbfc8e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fbfc40708d0 con 0x7fbfc4070370 2024-04-25T19:22:49.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.314+0000 7fbfc8e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fbfc415f160 con 0x7fbfc41443c0 2024-04-25T19:22:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.314+0000 7fbfc8e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbfc40cff30 con 0x7fbfc40cfb20 2024-04-25T19:22:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.314+0000 7fbfc1400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbfc4070370 0x7fbfc40cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.314+0000 7fbfc1400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbfc4070370 0x7fbfc40cf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:37818/0 (socket says 172.21.15.131:37818) 2024-04-25T19:22:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.314+0000 7fbfc1400640 1 -- 172.21.15.131:0/3007366831 learned_addr learned my addr 172.21.15.131:0/3007366831 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.315+0000 7fbfc1e00640 1 --2- 172.21.15.131:0/3007366831 >> v2:172.21.15.195:3300/0 conn(0x7fbfc41443c0 0x7fbfc406fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.315+0000 7fbfc2800640 1 --2- 172.21.15.131:0/3007366831 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbfc40cfb20 0x7fbfc40ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.315+0000 7fbfc1400640 1 -- 172.21.15.131:0/3007366831 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbfc40cfb20 msgr2=0x7fbfc40ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.315+0000 7fbfc1400640 1 --2- 172.21.15.131:0/3007366831 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbfc40cfb20 0x7fbfc40ce330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.315+0000 7fbfc1400640 1 -- 172.21.15.131:0/3007366831 >> v2:172.21.15.195:3300/0 conn(0x7fbfc41443c0 msgr2=0x7fbfc406fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.315+0000 7fbfc1400640 1 --2- 172.21.15.131:0/3007366831 >> v2:172.21.15.195:3300/0 conn(0x7fbfc41443c0 0x7fbfc406fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.315+0000 7fbfc1400640 1 -- 172.21.15.131:0/3007366831 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc415f5f0 con 0x7fbfc4070370 2024-04-25T19:22:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.316+0000 7fbfc1400640 1 --2- 172.21.15.131:0/3007366831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbfc4070370 0x7fbfc40cf5e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4072820 tx=0x7fbfac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4455df47b23fbde server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:49.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.316+0000 7fbfc0a00640 1 -- 172.21.15.131:0/3007366831 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac037070 con 0x7fbfc4070370 2024-04-25T19:22:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.316+0000 7fbfc0a00640 1 -- 172.21.15.131:0/3007366831 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfac032440 con 0x7fbfc4070370 2024-04-25T19:22:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.316+0000 7fbfc0a00640 1 -- 172.21.15.131:0/3007366831 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac032810 con 0x7fbfc4070370 2024-04-25T19:22:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.317+0000 7fbfc8e00640 1 -- 172.21.15.131:0/3007366831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbfc4070370 msgr2=0x7fbfc40cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.317+0000 7fbfc8e00640 1 --2- 172.21.15.131:0/3007366831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbfc4070370 0x7fbfc40cf5e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4072820 tx=0x7fbfac02a1e0 comp rx=0 tx=0).stop 2024-04-25T19:22:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.317+0000 7fbfc8e00640 1 -- 172.21.15.131:0/3007366831 shutdown_connections 2024-04-25T19:22:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.317+0000 7fbfc8e00640 1 --2- 172.21.15.131:0/3007366831 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbfc40cfb20 0x7fbfc40ce330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.317+0000 7fbfc8e00640 1 --2- 172.21.15.131:0/3007366831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbfc4070370 0x7fbfc40cf5e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.317+0000 7fbfc8e00640 1 --2- 172.21.15.131:0/3007366831 >> v2:172.21.15.195:3300/0 conn(0x7fbfc41443c0 0x7fbfc406fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.317+0000 7fbfc8e00640 1 -- 172.21.15.131:0/3007366831 >> 172.21.15.131:0/3007366831 conn(0x7fbfc40d1ae0 msgr2=0x7fbfc40d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.317+0000 7fbfc8e00640 1 -- 172.21.15.131:0/3007366831 shutdown_connections 2024-04-25T19:22:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.317+0000 7fbfc8e00640 1 -- 172.21.15.131:0/3007366831 wait complete. 2024-04-25T19:22:49.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.320+0000 7fbfc8e00640 1 Processor -- start 2024-04-25T19:22:49.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.320+0000 7fbfc8e00640 1 -- start start 2024-04-25T19:22:49.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.321+0000 7fbfc8e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbfc4070370 0x7fbfc40b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:49.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.321+0000 7fbfc8e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfc40cfb20 0x7fbfc41f7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:49.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.321+0000 7fbfc8e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbfc41443c0 0x7fbfc4142c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:49.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.321+0000 7fbfc8e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc415edf0 con 0x7fbfc4070370 2024-04-25T19:22:49.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.321+0000 7fbfc8e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc415eb10 con 0x7fbfc40cfb20 2024-04-25T19:22:49.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.321+0000 7fbfc8e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbfc41447d0 con 0x7fbfc41443c0 2024-04-25T19:22:49.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.322+0000 7fbfc1e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbfc4070370 0x7fbfc40b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:49.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.322+0000 7fbfc1e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbfc4070370 0x7fbfc40b00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:37830/0 (socket says 172.21.15.131:37830) 2024-04-25T19:22:49.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.322+0000 7fbfc1e00640 1 -- 172.21.15.131:0/2687722814 learned_addr learned my addr 172.21.15.131:0/2687722814 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:49.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.322+0000 7fbfc1400640 1 --2- 172.21.15.131:0/2687722814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfc40cfb20 0x7fbfc41f7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.322+0000 7fbfc2800640 1 --2- 172.21.15.131:0/2687722814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbfc41443c0 0x7fbfc4142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.322+0000 7fbfc1e00640 1 -- 172.21.15.131:0/2687722814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbfc41443c0 msgr2=0x7fbfc4142c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.322+0000 7fbfc1e00640 1 --2- 172.21.15.131:0/2687722814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbfc41443c0 0x7fbfc4142c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.322+0000 7fbfc1e00640 1 -- 172.21.15.131:0/2687722814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfc40cfb20 msgr2=0x7fbfc41f7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.322+0000 7fbfc1e00640 1 --2- 172.21.15.131:0/2687722814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfc40cfb20 0x7fbfc41f7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.322+0000 7fbfc1e00640 1 -- 172.21.15.131:0/2687722814 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc4155bb0 con 0x7fbfc4070370 2024-04-25T19:22:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.322+0000 7fbfc1400640 1 --2- 172.21.15.131:0/2687722814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfc40cfb20 0x7fbfc41f7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.323+0000 7fbfc1e00640 1 --2- 172.21.15.131:0/2687722814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbfc4070370 0x7fbfc40b00f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400d600 tx=0x7fbfb400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.323+0000 7fbfba000640 1 -- 172.21.15.131:0/2687722814 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4004240 con 0x7fbfc4070370 2024-04-25T19:22:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.323+0000 7fbfba000640 1 -- 172.21.15.131:0/2687722814 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfb40043e0 con 0x7fbfc4070370 2024-04-25T19:22:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.323+0000 7fbfba000640 1 -- 172.21.15.131:0/2687722814 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4003830 con 0x7fbfc4070370 2024-04-25T19:22:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.323+0000 7fbfc8e00640 1 -- 172.21.15.131:0/2687722814 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc4155e90 con 0x7fbfc4070370 2024-04-25T19:22:49.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.323+0000 7fbfc8e00640 1 -- 172.21.15.131:0/2687722814 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc40b0630 con 0x7fbfc4070370 2024-04-25T19:22:49.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.325+0000 7fbfc8e00640 1 -- 172.21.15.131:0/2687722814 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfc4050740 con 0x7fbfc4070370 2024-04-25T19:22:49.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.326+0000 7fbfba000640 1 -- 172.21.15.131:0/2687722814 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbfb40039d0 con 0x7fbfc4070370 2024-04-25T19:22:49.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.327+0000 7fbfba000640 1 --2- 172.21.15.131:0/2687722814 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbfa00744b0 0x7fbfa00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:49.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.327+0000 7fbfba000640 1 -- 172.21.15.131:0/2687722814 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbfb4095560 con 0x7fbfc4070370 2024-04-25T19:22:49.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.327+0000 7fbfc1400640 1 --2- 172.21.15.131:0/2687722814 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbfa00744b0 0x7fbfa00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:49.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.329+0000 7fbfc1400640 1 --2- 172.21.15.131:0/2687722814 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbfa00744b0 0x7fbfa00769c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbfac034000 tx=0x7fbfac02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:49.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.332+0000 7fbfba000640 1 -- 172.21.15.131:0/2687722814 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbfb405fce0 con 0x7fbfc4070370 2024-04-25T19:22:49.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.571+0000 7fbfc8e00640 1 -- 172.21.15.131:0/2687722814 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbfc406f950 con 0x7fbfc4070370 2024-04-25T19:22:49.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.572+0000 7fbfba000640 1 -- 172.21.15.131:0/2687722814 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fbfb405f5e0 con 0x7fbfc4070370 2024-04-25T19:22:49.574 INFO:teuthology.orchestra.run.smithi131.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T19:22:49.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.575+0000 7fbfc8e00640 1 -- 172.21.15.131:0/2687722814 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbfa00744b0 msgr2=0x7fbfa00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:49.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.575+0000 7fbfc8e00640 1 --2- 172.21.15.131:0/2687722814 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbfa00744b0 0x7fbfa00769c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbfac034000 tx=0x7fbfac02e000 comp rx=0 tx=0).stop 2024-04-25T19:22:49.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.575+0000 7fbfc8e00640 1 -- 172.21.15.131:0/2687722814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbfc4070370 msgr2=0x7fbfc40b00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:49.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.575+0000 7fbfc8e00640 1 --2- 172.21.15.131:0/2687722814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbfc4070370 0x7fbfc40b00f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400d600 tx=0x7fbfb400dac0 comp rx=0 tx=0).stop 2024-04-25T19:22:49.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.575+0000 7fbfc8e00640 1 -- 172.21.15.131:0/2687722814 shutdown_connections 2024-04-25T19:22:49.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.575+0000 7fbfc8e00640 1 --2- 172.21.15.131:0/2687722814 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbfa00744b0 0x7fbfa00769c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:49.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.575+0000 7fbfc8e00640 1 --2- 172.21.15.131:0/2687722814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbfc41443c0 0x7fbfc4142c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:49.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.575+0000 7fbfc8e00640 1 --2- 172.21.15.131:0/2687722814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfc40cfb20 0x7fbfc41f7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:49.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.575+0000 7fbfc8e00640 1 --2- 172.21.15.131:0/2687722814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbfc4070370 0x7fbfc40b00f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:49.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.575+0000 7fbfc8e00640 1 -- 172.21.15.131:0/2687722814 >> 172.21.15.131:0/2687722814 conn(0x7fbfc40d1ae0 msgr2=0x7fbfc4160ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:49.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.575+0000 7fbfc8e00640 1 -- 172.21.15.131:0/2687722814 shutdown_connections 2024-04-25T19:22:49.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:49.575+0000 7fbfc8e00640 1 -- 172.21.15.131:0/2687722814 wait complete. 2024-04-25T19:22:49.603 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T19:22:49.603 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T19:22:49.603 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi195.front.sepia.ceph.com 2024-04-25T19:22:49.603 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-25T19:22:49.603 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T19:22:49.603 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T19:22:49.603 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T19:22:49.603 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T19:22:49.603 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-25T19:22:49.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:49.604 DEBUG:teuthology.orchestra.run.smithi195:> ip addr 2024-04-25T19:22:49.661 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T19:22:49.661 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T19:22:49.661 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T19:22:49.661 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:49.661 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-04-25T19:22:49.661 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:49.662 INFO:teuthology.orchestra.run.smithi195.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T19:22:49.662 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:22:49.662 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f0 2024-04-25T19:22:49.662 INFO:teuthology.orchestra.run.smithi195.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T19:22:49.662 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:22:49.662 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f1 2024-04-25T19:22:49.662 INFO:teuthology.orchestra.run.smithi195.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T19:22:49.662 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:80 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:22:49.662 INFO:teuthology.orchestra.run.smithi195.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T19:22:49.662 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:81 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:22:49.662 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.21.15.195/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T19:22:49.662 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft 42633sec preferred_lft 42633sec 2024-04-25T19:22:49.663 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::ec4:7aff:fe88:8081/64 scope link 2024-04-25T19:22:49.663 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:49.663 INFO:teuthology.orchestra.run.smithi195.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T19:22:49.663 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 72:d2:7e:6c:b6:3a brd ff:ff:ff:ff:ff:ff 2024-04-25T19:22:49.663 INFO:teuthology.orchestra.run.smithi195.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T19:22:49.663 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:49.663 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::2c61:f8ff:fe2e:b6cd/64 scope link 2024-04-25T19:22:49.663 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:49.663 INFO:teuthology.orchestra.run.smithi195.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T19:22:49.663 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 72:d2:7e:6c:b6:3a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T19:22:49.664 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::70d2:7eff:fe6c:b63a/64 scope link 2024-04-25T19:22:49.664 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:49.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:49.665 DEBUG:teuthology.orchestra.run.smithi195:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T19:22:49.744 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-04-25T19:22:49.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:49.749 DEBUG:teuthology.orchestra.run.smithi195:> route 2024-04-25T19:22:49.802 INFO:teuthology.orchestra.run.smithi195.stdout:Kernel IP routing table 2024-04-25T19:22:49.803 INFO:teuthology.orchestra.run.smithi195.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T19:22:49.803 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T19:22:49.803 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T19:22:49.803 INFO:teuthology.orchestra.run.smithi195.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T19:22:49.804 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T19:22:49.804 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T19:22:49.804 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T19:22:49.804 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T19:22:49.805 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T19:22:49.805 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T19:22:49.906 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T19:22:50.003 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:50.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:50.013 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T19:22:50.059 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T19:22:50.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:50.060 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list-id 2024-04-25T19:22:50.156 INFO:teuthology.orchestra.run.smithi195.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-25T19:22:50.157 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T19:22:50.157 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T19:22:50.157 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T19:22:50.157 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-25T19:22:50.157 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T19:22:50.258 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T19:22:50.330 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:50.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:50.340 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T19:22:50.417 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T19:22:50.418 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T19:22:50.418 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T19:22:50.418 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:50.418 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-04-25T19:22:50.418 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:50.418 INFO:teuthology.orchestra.run.smithi195.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T19:22:50.418 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 7a:be:40:c9:dd:86 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T19:22:50.418 INFO:teuthology.orchestra.run.smithi195.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T19:22:50.418 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:50.418 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::78be:40ff:fec9:dd86/64 scope link 2024-04-25T19:22:50.418 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:50.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:50.422 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T19:22:50.502 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T19:22:50.502 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T19:22:50.502 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T19:22:50.502 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:50.503 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-04-25T19:22:50.503 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:50.503 INFO:teuthology.orchestra.run.smithi195.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T19:22:50.503 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 7a:be:40:c9:dd:86 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T19:22:50.503 INFO:teuthology.orchestra.run.smithi195.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T19:22:50.503 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:50.503 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::78be:40ff:fec9:dd86/64 scope link 2024-04-25T19:22:50.503 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:22:50.506 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-25T19:22:50.507 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T19:22:50.507 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T19:22:50.507 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-25T19:22:50.507 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T19:22:50.507 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-25T19:22:50.507 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-25T19:22:50.507 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-25T19:22:50.507 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T19:22:50.607 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T19:22:50.763 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:50.772 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T19:22:50.772 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T19:22:50.772 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set brx.1 up 2024-04-25T19:22:50.773 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T19:22:50.773 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T19:22:50.870 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T19:22:50.970 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:50.980 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T19:22:50.980 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-25T19:22:51.027 INFO:teuthology.orchestra.run.smithi195.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-25T19:22:51.027 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T19:22:51.027 DEBUG:teuthology.orchestra.run.smithi195:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-25T19:22:51.122 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T19:22:51.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:51.122 DEBUG:teuthology.orchestra.run.smithi195:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T19:22:51.313 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T19:22:51.313 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T19:22:51.313 INFO:teuthology.orchestra.run.smithi195.stdout:invalid new device string format 2024-04-25T19:22:51.339 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T19:22:51.339 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T19:22:51.339 INFO:teuthology.orchestra.run.smithi195.stdout:invalid new device string format 2024-04-25T19:22:51.339 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.131:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T19:22:51.340 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T19:22:51.372 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T19:22:51.372 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T19:22:51.372 INFO:teuthology.orchestra.run.smithi195.stdout:invalid new device string format 2024-04-25T19:22:51.373 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.131:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T19:22:51.373 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T19:22:51.373 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.131:6789,172.21.15.195:6789,172.21.15.195:6790" 2024-04-25T19:22:51.373 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.131:6789,172.21.15.195:6789,172.21.15.195:6790:/ 2024-04-25T19:22:51.373 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=4ba607f8-c2c3-4d8d-85a8-7800763c470f" will pass to kernel 2024-04-25T19:22:51.374 INFO:teuthology.orchestra.run.smithi195.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-04-25T19:22:51.374 INFO:teuthology.orchestra.run.smithi195.stdout: You just mounted a file system that supports labels which does not 2024-04-25T19:22:51.374 INFO:teuthology.orchestra.run.smithi195.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T19:22:51.374 INFO:teuthology.orchestra.run.smithi195.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T19:22:51.374 INFO:teuthology.orchestra.run.smithi195.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T19:22:51.378 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T19:22:51.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:22:51.378 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-25T19:22:51.447 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T19:22:51.545 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T19:22:51.549 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:51.558 INFO:teuthology.orchestra.run.smithi195.stdout:client4436 2024-04-25T19:22:51.559 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:22:51.559 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:22:51.609 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T19:22:51.754 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T19:22:51.759 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:51.768 INFO:teuthology.orchestra.run.smithi195.stdout:client4436 2024-04-25T19:22:51.768 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T19:22:51.867 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T19:22:51.872 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:51.882 INFO:teuthology.orchestra.run.smithi195.stdout:client4436 2024-04-25T19:22:51.882 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4ba607f8-c2c3-4d8d-85a8-7800763c470f.client4436/status') 2024-04-25T19:22:51.984 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T19:22:52.013 INFO:teuthology.orchestra.run.smithi195.stdout:instance: client.4436 (3)192.168.0.2:0/3218757299 2024-04-25T19:22:52.013 INFO:teuthology.orchestra.run.smithi195.stdout:blocklisted: false 2024-04-25T19:22:52.013 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records in 2024-04-25T19:22:52.013 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records out 2024-04-25T19:22:52.014 INFO:teuthology.orchestra.run.smithi195.stderr:69 bytes copied, 7.5967e-05 s, 908 kB/s 2024-04-25T19:22:52.016 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T19:22:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:22:52.025 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-25T19:22:52.043 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:22:52.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.323+0000 7fc039200640 1 Processor -- start 2024-04-25T19:22:52.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.324+0000 7fc039200640 1 -- start start 2024-04-25T19:22:52.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.326+0000 7fc039200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc0340cf5e0 0x7fc0340cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:52.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.326+0000 7fc039200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0340cff30 con 0x7fc03406c5c0 2024-04-25T19:22:52.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.326+0000 7fc039200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc03415f5f0 con 0x7fc0341443c0 2024-04-25T19:22:52.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.326+0000 7fc039200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fc0340708d0 con 0x7fc0340cf5e0 2024-04-25T19:22:52.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.326+0000 7fc032800640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fc03406c5c0 0x7fc03406c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:54668/0 (socket says 172.21.15.131:54668) 2024-04-25T19:22:52.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.326+0000 7fc032800640 1 -- 172.21.15.131:0/2067294458 learned_addr learned my addr 172.21.15.131:0/2067294458 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:52.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.327+0000 7fc031400640 1 --2- 172.21.15.131:0/2067294458 >> v2:172.21.15.195:3300/0 conn(0x7fc0340cf5e0 0x7fc0340cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:52.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.327+0000 7fc030a00640 1 -- 172.21.15.131:0/2067294458 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1299797941 0 0) 0x7fc02c001110 con 0x7fc03406c5c0 2024-04-25T19:22:52.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.327+0000 7fc030a00640 1 -- 172.21.15.131:0/2067294458 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc018003520 con 0x7fc03406c5c0 2024-04-25T19:22:52.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.327+0000 7fc030a00640 1 -- 172.21.15.131:0/2067294458 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 320144042 0 0) 0x7fc018003520 con 0x7fc03406c5c0 2024-04-25T19:22:52.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.327+0000 7fc030a00640 1 -- 172.21.15.131:0/2067294458 >> v2:172.21.15.195:3300/0 conn(0x7fc0340cf5e0 msgr2=0x7fc0340cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:52.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.327+0000 7fc030a00640 1 --2- 172.21.15.131:0/2067294458 >> v2:172.21.15.195:3300/0 conn(0x7fc0340cf5e0 0x7fc0340cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:52.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.327+0000 7fc030a00640 1 -- 172.21.15.131:0/2067294458 >> v1:172.21.15.195:6789/0 conn(0x7fc0341443c0 legacy=0x7fc03406fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:52.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.327+0000 7fc030a00640 1 -- 172.21.15.131:0/2067294458 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03415e830 con 0x7fc03406c5c0 2024-04-25T19:22:52.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.327+0000 7fc030a00640 1 -- 172.21.15.131:0/2067294458 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7fc02c001840 con 0x7fc03406c5c0 2024-04-25T19:22:52.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.328+0000 7fc030a00640 1 -- 172.21.15.131:0/2067294458 >> v1:172.21.15.131:6789/0 conn(0x7fc03406c5c0 legacy=0x7fc03406c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:52.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.328+0000 7fc030a00640 1 --2- 172.21.15.131:0/2067294458 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0180039b0 0x7fc018003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:52.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.328+0000 7fc030a00640 1 --2- 172.21.15.131:0/2067294458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc018004800 0x7fc018004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:52.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.328+0000 7fc030a00640 1 --2- 172.21.15.131:0/2067294458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc018005270 0x7fc01800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:52.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.328+0000 7fc030a00640 1 -- 172.21.15.131:0/2067294458 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc0340708d0 con 0x7fc018005270 2024-04-25T19:22:52.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.328+0000 7fc030a00640 1 -- 172.21.15.131:0/2067294458 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc01800c200 con 0x7fc018004800 2024-04-25T19:22:52.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.328+0000 7fc030a00640 1 -- 172.21.15.131:0/2067294458 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc01800c400 con 0x7fc0180039b0 2024-04-25T19:22:52.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.328+0000 7fc032800640 1 --2- 172.21.15.131:0/2067294458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc018005270 0x7fc01800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:52.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.328+0000 7fc031e00640 1 --2- 172.21.15.131:0/2067294458 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0180039b0 0x7fc018003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:52.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.328+0000 7fc031400640 1 --2- 172.21.15.131:0/2067294458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc018004800 0x7fc018004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:52.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.328+0000 7fc032800640 1 -- 172.21.15.131:0/2067294458 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0180039b0 msgr2=0x7fc018003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:52.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.328+0000 7fc032800640 1 --2- 172.21.15.131:0/2067294458 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0180039b0 0x7fc018003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:52.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.328+0000 7fc032800640 1 -- 172.21.15.131:0/2067294458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc018004800 msgr2=0x7fc018004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:52.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.328+0000 7fc032800640 1 --2- 172.21.15.131:0/2067294458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc018004800 0x7fc018004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:52.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.329+0000 7fc032800640 1 -- 172.21.15.131:0/2067294458 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc018003520 con 0x7fc018005270 2024-04-25T19:22:52.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.329+0000 7fc032800640 1 -- 172.21.15.131:0/2067294458 reap_dead start 2024-04-25T19:22:52.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.330+0000 7fc032800640 1 --2- 172.21.15.131:0/2067294458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc018005270 0x7fc01800b9c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00c490 tx=0x7fc018005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e502ee6b32dd68f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:52.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.330+0000 7fc030a00640 1 -- 172.21.15.131:0/2067294458 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c00c0e0 con 0x7fc018005270 2024-04-25T19:22:52.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.330+0000 7fc030a00640 1 -- 172.21.15.131:0/2067294458 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc02c0058d0 con 0x7fc018005270 2024-04-25T19:22:52.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.330+0000 7fc030a00640 1 -- 172.21.15.131:0/2067294458 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c005ca0 con 0x7fc018005270 2024-04-25T19:22:52.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.331+0000 7fc039200640 1 -- 172.21.15.131:0/2067294458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc018005270 msgr2=0x7fc01800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:52.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.331+0000 7fc039200640 1 --2- 172.21.15.131:0/2067294458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc018005270 0x7fc01800b9c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00c490 tx=0x7fc018005830 comp rx=0 tx=0).stop 2024-04-25T19:22:52.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.331+0000 7fc039200640 1 -- 172.21.15.131:0/2067294458 shutdown_connections 2024-04-25T19:22:52.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.331+0000 7fc039200640 1 --2- 172.21.15.131:0/2067294458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc018005270 0x7fc01800b9c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:52.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.331+0000 7fc039200640 1 -- 172.21.15.131:0/2067294458 >> 172.21.15.131:0/2067294458 conn(0x7fc0340d1ae0 msgr2=0x7fc0340d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:52.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.331+0000 7fc039200640 1 -- 172.21.15.131:0/2067294458 shutdown_connections 2024-04-25T19:22:52.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.331+0000 7fc039200640 1 -- 172.21.15.131:0/2067294458 wait complete. 2024-04-25T19:22:52.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.333+0000 7fc039200640 1 Processor -- start 2024-04-25T19:22:52.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.333+0000 7fc039200640 1 -- start start 2024-04-25T19:22:52.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.335+0000 7fc039200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc018005270 0x7fc03413dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:52.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.335+0000 7fc039200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc03415b400 0x7fc034141a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:52.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.335+0000 7fc039200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc034141f60 0x7fc0341f9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:52.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.335+0000 7fc039200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc03415edf0 con 0x7fc018005270 2024-04-25T19:22:52.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.335+0000 7fc039200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc03415f160 con 0x7fc034141f60 2024-04-25T19:22:52.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.335+0000 7fc039200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc0341447d0 con 0x7fc03415b400 2024-04-25T19:22:52.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.335+0000 7fc031e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc018005270 0x7fc03413dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:52.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.335+0000 7fc031e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc018005270 0x7fc03413dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:37856/0 (socket says 172.21.15.131:37856) 2024-04-25T19:22:52.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.335+0000 7fc031e00640 1 -- 172.21.15.131:0/3693369791 learned_addr learned my addr 172.21.15.131:0/3693369791 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:52.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.336+0000 7fc031400640 1 --2- 172.21.15.131:0/3693369791 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc03415b400 0x7fc034141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:52.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.336+0000 7fc031e00640 1 -- 172.21.15.131:0/3693369791 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc03415b400 msgr2=0x7fc034141a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:52.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.336+0000 7fc031e00640 1 --2- 172.21.15.131:0/3693369791 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc03415b400 0x7fc034141a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:52.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.336+0000 7fc031e00640 1 -- 172.21.15.131:0/3693369791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc034141f60 msgr2=0x7fc0341f9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:52.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.336+0000 7fc031e00640 1 --2- 172.21.15.131:0/3693369791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc034141f60 0x7fc0341f9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:52.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.336+0000 7fc031e00640 1 -- 172.21.15.131:0/3693369791 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc034142370 con 0x7fc018005270 2024-04-25T19:22:52.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.336+0000 7fc031400640 1 --2- 172.21.15.131:0/3693369791 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc03415b400 0x7fc034141a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:52.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.336+0000 7fc031e00640 1 --2- 172.21.15.131:0/3693369791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc018005270 0x7fc03413dcf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00e4e0 tx=0x7fc01c00e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:52.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.336+0000 7fc02a000640 1 -- 172.21.15.131:0/3693369791 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c0052e0 con 0x7fc018005270 2024-04-25T19:22:52.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.336+0000 7fc02a000640 1 -- 172.21.15.131:0/3693369791 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc01c018070 con 0x7fc018005270 2024-04-25T19:22:52.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.336+0000 7fc02a000640 1 -- 172.21.15.131:0/3693369791 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c003810 con 0x7fc018005270 2024-04-25T19:22:52.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.336+0000 7fc039200640 1 -- 172.21.15.131:0/3693369791 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0340af5c0 con 0x7fc018005270 2024-04-25T19:22:52.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.336+0000 7fc039200640 1 -- 172.21.15.131:0/3693369791 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc03413d630 con 0x7fc018005270 2024-04-25T19:22:52.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.338+0000 7fc039200640 1 -- 172.21.15.131:0/3693369791 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc034050740 con 0x7fc018005270 2024-04-25T19:22:52.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.339+0000 7fc02a000640 1 -- 172.21.15.131:0/3693369791 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc01c0039b0 con 0x7fc018005270 2024-04-25T19:22:52.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.340+0000 7fc02a000640 1 --2- 172.21.15.131:0/3693369791 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc0100744b0 0x7fc0100769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:52.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.340+0000 7fc02a000640 1 -- 172.21.15.131:0/3693369791 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc01c094eb0 con 0x7fc018005270 2024-04-25T19:22:52.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.341+0000 7fc031400640 1 --2- 172.21.15.131:0/3693369791 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc0100744b0 0x7fc0100769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:52.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.342+0000 7fc031400640 1 --2- 172.21.15.131:0/3693369791 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc0100744b0 0x7fc0100769c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc0340ceef0 tx=0x7fc02400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:52.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.345+0000 7fc02a000640 1 -- 172.21.15.131:0/3693369791 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc034142370 con 0x7fc018005270 2024-04-25T19:22:52.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.548+0000 7fc039200640 1 -- 172.21.15.131:0/3693369791 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc03406f950 con 0x7fc018005270 2024-04-25T19:22:52.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.550+0000 7fc02a000640 1 -- 172.21.15.131:0/3693369791 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16629 (secure 0 0 0) 0x7fc01c05f6f0 con 0x7fc018005270 2024-04-25T19:22:52.552 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:52.553 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":20,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:22:18.057809+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:22:14.779716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T19:22:15.552027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:22:52.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.553+0000 7fc039200640 1 -- 172.21.15.131:0/3693369791 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc0100744b0 msgr2=0x7fc0100769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.553+0000 7fc039200640 1 --2- 172.21.15.131:0/3693369791 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc0100744b0 0x7fc0100769c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc0340ceef0 tx=0x7fc02400b040 comp rx=0 tx=0).stop 2024-04-25T19:22:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.553+0000 7fc039200640 1 -- 172.21.15.131:0/3693369791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc018005270 msgr2=0x7fc03413dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.553+0000 7fc039200640 1 --2- 172.21.15.131:0/3693369791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc018005270 0x7fc03413dcf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00e4e0 tx=0x7fc01c00e9a0 comp rx=0 tx=0).stop 2024-04-25T19:22:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.554+0000 7fc039200640 1 -- 172.21.15.131:0/3693369791 shutdown_connections 2024-04-25T19:22:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.554+0000 7fc039200640 1 --2- 172.21.15.131:0/3693369791 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc0100744b0 0x7fc0100769c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.554+0000 7fc039200640 1 --2- 172.21.15.131:0/3693369791 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc03415b400 0x7fc034141a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.554+0000 7fc039200640 1 --2- 172.21.15.131:0/3693369791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc034141f60 0x7fc0341f9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.554+0000 7fc039200640 1 --2- 172.21.15.131:0/3693369791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc018005270 0x7fc03413dcf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.554+0000 7fc039200640 1 -- 172.21.15.131:0/3693369791 >> 172.21.15.131:0/3693369791 conn(0x7fc0340d1ae0 msgr2=0x7fc03415c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.554+0000 7fc039200640 1 -- 172.21.15.131:0/3693369791 shutdown_connections 2024-04-25T19:22:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.554+0000 7fc039200640 1 -- 172.21.15.131:0/3693369791 wait complete. 2024-04-25T19:22:52.582 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T19:22:04.178847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T19:22:14.779716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T19:22:15.552027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T19:22:52.582 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T19:22:52.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.859+0000 7f28d5800640 1 Processor -- start 2024-04-25T19:22:52.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.859+0000 7f28d5800640 1 -- start start 2024-04-25T19:22:52.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.861+0000 7f28d5800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28d00d4250 0x7f28d00bb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:52.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.861+0000 7f28d5800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f28d00b4db0 0x7f28d00b91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:52.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.861+0000 7f28d5800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28d00d4900 con 0x7f28d00b7580 2024-04-25T19:22:52.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.861+0000 7f28d5800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f28d00b9730 con 0x7f28d00b4db0 2024-04-25T19:22:52.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.861+0000 7f28d5800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f28d00d4be0 con 0x7f28d00d4250 2024-04-25T19:22:52.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.861+0000 7f28cf400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f28d00b4db0 0x7f28d00b91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:52.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.862+0000 7f28cf400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f28d00b4db0 0x7f28d00b91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:37858/0 (socket says 172.21.15.131:37858) 2024-04-25T19:22:52.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.862+0000 7f28cf400640 1 -- 172.21.15.131:0/4122596391 learned_addr learned my addr 172.21.15.131:0/4122596391 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:52.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.862+0000 7f28cfe00640 1 --2- 172.21.15.131:0/4122596391 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28d00d4250 0x7f28d00bb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:52.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.862+0000 7f28cf400640 1 -- 172.21.15.131:0/4122596391 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28d00d4250 msgr2=0x7f28d00bb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:52.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.862+0000 7f28cf400640 1 --2- 172.21.15.131:0/4122596391 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28d00d4250 0x7f28d00bb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:52.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.862+0000 7f28cf400640 1 -- 172.21.15.131:0/4122596391 >> v1:172.21.15.195:6789/0 conn(0x7f28d00b7580 legacy=0x7f28d00b7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:52.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.862+0000 7f28cf400640 1 -- 172.21.15.131:0/4122596391 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d00d4ec0 con 0x7f28d00b4db0 2024-04-25T19:22:52.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.863+0000 7f28cf400640 1 --2- 172.21.15.131:0/4122596391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28d00b4db0 0x7f28d00b91f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f28d00b98b0 tx=0x7f28bc02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e23c16e8251b1142 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:52.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.863+0000 7f28cea00640 1 -- 172.21.15.131:0/4122596391 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28bc037070 con 0x7f28d00b4db0 2024-04-25T19:22:52.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.863+0000 7f28cea00640 1 -- 172.21.15.131:0/4122596391 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28bc032440 con 0x7f28d00b4db0 2024-04-25T19:22:52.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.863+0000 7f28cea00640 1 -- 172.21.15.131:0/4122596391 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28bc032810 con 0x7f28d00b4db0 2024-04-25T19:22:52.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.864+0000 7f28d5800640 1 -- 172.21.15.131:0/4122596391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28d00b4db0 msgr2=0x7f28d00b91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:52.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.864+0000 7f28d5800640 1 --2- 172.21.15.131:0/4122596391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28d00b4db0 0x7f28d00b91f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f28d00b98b0 tx=0x7f28bc02a200 comp rx=0 tx=0).stop 2024-04-25T19:22:52.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.864+0000 7f28d5800640 1 -- 172.21.15.131:0/4122596391 shutdown_connections 2024-04-25T19:22:52.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.864+0000 7f28d5800640 1 --2- 172.21.15.131:0/4122596391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28d00b4db0 0x7f28d00b91f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:52.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.864+0000 7f28d5800640 1 --2- 172.21.15.131:0/4122596391 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28d00d4250 0x7f28d00bb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:52.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.864+0000 7f28d5800640 1 -- 172.21.15.131:0/4122596391 >> 172.21.15.131:0/4122596391 conn(0x7f28d00d2760 msgr2=0x7f28d00d2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:52.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.864+0000 7f28d5800640 1 -- 172.21.15.131:0/4122596391 shutdown_connections 2024-04-25T19:22:52.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.865+0000 7f28d5800640 1 -- 172.21.15.131:0/4122596391 wait complete. 2024-04-25T19:22:52.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.867+0000 7f28d5800640 1 Processor -- start 2024-04-25T19:22:52.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.867+0000 7f28d5800640 1 -- start start 2024-04-25T19:22:52.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.869+0000 7f28d5800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28d00b4db0 0x7f28d0159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:52.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.869+0000 7f28d5800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28d00b7580 0x7f28d0162a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:52.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.869+0000 7f28d5800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28d00d4250 0x7f28d0162fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:52.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.869+0000 7f28d5800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f28d00d1700 con 0x7f28d00b4db0 2024-04-25T19:22:52.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.869+0000 7f28d5800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f28d00d5480 con 0x7f28d00b7580 2024-04-25T19:22:52.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.869+0000 7f28d5800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f28d0163ff0 con 0x7f28d00d4250 2024-04-25T19:22:52.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.869+0000 7f28cfe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28d00b4db0 0x7f28d0159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:52.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.869+0000 7f28cfe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28d00b4db0 0x7f28d0159160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:37870/0 (socket says 172.21.15.131:37870) 2024-04-25T19:22:52.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.869+0000 7f28cfe00640 1 -- 172.21.15.131:0/3436290161 learned_addr learned my addr 172.21.15.131:0/3436290161 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:52.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.869+0000 7f28cf400640 1 --2- 172.21.15.131:0/3436290161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28d00b7580 0x7f28d0162a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:52.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.869+0000 7f28cfe00640 1 -- 172.21.15.131:0/3436290161 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28d00d4250 msgr2=0x7f28d0162fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:52.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.869+0000 7f28d4e00640 1 --2- 172.21.15.131:0/3436290161 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28d00d4250 0x7f28d0162fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:52.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.869+0000 7f28cfe00640 1 --2- 172.21.15.131:0/3436290161 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28d00d4250 0x7f28d0162fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:52.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.869+0000 7f28cfe00640 1 -- 172.21.15.131:0/3436290161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28d00b7580 msgr2=0x7f28d0162a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:52.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.869+0000 7f28cfe00640 1 --2- 172.21.15.131:0/3436290161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28d00b7580 0x7f28d0162a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:52.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.870+0000 7f28cfe00640 1 -- 172.21.15.131:0/3436290161 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d015c2a0 con 0x7f28d00b4db0 2024-04-25T19:22:52.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.870+0000 7f28cf400640 1 --2- 172.21.15.131:0/3436290161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28d00b7580 0x7f28d0162a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:52.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.870+0000 7f28cfe00640 1 --2- 172.21.15.131:0/3436290161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28d00b4db0 0x7f28d0159160 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f28c000d5f0 tx=0x7f28c000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:52.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.870+0000 7f28c7e00640 1 -- 172.21.15.131:0/3436290161 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c00125f0 con 0x7f28d00b4db0 2024-04-25T19:22:52.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.870+0000 7f28c7e00640 1 -- 172.21.15.131:0/3436290161 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28c0019070 con 0x7f28d00b4db0 2024-04-25T19:22:52.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.870+0000 7f28c7e00640 1 -- 172.21.15.131:0/3436290161 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c00129d0 con 0x7f28d00b4db0 2024-04-25T19:22:52.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.870+0000 7f28d5800640 1 -- 172.21.15.131:0/3436290161 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28d015c580 con 0x7f28d00b4db0 2024-04-25T19:22:52.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.870+0000 7f28d5800640 1 -- 172.21.15.131:0/3436290161 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28d015cb40 con 0x7f28d00b4db0 2024-04-25T19:22:52.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.872+0000 7f28d5800640 1 -- 172.21.15.131:0/3436290161 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28d0076c60 con 0x7f28d00b4db0 2024-04-25T19:22:52.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.873+0000 7f28c7e00640 1 -- 172.21.15.131:0/3436290161 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f28c0012b70 con 0x7f28d00b4db0 2024-04-25T19:22:52.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.874+0000 7f28c7e00640 1 --2- 172.21.15.131:0/3436290161 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f28b00744b0 0x7f28b00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:52.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.874+0000 7f28c7e00640 1 -- 172.21.15.131:0/3436290161 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f28c0095710 con 0x7f28d00b4db0 2024-04-25T19:22:52.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.875+0000 7f28cf400640 1 --2- 172.21.15.131:0/3436290161 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f28b00744b0 0x7f28b00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:52.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.876+0000 7f28cf400640 1 --2- 172.21.15.131:0/3436290161 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f28b00744b0 0x7f28b00769c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f28bc034000 tx=0x7f28bc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:52.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:52.879+0000 7f28c7e00640 1 -- 172.21.15.131:0/3436290161 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f28c005fea0 con 0x7f28d00b4db0 2024-04-25T19:22:53.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.079+0000 7f28d5800640 1 -- 172.21.15.131:0/3436290161 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f28d00d4030 con 0x7f28d00b4db0 2024-04-25T19:22:53.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.080+0000 7f28c7e00640 1 -- 172.21.15.131:0/3436290161 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f28c005f7a0 con 0x7f28d00b4db0 2024-04-25T19:22:53.081 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-25T19:22:53.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.082+0000 7f28d5800640 1 -- 172.21.15.131:0/3436290161 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f28b00744b0 msgr2=0x7f28b00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:53.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.082+0000 7f28d5800640 1 --2- 172.21.15.131:0/3436290161 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f28b00744b0 0x7f28b00769c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f28bc034000 tx=0x7f28bc02e000 comp rx=0 tx=0).stop 2024-04-25T19:22:53.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.082+0000 7f28d5800640 1 -- 172.21.15.131:0/3436290161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28d00b4db0 msgr2=0x7f28d0159160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:53.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.082+0000 7f28d5800640 1 --2- 172.21.15.131:0/3436290161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28d00b4db0 0x7f28d0159160 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f28c000d5f0 tx=0x7f28c000dab0 comp rx=0 tx=0).stop 2024-04-25T19:22:53.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.082+0000 7f28d5800640 1 -- 172.21.15.131:0/3436290161 shutdown_connections 2024-04-25T19:22:53.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.082+0000 7f28d5800640 1 --2- 172.21.15.131:0/3436290161 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f28b00744b0 0x7f28b00769c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:53.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.083+0000 7f28d5800640 1 --2- 172.21.15.131:0/3436290161 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28d00d4250 0x7f28d0162fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:53.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.083+0000 7f28d5800640 1 --2- 172.21.15.131:0/3436290161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28d00b7580 0x7f28d0162a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:53.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.083+0000 7f28d5800640 1 --2- 172.21.15.131:0/3436290161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28d00b4db0 0x7f28d0159160 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:53.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.083+0000 7f28d5800640 1 -- 172.21.15.131:0/3436290161 >> 172.21.15.131:0/3436290161 conn(0x7f28d00d2760 msgr2=0x7f28d00b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:53.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.083+0000 7f28d5800640 1 -- 172.21.15.131:0/3436290161 shutdown_connections 2024-04-25T19:22:53.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.083+0000 7f28d5800640 1 -- 172.21.15.131:0/3436290161 wait complete. 2024-04-25T19:22:53.111 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T19:22:53.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.380+0000 7febc9000640 1 Processor -- start 2024-04-25T19:22:53.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.380+0000 7febc9000640 1 -- start start 2024-04-25T19:22:53.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.382+0000 7febc9000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7febc406c5c0 0x7febc41638d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:53.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.382+0000 7febc9000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7febc40d05a0 0x7febc40b4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:53.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.382+0000 7febc9000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febc409b870 con 0x7febc40b3e70 2024-04-25T19:22:53.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.382+0000 7febc9000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7febc406ca10 con 0x7febc406c5c0 2024-04-25T19:22:53.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.382+0000 7febc9000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7febc40b3700 con 0x7febc40d05a0 2024-04-25T19:22:53.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.382+0000 7febc3400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7febc406c5c0 0x7febc41638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:53.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.382+0000 7febc2a00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7febc40b3e70 0x7febc40cfe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:54682/0 (socket says 172.21.15.131:54682) 2024-04-25T19:22:53.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.382+0000 7febc2a00640 1 -- 172.21.15.131:0/3555921371 learned_addr learned my addr 172.21.15.131:0/3555921371 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:53.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.382+0000 7febc3e00640 1 --2- 172.21.15.131:0/3555921371 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7febc40d05a0 0x7febc40b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:53.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.383+0000 7febc3400640 1 -- 172.21.15.131:0/3555921371 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7febc40d05a0 msgr2=0x7febc40b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:53.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.383+0000 7febc3400640 1 --2- 172.21.15.131:0/3555921371 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7febc40d05a0 0x7febc40b4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:53.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.383+0000 7febc3400640 1 -- 172.21.15.131:0/3555921371 >> v1:172.21.15.131:6789/0 conn(0x7febc40b3e70 legacy=0x7febc40cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:53.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.383+0000 7febc3400640 1 -- 172.21.15.131:0/3555921371 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc409bb50 con 0x7febc406c5c0 2024-04-25T19:22:53.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.383+0000 7febc2000640 1 -- 172.21.15.131:0/3555921371 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3381389228 0 0) 0x7febc409b870 con 0x7febc40b3e70 2024-04-25T19:22:53.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.384+0000 7febc3400640 1 --2- 172.21.15.131:0/3555921371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febc406c5c0 0x7febc41638d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7febb40097a0 tx=0x7febb402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82389a209b3f8d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:53.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.384+0000 7febc2000640 1 -- 172.21.15.131:0/3555921371 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb4037070 con 0x7febc406c5c0 2024-04-25T19:22:53.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.384+0000 7febc2000640 1 -- 172.21.15.131:0/3555921371 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febb4032440 con 0x7febc406c5c0 2024-04-25T19:22:53.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.384+0000 7febc2000640 1 -- 172.21.15.131:0/3555921371 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb4032810 con 0x7febc406c5c0 2024-04-25T19:22:53.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.385+0000 7febc9000640 1 -- 172.21.15.131:0/3555921371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febc406c5c0 msgr2=0x7febc41638d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:53.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.385+0000 7febc9000640 1 --2- 172.21.15.131:0/3555921371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febc406c5c0 0x7febc41638d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7febb40097a0 tx=0x7febb402a180 comp rx=0 tx=0).stop 2024-04-25T19:22:53.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.385+0000 7febc9000640 1 -- 172.21.15.131:0/3555921371 shutdown_connections 2024-04-25T19:22:53.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.385+0000 7febc9000640 1 --2- 172.21.15.131:0/3555921371 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7febc40d05a0 0x7febc40b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:53.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.385+0000 7febc9000640 1 --2- 172.21.15.131:0/3555921371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febc406c5c0 0x7febc41638d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:53.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.385+0000 7febc9000640 1 -- 172.21.15.131:0/3555921371 >> 172.21.15.131:0/3555921371 conn(0x7febc40739a0 msgr2=0x7febc40b6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:53.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.385+0000 7febc9000640 1 -- 172.21.15.131:0/3555921371 shutdown_connections 2024-04-25T19:22:53.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.385+0000 7febc9000640 1 -- 172.21.15.131:0/3555921371 wait complete. 2024-04-25T19:22:53.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.387+0000 7febc9000640 1 Processor -- start 2024-04-25T19:22:53.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.388+0000 7febc9000640 1 -- start start 2024-04-25T19:22:53.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.389+0000 7febc9000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7febc406c5c0 0x7febc415d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:53.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.389+0000 7febc9000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febc40b3e70 0x7febc40ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:53.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.389+0000 7febc9000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febc40d05a0 0x7febc40c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:53.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.389+0000 7febc9000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7febc406cc60 con 0x7febc40b3e70 2024-04-25T19:22:53.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.389+0000 7febc9000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7febc40b39e0 con 0x7febc40d05a0 2024-04-25T19:22:53.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.389+0000 7febc9000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7febc40b4820 con 0x7febc406c5c0 2024-04-25T19:22:53.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.389+0000 7febc2a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febc40b3e70 0x7febc40ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:53.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.389+0000 7febc2a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febc40b3e70 0x7febc40ceb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:37884/0 (socket says 172.21.15.131:37884) 2024-04-25T19:22:53.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.389+0000 7febc2a00640 1 -- 172.21.15.131:0/2506962573 learned_addr learned my addr 172.21.15.131:0/2506962573 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:53.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.390+0000 7febc3400640 1 --2- 172.21.15.131:0/2506962573 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7febc406c5c0 0x7febc415d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:53.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.390+0000 7febc3e00640 1 --2- 172.21.15.131:0/2506962573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febc40d05a0 0x7febc40c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:53.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.390+0000 7febc2a00640 1 -- 172.21.15.131:0/2506962573 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7febc406c5c0 msgr2=0x7febc415d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:53.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.390+0000 7febc2a00640 1 --2- 172.21.15.131:0/2506962573 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7febc406c5c0 0x7febc415d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:53.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.390+0000 7febc2a00640 1 -- 172.21.15.131:0/2506962573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febc40d05a0 msgr2=0x7febc40c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:53.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.390+0000 7febc2a00640 1 --2- 172.21.15.131:0/2506962573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febc40d05a0 0x7febc40c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:53.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.390+0000 7febc2a00640 1 -- 172.21.15.131:0/2506962573 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc40cd630 con 0x7febc40b3e70 2024-04-25T19:22:53.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.390+0000 7febc3e00640 1 --2- 172.21.15.131:0/2506962573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febc40d05a0 0x7febc40c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:53.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.390+0000 7febc2a00640 1 --2- 172.21.15.131:0/2506962573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febc40b3e70 0x7febc40ceb40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7febb000c7c0 tx=0x7febb000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:53.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.391+0000 7febbb400640 1 -- 172.21.15.131:0/2506962573 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb0018070 con 0x7febc40b3e70 2024-04-25T19:22:53.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.391+0000 7febbb400640 1 -- 172.21.15.131:0/2506962573 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febb000a640 con 0x7febc40b3e70 2024-04-25T19:22:53.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.391+0000 7febc9000640 1 -- 172.21.15.131:0/2506962573 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc40cdaa0 con 0x7febc40b3e70 2024-04-25T19:22:53.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.391+0000 7febbb400640 1 -- 172.21.15.131:0/2506962573 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb000aa30 con 0x7febc40b3e70 2024-04-25T19:22:53.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.391+0000 7febc9000640 1 -- 172.21.15.131:0/2506962573 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc40ce060 con 0x7febc40b3e70 2024-04-25T19:22:53.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.392+0000 7febc9000640 1 -- 172.21.15.131:0/2506962573 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febc406e080 con 0x7febc40b3e70 2024-04-25T19:22:53.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.393+0000 7febbb400640 1 -- 172.21.15.131:0/2506962573 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7febb001b070 con 0x7febc40b3e70 2024-04-25T19:22:53.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.394+0000 7febbb400640 1 --2- 172.21.15.131:0/2506962573 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7feba40744b0 0x7feba40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:53.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.394+0000 7febbb400640 1 -- 172.21.15.131:0/2506962573 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7febb0094740 con 0x7febc40b3e70 2024-04-25T19:22:53.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.395+0000 7febc3400640 1 --2- 172.21.15.131:0/2506962573 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7feba40744b0 0x7feba40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:53.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.396+0000 7febc3400640 1 --2- 172.21.15.131:0/2506962573 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7feba40744b0 0x7feba40769c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7febb4034000 tx=0x7febb402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:53.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.399+0000 7febbb400640 1 -- 172.21.15.131:0/2506962573 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7febb005e910 con 0x7febc40b3e70 2024-04-25T19:22:53.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.592+0000 7febc9000640 1 -- 172.21.15.131:0/2506962573 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7febc4076c60 con 0x7febc40b3e70 2024-04-25T19:22:53.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.593+0000 7febbb400640 1 -- 172.21.15.131:0/2506962573 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7febb0062c10 con 0x7febc40b3e70 2024-04-25T19:22:53.595 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-25T19:22:53.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.596+0000 7febc9000640 1 -- 172.21.15.131:0/2506962573 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7feba40744b0 msgr2=0x7feba40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:53.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.596+0000 7febc9000640 1 --2- 172.21.15.131:0/2506962573 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7feba40744b0 0x7feba40769c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7febb4034000 tx=0x7febb402e000 comp rx=0 tx=0).stop 2024-04-25T19:22:53.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.596+0000 7febc9000640 1 -- 172.21.15.131:0/2506962573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febc40b3e70 msgr2=0x7febc40ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:53.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.596+0000 7febc9000640 1 --2- 172.21.15.131:0/2506962573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febc40b3e70 0x7febc40ceb40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7febb000c7c0 tx=0x7febb000cc80 comp rx=0 tx=0).stop 2024-04-25T19:22:53.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.596+0000 7febc9000640 1 -- 172.21.15.131:0/2506962573 shutdown_connections 2024-04-25T19:22:53.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.596+0000 7febc9000640 1 --2- 172.21.15.131:0/2506962573 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7feba40744b0 0x7feba40769c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:53.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.596+0000 7febc9000640 1 --2- 172.21.15.131:0/2506962573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febc40d05a0 0x7febc40c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:53.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.596+0000 7febc9000640 1 --2- 172.21.15.131:0/2506962573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febc40b3e70 0x7febc40ceb40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:53.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.596+0000 7febc9000640 1 --2- 172.21.15.131:0/2506962573 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7febc406c5c0 0x7febc415d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:53.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.596+0000 7febc9000640 1 -- 172.21.15.131:0/2506962573 >> 172.21.15.131:0/2506962573 conn(0x7febc40739a0 msgr2=0x7febc40d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:53.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.596+0000 7febc9000640 1 -- 172.21.15.131:0/2506962573 shutdown_connections 2024-04-25T19:22:53.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.596+0000 7febc9000640 1 -- 172.21.15.131:0/2506962573 wait complete. 2024-04-25T19:22:53.622 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T19:22:53.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.895+0000 7f018d000640 1 Processor -- start 2024-04-25T19:22:53.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.895+0000 7f018d000640 1 -- start start 2024-04-25T19:22:53.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.897+0000 7f018d000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f018815e0c0 0x7f018806e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:53.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.897+0000 7f018d000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f018806e590 0x7f01880d0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:53.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.897+0000 7f018d000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0188161970 con 0x7f01880d1270 2024-04-25T19:22:53.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.897+0000 7f018d000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f01881614e0 con 0x7f018806e590 2024-04-25T19:22:53.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.897+0000 7f018d000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f01880d1a40 con 0x7f018815e0c0 2024-04-25T19:22:53.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.897+0000 7f0185400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f018806e590 0x7f01880d0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:53.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.897+0000 7f0185400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f018806e590 0x7f01880d0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:37890/0 (socket says 172.21.15.131:37890) 2024-04-25T19:22:53.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.897+0000 7f0185400640 1 -- 172.21.15.131:0/3555353634 learned_addr learned my addr 172.21.15.131:0/3555353634 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:53.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.897+0000 7f0185e00640 1 --2- 172.21.15.131:0/3555353634 >> v2:172.21.15.195:3300/0 conn(0x7f018815e0c0 0x7f018806e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:53.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.897+0000 7f0185400640 1 -- 172.21.15.131:0/3555353634 >> v2:172.21.15.195:3300/0 conn(0x7f018815e0c0 msgr2=0x7f018806e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:53.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.897+0000 7f0185400640 1 --2- 172.21.15.131:0/3555353634 >> v2:172.21.15.195:3300/0 conn(0x7f018815e0c0 0x7f018806e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:53.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.898+0000 7f0185400640 1 -- 172.21.15.131:0/3555353634 >> v1:172.21.15.131:6789/0 conn(0x7f01880d1270 legacy=0x7f01880b7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:53.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.898+0000 7f0185400640 1 -- 172.21.15.131:0/3555353634 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018806e9a0 con 0x7f018806e590 2024-04-25T19:22:53.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.899+0000 7f0185400640 1 --2- 172.21.15.131:0/3555353634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f018806e590 0x7f01880d0d30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f01880b8880 tx=0x7f017002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516a3ffce776503e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:53.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.899+0000 7f0184a00640 1 -- 172.21.15.131:0/3555353634 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170037070 con 0x7f018806e590 2024-04-25T19:22:53.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.899+0000 7f0184a00640 1 -- 172.21.15.131:0/3555353634 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0170032440 con 0x7f018806e590 2024-04-25T19:22:53.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.899+0000 7f0184a00640 1 -- 172.21.15.131:0/3555353634 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170032810 con 0x7f018806e590 2024-04-25T19:22:53.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.900+0000 7f018d000640 1 -- 172.21.15.131:0/3555353634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f018806e590 msgr2=0x7f01880d0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:53.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.900+0000 7f018d000640 1 --2- 172.21.15.131:0/3555353634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f018806e590 0x7f01880d0d30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f01880b8880 tx=0x7f017002a270 comp rx=0 tx=0).stop 2024-04-25T19:22:53.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.900+0000 7f018d000640 1 -- 172.21.15.131:0/3555353634 shutdown_connections 2024-04-25T19:22:53.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.900+0000 7f018d000640 1 --2- 172.21.15.131:0/3555353634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f018806e590 0x7f01880d0d30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:53.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.900+0000 7f018d000640 1 --2- 172.21.15.131:0/3555353634 >> v2:172.21.15.195:3300/0 conn(0x7f018815e0c0 0x7f018806e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:53.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.900+0000 7f018d000640 1 -- 172.21.15.131:0/3555353634 >> 172.21.15.131:0/3555353634 conn(0x7f01880d2800 msgr2=0x7f01880d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:53.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.900+0000 7f018d000640 1 -- 172.21.15.131:0/3555353634 shutdown_connections 2024-04-25T19:22:53.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.900+0000 7f018d000640 1 -- 172.21.15.131:0/3555353634 wait complete. 2024-04-25T19:22:53.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.902+0000 7f018d000640 1 Processor -- start 2024-04-25T19:22:53.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.903+0000 7f018d000640 1 -- start start 2024-04-25T19:22:53.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.904+0000 7f018d000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f018806e590 0x7f01881f6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:53.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.904+0000 7f018d000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01880d1270 0x7f01880b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:53.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.904+0000 7f018d000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f018815e0c0 0x7f01880b7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:53.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.904+0000 7f018d000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0188161170 con 0x7f018815e0c0 2024-04-25T19:22:53.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.904+0000 7f018d000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0188160e90 con 0x7f01880d1270 2024-04-25T19:22:53.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.904+0000 7f018d000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f01880d1680 con 0x7f018806e590 2024-04-25T19:22:53.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.905+0000 7f0186800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f018815e0c0 0x7f01880b7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:53.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.905+0000 7f0186800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f018815e0c0 0x7f01880b7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:37902/0 (socket says 172.21.15.131:37902) 2024-04-25T19:22:53.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.905+0000 7f0186800640 1 -- 172.21.15.131:0/1608587623 learned_addr learned my addr 172.21.15.131:0/1608587623 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:53.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.905+0000 7f0185e00640 1 --2- 172.21.15.131:0/1608587623 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f018806e590 0x7f01881f6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:53.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.905+0000 7f0185400640 1 --2- 172.21.15.131:0/1608587623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01880d1270 0x7f01880b74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:53.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.905+0000 7f0186800640 1 -- 172.21.15.131:0/1608587623 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f018806e590 msgr2=0x7f01881f6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:53.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.905+0000 7f0186800640 1 --2- 172.21.15.131:0/1608587623 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f018806e590 0x7f01881f6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:53.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.905+0000 7f0186800640 1 -- 172.21.15.131:0/1608587623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01880d1270 msgr2=0x7f01880b74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:53.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.905+0000 7f0186800640 1 --2- 172.21.15.131:0/1608587623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01880d1270 0x7f01880b74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:53.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.905+0000 7f0186800640 1 -- 172.21.15.131:0/1608587623 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01880cdcb0 con 0x7f018815e0c0 2024-04-25T19:22:53.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.906+0000 7f0186800640 1 --2- 172.21.15.131:0/1608587623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f018815e0c0 0x7f01880b7a10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f017800c390 tx=0x7f017800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:53.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.906+0000 7f017e000640 1 -- 172.21.15.131:0/1608587623 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0178017070 con 0x7f018815e0c0 2024-04-25T19:22:53.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.906+0000 7f017e000640 1 -- 172.21.15.131:0/1608587623 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01780052d0 con 0x7f018815e0c0 2024-04-25T19:22:53.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.906+0000 7f017e000640 1 -- 172.21.15.131:0/1608587623 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0178003810 con 0x7f018815e0c0 2024-04-25T19:22:53.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.906+0000 7f018d000640 1 -- 172.21.15.131:0/1608587623 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01880b6920 con 0x7f018815e0c0 2024-04-25T19:22:53.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.906+0000 7f018d000640 1 -- 172.21.15.131:0/1608587623 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01880c9c80 con 0x7f018815e0c0 2024-04-25T19:22:53.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.907+0000 7f018d000640 1 -- 172.21.15.131:0/1608587623 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0188050740 con 0x7f018815e0c0 2024-04-25T19:22:53.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.908+0000 7f017e000640 1 -- 172.21.15.131:0/1608587623 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f017801a070 con 0x7f018815e0c0 2024-04-25T19:22:53.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.909+0000 7f017e000640 1 --2- 172.21.15.131:0/1608587623 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f01640744e0 0x7f01640769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:53.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.909+0000 7f017e000640 1 -- 172.21.15.131:0/1608587623 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f01780944a0 con 0x7f018815e0c0 2024-04-25T19:22:53.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.910+0000 7f0185e00640 1 --2- 172.21.15.131:0/1608587623 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f01640744e0 0x7f01640769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:53.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.911+0000 7f0185e00640 1 --2- 172.21.15.131:0/1608587623 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f01640744e0 0x7f01640769f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f01800099c0 tx=0x7f0180003990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:53.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:53.914+0000 7f017e000640 1 -- 172.21.15.131:0/1608587623 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f017805ecc0 con 0x7f018815e0c0 2024-04-25T19:22:54.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.111+0000 7f018d000640 1 -- 172.21.15.131:0/1608587623 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f01880c94f0 con 0x7f018815e0c0 2024-04-25T19:22:54.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.112+0000 7f017e000640 1 -- 172.21.15.131:0/1608587623 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f017805e5c0 con 0x7f018815e0c0 2024-04-25T19:22:54.114 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 64 2024-04-25T19:22:54.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.115+0000 7f018d000640 1 -- 172.21.15.131:0/1608587623 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f01640744e0 msgr2=0x7f01640769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:54.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.115+0000 7f018d000640 1 --2- 172.21.15.131:0/1608587623 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f01640744e0 0x7f01640769f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f01800099c0 tx=0x7f0180003990 comp rx=0 tx=0).stop 2024-04-25T19:22:54.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.115+0000 7f018d000640 1 -- 172.21.15.131:0/1608587623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f018815e0c0 msgr2=0x7f01880b7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:54.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.115+0000 7f018d000640 1 --2- 172.21.15.131:0/1608587623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f018815e0c0 0x7f01880b7a10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f017800c390 tx=0x7f017800c850 comp rx=0 tx=0).stop 2024-04-25T19:22:54.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.115+0000 7f018d000640 1 -- 172.21.15.131:0/1608587623 shutdown_connections 2024-04-25T19:22:54.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.115+0000 7f018d000640 1 --2- 172.21.15.131:0/1608587623 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f01640744e0 0x7f01640769f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:54.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.115+0000 7f018d000640 1 --2- 172.21.15.131:0/1608587623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f018815e0c0 0x7f01880b7a10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:54.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.115+0000 7f018d000640 1 --2- 172.21.15.131:0/1608587623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01880d1270 0x7f01880b74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:54.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.115+0000 7f018d000640 1 --2- 172.21.15.131:0/1608587623 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f018806e590 0x7f01881f6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:54.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.115+0000 7f018d000640 1 -- 172.21.15.131:0/1608587623 >> 172.21.15.131:0/1608587623 conn(0x7f01880d2800 msgr2=0x7f0188152540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:54.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.115+0000 7f018d000640 1 -- 172.21.15.131:0/1608587623 shutdown_connections 2024-04-25T19:22:54.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.115+0000 7f018d000640 1 -- 172.21.15.131:0/1608587623 wait complete. 2024-04-25T19:22:54.144 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:22:54.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.405+0000 7f81ea200640 1 Processor -- start 2024-04-25T19:22:54.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.405+0000 7f81ea200640 1 -- start start 2024-04-25T19:22:54.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.407+0000 7f81ea200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f81e40cf2f0 0x7f81e40b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:54.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.407+0000 7f81ea200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81e40b74d0 con 0x7f81e415a810 2024-04-25T19:22:54.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.407+0000 7f81ea200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81e40b77b0 con 0x7f81e41608d0 2024-04-25T19:22:54.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.407+0000 7f81ea200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f81e406f870 con 0x7f81e40cf2f0 2024-04-25T19:22:54.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.407+0000 7f81e8e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f81e40cf2f0 0x7f81e40b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:54.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.407+0000 7f81e8e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f81e40cf2f0 0x7f81e40b6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:37906/0 (socket says 172.21.15.131:37906) 2024-04-25T19:22:54.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.407+0000 7f81dbe00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f81e415a810 0x7f81e40b4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:54700/0 (socket says 172.21.15.131:54700) 2024-04-25T19:22:54.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.407+0000 7f81e8e00640 1 -- 172.21.15.131:0/3247900652 learned_addr learned my addr 172.21.15.131:0/3247900652 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:54.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.408+0000 7f81e8e00640 1 -- 172.21.15.131:0/3247900652 >> v1:172.21.15.195:6789/0 conn(0x7f81e41608d0 legacy=0x7f81e4160ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:54.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.408+0000 7f81e8e00640 1 -- 172.21.15.131:0/3247900652 >> v1:172.21.15.131:6789/0 conn(0x7f81e415a810 legacy=0x7f81e40b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:54.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.408+0000 7f81e8e00640 1 -- 172.21.15.131:0/3247900652 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e406f220 con 0x7f81e40cf2f0 2024-04-25T19:22:54.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.408+0000 7f81e3e00640 1 -- 172.21.15.131:0/3247900652 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2099134644 0 0) 0x7f81e40b74d0 con 0x7f81e415a810 2024-04-25T19:22:54.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.409+0000 7f81e8e00640 1 --2- 172.21.15.131:0/3247900652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81e40cf2f0 0x7f81e40b6e10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f81e406f9f0 tx=0x7f81d402a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52831bedf1323808 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:54.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.409+0000 7f81e3e00640 1 -- 172.21.15.131:0/3247900652 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d4037070 con 0x7f81e40cf2f0 2024-04-25T19:22:54.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.409+0000 7f81e3e00640 1 -- 172.21.15.131:0/3247900652 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81d4032440 con 0x7f81e40cf2f0 2024-04-25T19:22:54.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.409+0000 7f81e3e00640 1 -- 172.21.15.131:0/3247900652 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d4032810 con 0x7f81e40cf2f0 2024-04-25T19:22:54.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.410+0000 7f81ea200640 1 -- 172.21.15.131:0/3247900652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81e40cf2f0 msgr2=0x7f81e40b6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:54.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.410+0000 7f81ea200640 1 --2- 172.21.15.131:0/3247900652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81e40cf2f0 0x7f81e40b6e10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f81e406f9f0 tx=0x7f81d402a290 comp rx=0 tx=0).stop 2024-04-25T19:22:54.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.410+0000 7f81ea200640 1 -- 172.21.15.131:0/3247900652 shutdown_connections 2024-04-25T19:22:54.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.410+0000 7f81ea200640 1 --2- 172.21.15.131:0/3247900652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81e40cf2f0 0x7f81e40b6e10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:54.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.410+0000 7f81ea200640 1 -- 172.21.15.131:0/3247900652 >> 172.21.15.131:0/3247900652 conn(0x7f81e40d1720 msgr2=0x7f81e40d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:54.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.410+0000 7f81ea200640 1 -- 172.21.15.131:0/3247900652 shutdown_connections 2024-04-25T19:22:54.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.410+0000 7f81ea200640 1 -- 172.21.15.131:0/3247900652 wait complete. 2024-04-25T19:22:54.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.413+0000 7f81ea200640 1 Processor -- start 2024-04-25T19:22:54.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.413+0000 7f81ea200640 1 -- start start 2024-04-25T19:22:54.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.414+0000 7f81ea200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81e40cf2f0 0x7f81e41fa530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:54.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.414+0000 7f81ea200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81e415a810 0x7f81e4147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:54.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.414+0000 7f81ea200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81e41608d0 0x7f81e415ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:54.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.414+0000 7f81ea200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f81e406fd00 con 0x7f81e415a810 2024-04-25T19:22:54.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.414+0000 7f81ea200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f81e415ac20 con 0x7f81e41608d0 2024-04-25T19:22:54.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.414+0000 7f81ea200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f81e406fe80 con 0x7f81e40cf2f0 2024-04-25T19:22:54.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.415+0000 7f81dbe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81e415a810 0x7f81e4147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:54.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.415+0000 7f81dbe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81e415a810 0x7f81e4147060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:37910/0 (socket says 172.21.15.131:37910) 2024-04-25T19:22:54.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.415+0000 7f81dbe00640 1 -- 172.21.15.131:0/3365269902 learned_addr learned my addr 172.21.15.131:0/3365269902 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:54.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.415+0000 7f81e8e00640 1 --2- 172.21.15.131:0/3365269902 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81e40cf2f0 0x7f81e41fa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:54.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.415+0000 7f81e9800640 1 --2- 172.21.15.131:0/3365269902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81e41608d0 0x7f81e415ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:54.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.415+0000 7f81dbe00640 1 -- 172.21.15.131:0/3365269902 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81e40cf2f0 msgr2=0x7f81e41fa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:54.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.415+0000 7f81dbe00640 1 --2- 172.21.15.131:0/3365269902 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81e40cf2f0 0x7f81e41fa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:54.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.415+0000 7f81dbe00640 1 -- 172.21.15.131:0/3365269902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81e41608d0 msgr2=0x7f81e415ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:54.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.415+0000 7f81dbe00640 1 --2- 172.21.15.131:0/3365269902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81e41608d0 0x7f81e415ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:54.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.415+0000 7f81dbe00640 1 -- 172.21.15.131:0/3365269902 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e41faa70 con 0x7f81e415a810 2024-04-25T19:22:54.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.415+0000 7f81dbe00640 1 --2- 172.21.15.131:0/3365269902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81e415a810 0x7f81e4147060 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00c460 tx=0x7f81cc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:54.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.416+0000 7f81e1600640 1 -- 172.21.15.131:0/3365269902 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc018070 con 0x7f81e415a810 2024-04-25T19:22:54.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.416+0000 7f81e1600640 1 -- 172.21.15.131:0/3365269902 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81cc007500 con 0x7f81e415a810 2024-04-25T19:22:54.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.416+0000 7f81e1600640 1 -- 172.21.15.131:0/3365269902 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc004a20 con 0x7f81e415a810 2024-04-25T19:22:54.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.416+0000 7f81ea200640 1 -- 172.21.15.131:0/3365269902 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81e41580c0 con 0x7f81e415a810 2024-04-25T19:22:54.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.416+0000 7f81ea200640 1 -- 172.21.15.131:0/3365269902 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81e4158680 con 0x7f81e415a810 2024-04-25T19:22:54.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.417+0000 7f81ea200640 1 -- 172.21.15.131:0/3365269902 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81e41fac40 con 0x7f81e415a810 2024-04-25T19:22:54.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.418+0000 7f81e1600640 1 -- 172.21.15.131:0/3365269902 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f81cc01b070 con 0x7f81e415a810 2024-04-25T19:22:54.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.420+0000 7f81e1600640 1 --2- 172.21.15.131:0/3365269902 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f81c00744b0 0x7f81c00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:54.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.420+0000 7f81e1600640 1 -- 172.21.15.131:0/3365269902 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f81cc0945a0 con 0x7f81e415a810 2024-04-25T19:22:54.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.420+0000 7f81e8e00640 1 --2- 172.21.15.131:0/3365269902 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f81c00744b0 0x7f81c00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:54.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.422+0000 7f81e8e00640 1 --2- 172.21.15.131:0/3365269902 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f81c00744b0 0x7f81c00769c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f81d4034000 tx=0x7f81d402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:54.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.424+0000 7f81e1600640 1 -- 172.21.15.131:0/3365269902 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f81cc05ec90 con 0x7f81e415a810 2024-04-25T19:22:54.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.620+0000 7f81ea200640 1 -- 172.21.15.131:0/3365269902 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81e406c770 con 0x7f81e415a810 2024-04-25T19:22:54.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.623+0000 7f81e1600640 1 -- 172.21.15.131:0/3365269902 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16629 (secure 0 0 0) 0x7f81cc05e590 con 0x7f81e415a810 2024-04-25T19:22:54.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:54.625 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":20,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:22:18.057809+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:22:14.779716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T19:22:15.552027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:22:54.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.626+0000 7f81ea200640 1 -- 172.21.15.131:0/3365269902 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f81c00744b0 msgr2=0x7f81c00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:54.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.626+0000 7f81ea200640 1 --2- 172.21.15.131:0/3365269902 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f81c00744b0 0x7f81c00769c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f81d4034000 tx=0x7f81d402e000 comp rx=0 tx=0).stop 2024-04-25T19:22:54.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.626+0000 7f81ea200640 1 -- 172.21.15.131:0/3365269902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81e415a810 msgr2=0x7f81e4147060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:54.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.626+0000 7f81ea200640 1 --2- 172.21.15.131:0/3365269902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81e415a810 0x7f81e4147060 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00c460 tx=0x7f81cc00c920 comp rx=0 tx=0).stop 2024-04-25T19:22:54.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.626+0000 7f81ea200640 1 -- 172.21.15.131:0/3365269902 shutdown_connections 2024-04-25T19:22:54.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.626+0000 7f81ea200640 1 --2- 172.21.15.131:0/3365269902 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f81c00744b0 0x7f81c00769c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:54.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.626+0000 7f81ea200640 1 --2- 172.21.15.131:0/3365269902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81e41608d0 0x7f81e415ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:54.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.626+0000 7f81ea200640 1 --2- 172.21.15.131:0/3365269902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81e415a810 0x7f81e4147060 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:54.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.626+0000 7f81ea200640 1 --2- 172.21.15.131:0/3365269902 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81e40cf2f0 0x7f81e41fa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:54.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.626+0000 7f81ea200640 1 -- 172.21.15.131:0/3365269902 >> 172.21.15.131:0/3365269902 conn(0x7f81e40d1720 msgr2=0x7f81e4072ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:54.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.626+0000 7f81ea200640 1 -- 172.21.15.131:0/3365269902 shutdown_connections 2024-04-25T19:22:54.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.626+0000 7f81ea200640 1 -- 172.21.15.131:0/3365269902 wait complete. 2024-04-25T19:22:54.652 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T19:22:04.178847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T19:22:14.779716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T19:22:15.552027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T19:22:54.653 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T19:22:54.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.914+0000 7f266ac00640 1 Processor -- start 2024-04-25T19:22:54.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.914+0000 7f266ac00640 1 -- start start 2024-04-25T19:22:54.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.916+0000 7f266ac00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26640ce250 0x7f266415cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:54.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.916+0000 7f266ac00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2664145cd0 con 0x7f26641458c0 2024-04-25T19:22:54.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.916+0000 7f266ac00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f266415d5c0 con 0x7f26640b47b0 2024-04-25T19:22:54.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.916+0000 7f266ac00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f26640742c0 con 0x7f26640ce250 2024-04-25T19:22:54.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.917+0000 7f2663400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f26641458c0 0x7f2664073bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:54706/0 (socket says 172.21.15.131:54706) 2024-04-25T19:22:54.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.917+0000 7f2663400640 1 -- 172.21.15.131:0/3882810512 learned_addr learned my addr 172.21.15.131:0/3882810512 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:54.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.917+0000 7f2663e00640 1 --2- 172.21.15.131:0/3882810512 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26640ce250 0x7f266415cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:54.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.917+0000 7f2662a00640 1 -- 172.21.15.131:0/3882810512 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2572709894 0 0) 0x7f2664145cd0 con 0x7f26641458c0 2024-04-25T19:22:54.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.917+0000 7f2662a00640 1 -- 172.21.15.131:0/3882810512 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2648003520 con 0x7f26641458c0 2024-04-25T19:22:54.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.917+0000 7f2662a00640 1 -- 172.21.15.131:0/3882810512 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2380065863 0 0) 0x7f266415d5c0 con 0x7f26640b47b0 2024-04-25T19:22:54.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.917+0000 7f2662a00640 1 -- 172.21.15.131:0/3882810512 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2664145cd0 con 0x7f26640b47b0 2024-04-25T19:22:54.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.918+0000 7f2662a00640 1 -- 172.21.15.131:0/3882810512 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 940670855 0 0) 0x7f2648003520 con 0x7f26641458c0 2024-04-25T19:22:54.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.918+0000 7f2662a00640 1 -- 172.21.15.131:0/3882810512 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26640ce250 msgr2=0x7f266415cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:54.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.918+0000 7f2662a00640 1 --2- 172.21.15.131:0/3882810512 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26640ce250 0x7f266415cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:54.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.918+0000 7f2662a00640 1 -- 172.21.15.131:0/3882810512 >> v1:172.21.15.195:6789/0 conn(0x7f26640b47b0 legacy=0x7f266406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:54.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.918+0000 7f2662a00640 1 -- 172.21.15.131:0/3882810512 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f266415d8a0 con 0x7f26641458c0 2024-04-25T19:22:54.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.918+0000 7f2662a00640 1 -- 172.21.15.131:0/3882810512 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f2650001670 con 0x7f26641458c0 2024-04-25T19:22:54.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.918+0000 7f2662a00640 1 -- 172.21.15.131:0/3882810512 >> v1:172.21.15.131:6789/0 conn(0x7f26641458c0 legacy=0x7f2664073bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:54.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.918+0000 7f2662a00640 1 --2- 172.21.15.131:0/3882810512 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2648003b70 0x7f2648003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:54.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.918+0000 7f2662a00640 1 --2- 172.21.15.131:0/3882810512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2648004800 0x7f2648004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:54.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.918+0000 7f2662a00640 1 --2- 172.21.15.131:0/3882810512 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26640ce250 0x7f2648005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:54.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.918+0000 7f2662a00640 1 -- 172.21.15.131:0/3882810512 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f26640742c0 con 0x7f2648004800 2024-04-25T19:22:54.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.918+0000 7f2662a00640 1 -- 172.21.15.131:0/3882810512 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f264800dd90 con 0x7f2648003b70 2024-04-25T19:22:54.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.918+0000 7f2662a00640 1 -- 172.21.15.131:0/3882810512 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f264800df90 con 0x7f26640ce250 2024-04-25T19:22:54.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.918+0000 7f2663400640 1 --2- 172.21.15.131:0/3882810512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2648004800 0x7f2648004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:54.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.918+0000 7f2663e00640 1 --2- 172.21.15.131:0/3882810512 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2648003b70 0x7f2648003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:54.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.918+0000 7f2668c00640 1 --2- 172.21.15.131:0/3882810512 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26640ce250 0x7f2648005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:54.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.919+0000 7f2663400640 1 -- 172.21.15.131:0/3882810512 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26640ce250 msgr2=0x7f2648005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:54.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.919+0000 7f2663400640 1 --2- 172.21.15.131:0/3882810512 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26640ce250 0x7f2648005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:54.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.919+0000 7f2663400640 1 -- 172.21.15.131:0/3882810512 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2648003b70 msgr2=0x7f2648003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:54.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.919+0000 7f2663400640 1 --2- 172.21.15.131:0/3882810512 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2648003b70 0x7f2648003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:54.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.919+0000 7f2663400640 1 -- 172.21.15.131:0/3882810512 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f266415d8a0 con 0x7f2648004800 2024-04-25T19:22:54.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.920+0000 7f2663400640 1 --2- 172.21.15.131:0/3882810512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2648004800 0x7f2648004c10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f265000c240 tx=0x7f2648005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bfdc9ce75a26626 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:54.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.920+0000 7f2662a00640 1 -- 172.21.15.131:0/3882810512 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2650007d30 con 0x7f2648004800 2024-04-25T19:22:54.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.920+0000 7f2662a00640 1 -- 172.21.15.131:0/3882810512 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2650005af0 con 0x7f2648004800 2024-04-25T19:22:54.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.920+0000 7f2662a00640 1 -- 172.21.15.131:0/3882810512 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2650007070 con 0x7f2648004800 2024-04-25T19:22:54.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.921+0000 7f266ac00640 1 -- 172.21.15.131:0/3882810512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2648004800 msgr2=0x7f2648004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:54.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.921+0000 7f266ac00640 1 --2- 172.21.15.131:0/3882810512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2648004800 0x7f2648004c10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f265000c240 tx=0x7f2648005830 comp rx=0 tx=0).stop 2024-04-25T19:22:54.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.921+0000 7f2668c00640 1 -- 172.21.15.131:0/3882810512 reap_dead start 2024-04-25T19:22:54.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.921+0000 7f266ac00640 1 -- 172.21.15.131:0/3882810512 shutdown_connections 2024-04-25T19:22:54.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.921+0000 7f266ac00640 1 -- 172.21.15.131:0/3882810512 >> 172.21.15.131:0/3882810512 conn(0x7f2664073090 msgr2=0x7f26640734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:54.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.921+0000 7f266ac00640 1 -- 172.21.15.131:0/3882810512 shutdown_connections 2024-04-25T19:22:54.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.921+0000 7f266ac00640 1 -- 172.21.15.131:0/3882810512 wait complete. 2024-04-25T19:22:54.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.923+0000 7f266ac00640 1 Processor -- start 2024-04-25T19:22:54.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.923+0000 7f266ac00640 1 -- start start 2024-04-25T19:22:54.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.925+0000 7f266ac00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2648004800 0x7f26641402b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:54.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.925+0000 7f266ac00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f266415bff0 0x7f2664140af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:54.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.925+0000 7f266ac00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26640af8e0 0x7f26640afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:54.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.925+0000 7f266ac00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f266415de60 con 0x7f2648004800 2024-04-25T19:22:54.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.925+0000 7f266ac00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f266406f640 con 0x7f266415bff0 2024-04-25T19:22:54.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.925+0000 7f266ac00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2664071310 con 0x7f26640af8e0 2024-04-25T19:22:54.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.925+0000 7f2663e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2648004800 0x7f26641402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:54.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.925+0000 7f2663e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2648004800 0x7f26641402b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:37928/0 (socket says 172.21.15.131:37928) 2024-04-25T19:22:54.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.925+0000 7f2663e00640 1 -- 172.21.15.131:0/3024494486 learned_addr learned my addr 172.21.15.131:0/3024494486 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:54.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.926+0000 7f2663400640 1 --2- 172.21.15.131:0/3024494486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f266415bff0 0x7f2664140af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:54.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.926+0000 7f2668c00640 1 --2- 172.21.15.131:0/3024494486 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26640af8e0 0x7f26640afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:54.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.926+0000 7f2663e00640 1 -- 172.21.15.131:0/3024494486 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26640af8e0 msgr2=0x7f26640afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:54.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.926+0000 7f2663e00640 1 --2- 172.21.15.131:0/3024494486 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26640af8e0 0x7f26640afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:54.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.926+0000 7f2663e00640 1 -- 172.21.15.131:0/3024494486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f266415bff0 msgr2=0x7f2664140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:54.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.926+0000 7f2663e00640 1 --2- 172.21.15.131:0/3024494486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f266415bff0 0x7f2664140af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:54.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.926+0000 7f2663e00640 1 -- 172.21.15.131:0/3024494486 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f266414e380 con 0x7f2648004800 2024-04-25T19:22:54.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.926+0000 7f2668c00640 1 --2- 172.21.15.131:0/3024494486 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26640af8e0 0x7f26640afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:54.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.926+0000 7f2663400640 1 --2- 172.21.15.131:0/3024494486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f266415bff0 0x7f2664140af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T19:22:54.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.926+0000 7f2663e00640 1 --2- 172.21.15.131:0/3024494486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2648004800 0x7f26641402b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2654011930 tx=0x7f2654011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:54.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.926+0000 7f265be00640 1 -- 172.21.15.131:0/3024494486 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265400f9d0 con 0x7f2648004800 2024-04-25T19:22:54.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.926+0000 7f265be00640 1 -- 172.21.15.131:0/3024494486 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f265400fb70 con 0x7f2648004800 2024-04-25T19:22:54.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.926+0000 7f266ac00640 1 -- 172.21.15.131:0/3024494486 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26640b0230 con 0x7f2648004800 2024-04-25T19:22:54.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.926+0000 7f265be00640 1 -- 172.21.15.131:0/3024494486 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2654014440 con 0x7f2648004800 2024-04-25T19:22:54.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.927+0000 7f266ac00640 1 -- 172.21.15.131:0/3024494486 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26641417b0 con 0x7f2648004800 2024-04-25T19:22:54.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.928+0000 7f266ac00640 1 -- 172.21.15.131:0/3024494486 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f266415ff30 con 0x7f2648004800 2024-04-25T19:22:54.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.929+0000 7f265be00640 1 -- 172.21.15.131:0/3024494486 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2654012040 con 0x7f2648004800 2024-04-25T19:22:54.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.930+0000 7f265be00640 1 --2- 172.21.15.131:0/3024494486 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f26440744b0 0x7f26440769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:54.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.930+0000 7f265be00640 1 -- 172.21.15.131:0/3024494486 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2654095970 con 0x7f2648004800 2024-04-25T19:22:54.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.931+0000 7f2663400640 1 --2- 172.21.15.131:0/3024494486 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f26440744b0 0x7f26440769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:54.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.931+0000 7f2663400640 1 --2- 172.21.15.131:0/3024494486 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f26440744b0 0x7f26440769c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2650033000 tx=0x7f265002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:54.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:54.935+0000 7f265be00640 1 -- 172.21.15.131:0/3024494486 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f266415ff30 con 0x7f2648004800 2024-04-25T19:22:55.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.138+0000 7f266ac00640 1 -- 172.21.15.131:0/3024494486 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2664050740 con 0x7f2648004800 2024-04-25T19:22:55.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.138+0000 7f265be00640 1 -- 172.21.15.131:0/3024494486 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f26640b0230 con 0x7f2648004800 2024-04-25T19:22:55.140 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-25T19:22:55.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.141+0000 7f266ac00640 1 -- 172.21.15.131:0/3024494486 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f26440744b0 msgr2=0x7f26440769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:55.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.141+0000 7f266ac00640 1 --2- 172.21.15.131:0/3024494486 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f26440744b0 0x7f26440769c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2650033000 tx=0x7f265002e000 comp rx=0 tx=0).stop 2024-04-25T19:22:55.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.141+0000 7f266ac00640 1 -- 172.21.15.131:0/3024494486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2648004800 msgr2=0x7f26641402b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:55.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.141+0000 7f266ac00640 1 --2- 172.21.15.131:0/3024494486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2648004800 0x7f26641402b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2654011930 tx=0x7f2654011df0 comp rx=0 tx=0).stop 2024-04-25T19:22:55.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.141+0000 7f266ac00640 1 -- 172.21.15.131:0/3024494486 shutdown_connections 2024-04-25T19:22:55.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.141+0000 7f266ac00640 1 --2- 172.21.15.131:0/3024494486 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f26440744b0 0x7f26440769c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:55.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.141+0000 7f266ac00640 1 --2- 172.21.15.131:0/3024494486 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26640af8e0 0x7f26640afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:55.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.141+0000 7f266ac00640 1 --2- 172.21.15.131:0/3024494486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f266415bff0 0x7f2664140af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:55.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.141+0000 7f266ac00640 1 --2- 172.21.15.131:0/3024494486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2648004800 0x7f26641402b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:55.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.141+0000 7f266ac00640 1 -- 172.21.15.131:0/3024494486 >> 172.21.15.131:0/3024494486 conn(0x7f2664073090 msgr2=0x7f26640b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:55.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.142+0000 7f266ac00640 1 -- 172.21.15.131:0/3024494486 shutdown_connections 2024-04-25T19:22:55.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.142+0000 7f266ac00640 1 -- 172.21.15.131:0/3024494486 wait complete. 2024-04-25T19:22:55.170 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T19:22:55.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.439+0000 7f5109600640 1 Processor -- start 2024-04-25T19:22:55.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.439+0000 7f5109600640 1 -- start start 2024-04-25T19:22:55.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.442+0000 7f5109600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f51040d56c0 0x7f51040b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:55.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.442+0000 7f5109600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5104160440 0x7f510406db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:55.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.442+0000 7f5109600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f510406e4b0 con 0x7f510406e0a0 2024-04-25T19:22:55.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.442+0000 7f5109600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f51040d43f0 con 0x7f5104160440 2024-04-25T19:22:55.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.442+0000 7f5109600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f51040d37e0 con 0x7f51040d56c0 2024-04-25T19:22:55.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.442+0000 7f50fbe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5104160440 0x7f510406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:55.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.442+0000 7f5108c00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f510406e0a0 0x7f51040d0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:54710/0 (socket says 172.21.15.131:54710) 2024-04-25T19:22:55.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.442+0000 7f50fbe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5104160440 0x7f510406db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:37938/0 (socket says 172.21.15.131:37938) 2024-04-25T19:22:55.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.442+0000 7f5108c00640 1 -- 172.21.15.131:0/2963569782 learned_addr learned my addr 172.21.15.131:0/2963569782 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:55.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.442+0000 7f5103e00640 1 --2- 172.21.15.131:0/2963569782 >> v2:172.21.15.195:3300/0 conn(0x7f51040d56c0 0x7f51040b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:55.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.443+0000 7f50fbe00640 1 -- 172.21.15.131:0/2963569782 >> v2:172.21.15.195:3300/0 conn(0x7f51040d56c0 msgr2=0x7f51040b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:55.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.443+0000 7f50fbe00640 1 --2- 172.21.15.131:0/2963569782 >> v2:172.21.15.195:3300/0 conn(0x7f51040d56c0 0x7f51040b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:55.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.443+0000 7f50fbe00640 1 -- 172.21.15.131:0/2963569782 >> v1:172.21.15.131:6789/0 conn(0x7f510406e0a0 legacy=0x7f51040d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:55.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.443+0000 7f50fbe00640 1 -- 172.21.15.131:0/2963569782 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51040d3ac0 con 0x7f5104160440 2024-04-25T19:22:55.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.443+0000 7f5103400640 1 -- 172.21.15.131:0/2963569782 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1134906805 0 0) 0x7f50fc001490 con 0x7f510406e0a0 2024-04-25T19:22:55.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.444+0000 7f50fbe00640 1 --2- 172.21.15.131:0/2963569782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5104160440 0x7f510406db60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f510408e390 tx=0x7f50ec02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e23c973de6ebea79 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:55.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.444+0000 7f5103400640 1 -- 172.21.15.131:0/2963569782 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ec037070 con 0x7f5104160440 2024-04-25T19:22:55.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.444+0000 7f5103400640 1 -- 172.21.15.131:0/2963569782 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50ec032440 con 0x7f5104160440 2024-04-25T19:22:55.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.444+0000 7f5103400640 1 -- 172.21.15.131:0/2963569782 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ec032810 con 0x7f5104160440 2024-04-25T19:22:55.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.445+0000 7f5109600640 1 -- 172.21.15.131:0/2963569782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5104160440 msgr2=0x7f510406db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:55.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.445+0000 7f5109600640 1 --2- 172.21.15.131:0/2963569782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5104160440 0x7f510406db60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f510408e390 tx=0x7f50ec02a1a0 comp rx=0 tx=0).stop 2024-04-25T19:22:55.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.445+0000 7f5109600640 1 -- 172.21.15.131:0/2963569782 shutdown_connections 2024-04-25T19:22:55.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.445+0000 7f5109600640 1 --2- 172.21.15.131:0/2963569782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5104160440 0x7f510406db60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:55.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.445+0000 7f5109600640 1 --2- 172.21.15.131:0/2963569782 >> v2:172.21.15.195:3300/0 conn(0x7f51040d56c0 0x7f51040b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:55.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.445+0000 7f5109600640 1 -- 172.21.15.131:0/2963569782 >> 172.21.15.131:0/2963569782 conn(0x7f51040d2c20 msgr2=0x7f51040d5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:55.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.445+0000 7f5109600640 1 -- 172.21.15.131:0/2963569782 shutdown_connections 2024-04-25T19:22:55.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.445+0000 7f5109600640 1 -- 172.21.15.131:0/2963569782 wait complete. 2024-04-25T19:22:55.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.447+0000 7f5109600640 1 Processor -- start 2024-04-25T19:22:55.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.447+0000 7f5109600640 1 -- start start 2024-04-25T19:22:55.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.449+0000 7f5109600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f510406e0a0 0x7f510414f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:55.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.449+0000 7f5109600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5104160440 0x7f51041f9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:55.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.449+0000 7f5109600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51041f9f60 0x7f51040cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:55.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.449+0000 7f5109600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f51040ba270 con 0x7f5104160440 2024-04-25T19:22:55.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.449+0000 7f5109600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f51040d4080 con 0x7f51041f9f60 2024-04-25T19:22:55.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.449+0000 7f5109600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f51040d4880 con 0x7f510406e0a0 2024-04-25T19:22:55.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.449+0000 7f50fbe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5104160440 0x7f51041f9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:55.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.449+0000 7f50fbe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5104160440 0x7f51041f9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:37944/0 (socket says 172.21.15.131:37944) 2024-04-25T19:22:55.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.449+0000 7f50fbe00640 1 -- 172.21.15.131:0/4098065638 learned_addr learned my addr 172.21.15.131:0/4098065638 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:55.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.449+0000 7f50fbe00640 1 -- 172.21.15.131:0/4098065638 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f510406e0a0 msgr2=0x7f510414f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:55.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.449+0000 7f50fbe00640 1 --2- 172.21.15.131:0/4098065638 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f510406e0a0 0x7f510414f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:55.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.449+0000 7f50fbe00640 1 -- 172.21.15.131:0/4098065638 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51041f9f60 msgr2=0x7f51040cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:55.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.449+0000 7f50fbe00640 1 --2- 172.21.15.131:0/4098065638 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51041f9f60 0x7f51040cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:55.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.449+0000 7f50fbe00640 1 -- 172.21.15.131:0/4098065638 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51040ccf50 con 0x7f5104160440 2024-04-25T19:22:55.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.450+0000 7f50fbe00640 1 --2- 172.21.15.131:0/4098065638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5104160440 0x7f51041f9a20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f50ec000c00 tx=0x7f50ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:55.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.450+0000 7f5100c00640 1 -- 172.21.15.131:0/4098065638 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ec037050 con 0x7f5104160440 2024-04-25T19:22:55.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.450+0000 7f5100c00640 1 -- 172.21.15.131:0/4098065638 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50ec038040 con 0x7f5104160440 2024-04-25T19:22:55.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.450+0000 7f5100c00640 1 -- 172.21.15.131:0/4098065638 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ec004470 con 0x7f5104160440 2024-04-25T19:22:55.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.450+0000 7f5109600640 1 -- 172.21.15.131:0/4098065638 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51040cd230 con 0x7f5104160440 2024-04-25T19:22:55.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.450+0000 7f5109600640 1 -- 172.21.15.131:0/4098065638 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51040cd7f0 con 0x7f5104160440 2024-04-25T19:22:55.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.451+0000 7f5109600640 1 -- 172.21.15.131:0/4098065638 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5104076c60 con 0x7f5104160440 2024-04-25T19:22:55.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.452+0000 7f5100c00640 1 -- 172.21.15.131:0/4098065638 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f50ec030900 con 0x7f5104160440 2024-04-25T19:22:55.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.453+0000 7f5100c00640 1 --2- 172.21.15.131:0/4098065638 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f50e00744b0 0x7f50e00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:55.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.453+0000 7f5100c00640 1 -- 172.21.15.131:0/4098065638 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f50ec0b5e20 con 0x7f5104160440 2024-04-25T19:22:55.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.454+0000 7f5103e00640 1 --2- 172.21.15.131:0/4098065638 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f50e00744b0 0x7f50e00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:55.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.455+0000 7f5103e00640 1 --2- 172.21.15.131:0/4098065638 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f50e00744b0 0x7f50e00769c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f50f4006fd0 tx=0x7f50f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:55.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.458+0000 7f5100c00640 1 -- 172.21.15.131:0/4098065638 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f50ec080510 con 0x7f5104160440 2024-04-25T19:22:55.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.655+0000 7f5109600640 1 -- 172.21.15.131:0/4098065638 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f51040b6290 con 0x7f5104160440 2024-04-25T19:22:55.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.655+0000 7f5100c00640 1 -- 172.21.15.131:0/4098065638 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f50ec07fe10 con 0x7f5104160440 2024-04-25T19:22:55.657 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-25T19:22:55.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.658+0000 7f5109600640 1 -- 172.21.15.131:0/4098065638 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f50e00744b0 msgr2=0x7f50e00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:55.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.658+0000 7f5109600640 1 --2- 172.21.15.131:0/4098065638 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f50e00744b0 0x7f50e00769c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f50f4006fd0 tx=0x7f50f4008040 comp rx=0 tx=0).stop 2024-04-25T19:22:55.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.658+0000 7f5109600640 1 -- 172.21.15.131:0/4098065638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5104160440 msgr2=0x7f51041f9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:55.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.658+0000 7f5109600640 1 --2- 172.21.15.131:0/4098065638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5104160440 0x7f51041f9a20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f50ec000c00 tx=0x7f50ec0046c0 comp rx=0 tx=0).stop 2024-04-25T19:22:55.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.658+0000 7f5109600640 1 -- 172.21.15.131:0/4098065638 shutdown_connections 2024-04-25T19:22:55.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.658+0000 7f5109600640 1 --2- 172.21.15.131:0/4098065638 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f50e00744b0 0x7f50e00769c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:55.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.658+0000 7f5109600640 1 --2- 172.21.15.131:0/4098065638 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51041f9f60 0x7f51040cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:55.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.658+0000 7f5109600640 1 --2- 172.21.15.131:0/4098065638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5104160440 0x7f51041f9a20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:55.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.658+0000 7f5109600640 1 --2- 172.21.15.131:0/4098065638 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f510406e0a0 0x7f510414f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:55.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.658+0000 7f5109600640 1 -- 172.21.15.131:0/4098065638 >> 172.21.15.131:0/4098065638 conn(0x7f51040d2c20 msgr2=0x7f51040cb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:55.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.658+0000 7f5109600640 1 -- 172.21.15.131:0/4098065638 shutdown_connections 2024-04-25T19:22:55.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.658+0000 7f5109600640 1 -- 172.21.15.131:0/4098065638 wait complete. 2024-04-25T19:22:55.684 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T19:22:55.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.947+0000 7f2c3ea00640 1 Processor -- start 2024-04-25T19:22:55.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.947+0000 7f2c3ea00640 1 -- start start 2024-04-25T19:22:55.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.949+0000 7f2c3ea00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2c380b93b0 0x7f2c381603d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:55.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.949+0000 7f2c3ea00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c380d0ef0 0x7f2c380d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:55.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.949+0000 7f2c3ea00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c38164070 con 0x7f2c3806e030 2024-04-25T19:22:55.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.949+0000 7f2c3ea00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f2c38164350 con 0x7f2c380b93b0 2024-04-25T19:22:55.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.949+0000 7f2c3ea00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2c38164630 con 0x7f2c380d0ef0 2024-04-25T19:22:55.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.949+0000 7f2c37e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2c380b93b0 0x7f2c381603d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:55.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.949+0000 7f2c37e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2c380b93b0 0x7f2c381603d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:37948/0 (socket says 172.21.15.131:37948) 2024-04-25T19:22:55.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.949+0000 7f2c37e00640 1 -- 172.21.15.131:0/2383184847 learned_addr learned my addr 172.21.15.131:0/2383184847 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:55.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.950+0000 7f2c37e00640 1 -- 172.21.15.131:0/2383184847 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c380d0ef0 msgr2=0x7f2c380d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:55.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.950+0000 7f2c3ca00640 1 --2- 172.21.15.131:0/2383184847 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c380d0ef0 0x7f2c380d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:55.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.950+0000 7f2c37e00640 1 --2- 172.21.15.131:0/2383184847 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c380d0ef0 0x7f2c380d1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:55.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.950+0000 7f2c37e00640 1 -- 172.21.15.131:0/2383184847 >> v1:172.21.15.195:6789/0 conn(0x7f2c3806e030 legacy=0x7f2c3806e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:55.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.950+0000 7f2c37e00640 1 -- 172.21.15.131:0/2383184847 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c38164910 con 0x7f2c380b93b0 2024-04-25T19:22:55.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.951+0000 7f2c37e00640 1 --2- 172.21.15.131:0/2383184847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c380b93b0 0x7f2c381603d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009870 tx=0x7f2c2802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae21044b3acc2a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:55.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.951+0000 7f2c36a00640 1 -- 172.21.15.131:0/2383184847 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c28037070 con 0x7f2c380b93b0 2024-04-25T19:22:55.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.951+0000 7f2c36a00640 1 -- 172.21.15.131:0/2383184847 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c28032440 con 0x7f2c380b93b0 2024-04-25T19:22:55.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.951+0000 7f2c36a00640 1 -- 172.21.15.131:0/2383184847 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c28032810 con 0x7f2c380b93b0 2024-04-25T19:22:55.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.952+0000 7f2c3ea00640 1 -- 172.21.15.131:0/2383184847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c380b93b0 msgr2=0x7f2c381603d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:55.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.952+0000 7f2c3ea00640 1 --2- 172.21.15.131:0/2383184847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c380b93b0 0x7f2c381603d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009870 tx=0x7f2c2802a180 comp rx=0 tx=0).stop 2024-04-25T19:22:55.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.952+0000 7f2c3ea00640 1 -- 172.21.15.131:0/2383184847 shutdown_connections 2024-04-25T19:22:55.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.952+0000 7f2c3ea00640 1 --2- 172.21.15.131:0/2383184847 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c380d0ef0 0x7f2c380d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:55.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.953+0000 7f2c3ea00640 1 --2- 172.21.15.131:0/2383184847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c380b93b0 0x7f2c381603d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:55.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.953+0000 7f2c3ea00640 1 -- 172.21.15.131:0/2383184847 >> 172.21.15.131:0/2383184847 conn(0x7f2c380d2780 msgr2=0x7f2c380d2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:55.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.953+0000 7f2c3ea00640 1 -- 172.21.15.131:0/2383184847 shutdown_connections 2024-04-25T19:22:55.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.953+0000 7f2c3ea00640 1 -- 172.21.15.131:0/2383184847 wait complete. 2024-04-25T19:22:55.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.955+0000 7f2c3ea00640 1 Processor -- start 2024-04-25T19:22:55.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.955+0000 7f2c3ea00640 1 -- start start 2024-04-25T19:22:55.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.957+0000 7f2c3ea00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c3806e030 0x7f2c380cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:55.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.957+0000 7f2c3ea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c380b93b0 0x7f2c381f9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:55.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.957+0000 7f2c3ea00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c380d0ef0 0x7f2c380cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:55.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.957+0000 7f2c3ea00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2c380d19c0 con 0x7f2c380b93b0 2024-04-25T19:22:55.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.957+0000 7f2c3ea00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2c380d1840 con 0x7f2c380d0ef0 2024-04-25T19:22:55.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.957+0000 7f2c3ea00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2c380d49b0 con 0x7f2c3806e030 2024-04-25T19:22:55.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.957+0000 7f2c37400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c380b93b0 0x7f2c381f9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:55.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.957+0000 7f2c37400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c380b93b0 0x7f2c381f9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:37960/0 (socket says 172.21.15.131:37960) 2024-04-25T19:22:55.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.957+0000 7f2c37400640 1 -- 172.21.15.131:0/683530247 learned_addr learned my addr 172.21.15.131:0/683530247 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:55.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.957+0000 7f2c37e00640 1 --2- 172.21.15.131:0/683530247 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c3806e030 0x7f2c380cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:55.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.957+0000 7f2c3ca00640 1 --2- 172.21.15.131:0/683530247 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c380d0ef0 0x7f2c380cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:55.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.957+0000 7f2c37400640 1 -- 172.21.15.131:0/683530247 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c3806e030 msgr2=0x7f2c380cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:55.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.957+0000 7f2c37400640 1 --2- 172.21.15.131:0/683530247 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c3806e030 0x7f2c380cd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:55.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.957+0000 7f2c37400640 1 -- 172.21.15.131:0/683530247 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c380d0ef0 msgr2=0x7f2c380cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:55.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.957+0000 7f2c37400640 1 --2- 172.21.15.131:0/683530247 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c380d0ef0 0x7f2c380cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:55.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.957+0000 7f2c37400640 1 -- 172.21.15.131:0/683530247 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c380ce050 con 0x7f2c380b93b0 2024-04-25T19:22:55.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.957+0000 7f2c3ca00640 1 --2- 172.21.15.131:0/683530247 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c380d0ef0 0x7f2c380cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:55.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.958+0000 7f2c37400640 1 --2- 172.21.15.131:0/683530247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c380b93b0 0x7f2c381f9560 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400ba50 tx=0x7f2c2400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:55.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.958+0000 7f2c2fe00640 1 -- 172.21.15.131:0/683530247 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c24019070 con 0x7f2c380b93b0 2024-04-25T19:22:55.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.958+0000 7f2c2fe00640 1 -- 172.21.15.131:0/683530247 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c2400cbc0 con 0x7f2c380b93b0 2024-04-25T19:22:55.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.958+0000 7f2c2fe00640 1 -- 172.21.15.131:0/683530247 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c24014440 con 0x7f2c380b93b0 2024-04-25T19:22:55.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.958+0000 7f2c3ea00640 1 -- 172.21.15.131:0/683530247 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c380ce330 con 0x7f2c380b93b0 2024-04-25T19:22:55.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.958+0000 7f2c3ea00640 1 -- 172.21.15.131:0/683530247 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c380c96b0 con 0x7f2c380b93b0 2024-04-25T19:22:55.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.959+0000 7f2c3ea00640 1 -- 172.21.15.131:0/683530247 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c38050740 con 0x7f2c380b93b0 2024-04-25T19:22:55.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.961+0000 7f2c2fe00640 1 -- 172.21.15.131:0/683530247 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2c2401c070 con 0x7f2c380b93b0 2024-04-25T19:22:55.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.962+0000 7f2c2fe00640 1 --2- 172.21.15.131:0/683530247 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2c180744e0 0x7f2c180769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:55.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.962+0000 7f2c2fe00640 1 -- 172.21.15.131:0/683530247 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2c24094e40 con 0x7f2c380b93b0 2024-04-25T19:22:55.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.963+0000 7f2c37e00640 1 --2- 172.21.15.131:0/683530247 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2c180744e0 0x7f2c180769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:55.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.964+0000 7f2c37e00640 1 --2- 172.21.15.131:0/683530247 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2c180744e0 0x7f2c180769f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2c28034000 tx=0x7f2c2802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:55.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:55.967+0000 7f2c2fe00640 1 -- 172.21.15.131:0/683530247 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2c2405ef80 con 0x7f2c380b93b0 2024-04-25T19:22:56.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.157+0000 7f2c3ea00640 1 -- 172.21.15.131:0/683530247 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2c380d2c30 con 0x7f2c380b93b0 2024-04-25T19:22:56.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.158+0000 7f2c2fe00640 1 -- 172.21.15.131:0/683530247 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f2c24063280 con 0x7f2c380b93b0 2024-04-25T19:22:56.160 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 64 2024-04-25T19:22:56.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.160+0000 7f2c3ea00640 1 -- 172.21.15.131:0/683530247 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2c180744e0 msgr2=0x7f2c180769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:56.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.160+0000 7f2c3ea00640 1 --2- 172.21.15.131:0/683530247 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2c180744e0 0x7f2c180769f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2c28034000 tx=0x7f2c2802e000 comp rx=0 tx=0).stop 2024-04-25T19:22:56.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.160+0000 7f2c3ea00640 1 -- 172.21.15.131:0/683530247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c380b93b0 msgr2=0x7f2c381f9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:56.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.160+0000 7f2c3ea00640 1 --2- 172.21.15.131:0/683530247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c380b93b0 0x7f2c381f9560 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400ba50 tx=0x7f2c2400bf10 comp rx=0 tx=0).stop 2024-04-25T19:22:56.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.161+0000 7f2c3ea00640 1 -- 172.21.15.131:0/683530247 shutdown_connections 2024-04-25T19:22:56.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.161+0000 7f2c3ea00640 1 --2- 172.21.15.131:0/683530247 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2c180744e0 0x7f2c180769f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:56.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.161+0000 7f2c3ea00640 1 --2- 172.21.15.131:0/683530247 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c380d0ef0 0x7f2c380cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:56.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.161+0000 7f2c3ea00640 1 --2- 172.21.15.131:0/683530247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c380b93b0 0x7f2c381f9560 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:56.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.161+0000 7f2c3ea00640 1 --2- 172.21.15.131:0/683530247 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c3806e030 0x7f2c380cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:56.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.161+0000 7f2c3ea00640 1 -- 172.21.15.131:0/683530247 >> 172.21.15.131:0/683530247 conn(0x7f2c380d2780 msgr2=0x7f2c380b5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:56.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.161+0000 7f2c3ea00640 1 -- 172.21.15.131:0/683530247 shutdown_connections 2024-04-25T19:22:56.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.161+0000 7f2c3ea00640 1 -- 172.21.15.131:0/683530247 wait complete. 2024-04-25T19:22:56.189 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:22:56.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.464+0000 7fbbce200640 1 Processor -- start 2024-04-25T19:22:56.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.464+0000 7fbbce200640 1 -- start start 2024-04-25T19:22:56.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.466+0000 7fbbce200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbbc80b6e10 0x7fbbc815a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:56.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.466+0000 7fbbce200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbc80b7220 con 0x7fbbc81608d0 2024-04-25T19:22:56.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.466+0000 7fbbce200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbc80b74d0 con 0x7fbbc80cf2f0 2024-04-25T19:22:56.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.466+0000 7fbbce200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fbbc806f870 con 0x7fbbc80b6e10 2024-04-25T19:22:56.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.466+0000 7fbbcd800640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fbbc81608d0 0x7fbbc8160ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:54722/0 (socket says 172.21.15.131:54722) 2024-04-25T19:22:56.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.466+0000 7fbbcd800640 1 -- 172.21.15.131:0/252371678 learned_addr learned my addr 172.21.15.131:0/252371678 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:56.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.467+0000 7fbbc7400640 1 -- 172.21.15.131:0/252371678 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2149395507 0 0) 0x7fbbc80b7220 con 0x7fbbc81608d0 2024-04-25T19:22:56.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.467+0000 7fbbc7400640 1 -- 172.21.15.131:0/252371678 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbb0003520 con 0x7fbbc81608d0 2024-04-25T19:22:56.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.467+0000 7fbbc7e00640 1 --2- 172.21.15.131:0/252371678 >> v2:172.21.15.195:3300/0 conn(0x7fbbc80b6e10 0x7fbbc815a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:56.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.467+0000 7fbbc7400640 1 -- 172.21.15.131:0/252371678 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1268649741 0 0) 0x7fbbb0003520 con 0x7fbbc81608d0 2024-04-25T19:22:56.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.467+0000 7fbbc7400640 1 -- 172.21.15.131:0/252371678 >> v2:172.21.15.195:3300/0 conn(0x7fbbc80b6e10 msgr2=0x7fbbc815a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:56.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.467+0000 7fbbc7400640 1 --2- 172.21.15.131:0/252371678 >> v2:172.21.15.195:3300/0 conn(0x7fbbc80b6e10 0x7fbbc815a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:56.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.467+0000 7fbbc7400640 1 -- 172.21.15.131:0/252371678 >> v1:172.21.15.195:6789/0 conn(0x7fbbc80cf2f0 legacy=0x7fbbc80b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:56.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.467+0000 7fbbc7400640 1 -- 172.21.15.131:0/252371678 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc80b77b0 con 0x7fbbc81608d0 2024-04-25T19:22:56.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.467+0000 7fbbc7400640 1 -- 172.21.15.131:0/252371678 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7fbbc00019f0 con 0x7fbbc81608d0 2024-04-25T19:22:56.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.467+0000 7fbbc7400640 1 -- 172.21.15.131:0/252371678 >> v1:172.21.15.131:6789/0 conn(0x7fbbc81608d0 legacy=0x7fbbc8160ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:56.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.467+0000 7fbbc7400640 1 --2- 172.21.15.131:0/252371678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbb00039b0 0x7fbbb0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:56.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.467+0000 7fbbc7400640 1 --2- 172.21.15.131:0/252371678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbb0004800 0x7fbbb0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:56.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.467+0000 7fbbc7400640 1 --2- 172.21.15.131:0/252371678 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbb00051c0 0x7fbbb000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:56.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.468+0000 7fbbc7400640 1 -- 172.21.15.131:0/252371678 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc806f870 con 0x7fbbb00039b0 2024-04-25T19:22:56.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.468+0000 7fbbc7400640 1 -- 172.21.15.131:0/252371678 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb000c160 con 0x7fbbb0004800 2024-04-25T19:22:56.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.468+0000 7fbbc7400640 1 -- 172.21.15.131:0/252371678 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbbb000c360 con 0x7fbbb00051c0 2024-04-25T19:22:56.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.468+0000 7fbbcce00640 1 --2- 172.21.15.131:0/252371678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbb00039b0 0x7fbbb0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:56.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.468+0000 7fbbcce00640 1 -- 172.21.15.131:0/252371678 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbb00051c0 msgr2=0x7fbbb000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:56.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.468+0000 7fbbcce00640 1 --2- 172.21.15.131:0/252371678 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbb00051c0 0x7fbbb000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:56.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.468+0000 7fbbcce00640 1 -- 172.21.15.131:0/252371678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbb0004800 msgr2=0x7fbbb0004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:56.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.468+0000 7fbbcce00640 1 --2- 172.21.15.131:0/252371678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbb0004800 0x7fbbb0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:56.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.468+0000 7fbbcce00640 1 -- 172.21.15.131:0/252371678 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb0003520 con 0x7fbbb00039b0 2024-04-25T19:22:56.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.468+0000 7fbbcd800640 1 -- 172.21.15.131:0/252371678 reap_dead start 2024-04-25T19:22:56.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.469+0000 7fbbcce00640 1 --2- 172.21.15.131:0/252371678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbb00039b0 0x7fbbb0003e20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc001750 tx=0x7fbbb0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a367d1155c12ca2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:56.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.469+0000 7fbbc7400640 1 -- 172.21.15.131:0/252371678 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc001370 con 0x7fbbb00039b0 2024-04-25T19:22:56.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.469+0000 7fbbc7400640 1 -- 172.21.15.131:0/252371678 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbbc0052d0 con 0x7fbbb00039b0 2024-04-25T19:22:56.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.469+0000 7fbbc7400640 1 -- 172.21.15.131:0/252371678 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc02ab00 con 0x7fbbb00039b0 2024-04-25T19:22:56.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.470+0000 7fbbce200640 1 -- 172.21.15.131:0/252371678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbb00039b0 msgr2=0x7fbbb0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:56.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.470+0000 7fbbce200640 1 --2- 172.21.15.131:0/252371678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbb00039b0 0x7fbbb0003e20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc001750 tx=0x7fbbb0005830 comp rx=0 tx=0).stop 2024-04-25T19:22:56.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.470+0000 7fbbce200640 1 -- 172.21.15.131:0/252371678 shutdown_connections 2024-04-25T19:22:56.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.470+0000 7fbbce200640 1 --2- 172.21.15.131:0/252371678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbb00039b0 0x7fbbb0003e20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:56.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.470+0000 7fbbce200640 1 -- 172.21.15.131:0/252371678 >> 172.21.15.131:0/252371678 conn(0x7fbbc80d1720 msgr2=0x7fbbc80d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:56.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.470+0000 7fbbce200640 1 -- 172.21.15.131:0/252371678 shutdown_connections 2024-04-25T19:22:56.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.470+0000 7fbbce200640 1 -- 172.21.15.131:0/252371678 wait complete. 2024-04-25T19:22:56.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.473+0000 7fbbce200640 1 Processor -- start 2024-04-25T19:22:56.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.473+0000 7fbbce200640 1 -- start start 2024-04-25T19:22:56.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.474+0000 7fbbce200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbb00039b0 0x7fbbc80cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:56.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.474+0000 7fbbce200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbc81433e0 0x7fbbc813c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:56.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.474+0000 7fbbce200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbc813cf60 0x7fbbc813d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:56.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.474+0000 7fbbce200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc815a810 con 0x7fbbc813cf60 2024-04-25T19:22:56.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.474+0000 7fbbce200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc806f500 con 0x7fbbc81433e0 2024-04-25T19:22:56.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.474+0000 7fbbce200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc815a990 con 0x7fbbb00039b0 2024-04-25T19:22:56.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.475+0000 7fbbcd800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbc813cf60 0x7fbbc813d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:56.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.475+0000 7fbbcd800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbc813cf60 0x7fbbc813d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:37982/0 (socket says 172.21.15.131:37982) 2024-04-25T19:22:56.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.475+0000 7fbbcd800640 1 -- 172.21.15.131:0/3343375503 learned_addr learned my addr 172.21.15.131:0/3343375503 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:56.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.475+0000 7fbbcd800640 1 -- 172.21.15.131:0/3343375503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbb00039b0 msgr2=0x7fbbc80cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:56.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.475+0000 7fbbcd800640 1 --2- 172.21.15.131:0/3343375503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbb00039b0 0x7fbbc80cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:56.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.475+0000 7fbbcd800640 1 -- 172.21.15.131:0/3343375503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbc81433e0 msgr2=0x7fbbc813c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:56.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.475+0000 7fbbc7e00640 1 --2- 172.21.15.131:0/3343375503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbc81433e0 0x7fbbc813c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:56.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.475+0000 7fbbcd800640 1 --2- 172.21.15.131:0/3343375503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbc81433e0 0x7fbbc813c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:56.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.475+0000 7fbbcd800640 1 -- 172.21.15.131:0/3343375503 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc813cd50 con 0x7fbbc813cf60 2024-04-25T19:22:56.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.475+0000 7fbbcd800640 1 --2- 172.21.15.131:0/3343375503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbc813cf60 0x7fbbc813d370 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0000f80 tx=0x7fbbc000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:56.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.476+0000 7fbbc4c00640 1 -- 172.21.15.131:0/3343375503 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc000a610 con 0x7fbbc813cf60 2024-04-25T19:22:56.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.476+0000 7fbbc4c00640 1 -- 172.21.15.131:0/3343375503 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbc000a7b0 con 0x7fbbc813cf60 2024-04-25T19:22:56.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.476+0000 7fbbc4c00640 1 -- 172.21.15.131:0/3343375503 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc000ab80 con 0x7fbbc813cf60 2024-04-25T19:22:56.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.476+0000 7fbbce200640 1 -- 172.21.15.131:0/3343375503 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbc80cce70 con 0x7fbbc813cf60 2024-04-25T19:22:56.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.476+0000 7fbbce200640 1 -- 172.21.15.131:0/3343375503 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbc8142900 con 0x7fbbc813cf60 2024-04-25T19:22:56.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.477+0000 7fbbce200640 1 -- 172.21.15.131:0/3343375503 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbc80ccbe0 con 0x7fbbc813cf60 2024-04-25T19:22:56.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.478+0000 7fbbc4c00640 1 -- 172.21.15.131:0/3343375503 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbbc0011070 con 0x7fbbc813cf60 2024-04-25T19:22:56.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.480+0000 7fbbc4c00640 1 --2- 172.21.15.131:0/3343375503 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbba80744b0 0x7fbba80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:56.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.480+0000 7fbbc4c00640 1 -- 172.21.15.131:0/3343375503 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5825+0+0 (secure 0 0 0) 0x7fbbc00948c0 con 0x7fbbc813cf60 2024-04-25T19:22:56.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.480+0000 7fbbcce00640 1 --2- 172.21.15.131:0/3343375503 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbba80744b0 0x7fbba80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:56.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.482+0000 7fbbcce00640 1 --2- 172.21.15.131:0/3343375503 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbba80744b0 0x7fbba80769c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc032000 tx=0x7fbbbc02c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:56.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.485+0000 7fbbc4c00640 1 -- 172.21.15.131:0/3343375503 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbbc005f050 con 0x7fbbc813cf60 2024-04-25T19:22:56.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.669+0000 7fbbce200640 1 -- 172.21.15.131:0/3343375503 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbbc8050740 con 0x7fbbc813cf60 2024-04-25T19:22:56.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.672+0000 7fbbc4c00640 1 -- 172.21.15.131:0/3343375503 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16878 (secure 0 0 0) 0x7fbbc005e950 con 0x7fbbc813cf60 2024-04-25T19:22:56.674 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:56.674 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":21,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:22:56.329038+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:22:14.779716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T19:22:15.552027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:22:56.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.674+0000 7fbbce200640 1 -- 172.21.15.131:0/3343375503 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbba80744b0 msgr2=0x7fbba80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:56.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.674+0000 7fbbce200640 1 --2- 172.21.15.131:0/3343375503 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbba80744b0 0x7fbba80769c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc032000 tx=0x7fbbbc02c000 comp rx=0 tx=0).stop 2024-04-25T19:22:56.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.674+0000 7fbbce200640 1 -- 172.21.15.131:0/3343375503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbc813cf60 msgr2=0x7fbbc813d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:56.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.674+0000 7fbbce200640 1 --2- 172.21.15.131:0/3343375503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbc813cf60 0x7fbbc813d370 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0000f80 tx=0x7fbbc000ccd0 comp rx=0 tx=0).stop 2024-04-25T19:22:56.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.675+0000 7fbbce200640 1 -- 172.21.15.131:0/3343375503 shutdown_connections 2024-04-25T19:22:56.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.675+0000 7fbbce200640 1 --2- 172.21.15.131:0/3343375503 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbba80744b0 0x7fbba80769c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:56.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.675+0000 7fbbce200640 1 --2- 172.21.15.131:0/3343375503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbc813cf60 0x7fbbc813d370 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:56.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.675+0000 7fbbce200640 1 --2- 172.21.15.131:0/3343375503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbc81433e0 0x7fbbc813c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:56.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.675+0000 7fbbce200640 1 --2- 172.21.15.131:0/3343375503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbb00039b0 0x7fbbc80cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:56.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.675+0000 7fbbce200640 1 -- 172.21.15.131:0/3343375503 >> 172.21.15.131:0/3343375503 conn(0x7fbbc80d1720 msgr2=0x7fbbc8159730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:56.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.675+0000 7fbbce200640 1 -- 172.21.15.131:0/3343375503 shutdown_connections 2024-04-25T19:22:56.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.675+0000 7fbbce200640 1 -- 172.21.15.131:0/3343375503 wait complete. 2024-04-25T19:22:56.704 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T19:22:04.178847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T19:22:14.779716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T19:22:15.552027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T19:22:56.705 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T19:22:56.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.976+0000 7f7eb3000640 1 Processor -- start 2024-04-25T19:22:56.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.976+0000 7f7eb3000640 1 -- start start 2024-04-25T19:22:56.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.978+0000 7f7eb3000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7eac0d56c0 0x7f7eac0b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:56.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.978+0000 7f7eb3000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7eac160440 0x7f7eac06db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:56.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.978+0000 7f7eb3000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7eac06e4b0 con 0x7f7eac06e0a0 2024-04-25T19:22:56.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.978+0000 7f7eb3000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f7eac0d43f0 con 0x7f7eac160440 2024-04-25T19:22:56.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.978+0000 7f7eb3000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7eac0d37e0 con 0x7f7eac0d56c0 2024-04-25T19:22:56.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.978+0000 7f7eb1200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7eac160440 0x7f7eac06db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:56.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.978+0000 7f7eb1200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7eac160440 0x7f7eac06db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:37996/0 (socket says 172.21.15.131:37996) 2024-04-25T19:22:56.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.978+0000 7f7eb1200640 1 -- 172.21.15.131:0/4272966947 learned_addr learned my addr 172.21.15.131:0/4272966947 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:56.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.979+0000 7f7eb1c00640 1 --2- 172.21.15.131:0/4272966947 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7eac0d56c0 0x7f7eac0b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:56.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.979+0000 7f7eb1200640 1 -- 172.21.15.131:0/4272966947 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7eac0d56c0 msgr2=0x7f7eac0b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:56.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.979+0000 7f7eb1200640 1 --2- 172.21.15.131:0/4272966947 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7eac0d56c0 0x7f7eac0b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:56.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.979+0000 7f7eb1200640 1 -- 172.21.15.131:0/4272966947 >> v1:172.21.15.195:6789/0 conn(0x7f7eac06e0a0 legacy=0x7f7eac0d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:56.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.979+0000 7f7eb1200640 1 -- 172.21.15.131:0/4272966947 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eac0d3ac0 con 0x7f7eac160440 2024-04-25T19:22:56.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.979+0000 7f7eb1c00640 1 --2- 172.21.15.131:0/4272966947 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7eac0d56c0 0x7f7eac0b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:56.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.980+0000 7f7eb1200640 1 --2- 172.21.15.131:0/4272966947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7eac160440 0x7f7eac06db60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009e50 tx=0x7f7ea002a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1548c2aa62d9a95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:56.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.980+0000 7f7eabe00640 1 -- 172.21.15.131:0/4272966947 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0036070 con 0x7f7eac160440 2024-04-25T19:22:56.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.980+0000 7f7eabe00640 1 -- 172.21.15.131:0/4272966947 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ea0031600 con 0x7f7eac160440 2024-04-25T19:22:56.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.980+0000 7f7eabe00640 1 -- 172.21.15.131:0/4272966947 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea00319d0 con 0x7f7eac160440 2024-04-25T19:22:56.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.981+0000 7f7eb3000640 1 -- 172.21.15.131:0/4272966947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7eac160440 msgr2=0x7f7eac06db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:56.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.981+0000 7f7eb3000640 1 --2- 172.21.15.131:0/4272966947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7eac160440 0x7f7eac06db60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009e50 tx=0x7f7ea002a6d0 comp rx=0 tx=0).stop 2024-04-25T19:22:56.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.981+0000 7f7eb3000640 1 -- 172.21.15.131:0/4272966947 shutdown_connections 2024-04-25T19:22:56.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.981+0000 7f7eb3000640 1 --2- 172.21.15.131:0/4272966947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7eac160440 0x7f7eac06db60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:56.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.981+0000 7f7eb3000640 1 --2- 172.21.15.131:0/4272966947 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7eac0d56c0 0x7f7eac0b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:56.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.981+0000 7f7eb3000640 1 -- 172.21.15.131:0/4272966947 >> 172.21.15.131:0/4272966947 conn(0x7f7eac0d2c20 msgr2=0x7f7eac0d5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:56.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.981+0000 7f7eb3000640 1 -- 172.21.15.131:0/4272966947 shutdown_connections 2024-04-25T19:22:56.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.981+0000 7f7eb3000640 1 -- 172.21.15.131:0/4272966947 wait complete. 2024-04-25T19:22:56.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.984+0000 7f7eb3000640 1 Processor -- start 2024-04-25T19:22:56.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.984+0000 7f7eb3000640 1 -- start start 2024-04-25T19:22:56.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.985+0000 7f7eb3000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7eac06e0a0 0x7f7eac157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:56.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.985+0000 7f7eb3000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7eac160440 0x7f7eac0c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:56.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.985+0000 7f7eb3000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7eac1558b0 0x7f7eac155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:56.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.985+0000 7f7eb3000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7eac0ba270 con 0x7f7eac1558b0 2024-04-25T19:22:56.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.985+0000 7f7eb3000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7eac0d4080 con 0x7f7eac06e0a0 2024-04-25T19:22:56.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.985+0000 7f7eb3000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7eac0d4880 con 0x7f7eac160440 2024-04-25T19:22:56.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.986+0000 7f7eb2600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7eac1558b0 0x7f7eac155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:56.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.986+0000 7f7eb2600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7eac1558b0 0x7f7eac155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38008/0 (socket says 172.21.15.131:38008) 2024-04-25T19:22:56.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.986+0000 7f7eb2600640 1 -- 172.21.15.131:0/869739316 learned_addr learned my addr 172.21.15.131:0/869739316 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:56.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.986+0000 7f7eb1c00640 1 --2- 172.21.15.131:0/869739316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7eac06e0a0 0x7f7eac157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:56.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.986+0000 7f7eb1200640 1 --2- 172.21.15.131:0/869739316 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7eac160440 0x7f7eac0c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:56.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.986+0000 7f7eb2600640 1 -- 172.21.15.131:0/869739316 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7eac160440 msgr2=0x7f7eac0c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:56.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.986+0000 7f7eb2600640 1 --2- 172.21.15.131:0/869739316 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7eac160440 0x7f7eac0c9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:56.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.986+0000 7f7eb2600640 1 -- 172.21.15.131:0/869739316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7eac06e0a0 msgr2=0x7f7eac157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:56.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.986+0000 7f7eb2600640 1 --2- 172.21.15.131:0/869739316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7eac06e0a0 0x7f7eac157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:56.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.986+0000 7f7eb2600640 1 -- 172.21.15.131:0/869739316 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eac156e40 con 0x7f7eac1558b0 2024-04-25T19:22:56.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.986+0000 7f7eb2600640 1 --2- 172.21.15.131:0/869739316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7eac1558b0 0x7f7eac155cc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7ea400b3e0 tx=0x7f7ea400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:56.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.987+0000 7f7ea9600640 1 -- 172.21.15.131:0/869739316 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4015030 con 0x7f7eac1558b0 2024-04-25T19:22:56.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.987+0000 7f7ea9600640 1 -- 172.21.15.131:0/869739316 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ea4004020 con 0x7f7eac1558b0 2024-04-25T19:22:56.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.987+0000 7f7ea9600640 1 -- 172.21.15.131:0/869739316 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4004450 con 0x7f7eac1558b0 2024-04-25T19:22:56.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.987+0000 7f7eb3000640 1 -- 172.21.15.131:0/869739316 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eac157120 con 0x7f7eac1558b0 2024-04-25T19:22:56.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.987+0000 7f7eb3000640 1 -- 172.21.15.131:0/869739316 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eac1576e0 con 0x7f7eac1558b0 2024-04-25T19:22:56.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.988+0000 7f7eb3000640 1 -- 172.21.15.131:0/869739316 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eac08e260 con 0x7f7eac1558b0 2024-04-25T19:22:56.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.989+0000 7f7ea9600640 1 -- 172.21.15.131:0/869739316 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7ea4018070 con 0x7f7eac1558b0 2024-04-25T19:22:56.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.990+0000 7f7ea9600640 1 --2- 172.21.15.131:0/869739316 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f7e900744b0 0x7f7e900769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:56.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.991+0000 7f7ea9600640 1 -- 172.21.15.131:0/869739316 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5825+0+0 (secure 0 0 0) 0x7f7ea4094e20 con 0x7f7eac1558b0 2024-04-25T19:22:56.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.991+0000 7f7eb1c00640 1 --2- 172.21.15.131:0/869739316 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f7e900744b0 0x7f7e900769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:56.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.992+0000 7f7eb1c00640 1 --2- 172.21.15.131:0/869739316 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f7e900744b0 0x7f7e900769c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0b8b30 tx=0x7f7e9c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:56.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:56.995+0000 7f7ea9600640 1 -- 172.21.15.131:0/869739316 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7eac08e260 con 0x7f7eac1558b0 2024-04-25T19:22:57.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.198+0000 7f7eb3000640 1 -- 172.21.15.131:0/869739316 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7eac076c60 con 0x7f7eac1558b0 2024-04-25T19:22:57.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.199+0000 7f7ea9600640 1 -- 172.21.15.131:0/869739316 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f7ea405f490 con 0x7f7eac1558b0 2024-04-25T19:22:57.201 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-25T19:22:57.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.201+0000 7f7eb3000640 1 -- 172.21.15.131:0/869739316 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f7e900744b0 msgr2=0x7f7e900769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:57.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.201+0000 7f7eb3000640 1 --2- 172.21.15.131:0/869739316 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f7e900744b0 0x7f7e900769c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0b8b30 tx=0x7f7e9c008040 comp rx=0 tx=0).stop 2024-04-25T19:22:57.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.201+0000 7f7eb3000640 1 -- 172.21.15.131:0/869739316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7eac1558b0 msgr2=0x7f7eac155cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:57.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.201+0000 7f7eb3000640 1 --2- 172.21.15.131:0/869739316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7eac1558b0 0x7f7eac155cc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7ea400b3e0 tx=0x7f7ea400b8a0 comp rx=0 tx=0).stop 2024-04-25T19:22:57.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.202+0000 7f7eb3000640 1 -- 172.21.15.131:0/869739316 shutdown_connections 2024-04-25T19:22:57.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.202+0000 7f7eb3000640 1 --2- 172.21.15.131:0/869739316 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f7e900744b0 0x7f7e900769c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:57.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.202+0000 7f7eb3000640 1 --2- 172.21.15.131:0/869739316 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7eac160440 0x7f7eac0c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:57.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.202+0000 7f7eb3000640 1 --2- 172.21.15.131:0/869739316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7eac1558b0 0x7f7eac155cc0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:57.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.202+0000 7f7eb3000640 1 --2- 172.21.15.131:0/869739316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7eac06e0a0 0x7f7eac157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:57.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.202+0000 7f7eb3000640 1 -- 172.21.15.131:0/869739316 >> 172.21.15.131:0/869739316 conn(0x7f7eac0d2c20 msgr2=0x7f7eac0d12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:57.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.202+0000 7f7eb3000640 1 -- 172.21.15.131:0/869739316 shutdown_connections 2024-04-25T19:22:57.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.202+0000 7f7eb3000640 1 -- 172.21.15.131:0/869739316 wait complete. 2024-04-25T19:22:57.230 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T19:22:57.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.508+0000 7fd51dc00640 1 Processor -- start 2024-04-25T19:22:57.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.509+0000 7fd51dc00640 1 -- start start 2024-04-25T19:22:57.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.511+0000 7fd51dc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd518070360 0x7fd51806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:57.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.511+0000 7fd51dc00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd51806f410 con 0x7fd518160240 2024-04-25T19:22:57.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.511+0000 7fd51dc00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd51806f6f0 con 0x7fd51806dce0 2024-04-25T19:22:57.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.511+0000 7fd51dc00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd51806ff90 con 0x7fd518070360 2024-04-25T19:22:57.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.511+0000 7fd516000640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fd518160240 0x7fd51806d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:54738/0 (socket says 172.21.15.131:54738) 2024-04-25T19:22:57.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.511+0000 7fd516000640 1 -- 172.21.15.131:0/2637731870 learned_addr learned my addr 172.21.15.131:0/2637731870 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:57.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.512+0000 7fd516a00640 1 --2- 172.21.15.131:0/2637731870 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd518070360 0x7fd51806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:57.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.512+0000 7fd515600640 1 -- 172.21.15.131:0/2637731870 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3396677458 0 0) 0x7fd51806f410 con 0x7fd518160240 2024-04-25T19:22:57.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.512+0000 7fd515600640 1 -- 172.21.15.131:0/2637731870 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4fc003520 con 0x7fd518160240 2024-04-25T19:22:57.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.512+0000 7fd515600640 1 -- 172.21.15.131:0/2637731870 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1513405467 0 0) 0x7fd4fc003520 con 0x7fd518160240 2024-04-25T19:22:57.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.512+0000 7fd515600640 1 -- 172.21.15.131:0/2637731870 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd518070360 msgr2=0x7fd51806ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:57.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.512+0000 7fd515600640 1 --2- 172.21.15.131:0/2637731870 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd518070360 0x7fd51806ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:57.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.512+0000 7fd515600640 1 -- 172.21.15.131:0/2637731870 >> v1:172.21.15.195:6789/0 conn(0x7fd51806dce0 legacy=0x7fd5180b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:57.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.512+0000 7fd515600640 1 -- 172.21.15.131:0/2637731870 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd51806f9d0 con 0x7fd518160240 2024-04-25T19:22:57.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.512+0000 7fd515600640 1 -- 172.21.15.131:0/2637731870 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7fd500001670 con 0x7fd518160240 2024-04-25T19:22:57.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.512+0000 7fd515600640 1 -- 172.21.15.131:0/2637731870 >> v1:172.21.15.131:6789/0 conn(0x7fd518160240 legacy=0x7fd51806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:57.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.512+0000 7fd515600640 1 --2- 172.21.15.131:0/2637731870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4fc0039e0 0x7fd4fc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:57.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.512+0000 7fd515600640 1 --2- 172.21.15.131:0/2637731870 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd518070360 0x7fd4fc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:57.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.512+0000 7fd515600640 1 --2- 172.21.15.131:0/2637731870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4fc004d40 0x7fd4fc0051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:57.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.512+0000 7fd515600640 1 -- 172.21.15.131:0/2637731870 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd51806ff90 con 0x7fd4fc0039e0 2024-04-25T19:22:57.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.512+0000 7fd515600640 1 -- 172.21.15.131:0/2637731870 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd4fc00bbf0 con 0x7fd4fc004d40 2024-04-25T19:22:57.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.512+0000 7fd515600640 1 -- 172.21.15.131:0/2637731870 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd4fc00bdf0 con 0x7fd518070360 2024-04-25T19:22:57.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.513+0000 7fd516a00640 1 --2- 172.21.15.131:0/2637731870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4fc0039e0 0x7fd4fc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:57.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.513+0000 7fd517400640 1 --2- 172.21.15.131:0/2637731870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4fc004d40 0x7fd4fc0051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:57.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.513+0000 7fd516a00640 1 -- 172.21.15.131:0/2637731870 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd518070360 msgr2=0x7fd4fc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:57.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.513+0000 7fd516a00640 1 --2- 172.21.15.131:0/2637731870 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd518070360 0x7fd4fc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:57.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.513+0000 7fd516a00640 1 -- 172.21.15.131:0/2637731870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4fc004d40 msgr2=0x7fd4fc0051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:57.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.513+0000 7fd516a00640 1 --2- 172.21.15.131:0/2637731870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4fc004d40 0x7fd4fc0051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:57.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.513+0000 7fd516a00640 1 -- 172.21.15.131:0/2637731870 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4fc003520 con 0x7fd4fc0039e0 2024-04-25T19:22:57.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.514+0000 7fd516a00640 1 --2- 172.21.15.131:0/2637731870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4fc0039e0 0x7fd4fc003e50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd510009ac0 tx=0x7fd4fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c111844cc5c6ba24 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:57.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.514+0000 7fd515600640 1 -- 172.21.15.131:0/2637731870 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd510036070 con 0x7fd4fc0039e0 2024-04-25T19:22:57.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.514+0000 7fd515600640 1 -- 172.21.15.131:0/2637731870 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd510031400 con 0x7fd4fc0039e0 2024-04-25T19:22:57.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.514+0000 7fd515600640 1 -- 172.21.15.131:0/2637731870 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd510009690 con 0x7fd4fc0039e0 2024-04-25T19:22:57.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.515+0000 7fd51dc00640 1 -- 172.21.15.131:0/2637731870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4fc0039e0 msgr2=0x7fd4fc003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:57.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.515+0000 7fd51dc00640 1 --2- 172.21.15.131:0/2637731870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4fc0039e0 0x7fd4fc003e50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd510009ac0 tx=0x7fd4fc005830 comp rx=0 tx=0).stop 2024-04-25T19:22:57.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.515+0000 7fd517400640 1 -- 172.21.15.131:0/2637731870 reap_dead start 2024-04-25T19:22:57.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.515+0000 7fd51dc00640 1 -- 172.21.15.131:0/2637731870 shutdown_connections 2024-04-25T19:22:57.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.515+0000 7fd51dc00640 1 -- 172.21.15.131:0/2637731870 >> 172.21.15.131:0/2637731870 conn(0x7fd5180730b0 msgr2=0x7fd5180734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:57.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.515+0000 7fd51dc00640 1 -- 172.21.15.131:0/2637731870 shutdown_connections 2024-04-25T19:22:57.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.515+0000 7fd51dc00640 1 -- 172.21.15.131:0/2637731870 wait complete. 2024-04-25T19:22:57.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.518+0000 7fd51dc00640 1 Processor -- start 2024-04-25T19:22:57.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.518+0000 7fd51dc00640 1 -- start start 2024-04-25T19:22:57.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.519+0000 7fd51dc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4fc0039e0 0x7fd518163f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:57.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.519+0000 7fd51dc00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5181f5e10 0x7fd5180c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:57.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.519+0000 7fd51dc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5180c8290 0x7fd518161820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:57.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.519+0000 7fd51dc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd518160650 con 0x7fd4fc0039e0 2024-04-25T19:22:57.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.519+0000 7fd51dc00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd5180cdde0 con 0x7fd5181f5e10 2024-04-25T19:22:57.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.519+0000 7fd51dc00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd5180af550 con 0x7fd5180c8290 2024-04-25T19:22:57.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.519+0000 7fd516a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4fc0039e0 0x7fd518163f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:57.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.519+0000 7fd516a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4fc0039e0 0x7fd518163f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38032/0 (socket says 172.21.15.131:38032) 2024-04-25T19:22:57.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.519+0000 7fd516a00640 1 -- 172.21.15.131:0/368414776 learned_addr learned my addr 172.21.15.131:0/368414776 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:57.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.520+0000 7fd517400640 1 --2- 172.21.15.131:0/368414776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5180c8290 0x7fd518161820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:57.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.520+0000 7fd516000640 1 --2- 172.21.15.131:0/368414776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5181f5e10 0x7fd5180c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:57.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.520+0000 7fd516a00640 1 -- 172.21.15.131:0/368414776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5180c8290 msgr2=0x7fd518161820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:57.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.520+0000 7fd516a00640 1 --2- 172.21.15.131:0/368414776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5180c8290 0x7fd518161820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:57.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.520+0000 7fd516a00640 1 -- 172.21.15.131:0/368414776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5181f5e10 msgr2=0x7fd5180c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:57.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.520+0000 7fd516a00640 1 --2- 172.21.15.131:0/368414776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5181f5e10 0x7fd5180c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:57.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.520+0000 7fd516a00640 1 -- 172.21.15.131:0/368414776 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5180c6cb0 con 0x7fd4fc0039e0 2024-04-25T19:22:57.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.520+0000 7fd517400640 1 --2- 172.21.15.131:0/368414776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5180c8290 0x7fd518161820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:57.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.520+0000 7fd516000640 1 --2- 172.21.15.131:0/368414776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5181f5e10 0x7fd5180c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:57.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.520+0000 7fd516a00640 1 --2- 172.21.15.131:0/368414776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4fc0039e0 0x7fd518163f70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd510009ac0 tx=0x7fd510004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:57.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.520+0000 7fd50ea00640 1 -- 172.21.15.131:0/368414776 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd510040020 con 0x7fd4fc0039e0 2024-04-25T19:22:57.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.521+0000 7fd50ea00640 1 -- 172.21.15.131:0/368414776 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd510003be0 con 0x7fd4fc0039e0 2024-04-25T19:22:57.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.521+0000 7fd50ea00640 1 -- 172.21.15.131:0/368414776 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd510036040 con 0x7fd4fc0039e0 2024-04-25T19:22:57.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.521+0000 7fd51dc00640 1 -- 172.21.15.131:0/368414776 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5180c6f90 con 0x7fd4fc0039e0 2024-04-25T19:22:57.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.521+0000 7fd51dc00640 1 -- 172.21.15.131:0/368414776 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5180c7550 con 0x7fd4fc0039e0 2024-04-25T19:22:57.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.522+0000 7fd51dc00640 1 -- 172.21.15.131:0/368414776 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd518050740 con 0x7fd4fc0039e0 2024-04-25T19:22:57.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.523+0000 7fd50ea00640 1 -- 172.21.15.131:0/368414776 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd510043020 con 0x7fd4fc0039e0 2024-04-25T19:22:57.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.524+0000 7fd50ea00640 1 --2- 172.21.15.131:0/368414776 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd4f40744e0 0x7fd4f40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:57.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.524+0000 7fd50ea00640 1 -- 172.21.15.131:0/368414776 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fd5100b54c0 con 0x7fd4fc0039e0 2024-04-25T19:22:57.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.525+0000 7fd516000640 1 --2- 172.21.15.131:0/368414776 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd4f40744e0 0x7fd4f40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:57.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.526+0000 7fd516000640 1 --2- 172.21.15.131:0/368414776 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd4f40744e0 0x7fd4f40769f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd518155f60 tx=0x7fd500009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:57.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.529+0000 7fd50ea00640 1 -- 172.21.15.131:0/368414776 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd51004a070 con 0x7fd4fc0039e0 2024-04-25T19:22:57.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.714+0000 7fd51dc00640 1 -- 172.21.15.131:0/368414776 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd5181644b0 con 0x7fd4fc0039e0 2024-04-25T19:22:57.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.715+0000 7fd50ea00640 1 -- 172.21.15.131:0/368414776 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7fd5100044e0 con 0x7fd4fc0039e0 2024-04-25T19:22:57.717 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-25T19:22:57.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.717+0000 7fd51dc00640 1 -- 172.21.15.131:0/368414776 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd4f40744e0 msgr2=0x7fd4f40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:57.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.717+0000 7fd51dc00640 1 --2- 172.21.15.131:0/368414776 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd4f40744e0 0x7fd4f40769f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd518155f60 tx=0x7fd500009040 comp rx=0 tx=0).stop 2024-04-25T19:22:57.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.717+0000 7fd51dc00640 1 -- 172.21.15.131:0/368414776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4fc0039e0 msgr2=0x7fd518163f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:57.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.717+0000 7fd51dc00640 1 --2- 172.21.15.131:0/368414776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4fc0039e0 0x7fd518163f70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd510009ac0 tx=0x7fd510004730 comp rx=0 tx=0).stop 2024-04-25T19:22:57.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.717+0000 7fd51dc00640 1 -- 172.21.15.131:0/368414776 shutdown_connections 2024-04-25T19:22:57.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.717+0000 7fd51dc00640 1 --2- 172.21.15.131:0/368414776 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd4f40744e0 0x7fd4f40769f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:57.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.717+0000 7fd51dc00640 1 --2- 172.21.15.131:0/368414776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5180c8290 0x7fd518161820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:57.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.717+0000 7fd51dc00640 1 --2- 172.21.15.131:0/368414776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5181f5e10 0x7fd5180c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:57.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.717+0000 7fd51dc00640 1 --2- 172.21.15.131:0/368414776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4fc0039e0 0x7fd518163f70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:57.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.717+0000 7fd51dc00640 1 -- 172.21.15.131:0/368414776 >> 172.21.15.131:0/368414776 conn(0x7fd5180730b0 msgr2=0x7fd5180af8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:57.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.717+0000 7fd51dc00640 1 -- 172.21.15.131:0/368414776 shutdown_connections 2024-04-25T19:22:57.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:57.717+0000 7fd51dc00640 1 -- 172.21.15.131:0/368414776 wait complete. 2024-04-25T19:22:57.742 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T19:22:58.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.011+0000 7fa7c9800640 1 Processor -- start 2024-04-25T19:22:58.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.011+0000 7fa7c9800640 1 -- start start 2024-04-25T19:22:58.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.014+0000 7fa7c9800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7c4070630 0x7fa7c40cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:58.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.014+0000 7fa7c9800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa7c415adf0 0x7fa7c406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:58.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.014+0000 7fa7c9800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7c406df20 con 0x7fa7c406db10 2024-04-25T19:22:58.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.014+0000 7fa7c9800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa7c40713f0 con 0x7fa7c415adf0 2024-04-25T19:22:58.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.014+0000 7fa7c9800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa7c40701a0 con 0x7fa7c4070630 2024-04-25T19:22:58.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.014+0000 7fa7c2000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa7c415adf0 0x7fa7c406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:58.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.014+0000 7fa7c2000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa7c415adf0 0x7fa7c406d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38276/0 (socket says 172.21.15.131:38276) 2024-04-25T19:22:58.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.014+0000 7fa7c2000640 1 -- 172.21.15.131:0/896156172 learned_addr learned my addr 172.21.15.131:0/896156172 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:58.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.014+0000 7fa7c2a00640 1 --2- 172.21.15.131:0/896156172 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7c4070630 0x7fa7c40cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:58.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.015+0000 7fa7c2000640 1 -- 172.21.15.131:0/896156172 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7c4070630 msgr2=0x7fa7c40cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:58.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.015+0000 7fa7c2000640 1 --2- 172.21.15.131:0/896156172 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7c4070630 0x7fa7c40cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:58.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.015+0000 7fa7c2000640 1 -- 172.21.15.131:0/896156172 >> v1:172.21.15.195:6789/0 conn(0x7fa7c406db10 legacy=0x7fa7c40b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:58.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.015+0000 7fa7c2000640 1 -- 172.21.15.131:0/896156172 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c4071110 con 0x7fa7c415adf0 2024-04-25T19:22:58.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.016+0000 7fa7c2000640 1 --2- 172.21.15.131:0/896156172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7c415adf0 0x7fa7c406d5d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000bb10 tx=0x7fa7b002c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df97630219705c10 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:58.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.016+0000 7fa7c1600640 1 -- 172.21.15.131:0/896156172 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b003a070 con 0x7fa7c415adf0 2024-04-25T19:22:58.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.016+0000 7fa7c1600640 1 -- 172.21.15.131:0/896156172 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7b00326f0 con 0x7fa7c415adf0 2024-04-25T19:22:58.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.016+0000 7fa7c1600640 1 -- 172.21.15.131:0/896156172 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0032ac0 con 0x7fa7c415adf0 2024-04-25T19:22:58.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.017+0000 7fa7c9800640 1 -- 172.21.15.131:0/896156172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7c415adf0 msgr2=0x7fa7c406d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:58.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.017+0000 7fa7c9800640 1 --2- 172.21.15.131:0/896156172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7c415adf0 0x7fa7c406d5d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000bb10 tx=0x7fa7b002c830 comp rx=0 tx=0).stop 2024-04-25T19:22:58.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.017+0000 7fa7c9800640 1 -- 172.21.15.131:0/896156172 shutdown_connections 2024-04-25T19:22:58.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.017+0000 7fa7c9800640 1 --2- 172.21.15.131:0/896156172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7c415adf0 0x7fa7c406d5d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:58.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.017+0000 7fa7c9800640 1 --2- 172.21.15.131:0/896156172 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7c4070630 0x7fa7c40cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:58.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.017+0000 7fa7c9800640 1 -- 172.21.15.131:0/896156172 >> 172.21.15.131:0/896156172 conn(0x7fa7c4073090 msgr2=0x7fa7c40734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:58.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.017+0000 7fa7c9800640 1 -- 172.21.15.131:0/896156172 shutdown_connections 2024-04-25T19:22:58.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.017+0000 7fa7c9800640 1 -- 172.21.15.131:0/896156172 wait complete. 2024-04-25T19:22:58.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.020+0000 7fa7c9800640 1 Processor -- start 2024-04-25T19:22:58.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.020+0000 7fa7c9800640 1 -- start start 2024-04-25T19:22:58.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.022+0000 7fa7c9800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7c406db10 0x7fa7c415cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:58.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.022+0000 7fa7c9800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7c4070630 0x7fa7c414ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:58.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.022+0000 7fa7c9800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7c415adf0 0x7fa7c415b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:58.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.022+0000 7fa7c9800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c40b0d00 con 0x7fa7c406db10 2024-04-25T19:22:58.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.022+0000 7fa7c9800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c406fe30 con 0x7fa7c415adf0 2024-04-25T19:22:58.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.022+0000 7fa7c9800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa7c40b0e80 con 0x7fa7c4070630 2024-04-25T19:22:58.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.022+0000 7fa7c2a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7c406db10 0x7fa7c415cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:58.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.022+0000 7fa7c2a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7c406db10 0x7fa7c415cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38292/0 (socket says 172.21.15.131:38292) 2024-04-25T19:22:58.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.022+0000 7fa7c2a00640 1 -- 172.21.15.131:0/680610789 learned_addr learned my addr 172.21.15.131:0/680610789 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:58.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.023+0000 7fa7c2000640 1 --2- 172.21.15.131:0/680610789 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7c4070630 0x7fa7c414ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:58.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.023+0000 7fa7c2a00640 1 -- 172.21.15.131:0/680610789 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7c4070630 msgr2=0x7fa7c414ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:58.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.023+0000 7fa7c2a00640 1 --2- 172.21.15.131:0/680610789 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7c4070630 0x7fa7c414ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:58.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.023+0000 7fa7c2a00640 1 -- 172.21.15.131:0/680610789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7c415adf0 msgr2=0x7fa7c415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:58.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.023+0000 7fa7c3400640 1 --2- 172.21.15.131:0/680610789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7c415adf0 0x7fa7c415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:58.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.023+0000 7fa7c2a00640 1 --2- 172.21.15.131:0/680610789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7c415adf0 0x7fa7c415b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:58.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.023+0000 7fa7c2a00640 1 -- 172.21.15.131:0/680610789 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c415bb10 con 0x7fa7c406db10 2024-04-25T19:22:58.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.023+0000 7fa7c2000640 1 --2- 172.21.15.131:0/680610789 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7c4070630 0x7fa7c414ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:58.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.023+0000 7fa7c2a00640 1 --2- 172.21.15.131:0/680610789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7c406db10 0x7fa7c415cbb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4007e90 tx=0x7fa7b400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:58.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.023+0000 7fa7baa00640 1 -- 172.21.15.131:0/680610789 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b401a070 con 0x7fa7c406db10 2024-04-25T19:22:58.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.024+0000 7fa7baa00640 1 -- 172.21.15.131:0/680610789 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7b4003b90 con 0x7fa7c406db10 2024-04-25T19:22:58.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.024+0000 7fa7baa00640 1 -- 172.21.15.131:0/680610789 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b400ee70 con 0x7fa7c406db10 2024-04-25T19:22:58.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.024+0000 7fa7c9800640 1 -- 172.21.15.131:0/680610789 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7c415bdf0 con 0x7fa7c406db10 2024-04-25T19:22:58.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.024+0000 7fa7c9800640 1 -- 172.21.15.131:0/680610789 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7c415c3b0 con 0x7fa7c406db10 2024-04-25T19:22:58.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.025+0000 7fa7c9800640 1 -- 172.21.15.131:0/680610789 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7c4050740 con 0x7fa7c406db10 2024-04-25T19:22:58.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.026+0000 7fa7baa00640 1 -- 172.21.15.131:0/680610789 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa7b401d070 con 0x7fa7c406db10 2024-04-25T19:22:58.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.027+0000 7fa7baa00640 1 --2- 172.21.15.131:0/680610789 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa7a40744b0 0x7fa7a40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:58.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.027+0000 7fa7baa00640 1 -- 172.21.15.131:0/680610789 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fa7b4095480 con 0x7fa7c406db10 2024-04-25T19:22:58.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.028+0000 7fa7c2000640 1 --2- 172.21.15.131:0/680610789 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa7a40744b0 0x7fa7a40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:58.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.029+0000 7fa7c2000640 1 --2- 172.21.15.131:0/680610789 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa7a40744b0 0x7fa7a40769c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0037000 tx=0x7fa7b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:58.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.032+0000 7fa7baa00640 1 -- 172.21.15.131:0/680610789 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa7b405f4a0 con 0x7fa7c406db10 2024-04-25T19:22:58.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.216+0000 7fa7c9800640 1 -- 172.21.15.131:0/680610789 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa7c4155970 con 0x7fa7c406db10 2024-04-25T19:22:58.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.217+0000 7fa7baa00640 1 -- 172.21.15.131:0/680610789 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7fa7b40637a0 con 0x7fa7c406db10 2024-04-25T19:22:58.219 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 64 2024-04-25T19:22:58.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.219+0000 7fa7c9800640 1 -- 172.21.15.131:0/680610789 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa7a40744b0 msgr2=0x7fa7a40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:58.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.219+0000 7fa7c9800640 1 --2- 172.21.15.131:0/680610789 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa7a40744b0 0x7fa7a40769c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0037000 tx=0x7fa7b0008040 comp rx=0 tx=0).stop 2024-04-25T19:22:58.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.219+0000 7fa7c9800640 1 -- 172.21.15.131:0/680610789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7c406db10 msgr2=0x7fa7c415cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:58.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.219+0000 7fa7c9800640 1 --2- 172.21.15.131:0/680610789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7c406db10 0x7fa7c415cbb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4007e90 tx=0x7fa7b400e4b0 comp rx=0 tx=0).stop 2024-04-25T19:22:58.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.219+0000 7fa7c9800640 1 -- 172.21.15.131:0/680610789 shutdown_connections 2024-04-25T19:22:58.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.219+0000 7fa7c9800640 1 --2- 172.21.15.131:0/680610789 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa7a40744b0 0x7fa7a40769c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:58.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.219+0000 7fa7c9800640 1 --2- 172.21.15.131:0/680610789 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7c4070630 0x7fa7c414ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:58.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.219+0000 7fa7c9800640 1 --2- 172.21.15.131:0/680610789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7c415adf0 0x7fa7c415b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:58.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.219+0000 7fa7c9800640 1 --2- 172.21.15.131:0/680610789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7c406db10 0x7fa7c415cbb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:58.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.219+0000 7fa7c9800640 1 -- 172.21.15.131:0/680610789 >> 172.21.15.131:0/680610789 conn(0x7fa7c4073090 msgr2=0x7fa7c406d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:58.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.220+0000 7fa7c9800640 1 -- 172.21.15.131:0/680610789 shutdown_connections 2024-04-25T19:22:58.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.220+0000 7fa7c9800640 1 -- 172.21.15.131:0/680610789 wait complete. 2024-04-25T19:22:58.246 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:22:58.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.502+0000 7f5ff3200640 1 Processor -- start 2024-04-25T19:22:58.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.503+0000 7f5ff3200640 1 -- start start 2024-04-25T19:22:58.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.505+0000 7f5ff3200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5ff4168720 0x7f5ff40cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:58.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.505+0000 7f5ff3200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff4071180 con 0x7f5ff40cf2f0 2024-04-25T19:22:58.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.505+0000 7f5ff3200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff40700e0 con 0x7f5ff406c5c0 2024-04-25T19:22:58.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.505+0000 7f5ff3200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f5ff4070cf0 con 0x7f5ff4168720 2024-04-25T19:22:58.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.505+0000 7f5ff1400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5ff4168720 0x7f5ff40cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:58.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.505+0000 7f5ff1400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5ff4168720 0x7f5ff40cf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38296/0 (socket says 172.21.15.131:38296) 2024-04-25T19:22:58.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.505+0000 7f5ff1e00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f5ff40cf2f0 0x7f5ff4168010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38582/0 (socket says 172.21.15.131:38582) 2024-04-25T19:22:58.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.505+0000 7f5ff1400640 1 -- 172.21.15.131:0/7552941 learned_addr learned my addr 172.21.15.131:0/7552941 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:58.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.506+0000 7f5ff1400640 1 -- 172.21.15.131:0/7552941 >> v1:172.21.15.195:6789/0 conn(0x7f5ff406c5c0 legacy=0x7f5ff406c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:58.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.506+0000 7f5ff1400640 1 -- 172.21.15.131:0/7552941 >> v1:172.21.15.131:6789/0 conn(0x7f5ff40cf2f0 legacy=0x7f5ff4168010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:58.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.506+0000 7f5ff1400640 1 -- 172.21.15.131:0/7552941 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff40703c0 con 0x7f5ff4168720 2024-04-25T19:22:58.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.507+0000 7f5ff1400640 1 --2- 172.21.15.131:0/7552941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ff4168720 0x7f5ff40cf700 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4009e50 tx=0x7f5fe402a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2707ee005740090 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:58.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.507+0000 7f5ff0a00640 1 -- 172.21.15.131:0/7552941 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4036070 con 0x7f5ff4168720 2024-04-25T19:22:58.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.507+0000 7f5ff0a00640 1 -- 172.21.15.131:0/7552941 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe4031600 con 0x7f5ff4168720 2024-04-25T19:22:58.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.507+0000 7f5ff0a00640 1 -- 172.21.15.131:0/7552941 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe40319d0 con 0x7f5ff4168720 2024-04-25T19:22:58.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.508+0000 7f5ff3200640 1 -- 172.21.15.131:0/7552941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ff4168720 msgr2=0x7f5ff40cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:58.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.508+0000 7f5ff3200640 1 --2- 172.21.15.131:0/7552941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ff4168720 0x7f5ff40cf700 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4009e50 tx=0x7f5fe402a760 comp rx=0 tx=0).stop 2024-04-25T19:22:58.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.508+0000 7f5ff3200640 1 -- 172.21.15.131:0/7552941 shutdown_connections 2024-04-25T19:22:58.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.508+0000 7f5ff3200640 1 --2- 172.21.15.131:0/7552941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ff4168720 0x7f5ff40cf700 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:58.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.508+0000 7f5ff3200640 1 -- 172.21.15.131:0/7552941 >> 172.21.15.131:0/7552941 conn(0x7f5ff40d1720 msgr2=0x7f5ff40d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:58.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.508+0000 7f5ff3200640 1 -- 172.21.15.131:0/7552941 shutdown_connections 2024-04-25T19:22:58.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.508+0000 7f5ff3200640 1 -- 172.21.15.131:0/7552941 wait complete. 2024-04-25T19:22:58.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.510+0000 7f5ff3200640 1 Processor -- start 2024-04-25T19:22:58.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.511+0000 7f5ff3200640 1 -- start start 2024-04-25T19:22:58.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.512+0000 7f5ff3200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ff406c5c0 0x7f5ff415dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:58.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.512+0000 7f5ff3200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ff40cf2f0 0x7f5ff4160c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:58.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.512+0000 7f5ff3200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ff41611b0 0x7f5ff40b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:58.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.512+0000 7f5ff3200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff4168d00 con 0x7f5ff41611b0 2024-04-25T19:22:58.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.512+0000 7f5ff3200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff4070980 con 0x7f5ff406c5c0 2024-04-25T19:22:58.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.512+0000 7f5ff3200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff4168e80 con 0x7f5ff40cf2f0 2024-04-25T19:22:58.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.512+0000 7f5ff2800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ff41611b0 0x7f5ff40b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:58.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.513+0000 7f5ff2800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ff41611b0 0x7f5ff40b6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38300/0 (socket says 172.21.15.131:38300) 2024-04-25T19:22:58.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.513+0000 7f5ff2800640 1 -- 172.21.15.131:0/351309098 learned_addr learned my addr 172.21.15.131:0/351309098 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:58.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.513+0000 7f5ff1e00640 1 --2- 172.21.15.131:0/351309098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ff406c5c0 0x7f5ff415dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:58.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.513+0000 7f5ff1400640 1 --2- 172.21.15.131:0/351309098 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ff40cf2f0 0x7f5ff4160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:58.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.513+0000 7f5ff2800640 1 -- 172.21.15.131:0/351309098 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ff40cf2f0 msgr2=0x7f5ff4160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:58.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.513+0000 7f5ff2800640 1 --2- 172.21.15.131:0/351309098 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ff40cf2f0 0x7f5ff4160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:58.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.513+0000 7f5ff2800640 1 -- 172.21.15.131:0/351309098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ff406c5c0 msgr2=0x7f5ff415dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:58.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.513+0000 7f5ff2800640 1 --2- 172.21.15.131:0/351309098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ff406c5c0 0x7f5ff415dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:58.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.513+0000 7f5ff2800640 1 -- 172.21.15.131:0/351309098 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff4162240 con 0x7f5ff41611b0 2024-04-25T19:22:58.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.513+0000 7f5ff1400640 1 --2- 172.21.15.131:0/351309098 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ff40cf2f0 0x7f5ff4160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:58.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.513+0000 7f5ff1e00640 1 --2- 172.21.15.131:0/351309098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ff406c5c0 0x7f5ff415dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:58.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.513+0000 7f5ff2800640 1 --2- 172.21.15.131:0/351309098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ff41611b0 0x7f5ff40b6a20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5fec00b410 tx=0x7f5fec00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:58.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.513+0000 7f5fea000640 1 -- 172.21.15.131:0/351309098 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec015030 con 0x7f5ff41611b0 2024-04-25T19:22:58.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.514+0000 7f5fea000640 1 -- 172.21.15.131:0/351309098 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fec004020 con 0x7f5ff41611b0 2024-04-25T19:22:58.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.514+0000 7f5fea000640 1 -- 172.21.15.131:0/351309098 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec004410 con 0x7f5ff41611b0 2024-04-25T19:22:58.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.514+0000 7f5ff3200640 1 -- 172.21.15.131:0/351309098 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff41619a0 con 0x7f5ff41611b0 2024-04-25T19:22:58.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.514+0000 7f5ff3200640 1 -- 172.21.15.131:0/351309098 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff4161f60 con 0x7f5ff41611b0 2024-04-25T19:22:58.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.515+0000 7f5ff3200640 1 -- 172.21.15.131:0/351309098 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff4161710 con 0x7f5ff41611b0 2024-04-25T19:22:58.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.516+0000 7f5fea000640 1 -- 172.21.15.131:0/351309098 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5fec018070 con 0x7f5ff41611b0 2024-04-25T19:22:58.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.517+0000 7f5fea000640 1 --2- 172.21.15.131:0/351309098 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f5fd00744b0 0x7f5fd00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:58.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.517+0000 7f5fea000640 1 -- 172.21.15.131:0/351309098 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f5fec094dd0 con 0x7f5ff41611b0 2024-04-25T19:22:58.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.518+0000 7f5ff1e00640 1 --2- 172.21.15.131:0/351309098 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f5fd00744b0 0x7f5fd00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:58.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.519+0000 7f5ff1e00640 1 --2- 172.21.15.131:0/351309098 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f5fd00744b0 0x7f5fd00769c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc000f60 tx=0x7f5fdc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:58.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.522+0000 7f5fea000640 1 -- 172.21.15.131:0/351309098 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5fec05f440 con 0x7f5ff41611b0 2024-04-25T19:22:58.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.708+0000 7f5ff3200640 1 -- 172.21.15.131:0/351309098 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ff4050740 con 0x7f5ff41611b0 2024-04-25T19:22:58.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.711+0000 7f5fea000640 1 -- 172.21.15.131:0/351309098 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16878 (secure 0 0 0) 0x7f5fec05ed40 con 0x7f5ff41611b0 2024-04-25T19:22:58.713 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:22:58.713 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":22,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:22:57.347297+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:22:14.779716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T19:22:15.552027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:22:58.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.713+0000 7f5ff3200640 1 -- 172.21.15.131:0/351309098 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f5fd00744b0 msgr2=0x7f5fd00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:58.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.713+0000 7f5ff3200640 1 --2- 172.21.15.131:0/351309098 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f5fd00744b0 0x7f5fd00769c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc000f60 tx=0x7f5fdc009040 comp rx=0 tx=0).stop 2024-04-25T19:22:58.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.713+0000 7f5ff3200640 1 -- 172.21.15.131:0/351309098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ff41611b0 msgr2=0x7f5ff40b6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:58.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.713+0000 7f5ff3200640 1 --2- 172.21.15.131:0/351309098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ff41611b0 0x7f5ff40b6a20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5fec00b410 tx=0x7f5fec00b8d0 comp rx=0 tx=0).stop 2024-04-25T19:22:58.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.713+0000 7f5ff3200640 1 -- 172.21.15.131:0/351309098 shutdown_connections 2024-04-25T19:22:58.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.713+0000 7f5ff3200640 1 --2- 172.21.15.131:0/351309098 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f5fd00744b0 0x7f5fd00769c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:58.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.713+0000 7f5ff3200640 1 --2- 172.21.15.131:0/351309098 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ff40cf2f0 0x7f5ff4160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:58.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.713+0000 7f5ff3200640 1 --2- 172.21.15.131:0/351309098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ff41611b0 0x7f5ff40b6a20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:58.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.713+0000 7f5ff3200640 1 --2- 172.21.15.131:0/351309098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ff406c5c0 0x7f5ff415dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:58.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.713+0000 7f5ff3200640 1 -- 172.21.15.131:0/351309098 >> 172.21.15.131:0/351309098 conn(0x7f5ff40d1720 msgr2=0x7f5ff40b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:58.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.714+0000 7f5ff3200640 1 -- 172.21.15.131:0/351309098 shutdown_connections 2024-04-25T19:22:58.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:58.714+0000 7f5ff3200640 1 -- 172.21.15.131:0/351309098 wait complete. 2024-04-25T19:22:58.739 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T19:22:04.178847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T19:22:14.779716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T19:22:15.552027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T19:22:58.740 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T19:22:59.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.003+0000 7f587a200640 1 Processor -- start 2024-04-25T19:22:59.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.003+0000 7f587a200640 1 -- start start 2024-04-25T19:22:59.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.005+0000 7f587a200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f58740ce520 0x7f587415d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:59.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.005+0000 7f587a200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f587406dce0 0x7f587415d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:59.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.005+0000 7f587a200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58740cda60 con 0x7f58740ce930 2024-04-25T19:22:59.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.005+0000 7f587a200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f587415dfe0 con 0x7f58740ce520 2024-04-25T19:22:59.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.005+0000 7f587a200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f587415e2c0 con 0x7f587406dce0 2024-04-25T19:22:59.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.005+0000 7f5878e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f58740ce520 0x7f587415d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:59.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.005+0000 7f5878e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f58740ce520 0x7f587415d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38304/0 (socket says 172.21.15.131:38304) 2024-04-25T19:22:59.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.005+0000 7f5878e00640 1 -- 172.21.15.131:0/1411582300 learned_addr learned my addr 172.21.15.131:0/1411582300 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:59.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.005+0000 7f5873e00640 1 --1- 172.21.15.131:0/1411582300 >> v1:172.21.15.131:6789/0 conn(0x7f58740ce930 0x7f587406d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38588/0 (socket says 172.21.15.131:38588) 2024-04-25T19:22:59.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.005+0000 7f5879800640 1 --2- 172.21.15.131:0/1411582300 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f587406dce0 0x7f587415d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:59.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.005+0000 7f5878e00640 1 -- 172.21.15.131:0/1411582300 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f587406dce0 msgr2=0x7f587415d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:59.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.005+0000 7f5878e00640 1 --2- 172.21.15.131:0/1411582300 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f587406dce0 0x7f587415d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:59.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.005+0000 7f5878e00640 1 -- 172.21.15.131:0/1411582300 >> v1:172.21.15.131:6789/0 conn(0x7f58740ce930 legacy=0x7f587406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:59.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.005+0000 7f5878e00640 1 -- 172.21.15.131:0/1411582300 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58740cdd20 con 0x7f58740ce520 2024-04-25T19:22:59.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.005+0000 7f5879800640 1 --2- 172.21.15.131:0/1411582300 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f587406dce0 0x7f587415d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:22:59.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.005+0000 7f5873400640 1 -- 172.21.15.131:0/1411582300 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1909659539 0 0) 0x7f58740cda60 con 0x7f58740ce930 2024-04-25T19:22:59.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.007+0000 7f5878e00640 1 --2- 172.21.15.131:0/1411582300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58740ce520 0x7f587415d4b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5868009870 tx=0x7f586802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f2af5ccfe3b490 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:59.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.007+0000 7f5873400640 1 -- 172.21.15.131:0/1411582300 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5868037070 con 0x7f58740ce520 2024-04-25T19:22:59.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.007+0000 7f5873400640 1 -- 172.21.15.131:0/1411582300 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5868032440 con 0x7f58740ce520 2024-04-25T19:22:59.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.007+0000 7f5873400640 1 -- 172.21.15.131:0/1411582300 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5868032810 con 0x7f58740ce520 2024-04-25T19:22:59.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.007+0000 7f587a200640 1 -- 172.21.15.131:0/1411582300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58740ce520 msgr2=0x7f587415d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:59.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.007+0000 7f587a200640 1 --2- 172.21.15.131:0/1411582300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58740ce520 0x7f587415d4b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5868009870 tx=0x7f586802a1c0 comp rx=0 tx=0).stop 2024-04-25T19:22:59.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.008+0000 7f587a200640 1 -- 172.21.15.131:0/1411582300 shutdown_connections 2024-04-25T19:22:59.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.008+0000 7f587a200640 1 --2- 172.21.15.131:0/1411582300 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f587406dce0 0x7f587415d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:59.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.008+0000 7f587a200640 1 --2- 172.21.15.131:0/1411582300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58740ce520 0x7f587415d4b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:59.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.008+0000 7f587a200640 1 -- 172.21.15.131:0/1411582300 >> 172.21.15.131:0/1411582300 conn(0x7f5874072f40 msgr2=0x7f5874073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:59.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.008+0000 7f587a200640 1 -- 172.21.15.131:0/1411582300 shutdown_connections 2024-04-25T19:22:59.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.008+0000 7f587a200640 1 -- 172.21.15.131:0/1411582300 wait complete. 2024-04-25T19:22:59.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.010+0000 7f587a200640 1 Processor -- start 2024-04-25T19:22:59.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.010+0000 7f587a200640 1 -- start start 2024-04-25T19:22:59.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.012+0000 7f587a200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58740ce520 0x7f587415c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:59.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.012+0000 7f587a200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58740ce930 0x7f58741f9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:59.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.012+0000 7f587a200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58741f9780 0x7f58741f2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:59.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.012+0000 7f587a200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f58740b73d0 con 0x7f58741f9780 2024-04-25T19:22:59.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.012+0000 7f587a200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5874160d30 con 0x7f58740ce520 2024-04-25T19:22:59.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.012+0000 7f587a200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f58740b7550 con 0x7f58740ce930 2024-04-25T19:22:59.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.012+0000 7f5879800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58741f9780 0x7f58741f2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:59.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.012+0000 7f5879800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58741f9780 0x7f58741f2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38312/0 (socket says 172.21.15.131:38312) 2024-04-25T19:22:59.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.012+0000 7f5879800640 1 -- 172.21.15.131:0/3952874723 learned_addr learned my addr 172.21.15.131:0/3952874723 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:59.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.012+0000 7f5879800640 1 -- 172.21.15.131:0/3952874723 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58740ce930 msgr2=0x7f58741f9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:59.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.012+0000 7f5879800640 1 --2- 172.21.15.131:0/3952874723 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58740ce930 0x7f58741f9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:59.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.012+0000 7f5879800640 1 -- 172.21.15.131:0/3952874723 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58740ce520 msgr2=0x7f587415c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:59.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.012+0000 7f5879800640 1 --2- 172.21.15.131:0/3952874723 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58740ce520 0x7f587415c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:59.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.012+0000 7f5879800640 1 -- 172.21.15.131:0/3952874723 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58741f9b90 con 0x7f58741f9780 2024-04-25T19:22:59.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.013+0000 7f5879800640 1 --2- 172.21.15.131:0/3952874723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58741f9780 0x7f58741f2a50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f586c00cdb0 tx=0x7f586c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:59.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.013+0000 7f5870c00640 1 -- 172.21.15.131:0/3952874723 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586c00f680 con 0x7f58741f9780 2024-04-25T19:22:59.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.013+0000 7f5870c00640 1 -- 172.21.15.131:0/3952874723 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f586c00f840 con 0x7f58741f9780 2024-04-25T19:22:59.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.013+0000 7f5870c00640 1 -- 172.21.15.131:0/3952874723 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586c00fc30 con 0x7f58741f9780 2024-04-25T19:22:59.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.013+0000 7f587a200640 1 -- 172.21.15.131:0/3952874723 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5874158400 con 0x7f58741f9780 2024-04-25T19:22:59.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.013+0000 7f587a200640 1 -- 172.21.15.131:0/3952874723 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58741589c0 con 0x7f58741f9780 2024-04-25T19:22:59.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.014+0000 7f587a200640 1 -- 172.21.15.131:0/3952874723 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5874155e30 con 0x7f58741f9780 2024-04-25T19:22:59.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.015+0000 7f5870c00640 1 -- 172.21.15.131:0/3952874723 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f586c0213f0 con 0x7f58741f9780 2024-04-25T19:22:59.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.016+0000 7f5870c00640 1 --2- 172.21.15.131:0/3952874723 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f58540744e0 0x7f58540769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:59.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.016+0000 7f5870c00640 1 -- 172.21.15.131:0/3952874723 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f586c096000 con 0x7f58741f9780 2024-04-25T19:22:59.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.017+0000 7f5878e00640 1 --2- 172.21.15.131:0/3952874723 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f58540744e0 0x7f58540769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:59.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.018+0000 7f5878e00640 1 --2- 172.21.15.131:0/3952874723 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f58540744e0 0x7f58540769f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5868034000 tx=0x7f586802c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:59.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.021+0000 7f5870c00640 1 -- 172.21.15.131:0/3952874723 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f58741f9b90 con 0x7f58741f9780 2024-04-25T19:22:59.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.205+0000 7f587a200640 1 -- 172.21.15.131:0/3952874723 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5874076c60 con 0x7f58741f9780 2024-04-25T19:22:59.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.206+0000 7f5870c00640 1 -- 172.21.15.131:0/3952874723 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f586c014030 con 0x7f58741f9780 2024-04-25T19:22:59.208 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-25T19:22:59.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.209+0000 7f587a200640 1 -- 172.21.15.131:0/3952874723 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f58540744e0 msgr2=0x7f58540769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:59.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.209+0000 7f587a200640 1 --2- 172.21.15.131:0/3952874723 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f58540744e0 0x7f58540769f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5868034000 tx=0x7f586802c000 comp rx=0 tx=0).stop 2024-04-25T19:22:59.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.209+0000 7f587a200640 1 -- 172.21.15.131:0/3952874723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58741f9780 msgr2=0x7f58741f2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:59.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.209+0000 7f587a200640 1 --2- 172.21.15.131:0/3952874723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58741f9780 0x7f58741f2a50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f586c00cdb0 tx=0x7f586c00a650 comp rx=0 tx=0).stop 2024-04-25T19:22:59.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.209+0000 7f587a200640 1 -- 172.21.15.131:0/3952874723 shutdown_connections 2024-04-25T19:22:59.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.209+0000 7f587a200640 1 --2- 172.21.15.131:0/3952874723 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f58540744e0 0x7f58540769f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:59.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.209+0000 7f587a200640 1 --2- 172.21.15.131:0/3952874723 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58740ce930 0x7f58741f9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:59.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.209+0000 7f587a200640 1 --2- 172.21.15.131:0/3952874723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58741f9780 0x7f58741f2a50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:59.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.209+0000 7f587a200640 1 --2- 172.21.15.131:0/3952874723 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58740ce520 0x7f587415c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:59.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.209+0000 7f587a200640 1 -- 172.21.15.131:0/3952874723 >> 172.21.15.131:0/3952874723 conn(0x7f5874072f40 msgr2=0x7f58740d0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:59.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.209+0000 7f587a200640 1 -- 172.21.15.131:0/3952874723 shutdown_connections 2024-04-25T19:22:59.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.209+0000 7f587a200640 1 -- 172.21.15.131:0/3952874723 wait complete. 2024-04-25T19:22:59.235 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T19:22:59.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.490+0000 7fda85600640 1 Processor -- start 2024-04-25T19:22:59.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.490+0000 7fda85600640 1 -- start start 2024-04-25T19:22:59.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.492+0000 7fda85600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fda8015ee60 0x7fda80168e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:59.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.492+0000 7fda85600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda80070000 con 0x7fda8006dce0 2024-04-25T19:22:59.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.492+0000 7fda85600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda8006f240 con 0x7fda80144340 2024-04-25T19:22:59.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.492+0000 7fda85600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fda8015f270 con 0x7fda8015ee60 2024-04-25T19:22:59.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.492+0000 7fda7f400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fda8006dce0 0x7fda8015e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38604/0 (socket says 172.21.15.131:38604) 2024-04-25T19:22:59.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.492+0000 7fda7f400640 1 -- 172.21.15.131:0/518017973 learned_addr learned my addr 172.21.15.131:0/518017973 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:22:59.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.492+0000 7fda7ea00640 1 -- 172.21.15.131:0/518017973 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1505242677 0 0) 0x7fda80070000 con 0x7fda8006dce0 2024-04-25T19:22:59.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.493+0000 7fda7ea00640 1 -- 172.21.15.131:0/518017973 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda64003520 con 0x7fda8006dce0 2024-04-25T19:22:59.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.493+0000 7fda84c00640 1 --2- 172.21.15.131:0/518017973 >> v2:172.21.15.195:3300/0 conn(0x7fda8015ee60 0x7fda80168e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:59.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.493+0000 7fda7ea00640 1 -- 172.21.15.131:0/518017973 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2335639862 0 0) 0x7fda64003520 con 0x7fda8006dce0 2024-04-25T19:22:59.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.493+0000 7fda7ea00640 1 -- 172.21.15.131:0/518017973 >> v2:172.21.15.195:3300/0 conn(0x7fda8015ee60 msgr2=0x7fda80168e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:59.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.493+0000 7fda7ea00640 1 --2- 172.21.15.131:0/518017973 >> v2:172.21.15.195:3300/0 conn(0x7fda8015ee60 0x7fda80168e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:59.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.493+0000 7fda7ea00640 1 -- 172.21.15.131:0/518017973 >> v1:172.21.15.195:6789/0 conn(0x7fda80144340 legacy=0x7fda8006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:59.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.493+0000 7fda7ea00640 1 -- 172.21.15.131:0/518017973 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda8006f520 con 0x7fda8006dce0 2024-04-25T19:22:59.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.493+0000 7fda7ea00640 1 -- 172.21.15.131:0/518017973 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7fda6c0019f0 con 0x7fda8006dce0 2024-04-25T19:22:59.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.493+0000 7fda7ea00640 1 -- 172.21.15.131:0/518017973 >> v1:172.21.15.131:6789/0 conn(0x7fda8006dce0 legacy=0x7fda8015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:59.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.493+0000 7fda7ea00640 1 --2- 172.21.15.131:0/518017973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda64003a00 0x7fda64003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:59.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.493+0000 7fda7ea00640 1 --2- 172.21.15.131:0/518017973 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda64004800 0x7fda64004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:59.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.493+0000 7fda7ea00640 1 --2- 172.21.15.131:0/518017973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda64005350 0x7fda6400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:59.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.493+0000 7fda7ea00640 1 -- 172.21.15.131:0/518017973 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fda6400c220 con 0x7fda64005350 2024-04-25T19:22:59.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.493+0000 7fda7ea00640 1 -- 172.21.15.131:0/518017973 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fda6400c3d0 con 0x7fda64003a00 2024-04-25T19:22:59.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.493+0000 7fda7ea00640 1 -- 172.21.15.131:0/518017973 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fda6400c5d0 con 0x7fda64004800 2024-04-25T19:22:59.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.493+0000 7fda84c00640 1 --2- 172.21.15.131:0/518017973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda64005350 0x7fda6400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:59.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.494+0000 7fda7f400640 1 --2- 172.21.15.131:0/518017973 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda64004800 0x7fda64004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:59.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.494+0000 7fda7fe00640 1 --2- 172.21.15.131:0/518017973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda64003a00 0x7fda64003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:59.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.494+0000 7fda84c00640 1 -- 172.21.15.131:0/518017973 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda64004800 msgr2=0x7fda64004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:59.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.494+0000 7fda84c00640 1 --2- 172.21.15.131:0/518017973 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda64004800 0x7fda64004c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:59.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.494+0000 7fda84c00640 1 -- 172.21.15.131:0/518017973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda64003a00 msgr2=0x7fda64003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:59.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.494+0000 7fda84c00640 1 --2- 172.21.15.131:0/518017973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda64003a00 0x7fda64003e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:59.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.494+0000 7fda84c00640 1 -- 172.21.15.131:0/518017973 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda64003520 con 0x7fda64005350 2024-04-25T19:22:59.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.495+0000 7fda84c00640 1 -- 172.21.15.131:0/518017973 reap_dead start 2024-04-25T19:22:59.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.495+0000 7fda84c00640 1 --2- 172.21.15.131:0/518017973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda64005350 0x7fda6400b9c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fda7800ba00 tx=0x7fda64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804b021877c33213 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:59.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.495+0000 7fda7ea00640 1 -- 172.21.15.131:0/518017973 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda78030070 con 0x7fda64005350 2024-04-25T19:22:59.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.495+0000 7fda7ea00640 1 -- 172.21.15.131:0/518017973 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda7802ade0 con 0x7fda64005350 2024-04-25T19:22:59.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.495+0000 7fda7ea00640 1 -- 172.21.15.131:0/518017973 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7800b600 con 0x7fda64005350 2024-04-25T19:22:59.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.496+0000 7fda85600640 1 -- 172.21.15.131:0/518017973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda64005350 msgr2=0x7fda6400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:59.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.496+0000 7fda85600640 1 --2- 172.21.15.131:0/518017973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda64005350 0x7fda6400b9c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fda7800ba00 tx=0x7fda64005830 comp rx=0 tx=0).stop 2024-04-25T19:22:59.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.496+0000 7fda85600640 1 -- 172.21.15.131:0/518017973 shutdown_connections 2024-04-25T19:22:59.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.496+0000 7fda85600640 1 --2- 172.21.15.131:0/518017973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda64005350 0x7fda6400b9c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:59.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.496+0000 7fda85600640 1 -- 172.21.15.131:0/518017973 >> 172.21.15.131:0/518017973 conn(0x7fda80072f40 msgr2=0x7fda80073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:59.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.496+0000 7fda85600640 1 -- 172.21.15.131:0/518017973 shutdown_connections 2024-04-25T19:22:59.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.496+0000 7fda85600640 1 -- 172.21.15.131:0/518017973 wait complete. 2024-04-25T19:22:59.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.498+0000 7fda85600640 1 Processor -- start 2024-04-25T19:22:59.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.499+0000 7fda85600640 1 -- start start 2024-04-25T19:22:59.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.501+0000 7fda85600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda64005350 0x7fda80157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:59.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.501+0000 7fda85600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda80161290 0x7fda801616a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:59.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.501+0000 7fda85600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda8013ded0 0x7fda8013e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:59.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.501+0000 7fda85600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fda8006fae0 con 0x7fda8013ded0 2024-04-25T19:22:59.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.501+0000 7fda85600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fda80144750 con 0x7fda64005350 2024-04-25T19:22:59.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.501+0000 7fda85600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fda8015e750 con 0x7fda80161290 2024-04-25T19:22:59.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.501+0000 7fda84c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda8013ded0 0x7fda8013e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:59.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.501+0000 7fda84c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda8013ded0 0x7fda8013e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38324/0 (socket says 172.21.15.131:38324) 2024-04-25T19:22:59.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.501+0000 7fda84c00640 1 -- 172.21.15.131:0/1890370548 learned_addr learned my addr 172.21.15.131:0/1890370548 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:59.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.501+0000 7fda84c00640 1 -- 172.21.15.131:0/1890370548 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda80161290 msgr2=0x7fda801616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:59.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.501+0000 7fda84c00640 1 --2- 172.21.15.131:0/1890370548 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda80161290 0x7fda801616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:59.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.501+0000 7fda84c00640 1 -- 172.21.15.131:0/1890370548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda64005350 msgr2=0x7fda80157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:59.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.501+0000 7fda84c00640 1 --2- 172.21.15.131:0/1890370548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda64005350 0x7fda80157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:59.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.501+0000 7fda84c00640 1 -- 172.21.15.131:0/1890370548 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda8013e820 con 0x7fda8013ded0 2024-04-25T19:22:59.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.501+0000 7fda84c00640 1 --2- 172.21.15.131:0/1890370548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda8013ded0 0x7fda8013e2e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fda7800bb20 tx=0x7fda780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:59.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.501+0000 7fda77e00640 1 -- 172.21.15.131:0/1890370548 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda78043070 con 0x7fda8013ded0 2024-04-25T19:22:59.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.501+0000 7fda77e00640 1 -- 172.21.15.131:0/1890370548 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda7802abe0 con 0x7fda8013ded0 2024-04-25T19:22:59.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.501+0000 7fda77e00640 1 -- 172.21.15.131:0/1890370548 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7803b7c0 con 0x7fda8013ded0 2024-04-25T19:22:59.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.501+0000 7fda85600640 1 -- 172.21.15.131:0/1890370548 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda80158e50 con 0x7fda8013ded0 2024-04-25T19:22:59.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.502+0000 7fda85600640 1 -- 172.21.15.131:0/1890370548 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda80159410 con 0x7fda8013ded0 2024-04-25T19:22:59.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.503+0000 7fda85600640 1 -- 172.21.15.131:0/1890370548 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda80158bc0 con 0x7fda8013ded0 2024-04-25T19:22:59.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.504+0000 7fda77e00640 1 -- 172.21.15.131:0/1890370548 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fda78046070 con 0x7fda8013ded0 2024-04-25T19:22:59.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.505+0000 7fda77e00640 1 --2- 172.21.15.131:0/1890370548 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fda600744e0 0x7fda600769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:59.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.505+0000 7fda77e00640 1 -- 172.21.15.131:0/1890370548 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fda780b4da0 con 0x7fda8013ded0 2024-04-25T19:22:59.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.505+0000 7fda7fe00640 1 --2- 172.21.15.131:0/1890370548 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fda600744e0 0x7fda600769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:59.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.506+0000 7fda7fe00640 1 --2- 172.21.15.131:0/1890370548 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fda600744e0 0x7fda600769f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda70000c00 tx=0x7fda70009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:22:59.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.509+0000 7fda77e00640 1 -- 172.21.15.131:0/1890370548 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fda8013e820 con 0x7fda8013ded0 2024-04-25T19:22:59.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.691+0000 7fda85600640 1 -- 172.21.15.131:0/1890370548 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fda800cfd30 con 0x7fda8013ded0 2024-04-25T19:22:59.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.692+0000 7fda77e00640 1 -- 172.21.15.131:0/1890370548 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7fda800cfd30 con 0x7fda8013ded0 2024-04-25T19:22:59.694 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-25T19:22:59.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.695+0000 7fda85600640 1 -- 172.21.15.131:0/1890370548 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fda600744e0 msgr2=0x7fda600769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:59.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.695+0000 7fda85600640 1 --2- 172.21.15.131:0/1890370548 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fda600744e0 0x7fda600769f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda70000c00 tx=0x7fda70009040 comp rx=0 tx=0).stop 2024-04-25T19:22:59.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.695+0000 7fda85600640 1 -- 172.21.15.131:0/1890370548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda8013ded0 msgr2=0x7fda8013e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:59.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.695+0000 7fda85600640 1 --2- 172.21.15.131:0/1890370548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda8013ded0 0x7fda8013e2e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fda7800bb20 tx=0x7fda780046c0 comp rx=0 tx=0).stop 2024-04-25T19:22:59.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.695+0000 7fda85600640 1 -- 172.21.15.131:0/1890370548 shutdown_connections 2024-04-25T19:22:59.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.695+0000 7fda85600640 1 --2- 172.21.15.131:0/1890370548 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fda600744e0 0x7fda600769f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:59.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.695+0000 7fda85600640 1 --2- 172.21.15.131:0/1890370548 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda80161290 0x7fda801616a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:59.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.695+0000 7fda85600640 1 --2- 172.21.15.131:0/1890370548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda8013ded0 0x7fda8013e2e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:59.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.695+0000 7fda85600640 1 --2- 172.21.15.131:0/1890370548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda64005350 0x7fda80157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:22:59.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.695+0000 7fda85600640 1 -- 172.21.15.131:0/1890370548 >> 172.21.15.131:0/1890370548 conn(0x7fda80072f40 msgr2=0x7fda80142f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:22:59.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.695+0000 7fda85600640 1 -- 172.21.15.131:0/1890370548 shutdown_connections 2024-04-25T19:22:59.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.695+0000 7fda85600640 1 -- 172.21.15.131:0/1890370548 wait complete. 2024-04-25T19:22:59.722 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T19:22:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.995+0000 7f44c9c00640 1 Processor -- start 2024-04-25T19:22:59.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.995+0000 7f44c9c00640 1 -- start start 2024-04-25T19:22:59.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.997+0000 7f44c9c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f44c406dce0 0x7f44c40ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:22:59.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.997+0000 7f44c9c00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c41623f0 con 0x7f44c406f930 2024-04-25T19:22:59.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.997+0000 7f44c9c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c41626d0 con 0x7f44c4070d20 2024-04-25T19:22:59.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.997+0000 7f44c9c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f44c406f130 con 0x7f44c406dce0 2024-04-25T19:22:59.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.997+0000 7f44c9200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f44c406dce0 0x7f44c40ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:22:59.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.997+0000 7f44c9200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f44c406dce0 0x7f44c40ce7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38334/0 (socket says 172.21.15.131:38334) 2024-04-25T19:22:59.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.997+0000 7f44c9200640 1 -- 172.21.15.131:0/1650254704 learned_addr learned my addr 172.21.15.131:0/1650254704 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:22:59.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.998+0000 7f44c9200640 1 -- 172.21.15.131:0/1650254704 >> v1:172.21.15.195:6789/0 conn(0x7f44c4070d20 legacy=0x7f44c4161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:22:59.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.998+0000 7f44c9200640 1 -- 172.21.15.131:0/1650254704 >> v1:172.21.15.131:6789/0 conn(0x7f44c406f930 legacy=0x7f44c406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:22:59.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.998+0000 7f44c9200640 1 -- 172.21.15.131:0/1650254704 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c406f410 con 0x7f44c406dce0 2024-04-25T19:22:59.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.998+0000 7f44c3400640 1 -- 172.21.15.131:0/1650254704 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3802452448 0 0) 0x7f44c41623f0 con 0x7f44c406f930 2024-04-25T19:22:59.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.999+0000 7f44c9200640 1 --2- 172.21.15.131:0/1650254704 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44c406dce0 0x7f44c40ce7e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f44bc009e50 tx=0x7f44bc02a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b248446903e8456a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:00.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.999+0000 7f44c3400640 1 -- 172.21.15.131:0/1650254704 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44bc036070 con 0x7f44c406dce0 2024-04-25T19:23:00.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.999+0000 7f44c3400640 1 -- 172.21.15.131:0/1650254704 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44bc031600 con 0x7f44c406dce0 2024-04-25T19:23:00.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:22:59.999+0000 7f44c3400640 1 -- 172.21.15.131:0/1650254704 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44bc0319d0 con 0x7f44c406dce0 2024-04-25T19:23:00.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.000+0000 7f44c9c00640 1 -- 172.21.15.131:0/1650254704 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44c406dce0 msgr2=0x7f44c40ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:00.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.000+0000 7f44c9c00640 1 --2- 172.21.15.131:0/1650254704 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44c406dce0 0x7f44c40ce7e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f44bc009e50 tx=0x7f44bc02a6d0 comp rx=0 tx=0).stop 2024-04-25T19:23:00.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.000+0000 7f44c9c00640 1 -- 172.21.15.131:0/1650254704 shutdown_connections 2024-04-25T19:23:00.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.000+0000 7f44c9c00640 1 --2- 172.21.15.131:0/1650254704 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44c406dce0 0x7f44c40ce7e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:00.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.000+0000 7f44c9c00640 1 -- 172.21.15.131:0/1650254704 >> 172.21.15.131:0/1650254704 conn(0x7f44c4073160 msgr2=0x7f44c4073570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:00.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.000+0000 7f44c9c00640 1 -- 172.21.15.131:0/1650254704 shutdown_connections 2024-04-25T19:23:00.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.000+0000 7f44c9c00640 1 -- 172.21.15.131:0/1650254704 wait complete. 2024-04-25T19:23:00.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.002+0000 7f44c9c00640 1 Processor -- start 2024-04-25T19:23:00.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.002+0000 7f44c9c00640 1 -- start start 2024-04-25T19:23:00.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.004+0000 7f44c9c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44c406f930 0x7f44c41fa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:00.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.004+0000 7f44c9c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44c4070d20 0x7f44c415fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:00.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.004+0000 7f44c9c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44c415e5f0 0x7f44c414fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:00.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.004+0000 7f44c9c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f44c415e470 con 0x7f44c406f930 2024-04-25T19:23:00.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.004+0000 7f44c9c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f44c415e2f0 con 0x7f44c415e5f0 2024-04-25T19:23:00.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.004+0000 7f44c9c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f44c406fd40 con 0x7f44c4070d20 2024-04-25T19:23:00.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.004+0000 7f44c3e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44c406f930 0x7f44c41fa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:00.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.004+0000 7f44c3e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44c406f930 0x7f44c41fa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38342/0 (socket says 172.21.15.131:38342) 2024-04-25T19:23:00.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.004+0000 7f44c3e00640 1 -- 172.21.15.131:0/3310909925 learned_addr learned my addr 172.21.15.131:0/3310909925 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:00.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.005+0000 7f44c3e00640 1 -- 172.21.15.131:0/3310909925 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44c4070d20 msgr2=0x7f44c415fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:00.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.005+0000 7f44c3e00640 1 --2- 172.21.15.131:0/3310909925 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44c4070d20 0x7f44c415fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:00.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.005+0000 7f44c3e00640 1 -- 172.21.15.131:0/3310909925 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44c415e5f0 msgr2=0x7f44c414fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:00.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.005+0000 7f44c9200640 1 --2- 172.21.15.131:0/3310909925 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44c415e5f0 0x7f44c414fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:00.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.005+0000 7f44c3e00640 1 --2- 172.21.15.131:0/3310909925 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44c415e5f0 0x7f44c414fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:00.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.005+0000 7f44c3e00640 1 -- 172.21.15.131:0/3310909925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c40ccf00 con 0x7f44c406f930 2024-04-25T19:23:00.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.005+0000 7f44c3e00640 1 --2- 172.21.15.131:0/3310909925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44c406f930 0x7f44c41fa150 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f44b400b3f0 tx=0x7f44b400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:00.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.005+0000 7f44c0c00640 1 -- 172.21.15.131:0/3310909925 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b4015020 con 0x7f44c406f930 2024-04-25T19:23:00.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.005+0000 7f44c0c00640 1 -- 172.21.15.131:0/3310909925 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44b4011830 con 0x7f44c406f930 2024-04-25T19:23:00.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.005+0000 7f44c0c00640 1 -- 172.21.15.131:0/3310909925 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b4011c20 con 0x7f44c406f930 2024-04-25T19:23:00.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.005+0000 7f44c9c00640 1 -- 172.21.15.131:0/3310909925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44c40cd1e0 con 0x7f44c406f930 2024-04-25T19:23:00.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.006+0000 7f44c9c00640 1 -- 172.21.15.131:0/3310909925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44c40cc990 con 0x7f44c406f930 2024-04-25T19:23:00.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.007+0000 7f44c9c00640 1 -- 172.21.15.131:0/3310909925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44c4076c60 con 0x7f44c406f930 2024-04-25T19:23:00.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.008+0000 7f44c0c00640 1 -- 172.21.15.131:0/3310909925 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f44b4018020 con 0x7f44c406f930 2024-04-25T19:23:00.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.009+0000 7f44c0c00640 1 --2- 172.21.15.131:0/3310909925 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f44a00744b0 0x7f44a00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:00.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.009+0000 7f44c0c00640 1 -- 172.21.15.131:0/3310909925 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f44b4094e90 con 0x7f44c406f930 2024-04-25T19:23:00.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.009+0000 7f44bb400640 1 --2- 172.21.15.131:0/3310909925 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f44a00744b0 0x7f44a00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.010+0000 7f44bb400640 1 --2- 172.21.15.131:0/3310909925 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f44a00744b0 0x7f44a00769c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f44c40b0580 tx=0x7f44ac007930 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.013+0000 7f44c0c00640 1 -- 172.21.15.131:0/3310909925 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f44b401f030 con 0x7f44c406f930 2024-04-25T19:23:00.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.215+0000 7f44c9c00640 1 -- 172.21.15.131:0/3310909925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f44c40cd3b0 con 0x7f44c406f930 2024-04-25T19:23:00.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.216+0000 7f44c0c00640 1 -- 172.21.15.131:0/3310909925 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f44b405f630 con 0x7f44c406f930 2024-04-25T19:23:00.217 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 64 2024-04-25T19:23:00.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.219+0000 7f44c9c00640 1 -- 172.21.15.131:0/3310909925 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f44a00744b0 msgr2=0x7f44a00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:00.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.219+0000 7f44c9c00640 1 --2- 172.21.15.131:0/3310909925 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f44a00744b0 0x7f44a00769c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f44c40b0580 tx=0x7f44ac007930 comp rx=0 tx=0).stop 2024-04-25T19:23:00.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.219+0000 7f44c9c00640 1 -- 172.21.15.131:0/3310909925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44c406f930 msgr2=0x7f44c41fa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:00.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.219+0000 7f44c9c00640 1 --2- 172.21.15.131:0/3310909925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44c406f930 0x7f44c41fa150 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f44b400b3f0 tx=0x7f44b400b8b0 comp rx=0 tx=0).stop 2024-04-25T19:23:00.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.219+0000 7f44c9c00640 1 -- 172.21.15.131:0/3310909925 shutdown_connections 2024-04-25T19:23:00.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.219+0000 7f44c9c00640 1 --2- 172.21.15.131:0/3310909925 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f44a00744b0 0x7f44a00769c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:00.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.219+0000 7f44c9c00640 1 --2- 172.21.15.131:0/3310909925 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44c4070d20 0x7f44c415fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:00.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.219+0000 7f44c9c00640 1 --2- 172.21.15.131:0/3310909925 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44c415e5f0 0x7f44c414fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:00.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.219+0000 7f44c9c00640 1 --2- 172.21.15.131:0/3310909925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44c406f930 0x7f44c41fa150 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:00.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.219+0000 7f44c9c00640 1 -- 172.21.15.131:0/3310909925 >> 172.21.15.131:0/3310909925 conn(0x7f44c4073160 msgr2=0x7f44c415d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:00.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.219+0000 7f44c9c00640 1 -- 172.21.15.131:0/3310909925 shutdown_connections 2024-04-25T19:23:00.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.219+0000 7f44c9c00640 1 -- 172.21.15.131:0/3310909925 wait complete. 2024-04-25T19:23:00.286 INFO:tasks.cephfs_test_runner:Starting test: test_basic (tasks.cephfs.test_dump_tree.TestDumpTree) 2024-04-25T19:23:00.286 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:23:00.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.564+0000 7f9e8b600640 1 Processor -- start 2024-04-25T19:23:00.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.565+0000 7f9e8b600640 1 -- start start 2024-04-25T19:23:00.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.566+0000 7f9e8b600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e841443c0 0x7f9e8406fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:00.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.566+0000 7f9e8b600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9e84070370 0x7f9e840cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:00.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.566+0000 7f9e8b600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e840cff30 con 0x7f9e840cfb20 2024-04-25T19:23:00.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.566+0000 7f9e8b600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f9e840708d0 con 0x7f9e84070370 2024-04-25T19:23:00.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.566+0000 7f9e8b600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9e8415f160 con 0x7f9e841443c0 2024-04-25T19:23:00.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.567+0000 7f9e7be00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9e84070370 0x7f9e840cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:00.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.567+0000 7f9e89600640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f9e840cfb20 0x7f9e840ce330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38622/0 (socket says 172.21.15.131:38622) 2024-04-25T19:23:00.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.567+0000 7f9e89600640 1 -- 172.21.15.131:0/1017752140 learned_addr learned my addr 172.21.15.131:0/1017752140 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:00.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.567+0000 7f9e88c00640 1 --2- 172.21.15.131:0/1017752140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e841443c0 0x7f9e8406fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:00.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.567+0000 7f9e7be00640 1 -- 172.21.15.131:0/1017752140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e841443c0 msgr2=0x7f9e8406fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:00.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.567+0000 7f9e7be00640 1 --2- 172.21.15.131:0/1017752140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e841443c0 0x7f9e8406fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:00.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.567+0000 7f9e7be00640 1 -- 172.21.15.131:0/1017752140 >> v1:172.21.15.131:6789/0 conn(0x7f9e840cfb20 legacy=0x7f9e840ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:00.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.567+0000 7f9e7be00640 1 -- 172.21.15.131:0/1017752140 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8415f5f0 con 0x7f9e84070370 2024-04-25T19:23:00.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.567+0000 7f9e83e00640 1 -- 172.21.15.131:0/1017752140 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3558394586 0 0) 0x7f9e7c001490 con 0x7f9e840cfb20 2024-04-25T19:23:00.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.568+0000 7f9e7be00640 1 --2- 172.21.15.131:0/1017752140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e84070370 0x7f9e840cf5e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0097a0 tx=0x7f9e6c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48eb80c916fb667f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:00.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.569+0000 7f9e83e00640 1 -- 172.21.15.131:0/1017752140 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c037070 con 0x7f9e84070370 2024-04-25T19:23:00.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.569+0000 7f9e83e00640 1 -- 172.21.15.131:0/1017752140 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e6c032440 con 0x7f9e84070370 2024-04-25T19:23:00.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.569+0000 7f9e83e00640 1 -- 172.21.15.131:0/1017752140 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c032810 con 0x7f9e84070370 2024-04-25T19:23:00.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.569+0000 7f9e8b600640 1 -- 172.21.15.131:0/1017752140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e84070370 msgr2=0x7f9e840cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:00.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.569+0000 7f9e8b600640 1 --2- 172.21.15.131:0/1017752140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e84070370 0x7f9e840cf5e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0097a0 tx=0x7f9e6c02a180 comp rx=0 tx=0).stop 2024-04-25T19:23:00.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.569+0000 7f9e8b600640 1 -- 172.21.15.131:0/1017752140 shutdown_connections 2024-04-25T19:23:00.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.569+0000 7f9e8b600640 1 --2- 172.21.15.131:0/1017752140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e84070370 0x7f9e840cf5e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:00.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.569+0000 7f9e8b600640 1 --2- 172.21.15.131:0/1017752140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e841443c0 0x7f9e8406fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:00.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.569+0000 7f9e8b600640 1 -- 172.21.15.131:0/1017752140 >> 172.21.15.131:0/1017752140 conn(0x7f9e840d1ae0 msgr2=0x7f9e840d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:00.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.570+0000 7f9e8b600640 1 -- 172.21.15.131:0/1017752140 shutdown_connections 2024-04-25T19:23:00.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.570+0000 7f9e8b600640 1 -- 172.21.15.131:0/1017752140 wait complete. 2024-04-25T19:23:00.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.572+0000 7f9e8b600640 1 Processor -- start 2024-04-25T19:23:00.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.572+0000 7f9e8b600640 1 -- start start 2024-04-25T19:23:00.575 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.574+0000 7f9e8b600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e84070370 0x7f9e8413b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:00.575 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.574+0000 7f9e8b600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e840cfb20 0x7f9e8414d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:00.575 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.574+0000 7f9e8b600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e841443c0 0x7f9e8414d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:00.575 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.574+0000 7f9e8b600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8415edf0 con 0x7f9e84070370 2024-04-25T19:23:00.575 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.574+0000 7f9e8b600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8415eb10 con 0x7f9e840cfb20 2024-04-25T19:23:00.575 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.574+0000 7f9e8b600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9e8406d5d0 con 0x7f9e841443c0 2024-04-25T19:23:00.575 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.574+0000 7f9e88c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e84070370 0x7f9e8413b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:00.575 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.574+0000 7f9e88c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e84070370 0x7f9e8413b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38374/0 (socket says 172.21.15.131:38374) 2024-04-25T19:23:00.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.574+0000 7f9e88c00640 1 -- 172.21.15.131:0/1439782381 learned_addr learned my addr 172.21.15.131:0/1439782381 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:00.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.574+0000 7f9e88c00640 1 -- 172.21.15.131:0/1439782381 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e841443c0 msgr2=0x7f9e8414d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:00.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.574+0000 7f9e88c00640 1 --2- 172.21.15.131:0/1439782381 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e841443c0 0x7f9e8414d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:00.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.574+0000 7f9e88c00640 1 -- 172.21.15.131:0/1439782381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e840cfb20 msgr2=0x7f9e8414d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:00.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.574+0000 7f9e88c00640 1 --2- 172.21.15.131:0/1439782381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e840cfb20 0x7f9e8414d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:00.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.574+0000 7f9e88c00640 1 -- 172.21.15.131:0/1439782381 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8414b260 con 0x7f9e84070370 2024-04-25T19:23:00.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.575+0000 7f9e88c00640 1 --2- 172.21.15.131:0/1439782381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e84070370 0x7f9e8413b650 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9e7400d600 tx=0x7f9e7400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:00.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.575+0000 7f9e81600640 1 -- 172.21.15.131:0/1439782381 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e74004240 con 0x7f9e84070370 2024-04-25T19:23:00.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.575+0000 7f9e81600640 1 -- 172.21.15.131:0/1439782381 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e740043e0 con 0x7f9e84070370 2024-04-25T19:23:00.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.575+0000 7f9e8b600640 1 -- 172.21.15.131:0/1439782381 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e8414b500 con 0x7f9e84070370 2024-04-25T19:23:00.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.575+0000 7f9e81600640 1 -- 172.21.15.131:0/1439782381 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e74003850 con 0x7f9e84070370 2024-04-25T19:23:00.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.575+0000 7f9e8b600640 1 -- 172.21.15.131:0/1439782381 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e8414bac0 con 0x7f9e84070370 2024-04-25T19:23:00.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.576+0000 7f9e8b600640 1 -- 172.21.15.131:0/1439782381 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e84050740 con 0x7f9e84070370 2024-04-25T19:23:00.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.577+0000 7f9e81600640 1 -- 172.21.15.131:0/1439782381 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9e740039f0 con 0x7f9e84070370 2024-04-25T19:23:00.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.578+0000 7f9e81600640 1 --2- 172.21.15.131:0/1439782381 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9e600744b0 0x7f9e600769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:00.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.579+0000 7f9e81600640 1 -- 172.21.15.131:0/1439782381 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f9e74095670 con 0x7f9e84070370 2024-04-25T19:23:00.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.579+0000 7f9e7be00640 1 --2- 172.21.15.131:0/1439782381 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9e600744b0 0x7f9e600769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:00.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.580+0000 7f9e7be00640 1 --2- 172.21.15.131:0/1439782381 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9e600744b0 0x7f9e600769c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c034000 tx=0x7f9e6c02c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:00.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.583+0000 7f9e81600640 1 -- 172.21.15.131:0/1439782381 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9e7405fce0 con 0x7f9e84070370 2024-04-25T19:23:00.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.768+0000 7f9e8b600640 1 -- 172.21.15.131:0/1439782381 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e840ae8f0 con 0x7f9e84070370 2024-04-25T19:23:00.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.770+0000 7f9e81600640 1 -- 172.21.15.131:0/1439782381 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16878 (secure 0 0 0) 0x7f9e7405f5e0 con 0x7f9e84070370 2024-04-25T19:23:00.772 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:00.772 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":22,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:22:57.347297+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:22:14.779716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T19:22:15.552027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:23:00.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.773+0000 7f9e8b600640 1 -- 172.21.15.131:0/1439782381 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9e600744b0 msgr2=0x7f9e600769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:00.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.773+0000 7f9e8b600640 1 --2- 172.21.15.131:0/1439782381 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9e600744b0 0x7f9e600769c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c034000 tx=0x7f9e6c02c000 comp rx=0 tx=0).stop 2024-04-25T19:23:00.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.773+0000 7f9e8b600640 1 -- 172.21.15.131:0/1439782381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e84070370 msgr2=0x7f9e8413b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:00.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.773+0000 7f9e8b600640 1 --2- 172.21.15.131:0/1439782381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e84070370 0x7f9e8413b650 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9e7400d600 tx=0x7f9e7400dac0 comp rx=0 tx=0).stop 2024-04-25T19:23:00.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.773+0000 7f9e8b600640 1 -- 172.21.15.131:0/1439782381 shutdown_connections 2024-04-25T19:23:00.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.773+0000 7f9e8b600640 1 --2- 172.21.15.131:0/1439782381 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9e600744b0 0x7f9e600769c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:00.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.773+0000 7f9e8b600640 1 --2- 172.21.15.131:0/1439782381 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e841443c0 0x7f9e8414d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:00.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.773+0000 7f9e8b600640 1 --2- 172.21.15.131:0/1439782381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e840cfb20 0x7f9e8414d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:00.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.773+0000 7f9e8b600640 1 --2- 172.21.15.131:0/1439782381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e84070370 0x7f9e8413b650 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:00.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.773+0000 7f9e8b600640 1 -- 172.21.15.131:0/1439782381 >> 172.21.15.131:0/1439782381 conn(0x7f9e840d1ae0 msgr2=0x7f9e84161aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:00.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.773+0000 7f9e8b600640 1 -- 172.21.15.131:0/1439782381 shutdown_connections 2024-04-25T19:23:00.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:00.773+0000 7f9e8b600640 1 -- 172.21.15.131:0/1439782381 wait complete. 2024-04-25T19:23:00.797 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T19:22:04.178847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T19:22:14.779716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T19:22:15.552027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T19:23:00.798 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T19:23:01.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.067+0000 7f7586800640 1 Processor -- start 2024-04-25T19:23:01.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.067+0000 7f7586800640 1 -- start start 2024-04-25T19:23:01.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.070+0000 7f7586800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f758006dce0 0x7f75801458c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:01.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.070+0000 7f7586800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f758015d5c0 con 0x7f75800ce250 2024-04-25T19:23:01.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.070+0000 7f7586800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f758015d8a0 con 0x7f758015cfa0 2024-04-25T19:23:01.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.070+0000 7f7586800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f75800b4ec0 con 0x7f758006dce0 2024-04-25T19:23:01.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.070+0000 7f757f400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f75800ce250 0x7f75800b47b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38628/0 (socket says 172.21.15.131:38628) 2024-04-25T19:23:01.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.070+0000 7f757f400640 1 -- 172.21.15.131:0/3342333661 learned_addr learned my addr 172.21.15.131:0/3342333661 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:01.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.070+0000 7f757fe00640 1 --2- 172.21.15.131:0/3342333661 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f758006dce0 0x7f75801458c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:01.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.070+0000 7f757ea00640 1 -- 172.21.15.131:0/3342333661 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2385763427 0 0) 0x7f758015d5c0 con 0x7f75800ce250 2024-04-25T19:23:01.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.070+0000 7f757ea00640 1 -- 172.21.15.131:0/3342333661 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7564005730 con 0x7f75800ce250 2024-04-25T19:23:01.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.071+0000 7f757ea00640 1 -- 172.21.15.131:0/3342333661 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3454920752 0 0) 0x7f7564005730 con 0x7f75800ce250 2024-04-25T19:23:01.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.071+0000 7f757ea00640 1 -- 172.21.15.131:0/3342333661 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f758006dce0 msgr2=0x7f75801458c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:01.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.071+0000 7f757ea00640 1 --2- 172.21.15.131:0/3342333661 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f758006dce0 0x7f75801458c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:01.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.071+0000 7f757ea00640 1 -- 172.21.15.131:0/3342333661 >> v1:172.21.15.195:6789/0 conn(0x7f758015cfa0 legacy=0x7f758006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:01.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.071+0000 7f757ea00640 1 -- 172.21.15.131:0/3342333661 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f758015db80 con 0x7f75800ce250 2024-04-25T19:23:01.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.071+0000 7f757ea00640 1 -- 172.21.15.131:0/3342333661 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f7570001670 con 0x7f75800ce250 2024-04-25T19:23:01.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.071+0000 7f757ea00640 1 -- 172.21.15.131:0/3342333661 >> v1:172.21.15.131:6789/0 conn(0x7f75800ce250 legacy=0x7f75800b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:01.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.071+0000 7f757ea00640 1 --2- 172.21.15.131:0/3342333661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7564005bf0 0x7f7564006060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:01.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.071+0000 7f757ea00640 1 --2- 172.21.15.131:0/3342333661 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7564006a10 0x7f7564006e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:01.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.071+0000 7f757ea00640 1 --2- 172.21.15.131:0/3342333661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7564007360 0x7f756400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:01.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.071+0000 7f757ea00640 1 -- 172.21.15.131:0/3342333661 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f75800b4ec0 con 0x7f7564005bf0 2024-04-25T19:23:01.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.071+0000 7f757ea00640 1 -- 172.21.15.131:0/3342333661 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f756400e220 con 0x7f7564007360 2024-04-25T19:23:01.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.071+0000 7f757ea00640 1 -- 172.21.15.131:0/3342333661 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f756400e420 con 0x7f7564006a10 2024-04-25T19:23:01.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.071+0000 7f757f400640 1 --2- 172.21.15.131:0/3342333661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7564005bf0 0x7f7564006060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:01.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.072+0000 7f757fe00640 1 --2- 172.21.15.131:0/3342333661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7564007360 0x7f756400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:01.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.072+0000 7f757f400640 1 -- 172.21.15.131:0/3342333661 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7564006a10 msgr2=0x7f7564006e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:01.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.072+0000 7f757f400640 1 --2- 172.21.15.131:0/3342333661 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7564006a10 0x7f7564006e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:01.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.072+0000 7f757f400640 1 -- 172.21.15.131:0/3342333661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7564007360 msgr2=0x7f756400dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:01.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.072+0000 7f757f400640 1 --2- 172.21.15.131:0/3342333661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7564007360 0x7f756400dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:01.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.072+0000 7f757f400640 1 -- 172.21.15.131:0/3342333661 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7564005730 con 0x7f7564005bf0 2024-04-25T19:23:01.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.072+0000 7f757fe00640 1 --2- 172.21.15.131:0/3342333661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7564007360 0x7f756400dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:01.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.073+0000 7f757f400640 1 --2- 172.21.15.131:0/3342333661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7564005bf0 0x7f7564006060 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f75800b4500 tx=0x7f7564007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db0a2a6184aa826 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:01.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.073+0000 7f757ea00640 1 -- 172.21.15.131:0/3342333661 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570007cf0 con 0x7f7564005bf0 2024-04-25T19:23:01.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.073+0000 7f757ea00640 1 -- 172.21.15.131:0/3342333661 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7570005af0 con 0x7f7564005bf0 2024-04-25T19:23:01.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.073+0000 7f757ea00640 1 -- 172.21.15.131:0/3342333661 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570007070 con 0x7f7564005bf0 2024-04-25T19:23:01.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.074+0000 7f7586800640 1 -- 172.21.15.131:0/3342333661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7564005bf0 msgr2=0x7f7564006060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:01.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.074+0000 7f7586800640 1 --2- 172.21.15.131:0/3342333661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7564005bf0 0x7f7564006060 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f75800b4500 tx=0x7f7564007a40 comp rx=0 tx=0).stop 2024-04-25T19:23:01.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.074+0000 7f757fe00640 1 -- 172.21.15.131:0/3342333661 reap_dead start 2024-04-25T19:23:01.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.074+0000 7f7586800640 1 -- 172.21.15.131:0/3342333661 shutdown_connections 2024-04-25T19:23:01.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.074+0000 7f7586800640 1 -- 172.21.15.131:0/3342333661 >> 172.21.15.131:0/3342333661 conn(0x7f7580073090 msgr2=0x7f75800734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:01.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.074+0000 7f7586800640 1 -- 172.21.15.131:0/3342333661 shutdown_connections 2024-04-25T19:23:01.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.074+0000 7f7586800640 1 -- 172.21.15.131:0/3342333661 wait complete. 2024-04-25T19:23:01.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.076+0000 7f7586800640 1 Processor -- start 2024-04-25T19:23:01.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.076+0000 7f7586800640 1 -- start start 2024-04-25T19:23:01.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.078+0000 7f7586800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7564005bf0 0x7f75800ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:01.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.078+0000 7f7586800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f75800b0cf0 0x7f75801fa030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:01.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.078+0000 7f7586800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7580151a70 0x7f7580154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:01.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.078+0000 7f7586800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7580071310 con 0x7f7564005bf0 2024-04-25T19:23:01.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.078+0000 7f7586800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f758015de60 con 0x7f7580151a70 2024-04-25T19:23:01.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.078+0000 7f7586800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f758006dce0 con 0x7f75800b0cf0 2024-04-25T19:23:01.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.078+0000 7f757f400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7564005bf0 0x7f75800ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:01.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.078+0000 7f757f400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7564005bf0 0x7f75800ae640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38386/0 (socket says 172.21.15.131:38386) 2024-04-25T19:23:01.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.078+0000 7f757f400640 1 -- 172.21.15.131:0/3154932931 learned_addr learned my addr 172.21.15.131:0/3154932931 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:01.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.078+0000 7f757f400640 1 -- 172.21.15.131:0/3154932931 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f75800b0cf0 msgr2=0x7f75801fa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:01.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.078+0000 7f757f400640 1 --2- 172.21.15.131:0/3154932931 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f75800b0cf0 0x7f75801fa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:01.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.078+0000 7f757f400640 1 -- 172.21.15.131:0/3154932931 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7580151a70 msgr2=0x7f7580154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:01.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.078+0000 7f757f400640 1 --2- 172.21.15.131:0/3154932931 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7580151a70 0x7f7580154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:01.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.078+0000 7f757f400640 1 -- 172.21.15.131:0/3154932931 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75801fa570 con 0x7f7564005bf0 2024-04-25T19:23:01.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.079+0000 7f757f400640 1 --2- 172.21.15.131:0/3154932931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7564005bf0 0x7f75800ae640 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f757000c300 tx=0x7f758015dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:01.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.079+0000 7f7577400640 1 -- 172.21.15.131:0/3154932931 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570001630 con 0x7f7564005bf0 2024-04-25T19:23:01.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.079+0000 7f7577400640 1 -- 172.21.15.131:0/3154932931 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7570042070 con 0x7f7564005bf0 2024-04-25T19:23:01.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.079+0000 7f7577400640 1 -- 172.21.15.131:0/3154932931 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570007270 con 0x7f7564005bf0 2024-04-25T19:23:01.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.079+0000 7f7586800640 1 -- 172.21.15.131:0/3154932931 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75800b2dc0 con 0x7f7564005bf0 2024-04-25T19:23:01.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.079+0000 7f7586800640 1 -- 172.21.15.131:0/3154932931 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75801f9830 con 0x7f7564005bf0 2024-04-25T19:23:01.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.080+0000 7f7586800640 1 -- 172.21.15.131:0/3154932931 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7580050740 con 0x7f7564005bf0 2024-04-25T19:23:01.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.081+0000 7f7577400640 1 -- 172.21.15.131:0/3154932931 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7570007410 con 0x7f7564005bf0 2024-04-25T19:23:01.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.082+0000 7f7577400640 1 --2- 172.21.15.131:0/3154932931 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f755c0744b0 0x7f755c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:01.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.082+0000 7f7577400640 1 -- 172.21.15.131:0/3154932931 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f75700b5520 con 0x7f7564005bf0 2024-04-25T19:23:01.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.083+0000 7f7577e00640 1 --2- 172.21.15.131:0/3154932931 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f755c0744b0 0x7f755c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:01.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.084+0000 7f7577e00640 1 --2- 172.21.15.131:0/3154932931 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f755c0744b0 0x7f755c0769c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f75800b2cb0 tx=0x7f7568007990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:01.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.087+0000 7f7577400640 1 -- 172.21.15.131:0/3154932931 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f757007fb90 con 0x7f7564005bf0 2024-04-25T19:23:01.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.284+0000 7f7586800640 1 -- 172.21.15.131:0/3154932931 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f75800b6600 con 0x7f7564005bf0 2024-04-25T19:23:01.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.286+0000 7f7577400640 1 -- 172.21.15.131:0/3154932931 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f757007f490 con 0x7f7564005bf0 2024-04-25T19:23:01.286 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-25T19:23:01.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.288+0000 7f7586800640 1 -- 172.21.15.131:0/3154932931 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f755c0744b0 msgr2=0x7f755c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:01.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.288+0000 7f7586800640 1 --2- 172.21.15.131:0/3154932931 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f755c0744b0 0x7f755c0769c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f75800b2cb0 tx=0x7f7568007990 comp rx=0 tx=0).stop 2024-04-25T19:23:01.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.288+0000 7f7586800640 1 -- 172.21.15.131:0/3154932931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7564005bf0 msgr2=0x7f75800ae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:01.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.288+0000 7f7586800640 1 --2- 172.21.15.131:0/3154932931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7564005bf0 0x7f75800ae640 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f757000c300 tx=0x7f758015dd50 comp rx=0 tx=0).stop 2024-04-25T19:23:01.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.288+0000 7f7586800640 1 -- 172.21.15.131:0/3154932931 shutdown_connections 2024-04-25T19:23:01.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.288+0000 7f7586800640 1 --2- 172.21.15.131:0/3154932931 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f755c0744b0 0x7f755c0769c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:01.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.288+0000 7f7586800640 1 --2- 172.21.15.131:0/3154932931 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f75800b0cf0 0x7f75801fa030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:01.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.288+0000 7f7586800640 1 --2- 172.21.15.131:0/3154932931 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7580151a70 0x7f7580154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:01.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.288+0000 7f7586800640 1 --2- 172.21.15.131:0/3154932931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7564005bf0 0x7f75800ae640 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:01.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.288+0000 7f7586800640 1 -- 172.21.15.131:0/3154932931 >> 172.21.15.131:0/3154932931 conn(0x7f7580073090 msgr2=0x7f75800cd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:01.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.289+0000 7f7586800640 1 -- 172.21.15.131:0/3154932931 shutdown_connections 2024-04-25T19:23:01.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.289+0000 7f7586800640 1 -- 172.21.15.131:0/3154932931 wait complete. 2024-04-25T19:23:01.314 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T19:23:01.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.582+0000 7fbb2dc00640 1 Processor -- start 2024-04-25T19:23:01.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.583+0000 7fbb2dc00640 1 -- start start 2024-04-25T19:23:01.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.585+0000 7fbb2dc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb2815ee60 0x7fbb28168e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:01.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.585+0000 7fbb2dc00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb28070000 con 0x7fbb2806dce0 2024-04-25T19:23:01.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.585+0000 7fbb2dc00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb2806f240 con 0x7fbb28144340 2024-04-25T19:23:01.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.585+0000 7fbb2dc00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbb2815f270 con 0x7fbb2815ee60 2024-04-25T19:23:01.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.585+0000 7fbb1f400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fbb2806dce0 0x7fbb2815e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38644/0 (socket says 172.21.15.131:38644) 2024-04-25T19:23:01.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.585+0000 7fbb1f400640 1 -- 172.21.15.131:0/1180512598 learned_addr learned my addr 172.21.15.131:0/1180512598 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:01.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.586+0000 7fbb2d200640 1 --2- 172.21.15.131:0/1180512598 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb2815ee60 0x7fbb28168e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:01.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.586+0000 7fbb27400640 1 -- 172.21.15.131:0/1180512598 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3119776862 0 0) 0x7fbb28070000 con 0x7fbb2806dce0 2024-04-25T19:23:01.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.586+0000 7fbb27400640 1 -- 172.21.15.131:0/1180512598 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb0c003520 con 0x7fbb2806dce0 2024-04-25T19:23:01.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.586+0000 7fbb27400640 1 -- 172.21.15.131:0/1180512598 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1365273424 0 0) 0x7fbb0c003520 con 0x7fbb2806dce0 2024-04-25T19:23:01.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.586+0000 7fbb27400640 1 -- 172.21.15.131:0/1180512598 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb2815ee60 msgr2=0x7fbb28168e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:01.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.586+0000 7fbb27400640 1 --2- 172.21.15.131:0/1180512598 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb2815ee60 0x7fbb28168e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:01.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.586+0000 7fbb27400640 1 -- 172.21.15.131:0/1180512598 >> v1:172.21.15.195:6789/0 conn(0x7fbb28144340 legacy=0x7fbb2806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:01.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.586+0000 7fbb27400640 1 -- 172.21.15.131:0/1180512598 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb2806f520 con 0x7fbb2806dce0 2024-04-25T19:23:01.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.586+0000 7fbb27400640 1 -- 172.21.15.131:0/1180512598 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7fbb10001670 con 0x7fbb2806dce0 2024-04-25T19:23:01.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.586+0000 7fbb27400640 1 -- 172.21.15.131:0/1180512598 >> v1:172.21.15.131:6789/0 conn(0x7fbb2806dce0 legacy=0x7fbb2815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:01.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.586+0000 7fbb27400640 1 --2- 172.21.15.131:0/1180512598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb0c0039e0 0x7fbb0c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:01.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.586+0000 7fbb27400640 1 --2- 172.21.15.131:0/1180512598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb0c004800 0x7fbb0c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:01.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.587+0000 7fbb27400640 1 --2- 172.21.15.131:0/1180512598 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb2815ee60 0x7fbb0c0052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:01.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.587+0000 7fbb27400640 1 -- 172.21.15.131:0/1180512598 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0c00bb50 con 0x7fbb0c0039e0 2024-04-25T19:23:01.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.587+0000 7fbb27400640 1 -- 172.21.15.131:0/1180512598 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0c00bcd0 con 0x7fbb0c004800 2024-04-25T19:23:01.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.587+0000 7fbb27400640 1 -- 172.21.15.131:0/1180512598 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbb0c00bed0 con 0x7fbb2815ee60 2024-04-25T19:23:01.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.587+0000 7fbb27e00640 1 --2- 172.21.15.131:0/1180512598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb0c0039e0 0x7fbb0c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:01.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.587+0000 7fbb1f400640 1 --2- 172.21.15.131:0/1180512598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb0c004800 0x7fbb0c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:01.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.587+0000 7fbb27e00640 1 -- 172.21.15.131:0/1180512598 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb2815ee60 msgr2=0x7fbb0c0052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:01.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.587+0000 7fbb2d200640 1 --2- 172.21.15.131:0/1180512598 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb2815ee60 0x7fbb0c0052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:01.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.587+0000 7fbb27e00640 1 --2- 172.21.15.131:0/1180512598 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb2815ee60 0x7fbb0c0052d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:01.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.587+0000 7fbb27e00640 1 -- 172.21.15.131:0/1180512598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb0c004800 msgr2=0x7fbb0c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:01.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.587+0000 7fbb27e00640 1 --2- 172.21.15.131:0/1180512598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb0c004800 0x7fbb0c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:01.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.587+0000 7fbb27e00640 1 -- 172.21.15.131:0/1180512598 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb0c003520 con 0x7fbb0c0039e0 2024-04-25T19:23:01.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.587+0000 7fbb1f400640 1 --2- 172.21.15.131:0/1180512598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb0c004800 0x7fbb0c004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:01.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.588+0000 7fbb27e00640 1 --2- 172.21.15.131:0/1180512598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb0c0039e0 0x7fbb0c003e50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbb18001750 tx=0x7fbb0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e625ee2eefdca4cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:01.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.589+0000 7fbb27400640 1 -- 172.21.15.131:0/1180512598 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb18001370 con 0x7fbb0c0039e0 2024-04-25T19:23:01.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.589+0000 7fbb27400640 1 -- 172.21.15.131:0/1180512598 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb180052d0 con 0x7fbb0c0039e0 2024-04-25T19:23:01.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.589+0000 7fbb27400640 1 -- 172.21.15.131:0/1180512598 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1802abe0 con 0x7fbb0c0039e0 2024-04-25T19:23:01.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.589+0000 7fbb2dc00640 1 -- 172.21.15.131:0/1180512598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb0c0039e0 msgr2=0x7fbb0c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:01.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.589+0000 7fbb2dc00640 1 --2- 172.21.15.131:0/1180512598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb0c0039e0 0x7fbb0c003e50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbb18001750 tx=0x7fbb0c005830 comp rx=0 tx=0).stop 2024-04-25T19:23:01.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.589+0000 7fbb2d200640 1 -- 172.21.15.131:0/1180512598 reap_dead start 2024-04-25T19:23:01.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.590+0000 7fbb2dc00640 1 -- 172.21.15.131:0/1180512598 shutdown_connections 2024-04-25T19:23:01.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.590+0000 7fbb2dc00640 1 -- 172.21.15.131:0/1180512598 >> 172.21.15.131:0/1180512598 conn(0x7fbb28072f40 msgr2=0x7fbb28073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:01.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.590+0000 7fbb2dc00640 1 -- 172.21.15.131:0/1180512598 shutdown_connections 2024-04-25T19:23:01.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.590+0000 7fbb2dc00640 1 -- 172.21.15.131:0/1180512598 wait complete. 2024-04-25T19:23:01.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.592+0000 7fbb2dc00640 1 Processor -- start 2024-04-25T19:23:01.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.592+0000 7fbb2dc00640 1 -- start start 2024-04-25T19:23:01.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.594+0000 7fbb2dc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb0c0039e0 0x7fbb28158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:01.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.594+0000 7fbb2dc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb28140240 0x7fbb28140650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:01.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.594+0000 7fbb2dc00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb280af690 0x7fbb280afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:01.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.594+0000 7fbb2dc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2806fae0 con 0x7fbb0c0039e0 2024-04-25T19:23:01.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.594+0000 7fbb2dc00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fbb28144750 con 0x7fbb280af690 2024-04-25T19:23:01.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.594+0000 7fbb2dc00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbb281604b0 con 0x7fbb28140240 2024-04-25T19:23:01.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.594+0000 7fbb27e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb0c0039e0 0x7fbb28158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:01.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.594+0000 7fbb27e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb0c0039e0 0x7fbb28158380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38398/0 (socket says 172.21.15.131:38398) 2024-04-25T19:23:01.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.594+0000 7fbb27e00640 1 -- 172.21.15.131:0/2079069316 learned_addr learned my addr 172.21.15.131:0/2079069316 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:01.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.594+0000 7fbb2d200640 1 --2- 172.21.15.131:0/2079069316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb280af690 0x7fbb280afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:01.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.594+0000 7fbb27e00640 1 -- 172.21.15.131:0/2079069316 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb28140240 msgr2=0x7fbb28140650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:01.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.594+0000 7fbb1f400640 1 --2- 172.21.15.131:0/2079069316 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb28140240 0x7fbb28140650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:01.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.594+0000 7fbb27e00640 1 --2- 172.21.15.131:0/2079069316 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb28140240 0x7fbb28140650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:01.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.594+0000 7fbb27e00640 1 -- 172.21.15.131:0/2079069316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb280af690 msgr2=0x7fbb280afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:01.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.594+0000 7fbb27e00640 1 --2- 172.21.15.131:0/2079069316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb280af690 0x7fbb280afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:01.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.594+0000 7fbb27e00640 1 -- 172.21.15.131:0/2079069316 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb280affe0 con 0x7fbb0c0039e0 2024-04-25T19:23:01.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.595+0000 7fbb2d200640 1 --2- 172.21.15.131:0/2079069316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb280af690 0x7fbb280afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:01.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.595+0000 7fbb27e00640 1 --2- 172.21.15.131:0/2079069316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb0c0039e0 0x7fbb28158380 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbb18001870 tx=0x7fbb18001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:01.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.595+0000 7fbb24c00640 1 -- 172.21.15.131:0/2079069316 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb18037040 con 0x7fbb0c0039e0 2024-04-25T19:23:01.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.595+0000 7fbb24c00640 1 -- 172.21.15.131:0/2079069316 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb18005480 con 0x7fbb0c0039e0 2024-04-25T19:23:01.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.595+0000 7fbb24c00640 1 -- 172.21.15.131:0/2079069316 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb18007a30 con 0x7fbb0c0039e0 2024-04-25T19:23:01.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.595+0000 7fbb2dc00640 1 -- 172.21.15.131:0/2079069316 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb2813ec00 con 0x7fbb0c0039e0 2024-04-25T19:23:01.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.595+0000 7fbb2dc00640 1 -- 172.21.15.131:0/2079069316 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb2813f1c0 con 0x7fbb0c0039e0 2024-04-25T19:23:01.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.597+0000 7fbb2dc00640 1 -- 172.21.15.131:0/2079069316 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb28159df0 con 0x7fbb0c0039e0 2024-04-25T19:23:01.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.598+0000 7fbb24c00640 1 -- 172.21.15.131:0/2079069316 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbb18044020 con 0x7fbb0c0039e0 2024-04-25T19:23:01.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.599+0000 7fbb24c00640 1 --2- 172.21.15.131:0/2079069316 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbb040744b0 0x7fbb040769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:01.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.599+0000 7fbb24c00640 1 -- 172.21.15.131:0/2079069316 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fbb180b4f90 con 0x7fbb0c0039e0 2024-04-25T19:23:01.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.600+0000 7fbb1f400640 1 --2- 172.21.15.131:0/2079069316 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbb040744b0 0x7fbb040769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:01.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.601+0000 7fbb1f400640 1 --2- 172.21.15.131:0/2079069316 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbb040744b0 0x7fbb040769c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbb2813fe10 tx=0x7fbb10009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:01.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.604+0000 7fbb24c00640 1 -- 172.21.15.131:0/2079069316 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbb28159df0 con 0x7fbb0c0039e0 2024-04-25T19:23:01.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.800+0000 7fbb2dc00640 1 -- 172.21.15.131:0/2079069316 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbb28076c60 con 0x7fbb0c0039e0 2024-04-25T19:23:01.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.801+0000 7fbb24c00640 1 -- 172.21.15.131:0/2079069316 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7fbb280affe0 con 0x7fbb0c0039e0 2024-04-25T19:23:01.802 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-25T19:23:01.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.804+0000 7fbb2dc00640 1 -- 172.21.15.131:0/2079069316 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbb040744b0 msgr2=0x7fbb040769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:01.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.804+0000 7fbb2dc00640 1 --2- 172.21.15.131:0/2079069316 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbb040744b0 0x7fbb040769c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbb2813fe10 tx=0x7fbb10009040 comp rx=0 tx=0).stop 2024-04-25T19:23:01.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.804+0000 7fbb2dc00640 1 -- 172.21.15.131:0/2079069316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb0c0039e0 msgr2=0x7fbb28158380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:01.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.804+0000 7fbb2dc00640 1 --2- 172.21.15.131:0/2079069316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb0c0039e0 0x7fbb28158380 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbb18001870 tx=0x7fbb18001120 comp rx=0 tx=0).stop 2024-04-25T19:23:01.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.804+0000 7fbb2dc00640 1 -- 172.21.15.131:0/2079069316 shutdown_connections 2024-04-25T19:23:01.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.804+0000 7fbb2dc00640 1 --2- 172.21.15.131:0/2079069316 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbb040744b0 0x7fbb040769c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.804+0000 7fbb2dc00640 1 --2- 172.21.15.131:0/2079069316 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb28140240 0x7fbb28140650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.804+0000 7fbb2dc00640 1 --2- 172.21.15.131:0/2079069316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb280af690 0x7fbb280afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.804+0000 7fbb2dc00640 1 --2- 172.21.15.131:0/2079069316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb0c0039e0 0x7fbb28158380 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.804+0000 7fbb2dc00640 1 -- 172.21.15.131:0/2079069316 >> 172.21.15.131:0/2079069316 conn(0x7fbb28072f40 msgr2=0x7fbb280b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.805+0000 7fbb2dc00640 1 -- 172.21.15.131:0/2079069316 shutdown_connections 2024-04-25T19:23:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:01.805+0000 7fbb2dc00640 1 -- 172.21.15.131:0/2079069316 wait complete. 2024-04-25T19:23:01.830 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T19:23:02.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.106+0000 7f5490a00640 1 Processor -- start 2024-04-25T19:23:02.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.106+0000 7f5490a00640 1 -- start start 2024-04-25T19:23:02.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.108+0000 7f5490a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f548c06f930 0x7f548c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:02.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.108+0000 7f5490a00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f548c1623f0 con 0x7f548c070d20 2024-04-25T19:23:02.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.108+0000 7f5490a00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f548c1626d0 con 0x7f548c06fd40 2024-04-25T19:23:02.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.108+0000 7f5490a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f548c06f130 con 0x7f548c06f930 2024-04-25T19:23:02.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.109+0000 7f548b400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f548c070d20 0x7f548c161b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38652/0 (socket says 172.21.15.131:38652) 2024-04-25T19:23:02.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.109+0000 7f548b400640 1 -- 172.21.15.131:0/2542834550 learned_addr learned my addr 172.21.15.131:0/2542834550 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:02.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.109+0000 7f548aa00640 1 --2- 172.21.15.131:0/2542834550 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f548c06f930 0x7f548c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:02.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.109+0000 7f548a000640 1 -- 172.21.15.131:0/2542834550 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1492029201 0 0) 0x7f548c1623f0 con 0x7f548c070d20 2024-04-25T19:23:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.109+0000 7f548a000640 1 -- 172.21.15.131:0/2542834550 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5470003520 con 0x7f548c070d20 2024-04-25T19:23:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.110+0000 7f548a000640 1 -- 172.21.15.131:0/2542834550 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 499285094 0 0) 0x7f5470003520 con 0x7f548c070d20 2024-04-25T19:23:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.110+0000 7f548a000640 1 -- 172.21.15.131:0/2542834550 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f548c06f930 msgr2=0x7f548c06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.110+0000 7f548a000640 1 --2- 172.21.15.131:0/2542834550 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f548c06f930 0x7f548c06d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.110+0000 7f548a000640 1 -- 172.21.15.131:0/2542834550 >> v1:172.21.15.195:6789/0 conn(0x7f548c06fd40 legacy=0x7f548c0ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.110+0000 7f548a000640 1 -- 172.21.15.131:0/2542834550 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548c06f410 con 0x7f548c070d20 2024-04-25T19:23:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.110+0000 7f548a000640 1 -- 172.21.15.131:0/2542834550 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f5474001670 con 0x7f548c070d20 2024-04-25T19:23:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.110+0000 7f548a000640 1 -- 172.21.15.131:0/2542834550 >> v1:172.21.15.131:6789/0 conn(0x7f548c070d20 legacy=0x7f548c161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.110+0000 7f548a000640 1 --2- 172.21.15.131:0/2542834550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54700039e0 0x7f5470003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.110+0000 7f548a000640 1 --2- 172.21.15.131:0/2542834550 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f548c06f930 0x7f5470004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.110+0000 7f548a000640 1 --2- 172.21.15.131:0/2542834550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5470004d40 0x7f5470005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.110+0000 7f548a000640 1 -- 172.21.15.131:0/2542834550 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f548c06f130 con 0x7f54700039e0 2024-04-25T19:23:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.110+0000 7f548a000640 1 -- 172.21.15.131:0/2542834550 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f547000bb80 con 0x7f5470004d40 2024-04-25T19:23:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.110+0000 7f548a000640 1 -- 172.21.15.131:0/2542834550 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f547000bd80 con 0x7f548c06f930 2024-04-25T19:23:02.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.110+0000 7f548b400640 1 --2- 172.21.15.131:0/2542834550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54700039e0 0x7f5470003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:02.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.110+0000 7f548aa00640 1 --2- 172.21.15.131:0/2542834550 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f548c06f930 0x7f5470004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:02.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.111+0000 7f548be00640 1 --2- 172.21.15.131:0/2542834550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5470004d40 0x7f5470005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:02.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.111+0000 7f548b400640 1 -- 172.21.15.131:0/2542834550 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f548c06f930 msgr2=0x7f5470004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:02.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.111+0000 7f548b400640 1 --2- 172.21.15.131:0/2542834550 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f548c06f930 0x7f5470004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:02.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.111+0000 7f548b400640 1 -- 172.21.15.131:0/2542834550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5470004d40 msgr2=0x7f5470005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:02.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.111+0000 7f548b400640 1 --2- 172.21.15.131:0/2542834550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5470004d40 0x7f5470005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:02.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.111+0000 7f548b400640 1 -- 172.21.15.131:0/2542834550 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5470003520 con 0x7f54700039e0 2024-04-25T19:23:02.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.111+0000 7f548aa00640 1 --2- 172.21.15.131:0/2542834550 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f548c06f930 0x7f5470004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:02.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.111+0000 7f548be00640 1 --2- 172.21.15.131:0/2542834550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5470004d40 0x7f5470005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:02.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.112+0000 7f548b400640 1 --2- 172.21.15.131:0/2542834550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54700039e0 0x7f5470003e50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f548c0b1350 tx=0x7f5470005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ffb6c624737081 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:02.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.112+0000 7f548a000640 1 -- 172.21.15.131:0/2542834550 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5474007d30 con 0x7f54700039e0 2024-04-25T19:23:02.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.112+0000 7f548a000640 1 -- 172.21.15.131:0/2542834550 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54740058d0 con 0x7f54700039e0 2024-04-25T19:23:02.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.112+0000 7f548a000640 1 -- 172.21.15.131:0/2542834550 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5474005ce0 con 0x7f54700039e0 2024-04-25T19:23:02.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.113+0000 7f5490a00640 1 -- 172.21.15.131:0/2542834550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54700039e0 msgr2=0x7f5470003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:02.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.113+0000 7f5490a00640 1 --2- 172.21.15.131:0/2542834550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54700039e0 0x7f5470003e50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f548c0b1350 tx=0x7f5470005830 comp rx=0 tx=0).stop 2024-04-25T19:23:02.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.113+0000 7f548be00640 1 -- 172.21.15.131:0/2542834550 reap_dead start 2024-04-25T19:23:02.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.113+0000 7f5490a00640 1 -- 172.21.15.131:0/2542834550 shutdown_connections 2024-04-25T19:23:02.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.113+0000 7f5490a00640 1 -- 172.21.15.131:0/2542834550 >> 172.21.15.131:0/2542834550 conn(0x7f548c073160 msgr2=0x7f548c073570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:02.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.113+0000 7f5490a00640 1 -- 172.21.15.131:0/2542834550 shutdown_connections 2024-04-25T19:23:02.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.113+0000 7f5490a00640 1 -- 172.21.15.131:0/2542834550 wait complete. 2024-04-25T19:23:02.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.115+0000 7f5490a00640 1 Processor -- start 2024-04-25T19:23:02.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.115+0000 7f5490a00640 1 -- start start 2024-04-25T19:23:02.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.117+0000 7f5490a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54700039e0 0x7f548c0b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:02.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.117+0000 7f5490a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f548c144670 0x7f548c144a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:02.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.117+0000 7f5490a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f548c15e5f0 0x7f548c15ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:02.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.117+0000 7f5490a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f548c15e470 con 0x7f54700039e0 2024-04-25T19:23:02.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.117+0000 7f5490a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f548c15e2f0 con 0x7f548c144670 2024-04-25T19:23:02.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.117+0000 7f5490a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f548c0ceef0 con 0x7f548c15e5f0 2024-04-25T19:23:02.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.117+0000 7f548b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54700039e0 0x7f548c0b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:02.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.117+0000 7f548b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54700039e0 0x7f548c0b60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38414/0 (socket says 172.21.15.131:38414) 2024-04-25T19:23:02.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.117+0000 7f548b400640 1 -- 172.21.15.131:0/2474277143 learned_addr learned my addr 172.21.15.131:0/2474277143 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:02.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.118+0000 7f548aa00640 1 --2- 172.21.15.131:0/2474277143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f548c144670 0x7f548c144a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:02.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.118+0000 7f548be00640 1 --2- 172.21.15.131:0/2474277143 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f548c15e5f0 0x7f548c15ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:02.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.118+0000 7f548b400640 1 -- 172.21.15.131:0/2474277143 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f548c15e5f0 msgr2=0x7f548c15ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:02.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.118+0000 7f548b400640 1 --2- 172.21.15.131:0/2474277143 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f548c15e5f0 0x7f548c15ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:02.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.118+0000 7f548b400640 1 -- 172.21.15.131:0/2474277143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f548c144670 msgr2=0x7f548c144a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:02.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.118+0000 7f548b400640 1 --2- 172.21.15.131:0/2474277143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f548c144670 0x7f548c144a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:02.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.118+0000 7f548b400640 1 -- 172.21.15.131:0/2474277143 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548c144fc0 con 0x7f54700039e0 2024-04-25T19:23:02.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.118+0000 7f548be00640 1 --2- 172.21.15.131:0/2474277143 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f548c15e5f0 0x7f548c15ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:02.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.118+0000 7f548b400640 1 --2- 172.21.15.131:0/2474277143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54700039e0 0x7f548c0b60d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5474001970 tx=0x7f5474001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:02.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.118+0000 7f5483400640 1 -- 172.21.15.131:0/2474277143 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5474043070 con 0x7f54700039e0 2024-04-25T19:23:02.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.118+0000 7f5483400640 1 -- 172.21.15.131:0/2474277143 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54740049e0 con 0x7f54700039e0 2024-04-25T19:23:02.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.118+0000 7f5483400640 1 -- 172.21.15.131:0/2474277143 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5474038040 con 0x7f54700039e0 2024-04-25T19:23:02.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.118+0000 7f5490a00640 1 -- 172.21.15.131:0/2474277143 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f548c15ef40 con 0x7f54700039e0 2024-04-25T19:23:02.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.119+0000 7f5490a00640 1 -- 172.21.15.131:0/2474277143 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f548c0b5310 con 0x7f54700039e0 2024-04-25T19:23:02.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.120+0000 7f5490a00640 1 -- 172.21.15.131:0/2474277143 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f548c076c60 con 0x7f54700039e0 2024-04-25T19:23:02.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.121+0000 7f5483400640 1 -- 172.21.15.131:0/2474277143 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5474046070 con 0x7f54700039e0 2024-04-25T19:23:02.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.122+0000 7f5483400640 1 --2- 172.21.15.131:0/2474277143 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f54680744b0 0x7f54680769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:02.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.122+0000 7f5483400640 1 -- 172.21.15.131:0/2474277143 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f54740b4870 con 0x7f54700039e0 2024-04-25T19:23:02.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.122+0000 7f548aa00640 1 --2- 172.21.15.131:0/2474277143 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f54680744b0 0x7f54680769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:02.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.124+0000 7f548aa00640 1 --2- 172.21.15.131:0/2474277143 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f54680744b0 0x7f54680769c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f547c009160 tx=0x7f547c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:02.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.127+0000 7f5483400640 1 -- 172.21.15.131:0/2474277143 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f547407e9c0 con 0x7f54700039e0 2024-04-25T19:23:02.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.324+0000 7f5490a00640 1 -- 172.21.15.131:0/2474277143 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f548c074070 con 0x7f54700039e0 2024-04-25T19:23:02.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.325+0000 7f5483400640 1 -- 172.21.15.131:0/2474277143 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f5474082cc0 con 0x7f54700039e0 2024-04-25T19:23:02.326 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 64 2024-04-25T19:23:02.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.328+0000 7f5490a00640 1 -- 172.21.15.131:0/2474277143 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f54680744b0 msgr2=0x7f54680769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:02.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.328+0000 7f5490a00640 1 --2- 172.21.15.131:0/2474277143 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f54680744b0 0x7f54680769c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f547c009160 tx=0x7f547c008040 comp rx=0 tx=0).stop 2024-04-25T19:23:02.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.328+0000 7f5490a00640 1 -- 172.21.15.131:0/2474277143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54700039e0 msgr2=0x7f548c0b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:02.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.328+0000 7f5490a00640 1 --2- 172.21.15.131:0/2474277143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54700039e0 0x7f548c0b60d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5474001970 tx=0x7f5474001a40 comp rx=0 tx=0).stop 2024-04-25T19:23:02.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.328+0000 7f5490a00640 1 -- 172.21.15.131:0/2474277143 shutdown_connections 2024-04-25T19:23:02.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.328+0000 7f5490a00640 1 --2- 172.21.15.131:0/2474277143 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f54680744b0 0x7f54680769c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:02.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.328+0000 7f5490a00640 1 --2- 172.21.15.131:0/2474277143 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f548c15e5f0 0x7f548c15ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:02.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.328+0000 7f5490a00640 1 --2- 172.21.15.131:0/2474277143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f548c144670 0x7f548c144a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:02.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.328+0000 7f5490a00640 1 --2- 172.21.15.131:0/2474277143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54700039e0 0x7f548c0b60d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:02.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.328+0000 7f5490a00640 1 -- 172.21.15.131:0/2474277143 >> 172.21.15.131:0/2474277143 conn(0x7f548c073160 msgr2=0x7f548c06d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:02.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.328+0000 7f5490a00640 1 -- 172.21.15.131:0/2474277143 shutdown_connections 2024-04-25T19:23:02.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.328+0000 7f5490a00640 1 -- 172.21.15.131:0/2474277143 wait complete. 2024-04-25T19:23:02.355 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_dump_tree.TestDumpTree.test_basic' 2024-04-25T19:23:02.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.626+0000 7f5fc0c00640 1 Processor -- start 2024-04-25T19:23:02.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.626+0000 7f5fc0c00640 1 -- start start 2024-04-25T19:23:02.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.628+0000 7f5fc0c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5fbc1443c0 0x7f5fbc06fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:02.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.628+0000 7f5fc0c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5fbc070370 0x7f5fbc0cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:02.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.629+0000 7f5fc0c00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fbc0cff30 con 0x7f5fbc0cfb20 2024-04-25T19:23:02.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.629+0000 7f5fc0c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f5fbc0708d0 con 0x7f5fbc1443c0 2024-04-25T19:23:02.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.629+0000 7f5fc0c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f5fbc15f160 con 0x7f5fbc070370 2024-04-25T19:23:02.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.629+0000 7f5fb9e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5fbc1443c0 0x7f5fbc06fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:02.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.629+0000 7f5fb9e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5fbc1443c0 0x7f5fbc06fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38422/0 (socket says 172.21.15.131:38422) 2024-04-25T19:23:02.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.629+0000 7f5fb9e00640 1 -- 172.21.15.131:0/473043896 learned_addr learned my addr 172.21.15.131:0/473043896 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:02.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.629+0000 7f5fb9400640 1 --2- 172.21.15.131:0/473043896 >> v2:172.21.15.195:3300/0 conn(0x7f5fbc070370 0x7f5fbc0cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:02.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.630+0000 7f5fb9e00640 1 -- 172.21.15.131:0/473043896 >> v2:172.21.15.195:3300/0 conn(0x7f5fbc070370 msgr2=0x7f5fbc0cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:02.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.630+0000 7f5fb9e00640 1 --2- 172.21.15.131:0/473043896 >> v2:172.21.15.195:3300/0 conn(0x7f5fbc070370 0x7f5fbc0cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:02.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.630+0000 7f5fb9e00640 1 -- 172.21.15.131:0/473043896 >> v1:172.21.15.131:6789/0 conn(0x7f5fbc0cfb20 legacy=0x7f5fbc0ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:02.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.630+0000 7f5fb9e00640 1 -- 172.21.15.131:0/473043896 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fbc15f5f0 con 0x7f5fbc1443c0 2024-04-25T19:23:02.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.630+0000 7f5fb8a00640 1 -- 172.21.15.131:0/473043896 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 233018186 0 0) 0x7f5fb4001490 con 0x7f5fbc0cfb20 2024-04-25T19:23:02.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.631+0000 7f5fb9e00640 1 --2- 172.21.15.131:0/473043896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fbc1443c0 0x7f5fbc06fe30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc06f920 tx=0x7f5fac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9fa8f50b9c7507f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:02.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.631+0000 7f5fb8a00640 1 -- 172.21.15.131:0/473043896 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac037070 con 0x7f5fbc1443c0 2024-04-25T19:23:02.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.631+0000 7f5fb8a00640 1 -- 172.21.15.131:0/473043896 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fac032440 con 0x7f5fbc1443c0 2024-04-25T19:23:02.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.631+0000 7f5fb8a00640 1 -- 172.21.15.131:0/473043896 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac032810 con 0x7f5fbc1443c0 2024-04-25T19:23:02.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.632+0000 7f5fc0c00640 1 -- 172.21.15.131:0/473043896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fbc1443c0 msgr2=0x7f5fbc06fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:02.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.632+0000 7f5fc0c00640 1 --2- 172.21.15.131:0/473043896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fbc1443c0 0x7f5fbc06fe30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc06f920 tx=0x7f5fac02a270 comp rx=0 tx=0).stop 2024-04-25T19:23:02.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.632+0000 7f5fc0c00640 1 -- 172.21.15.131:0/473043896 shutdown_connections 2024-04-25T19:23:02.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.632+0000 7f5fc0c00640 1 --2- 172.21.15.131:0/473043896 >> v2:172.21.15.195:3300/0 conn(0x7f5fbc070370 0x7f5fbc0cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:02.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.632+0000 7f5fc0c00640 1 --2- 172.21.15.131:0/473043896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fbc1443c0 0x7f5fbc06fe30 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:02.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.632+0000 7f5fc0c00640 1 -- 172.21.15.131:0/473043896 >> 172.21.15.131:0/473043896 conn(0x7f5fbc0d1ae0 msgr2=0x7f5fbc0d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:02.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.632+0000 7f5fc0c00640 1 -- 172.21.15.131:0/473043896 shutdown_connections 2024-04-25T19:23:02.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.632+0000 7f5fc0c00640 1 -- 172.21.15.131:0/473043896 wait complete. 2024-04-25T19:23:02.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.634+0000 7f5fc0c00640 1 Processor -- start 2024-04-25T19:23:02.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.634+0000 7f5fc0c00640 1 -- start start 2024-04-25T19:23:02.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.636+0000 7f5fc0c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fbc070370 0x7f5fbc0af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:02.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.636+0000 7f5fc0c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5fbc0cfb20 0x7f5fbc1f6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:02.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.636+0000 7f5fc0c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fbc1443c0 0x7f5fbc1f6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:02.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.636+0000 7f5fc0c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc15edf0 con 0x7f5fbc070370 2024-04-25T19:23:02.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.636+0000 7f5fc0c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc15eb10 con 0x7f5fbc1443c0 2024-04-25T19:23:02.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.636+0000 7f5fc0c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5fbc06d5d0 con 0x7f5fbc0cfb20 2024-04-25T19:23:02.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.636+0000 7f5fb9e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fbc070370 0x7f5fbc0af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:02.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.636+0000 7f5fb9e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fbc070370 0x7f5fbc0af050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38432/0 (socket says 172.21.15.131:38432) 2024-04-25T19:23:02.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.636+0000 7f5fb9e00640 1 -- 172.21.15.131:0/2014904768 learned_addr learned my addr 172.21.15.131:0/2014904768 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:02.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.637+0000 7f5fb9400640 1 --2- 172.21.15.131:0/2014904768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5fbc0cfb20 0x7f5fbc1f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:02.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.637+0000 7f5fb9e00640 1 -- 172.21.15.131:0/2014904768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5fbc0cfb20 msgr2=0x7f5fbc1f6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:02.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.637+0000 7f5fba800640 1 --2- 172.21.15.131:0/2014904768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fbc1443c0 0x7f5fbc1f6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:02.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.637+0000 7f5fb9e00640 1 --2- 172.21.15.131:0/2014904768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5fbc0cfb20 0x7f5fbc1f6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:02.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.637+0000 7f5fb9e00640 1 -- 172.21.15.131:0/2014904768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fbc1443c0 msgr2=0x7f5fbc1f6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:02.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.637+0000 7f5fb9e00640 1 --2- 172.21.15.131:0/2014904768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fbc1443c0 0x7f5fbc1f6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:02.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.637+0000 7f5fb9e00640 1 -- 172.21.15.131:0/2014904768 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fbc0af8f0 con 0x7f5fbc070370 2024-04-25T19:23:02.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.637+0000 7f5fba800640 1 --2- 172.21.15.131:0/2014904768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fbc1443c0 0x7f5fbc1f6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:02.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.637+0000 7f5fb9e00640 1 --2- 172.21.15.131:0/2014904768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fbc070370 0x7f5fbc0af050 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5fac02a2b0 tx=0x7f5fac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:02.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.637+0000 7f5fb2000640 1 -- 172.21.15.131:0/2014904768 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac041020 con 0x7f5fbc070370 2024-04-25T19:23:02.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.637+0000 7f5fb2000640 1 -- 172.21.15.131:0/2014904768 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fac0306c0 con 0x7f5fbc070370 2024-04-25T19:23:02.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.637+0000 7f5fb2000640 1 -- 172.21.15.131:0/2014904768 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac037040 con 0x7f5fbc070370 2024-04-25T19:23:02.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.637+0000 7f5fc0c00640 1 -- 172.21.15.131:0/2014904768 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fbc0afbd0 con 0x7f5fbc070370 2024-04-25T19:23:02.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.638+0000 7f5fc0c00640 1 -- 172.21.15.131:0/2014904768 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fbc14b940 con 0x7f5fbc070370 2024-04-25T19:23:02.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.639+0000 7f5fc0c00640 1 -- 172.21.15.131:0/2014904768 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fbc050740 con 0x7f5fbc070370 2024-04-25T19:23:02.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.640+0000 7f5fb2000640 1 -- 172.21.15.131:0/2014904768 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5fac044020 con 0x7f5fbc070370 2024-04-25T19:23:02.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.641+0000 7f5fb2000640 1 --2- 172.21.15.131:0/2014904768 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f5f9c0744e0 0x7f5f9c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:02.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.642+0000 7f5fb2000640 1 -- 172.21.15.131:0/2014904768 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f5fac0b5be0 con 0x7f5fbc070370 2024-04-25T19:23:02.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.642+0000 7f5fb9400640 1 --2- 172.21.15.131:0/2014904768 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f5f9c0744e0 0x7f5f9c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:02.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.643+0000 7f5fb9400640 1 --2- 172.21.15.131:0/2014904768 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f5f9c0744e0 0x7f5f9c0769f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8006fd0 tx=0x7f5fa8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:02.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.647+0000 7f5fb2000640 1 -- 172.21.15.131:0/2014904768 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5fac04b030 con 0x7f5fbc070370 2024-04-25T19:23:02.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:02.914+0000 7f5fc0c00640 1 -- 172.21.15.131:0/2014904768 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_dump_tree.TestDumpTree.test_basic"]} v 0) -- 0x7f5fbc13efe0 con 0x7f5fbc070370 2024-04-25T19:23:03.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.405+0000 7f5fb2000640 1 -- 172.21.15.131:0/2014904768 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_dump_tree.TestDumpTree.test_basic"]}]=0 v66) ==== 133+0+0 (secure 0 0 0) 0x7f5fac080250 con 0x7f5fbc070370 2024-04-25T19:23:03.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.409+0000 7f5fc0c00640 1 -- 172.21.15.131:0/2014904768 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f5f9c0744e0 msgr2=0x7f5f9c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:03.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.409+0000 7f5fc0c00640 1 --2- 172.21.15.131:0/2014904768 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f5f9c0744e0 0x7f5f9c0769f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8006fd0 tx=0x7f5fa8008040 comp rx=0 tx=0).stop 2024-04-25T19:23:03.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.409+0000 7f5fc0c00640 1 -- 172.21.15.131:0/2014904768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fbc070370 msgr2=0x7f5fbc0af050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:03.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.409+0000 7f5fc0c00640 1 --2- 172.21.15.131:0/2014904768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fbc070370 0x7f5fbc0af050 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5fac02a2b0 tx=0x7f5fac0046c0 comp rx=0 tx=0).stop 2024-04-25T19:23:03.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.409+0000 7f5fc0c00640 1 -- 172.21.15.131:0/2014904768 shutdown_connections 2024-04-25T19:23:03.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.409+0000 7f5fc0c00640 1 --2- 172.21.15.131:0/2014904768 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f5f9c0744e0 0x7f5f9c0769f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:03.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.409+0000 7f5fc0c00640 1 --2- 172.21.15.131:0/2014904768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5fbc0cfb20 0x7f5fbc1f6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:03.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.410+0000 7f5fc0c00640 1 --2- 172.21.15.131:0/2014904768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fbc1443c0 0x7f5fbc1f6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:03.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.410+0000 7f5fc0c00640 1 --2- 172.21.15.131:0/2014904768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fbc070370 0x7f5fbc0af050 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:03.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.410+0000 7f5fc0c00640 1 -- 172.21.15.131:0/2014904768 >> 172.21.15.131:0/2014904768 conn(0x7f5fbc0d1ae0 msgr2=0x7f5fbc15fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:03.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.410+0000 7f5fc0c00640 1 -- 172.21.15.131:0/2014904768 shutdown_connections 2024-04-25T19:23:03.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.410+0000 7f5fc0c00640 1 -- 172.21.15.131:0/2014904768 wait complete. 2024-04-25T19:23:03.446 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T19:23:03.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.723+0000 7fc6aec00640 1 Processor -- start 2024-04-25T19:23:03.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.723+0000 7fc6aec00640 1 -- start start 2024-04-25T19:23:03.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.725+0000 7fc6aec00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc6a8160440 0x7fc6a806db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:03.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.725+0000 7fc6aec00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6a806e0a0 0x7fc6a80b9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:03.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.725+0000 7fc6aec00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6a806e4b0 con 0x7fc6a80d56c0 2024-04-25T19:23:03.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.725+0000 7fc6aec00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fc6a80d43f0 con 0x7fc6a8160440 2024-04-25T19:23:03.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.725+0000 7fc6aec00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc6a80b53c0 con 0x7fc6a806e0a0 2024-04-25T19:23:03.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.725+0000 7fc6ace00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc6a8160440 0x7fc6a806db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:03.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.725+0000 7fc6ad800640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fc6a80d56c0 0x7fc6a80b4cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.131:58176/0 (socket says 172.21.15.131:58176) 2024-04-25T19:23:03.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.725+0000 7fc6ad800640 1 -- 172.21.15.131:0/4086188979 learned_addr learned my addr 172.21.15.131:0/4086188979 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:03.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.725+0000 7fc6ae200640 1 --2- 172.21.15.131:0/4086188979 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6a806e0a0 0x7fc6a80b9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:03.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.726+0000 7fc6ace00640 1 -- 172.21.15.131:0/4086188979 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6a806e0a0 msgr2=0x7fc6a80b9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:03.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.726+0000 7fc6ace00640 1 --2- 172.21.15.131:0/4086188979 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6a806e0a0 0x7fc6a80b9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:03.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.726+0000 7fc6ace00640 1 -- 172.21.15.131:0/4086188979 >> v1:172.21.15.195:6789/0 conn(0x7fc6a80d56c0 legacy=0x7fc6a80b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:03.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.726+0000 7fc6ace00640 1 -- 172.21.15.131:0/4086188979 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a80d37e0 con 0x7fc6a8160440 2024-04-25T19:23:03.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.727+0000 7fc6ace00640 1 --2- 172.21.15.131:0/4086188979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6a8160440 0x7fc6a806db60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc6980097a0 tx=0x7fc69802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7271371603ebebfe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:03.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.728+0000 7fc6a7e00640 1 -- 172.21.15.131:0/4086188979 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc698037070 con 0x7fc6a8160440 2024-04-25T19:23:03.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.728+0000 7fc6a7e00640 1 -- 172.21.15.131:0/4086188979 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc698032440 con 0x7fc6a8160440 2024-04-25T19:23:03.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.728+0000 7fc6a7e00640 1 -- 172.21.15.131:0/4086188979 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc698032810 con 0x7fc6a8160440 2024-04-25T19:23:03.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.728+0000 7fc6aec00640 1 -- 172.21.15.131:0/4086188979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6a8160440 msgr2=0x7fc6a806db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:03.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.728+0000 7fc6aec00640 1 --2- 172.21.15.131:0/4086188979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6a8160440 0x7fc6a806db60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc6980097a0 tx=0x7fc69802a180 comp rx=0 tx=0).stop 2024-04-25T19:23:03.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.729+0000 7fc6aec00640 1 -- 172.21.15.131:0/4086188979 shutdown_connections 2024-04-25T19:23:03.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.729+0000 7fc6aec00640 1 --2- 172.21.15.131:0/4086188979 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6a806e0a0 0x7fc6a80b9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:03.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.729+0000 7fc6aec00640 1 --2- 172.21.15.131:0/4086188979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6a8160440 0x7fc6a806db60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:03.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.729+0000 7fc6aec00640 1 -- 172.21.15.131:0/4086188979 >> 172.21.15.131:0/4086188979 conn(0x7fc6a80d2c20 msgr2=0x7fc6a80d5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:03.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.729+0000 7fc6aec00640 1 -- 172.21.15.131:0/4086188979 shutdown_connections 2024-04-25T19:23:03.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.729+0000 7fc6aec00640 1 -- 172.21.15.131:0/4086188979 wait complete. 2024-04-25T19:23:03.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.731+0000 7fc6aec00640 1 Processor -- start 2024-04-25T19:23:03.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.731+0000 7fc6aec00640 1 -- start start 2024-04-25T19:23:03.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.733+0000 7fc6aec00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6a806e0a0 0x7fc6a81fa320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:03.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.733+0000 7fc6aec00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6a8160440 0x7fc6a81f63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:03.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.733+0000 7fc6aec00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6a80cf140 0x7fc6a8151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:03.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.733+0000 7fc6aec00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a80d4080 con 0x7fc6a8160440 2024-04-25T19:23:03.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.733+0000 7fc6aec00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a80d3da0 con 0x7fc6a806e0a0 2024-04-25T19:23:03.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.733+0000 7fc6aec00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc6a80d4880 con 0x7fc6a80cf140 2024-04-25T19:23:03.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.733+0000 7fc6ace00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6a8160440 0x7fc6a81f63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:03.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.733+0000 7fc6ace00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6a8160440 0x7fc6a81f63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38442/0 (socket says 172.21.15.131:38442) 2024-04-25T19:23:03.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.733+0000 7fc6ace00640 1 -- 172.21.15.131:0/3683858561 learned_addr learned my addr 172.21.15.131:0/3683858561 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:03.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.733+0000 7fc6ae200640 1 --2- 172.21.15.131:0/3683858561 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6a80cf140 0x7fc6a8151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:03.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.733+0000 7fc6ad800640 1 --2- 172.21.15.131:0/3683858561 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6a806e0a0 0x7fc6a81fa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:03.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.733+0000 7fc6ace00640 1 -- 172.21.15.131:0/3683858561 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6a80cf140 msgr2=0x7fc6a8151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:03.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.733+0000 7fc6ace00640 1 --2- 172.21.15.131:0/3683858561 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6a80cf140 0x7fc6a8151ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:03.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.733+0000 7fc6ace00640 1 -- 172.21.15.131:0/3683858561 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6a806e0a0 msgr2=0x7fc6a81fa320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:03.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.733+0000 7fc6ace00640 1 --2- 172.21.15.131:0/3683858561 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6a806e0a0 0x7fc6a81fa320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:03.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.733+0000 7fc6ace00640 1 -- 172.21.15.131:0/3683858561 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a81fa860 con 0x7fc6a8160440 2024-04-25T19:23:03.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.733+0000 7fc6ad800640 1 --2- 172.21.15.131:0/3683858561 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6a806e0a0 0x7fc6a81fa320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:03.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.734+0000 7fc6ace00640 1 --2- 172.21.15.131:0/3683858561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6a8160440 0x7fc6a81f63b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc698000c00 tx=0x7fc6980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:03.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.734+0000 7fc6a5600640 1 -- 172.21.15.131:0/3683858561 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc698037040 con 0x7fc6a8160440 2024-04-25T19:23:03.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.734+0000 7fc6a5600640 1 -- 172.21.15.131:0/3683858561 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc698042070 con 0x7fc6a8160440 2024-04-25T19:23:03.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.734+0000 7fc6aec00640 1 -- 172.21.15.131:0/3683858561 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6a81f68f0 con 0x7fc6a8160440 2024-04-25T19:23:03.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.734+0000 7fc6a5600640 1 -- 172.21.15.131:0/3683858561 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc698030920 con 0x7fc6a8160440 2024-04-25T19:23:03.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.734+0000 7fc6aec00640 1 -- 172.21.15.131:0/3683858561 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6a81f7050 con 0x7fc6a8160440 2024-04-25T19:23:03.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.736+0000 7fc6aec00640 1 -- 172.21.15.131:0/3683858561 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6a81f7290 con 0x7fc6a8160440 2024-04-25T19:23:03.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.737+0000 7fc6a5600640 1 -- 172.21.15.131:0/3683858561 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc698030ac0 con 0x7fc6a8160440 2024-04-25T19:23:03.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.738+0000 7fc6a5600640 1 --2- 172.21.15.131:0/3683858561 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc68c0744e0 0x7fc68c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:03.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.738+0000 7fc6a5600640 1 -- 172.21.15.131:0/3683858561 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fc6980b5ac0 con 0x7fc6a8160440 2024-04-25T19:23:03.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.739+0000 7fc6ad800640 1 --2- 172.21.15.131:0/3683858561 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc68c0744e0 0x7fc68c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:03.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.740+0000 7fc6ad800640 1 --2- 172.21.15.131:0/3683858561 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc68c0744e0 0x7fc68c0769f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc69c005880 tx=0x7fc69c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:03.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.742+0000 7fc6a5600640 1 -- 172.21.15.131:0/3683858561 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc6a81f7290 con 0x7fc6a8160440 2024-04-25T19:23:03.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.927+0000 7fc6aec00640 1 -- 172.21.15.131:0/3683858561 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fc6a80cfd50 con 0x7fc6a8160440 2024-04-25T19:23:03.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.934+0000 7fc6a5600640 1 -- 172.21.15.131:0/3683858561 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fc6a80cfd50 con 0x7fc6a8160440 2024-04-25T19:23:03.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.937+0000 7fc6aec00640 1 -- 172.21.15.131:0/3683858561 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc68c0744e0 msgr2=0x7fc68c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:03.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.937+0000 7fc6aec00640 1 --2- 172.21.15.131:0/3683858561 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc68c0744e0 0x7fc68c0769f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc69c005880 tx=0x7fc69c009040 comp rx=0 tx=0).stop 2024-04-25T19:23:03.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.937+0000 7fc6aec00640 1 -- 172.21.15.131:0/3683858561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6a8160440 msgr2=0x7fc6a81f63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:03.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.937+0000 7fc6aec00640 1 --2- 172.21.15.131:0/3683858561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6a8160440 0x7fc6a81f63b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc698000c00 tx=0x7fc6980046c0 comp rx=0 tx=0).stop 2024-04-25T19:23:03.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.937+0000 7fc6aec00640 1 -- 172.21.15.131:0/3683858561 shutdown_connections 2024-04-25T19:23:03.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.937+0000 7fc6aec00640 1 --2- 172.21.15.131:0/3683858561 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc68c0744e0 0x7fc68c0769f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:03.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.937+0000 7fc6aec00640 1 --2- 172.21.15.131:0/3683858561 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6a80cf140 0x7fc6a8151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:03.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.937+0000 7fc6aec00640 1 --2- 172.21.15.131:0/3683858561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6a8160440 0x7fc6a81f63b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:03.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.937+0000 7fc6aec00640 1 --2- 172.21.15.131:0/3683858561 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6a806e0a0 0x7fc6a81fa320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:03.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.937+0000 7fc6aec00640 1 -- 172.21.15.131:0/3683858561 >> 172.21.15.131:0/3683858561 conn(0x7fc6a80d2c20 msgr2=0x7fc6a80b9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:03.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.937+0000 7fc6aec00640 1 -- 172.21.15.131:0/3683858561 shutdown_connections 2024-04-25T19:23:03.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:03.937+0000 7fc6aec00640 1 -- 172.21.15.131:0/3683858561 wait complete. 2024-04-25T19:23:03.965 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T19:23:03.966 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T19:23:04.072 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T19:23:04.187 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T19:23:04.187 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:23:04.187 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:23:04.244 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:23:04.245 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:23:04.299 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:23:04.299 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:23:04.396 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:23:04.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.670+0000 7ff45fe00640 1 Processor -- start 2024-04-25T19:23:04.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.670+0000 7ff45fe00640 1 -- start start 2024-04-25T19:23:04.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.672+0000 7ff45fe00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff46006c5c0 0x7ff4600cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:04.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.672+0000 7ff45fe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff4600b4ea0 0x7ff46015e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:04.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.672+0000 7ff45fe00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4600d1230 con 0x7ff460144370 2024-04-25T19:23:04.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.672+0000 7ff45fe00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ff4600d06b0 con 0x7ff4600b4ea0 2024-04-25T19:23:04.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.672+0000 7ff45fe00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7ff4600d0990 con 0x7ff46006c5c0 2024-04-25T19:23:04.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.673+0000 7ff45f400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff4600b4ea0 0x7ff46015e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:04.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.673+0000 7ff45f400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff4600b4ea0 0x7ff46015e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38450/0 (socket says 172.21.15.131:38450) 2024-04-25T19:23:04.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.673+0000 7ff45f400640 1 -- 172.21.15.131:0/4294016594 learned_addr learned my addr 172.21.15.131:0/4294016594 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:04.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.673+0000 7ff45ea00640 1 --2- 172.21.15.131:0/4294016594 >> v2:172.21.15.195:3300/0 conn(0x7ff46006c5c0 0x7ff4600cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:04.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.673+0000 7ff45f400640 1 -- 172.21.15.131:0/4294016594 >> v2:172.21.15.195:3300/0 conn(0x7ff46006c5c0 msgr2=0x7ff4600cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:04.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.673+0000 7ff45f400640 1 --2- 172.21.15.131:0/4294016594 >> v2:172.21.15.195:3300/0 conn(0x7ff46006c5c0 0x7ff4600cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:04.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.673+0000 7ff45f400640 1 -- 172.21.15.131:0/4294016594 >> v1:172.21.15.131:6789/0 conn(0x7ff460144370 legacy=0x7ff4600b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:04.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.673+0000 7ff45f400640 1 -- 172.21.15.131:0/4294016594 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4600d0c70 con 0x7ff4600b4ea0 2024-04-25T19:23:04.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.673+0000 7ff45e000640 1 -- 172.21.15.131:0/4294016594 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3594920291 0 0) 0x7ff4600d1230 con 0x7ff460144370 2024-04-25T19:23:04.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.674+0000 7ff45f400640 1 --2- 172.21.15.131:0/4294016594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4600b4ea0 0x7ff46015e770 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff4600726b0 tx=0x7ff45802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf26a418a7275d8e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:04.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.675+0000 7ff45e000640 1 -- 172.21.15.131:0/4294016594 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458037070 con 0x7ff4600b4ea0 2024-04-25T19:23:04.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.675+0000 7ff45e000640 1 -- 172.21.15.131:0/4294016594 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff458032440 con 0x7ff4600b4ea0 2024-04-25T19:23:04.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.675+0000 7ff45e000640 1 -- 172.21.15.131:0/4294016594 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458032810 con 0x7ff4600b4ea0 2024-04-25T19:23:04.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.675+0000 7ff45fe00640 1 -- 172.21.15.131:0/4294016594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4600b4ea0 msgr2=0x7ff46015e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:04.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.675+0000 7ff45fe00640 1 --2- 172.21.15.131:0/4294016594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4600b4ea0 0x7ff46015e770 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff4600726b0 tx=0x7ff45802a270 comp rx=0 tx=0).stop 2024-04-25T19:23:04.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.676+0000 7ff45fe00640 1 -- 172.21.15.131:0/4294016594 shutdown_connections 2024-04-25T19:23:04.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.676+0000 7ff45fe00640 1 --2- 172.21.15.131:0/4294016594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4600b4ea0 0x7ff46015e770 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:04.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.676+0000 7ff45fe00640 1 --2- 172.21.15.131:0/4294016594 >> v2:172.21.15.195:3300/0 conn(0x7ff46006c5c0 0x7ff4600cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:04.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.676+0000 7ff45fe00640 1 -- 172.21.15.131:0/4294016594 >> 172.21.15.131:0/4294016594 conn(0x7ff4600d1720 msgr2=0x7ff4600d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:04.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.676+0000 7ff45fe00640 1 -- 172.21.15.131:0/4294016594 shutdown_connections 2024-04-25T19:23:04.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.676+0000 7ff45fe00640 1 -- 172.21.15.131:0/4294016594 wait complete. 2024-04-25T19:23:04.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.679+0000 7ff45fe00640 1 Processor -- start 2024-04-25T19:23:04.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.679+0000 7ff45fe00640 1 -- start start 2024-04-25T19:23:04.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.681+0000 7ff45fe00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff46006c5c0 0x7ff46013f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:04.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.681+0000 7ff45fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff460144370 0x7ff46015d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:04.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.681+0000 7ff45fe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff46013f9c0 0x7ff46015d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:04.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.681+0000 7ff45fe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff4600d0450 con 0x7ff460144370 2024-04-25T19:23:04.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.681+0000 7ff45fe00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff4600d02d0 con 0x7ff46006c5c0 2024-04-25T19:23:04.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.681+0000 7ff45fe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff460147760 con 0x7ff46013f9c0 2024-04-25T19:23:04.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.681+0000 7ff456000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff460144370 0x7ff46015d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:04.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.681+0000 7ff456000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff460144370 0x7ff46015d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38454/0 (socket says 172.21.15.131:38454) 2024-04-25T19:23:04.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.681+0000 7ff456000640 1 -- 172.21.15.131:0/702125461 learned_addr learned my addr 172.21.15.131:0/702125461 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:04.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.681+0000 7ff456000640 1 -- 172.21.15.131:0/702125461 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff46013f9c0 msgr2=0x7ff46015d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:04.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.681+0000 7ff456000640 1 --2- 172.21.15.131:0/702125461 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff46013f9c0 0x7ff46015d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:04.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.681+0000 7ff456000640 1 -- 172.21.15.131:0/702125461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff46006c5c0 msgr2=0x7ff46013f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:04.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.681+0000 7ff456000640 1 --2- 172.21.15.131:0/702125461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff46006c5c0 0x7ff46013f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:04.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.681+0000 7ff456000640 1 -- 172.21.15.131:0/702125461 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4600b2fd0 con 0x7ff460144370 2024-04-25T19:23:04.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.682+0000 7ff456000640 1 --2- 172.21.15.131:0/702125461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff460144370 0x7ff46015d230 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff44800c820 tx=0x7ff44800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:04.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.682+0000 7ff457400640 1 -- 172.21.15.131:0/702125461 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff448017070 con 0x7ff460144370 2024-04-25T19:23:04.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.682+0000 7ff457400640 1 -- 172.21.15.131:0/702125461 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff448003da0 con 0x7ff460144370 2024-04-25T19:23:04.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.682+0000 7ff457400640 1 -- 172.21.15.131:0/702125461 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff448005290 con 0x7ff460144370 2024-04-25T19:23:04.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.682+0000 7ff45fe00640 1 -- 172.21.15.131:0/702125461 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff46006f3d0 con 0x7ff460144370 2024-04-25T19:23:04.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.682+0000 7ff45fe00640 1 -- 172.21.15.131:0/702125461 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff46006f990 con 0x7ff460144370 2024-04-25T19:23:04.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.684+0000 7ff45fe00640 1 -- 172.21.15.131:0/702125461 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff460050740 con 0x7ff460144370 2024-04-25T19:23:04.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.685+0000 7ff457400640 1 -- 172.21.15.131:0/702125461 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff44801a070 con 0x7ff460144370 2024-04-25T19:23:04.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.686+0000 7ff457400640 1 --2- 172.21.15.131:0/702125461 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff43c0744b0 0x7ff43c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:04.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.686+0000 7ff457400640 1 -- 172.21.15.131:0/702125461 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7ff4480949e0 con 0x7ff460144370 2024-04-25T19:23:04.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.686+0000 7ff45ea00640 1 --2- 172.21.15.131:0/702125461 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff43c0744b0 0x7ff43c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:04.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.688+0000 7ff45ea00640 1 --2- 172.21.15.131:0/702125461 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff43c0744b0 0x7ff43c0769c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff450006fd0 tx=0x7ff450008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:04.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.691+0000 7ff457400640 1 -- 172.21.15.131:0/702125461 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff44805f050 con 0x7ff460144370 2024-04-25T19:23:04.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.890+0000 7ff45fe00640 1 -- 172.21.15.131:0/702125461 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff4600b6540 con 0x7ff460144370 2024-04-25T19:23:04.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.893+0000 7ff457400640 1 -- 172.21.15.131:0/702125461 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16878 (secure 0 0 0) 0x7ff4480670d0 con 0x7ff460144370 2024-04-25T19:23:04.894 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:04.894 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":22,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:22:57.347297+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:22:14.779716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T19:22:15.552027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:23:04.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.896+0000 7ff45fe00640 1 -- 172.21.15.131:0/702125461 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff43c0744b0 msgr2=0x7ff43c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:04.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.896+0000 7ff45fe00640 1 --2- 172.21.15.131:0/702125461 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff43c0744b0 0x7ff43c0769c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff450006fd0 tx=0x7ff450008040 comp rx=0 tx=0).stop 2024-04-25T19:23:04.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.896+0000 7ff45fe00640 1 -- 172.21.15.131:0/702125461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff460144370 msgr2=0x7ff46015d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:04.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.896+0000 7ff45fe00640 1 --2- 172.21.15.131:0/702125461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff460144370 0x7ff46015d230 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff44800c820 tx=0x7ff44800cce0 comp rx=0 tx=0).stop 2024-04-25T19:23:04.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.896+0000 7ff45fe00640 1 -- 172.21.15.131:0/702125461 shutdown_connections 2024-04-25T19:23:04.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.896+0000 7ff45fe00640 1 --2- 172.21.15.131:0/702125461 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff43c0744b0 0x7ff43c0769c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:04.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.896+0000 7ff45fe00640 1 --2- 172.21.15.131:0/702125461 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff46013f9c0 0x7ff46015d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:04.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.896+0000 7ff45fe00640 1 --2- 172.21.15.131:0/702125461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff460144370 0x7ff46015d230 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:04.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.896+0000 7ff45fe00640 1 --2- 172.21.15.131:0/702125461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff46006c5c0 0x7ff46013f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:04.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.896+0000 7ff45fe00640 1 -- 172.21.15.131:0/702125461 >> 172.21.15.131:0/702125461 conn(0x7ff4600d1720 msgr2=0x7ff4600b4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:04.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.896+0000 7ff45fe00640 1 -- 172.21.15.131:0/702125461 shutdown_connections 2024-04-25T19:23:04.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:04.896+0000 7ff45fe00640 1 -- 172.21.15.131:0/702125461 wait complete. 2024-04-25T19:23:04.923 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T19:22:04.178847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T19:22:14.779716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T19:22:15.552027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T19:23:04.923 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T19:23:05.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.202+0000 7f62fce00640 1 Processor -- start 2024-04-25T19:23:05.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.202+0000 7f62fce00640 1 -- start start 2024-04-25T19:23:05.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.204+0000 7f62fce00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f62f8158850 0x7f62f8070820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:05.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.204+0000 7f62fce00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62f806d5d0 0x7f62f806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:05.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.205+0000 7f62fce00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62f806df20 con 0x7f62f815e780 2024-04-25T19:23:05.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.205+0000 7f62fce00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f62f8158c60 con 0x7f62f8158850 2024-04-25T19:23:05.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.205+0000 7f62fce00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f62f815ef90 con 0x7f62f806d5d0 2024-04-25T19:23:05.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.205+0000 7f62f5e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f62f8158850 0x7f62f8070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:05.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.205+0000 7f62f5e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f62f8158850 0x7f62f8070820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38470/0 (socket says 172.21.15.131:38470) 2024-04-25T19:23:05.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.205+0000 7f62f5e00640 1 -- 172.21.15.131:0/1675526101 learned_addr learned my addr 172.21.15.131:0/1675526101 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:05.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.205+0000 7f62f5e00640 1 -- 172.21.15.131:0/1675526101 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62f806d5d0 msgr2=0x7f62f806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:05.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.205+0000 7f62f5e00640 1 --2- 172.21.15.131:0/1675526101 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62f806d5d0 0x7f62f806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:05.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.205+0000 7f62f5e00640 1 -- 172.21.15.131:0/1675526101 >> v1:172.21.15.195:6789/0 conn(0x7f62f815e780 legacy=0x7f62f815f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:05.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.205+0000 7f62f5e00640 1 -- 172.21.15.131:0/1675526101 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f815f270 con 0x7f62f8158850 2024-04-25T19:23:05.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.206+0000 7f62f5e00640 1 --2- 172.21.15.131:0/1675526101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62f8158850 0x7f62f8070820 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009870 tx=0x7f62e802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c8d43764a88840 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:05.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.207+0000 7f62f5400640 1 -- 172.21.15.131:0/1675526101 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e8037070 con 0x7f62f8158850 2024-04-25T19:23:05.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.207+0000 7f62f5400640 1 -- 172.21.15.131:0/1675526101 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e8032440 con 0x7f62f8158850 2024-04-25T19:23:05.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.207+0000 7f62f5400640 1 -- 172.21.15.131:0/1675526101 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e8032810 con 0x7f62f8158850 2024-04-25T19:23:05.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.208+0000 7f62fce00640 1 -- 172.21.15.131:0/1675526101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62f8158850 msgr2=0x7f62f8070820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:05.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.208+0000 7f62fce00640 1 --2- 172.21.15.131:0/1675526101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62f8158850 0x7f62f8070820 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009870 tx=0x7f62e802a230 comp rx=0 tx=0).stop 2024-04-25T19:23:05.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.208+0000 7f62fce00640 1 -- 172.21.15.131:0/1675526101 shutdown_connections 2024-04-25T19:23:05.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.208+0000 7f62fce00640 1 --2- 172.21.15.131:0/1675526101 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62f806d5d0 0x7f62f806d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:05.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.208+0000 7f62fce00640 1 --2- 172.21.15.131:0/1675526101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62f8158850 0x7f62f8070820 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:05.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.208+0000 7f62fce00640 1 -- 172.21.15.131:0/1675526101 >> 172.21.15.131:0/1675526101 conn(0x7f62f80730b0 msgr2=0x7f62f80734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:05.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.208+0000 7f62fce00640 1 -- 172.21.15.131:0/1675526101 shutdown_connections 2024-04-25T19:23:05.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.208+0000 7f62fce00640 1 -- 172.21.15.131:0/1675526101 wait complete. 2024-04-25T19:23:05.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.211+0000 7f62fce00640 1 Processor -- start 2024-04-25T19:23:05.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.211+0000 7f62fce00640 1 -- start start 2024-04-25T19:23:05.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.213+0000 7f62fce00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62f806d5d0 0x7f62f81e7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:05.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.213+0000 7f62fce00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62f8158850 0x7f62f815b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:05.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.213+0000 7f62fce00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62f815e780 0x7f62f8148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:05.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.213+0000 7f62fce00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f62f8160010 con 0x7f62f8158850 2024-04-25T19:23:05.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.213+0000 7f62fce00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f62f806f040 con 0x7f62f815e780 2024-04-25T19:23:05.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.213+0000 7f62fce00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f62f815eb90 con 0x7f62f806d5d0 2024-04-25T19:23:05.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.213+0000 7f62efe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62f8158850 0x7f62f815b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:05.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.213+0000 7f62efe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62f8158850 0x7f62f815b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38472/0 (socket says 172.21.15.131:38472) 2024-04-25T19:23:05.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.213+0000 7f62efe00640 1 -- 172.21.15.131:0/1795810793 learned_addr learned my addr 172.21.15.131:0/1795810793 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:05.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.214+0000 7f62f5e00640 1 --2- 172.21.15.131:0/1795810793 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62f806d5d0 0x7f62f81e7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:05.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.214+0000 7f62f6800640 1 --2- 172.21.15.131:0/1795810793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62f815e780 0x7f62f8148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:05.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.214+0000 7f62efe00640 1 -- 172.21.15.131:0/1795810793 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62f806d5d0 msgr2=0x7f62f81e7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:05.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.214+0000 7f62efe00640 1 --2- 172.21.15.131:0/1795810793 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62f806d5d0 0x7f62f81e7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:05.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.214+0000 7f62efe00640 1 -- 172.21.15.131:0/1795810793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62f815e780 msgr2=0x7f62f8148ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:05.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.214+0000 7f62efe00640 1 --2- 172.21.15.131:0/1795810793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62f815e780 0x7f62f8148ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:05.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.214+0000 7f62efe00640 1 -- 172.21.15.131:0/1795810793 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f81e80b0 con 0x7f62f8158850 2024-04-25T19:23:05.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.214+0000 7f62f6800640 1 --2- 172.21.15.131:0/1795810793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62f815e780 0x7f62f8148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:05.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.214+0000 7f62efe00640 1 --2- 172.21.15.131:0/1795810793 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62f8158850 0x7f62f815b6f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f62e000b420 tx=0x7f62e000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:05.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.215+0000 7f62ee000640 1 -- 172.21.15.131:0/1795810793 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e0011830 con 0x7f62f8158850 2024-04-25T19:23:05.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.215+0000 7f62ee000640 1 -- 172.21.15.131:0/1795810793 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e0016070 con 0x7f62f8158850 2024-04-25T19:23:05.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.215+0000 7f62fce00640 1 -- 172.21.15.131:0/1795810793 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f80af3c0 con 0x7f62f8158850 2024-04-25T19:23:05.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.215+0000 7f62ee000640 1 -- 172.21.15.131:0/1795810793 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e0011c10 con 0x7f62f8158850 2024-04-25T19:23:05.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.215+0000 7f62fce00640 1 -- 172.21.15.131:0/1795810793 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f80af980 con 0x7f62f8158850 2024-04-25T19:23:05.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.216+0000 7f62fce00640 1 -- 172.21.15.131:0/1795810793 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62f80761c0 con 0x7f62f8158850 2024-04-25T19:23:05.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.217+0000 7f62ee000640 1 -- 172.21.15.131:0/1795810793 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f62e001b460 con 0x7f62f8158850 2024-04-25T19:23:05.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.218+0000 7f62ee000640 1 --2- 172.21.15.131:0/1795810793 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f62d40744b0 0x7f62d40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:05.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.219+0000 7f62ee000640 1 -- 172.21.15.131:0/1795810793 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f62e0094e10 con 0x7f62f8158850 2024-04-25T19:23:05.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.219+0000 7f62f5e00640 1 --2- 172.21.15.131:0/1795810793 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f62d40744b0 0x7f62d40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:05.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.221+0000 7f62f5e00640 1 --2- 172.21.15.131:0/1795810793 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f62d40744b0 0x7f62d40769c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f62e8034000 tx=0x7f62e802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:05.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.224+0000 7f62ee000640 1 -- 172.21.15.131:0/1795810793 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f62e0098030 con 0x7f62f8158850 2024-04-25T19:23:05.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.428+0000 7f62fce00640 1 -- 172.21.15.131:0/1795810793 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f62f8050740 con 0x7f62f8158850 2024-04-25T19:23:05.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.429+0000 7f62ee000640 1 -- 172.21.15.131:0/1795810793 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f62e0020020 con 0x7f62f8158850 2024-04-25T19:23:05.429 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-25T19:23:05.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.431+0000 7f62fce00640 1 -- 172.21.15.131:0/1795810793 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f62d40744b0 msgr2=0x7f62d40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:05.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.431+0000 7f62fce00640 1 --2- 172.21.15.131:0/1795810793 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f62d40744b0 0x7f62d40769c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f62e8034000 tx=0x7f62e802e000 comp rx=0 tx=0).stop 2024-04-25T19:23:05.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.432+0000 7f62fce00640 1 -- 172.21.15.131:0/1795810793 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62f8158850 msgr2=0x7f62f815b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:05.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.432+0000 7f62fce00640 1 --2- 172.21.15.131:0/1795810793 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62f8158850 0x7f62f815b6f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f62e000b420 tx=0x7f62e000b8e0 comp rx=0 tx=0).stop 2024-04-25T19:23:05.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.432+0000 7f62fce00640 1 -- 172.21.15.131:0/1795810793 shutdown_connections 2024-04-25T19:23:05.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.432+0000 7f62fce00640 1 --2- 172.21.15.131:0/1795810793 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f62d40744b0 0x7f62d40769c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:05.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.432+0000 7f62fce00640 1 --2- 172.21.15.131:0/1795810793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62f815e780 0x7f62f8148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:05.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.432+0000 7f62fce00640 1 --2- 172.21.15.131:0/1795810793 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62f8158850 0x7f62f815b6f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:05.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.432+0000 7f62fce00640 1 --2- 172.21.15.131:0/1795810793 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62f806d5d0 0x7f62f81e7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:05.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.432+0000 7f62fce00640 1 -- 172.21.15.131:0/1795810793 >> 172.21.15.131:0/1795810793 conn(0x7f62f80730b0 msgr2=0x7f62f815c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:05.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.432+0000 7f62fce00640 1 -- 172.21.15.131:0/1795810793 shutdown_connections 2024-04-25T19:23:05.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.432+0000 7f62fce00640 1 -- 172.21.15.131:0/1795810793 wait complete. 2024-04-25T19:23:05.458 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T19:23:05.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.740+0000 7fa244c00640 1 Processor -- start 2024-04-25T19:23:05.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.740+0000 7fa244c00640 1 -- start start 2024-04-25T19:23:05.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.742+0000 7fa244c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2400b9100 0x7fa2400b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:05.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.742+0000 7fa244c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa2400b4a50 0x7fa2400d2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:05.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.742+0000 7fa244c00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2400d1ed0 con 0x7fa2400b55c0 2024-04-25T19:23:05.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.742+0000 7fa244c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa2400b9510 con 0x7fa2400b4a50 2024-04-25T19:23:05.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.742+0000 7fa244c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa2400d1ca0 con 0x7fa2400b9100 2024-04-25T19:23:05.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.743+0000 7fa23fe00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fa2400b55c0 0x7fa2400b59d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38688/0 (socket says 172.21.15.131:38688) 2024-04-25T19:23:05.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.743+0000 7fa23fe00640 1 -- 172.21.15.131:0/1576525339 learned_addr learned my addr 172.21.15.131:0/1576525339 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:05.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.743+0000 7fa23ea00640 1 --2- 172.21.15.131:0/1576525339 >> v2:172.21.15.131:3300/0 conn(0x7fa2400b4a50 0x7fa2400d2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:05.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.743+0000 7fa23f400640 1 --2- 172.21.15.131:0/1576525339 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2400b9100 0x7fa2400b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:05.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.743+0000 7fa23e000640 1 -- 172.21.15.131:0/1576525339 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2973672907 0 0) 0x7fa2400d1ed0 con 0x7fa2400b55c0 2024-04-25T19:23:05.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.743+0000 7fa23e000640 1 -- 172.21.15.131:0/1576525339 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa224003520 con 0x7fa2400b55c0 2024-04-25T19:23:05.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.743+0000 7fa23ea00640 1 -- 172.21.15.131:0/1576525339 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2400b9100 msgr2=0x7fa2400b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:05.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.743+0000 7fa23ea00640 1 --2- 172.21.15.131:0/1576525339 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2400b9100 0x7fa2400b2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:05.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.743+0000 7fa23ea00640 1 -- 172.21.15.131:0/1576525339 >> v1:172.21.15.131:6789/0 conn(0x7fa2400b55c0 legacy=0x7fa2400b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:05.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.743+0000 7fa23ea00640 1 -- 172.21.15.131:0/1576525339 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2400d21b0 con 0x7fa2400b4a50 2024-04-25T19:23:05.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.744+0000 7fa23ea00640 1 --2- 172.21.15.131:0/1576525339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2400b4a50 0x7fa2400d2c90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa22c0097a0 tx=0x7fa22c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9acb052ea282c3a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:05.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.745+0000 7fa23e000640 1 -- 172.21.15.131:0/1576525339 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22c037070 con 0x7fa2400b4a50 2024-04-25T19:23:05.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.745+0000 7fa23e000640 1 -- 172.21.15.131:0/1576525339 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa22c02ae50 con 0x7fa2400b4a50 2024-04-25T19:23:05.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.745+0000 7fa23e000640 1 -- 172.21.15.131:0/1576525339 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22c032640 con 0x7fa2400b4a50 2024-04-25T19:23:05.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.746+0000 7fa244c00640 1 -- 172.21.15.131:0/1576525339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2400b4a50 msgr2=0x7fa2400d2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:05.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.746+0000 7fa244c00640 1 --2- 172.21.15.131:0/1576525339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2400b4a50 0x7fa2400d2c90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa22c0097a0 tx=0x7fa22c02a100 comp rx=0 tx=0).stop 2024-04-25T19:23:05.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.746+0000 7fa244c00640 1 -- 172.21.15.131:0/1576525339 shutdown_connections 2024-04-25T19:23:05.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.746+0000 7fa244c00640 1 --2- 172.21.15.131:0/1576525339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2400b4a50 0x7fa2400d2c90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:05.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.746+0000 7fa244c00640 1 --2- 172.21.15.131:0/1576525339 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2400b9100 0x7fa2400b2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:05.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.746+0000 7fa244c00640 1 -- 172.21.15.131:0/1576525339 >> 172.21.15.131:0/1576525339 conn(0x7fa24008d180 msgr2=0x7fa24008d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:05.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.746+0000 7fa244c00640 1 -- 172.21.15.131:0/1576525339 shutdown_connections 2024-04-25T19:23:05.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.746+0000 7fa244c00640 1 -- 172.21.15.131:0/1576525339 wait complete. 2024-04-25T19:23:05.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.748+0000 7fa244c00640 1 Processor -- start 2024-04-25T19:23:05.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.748+0000 7fa244c00640 1 -- start start 2024-04-25T19:23:05.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.750+0000 7fa244c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2400b4a50 0x7fa2400cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:05.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.750+0000 7fa244c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2400b55c0 0x7fa240155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:05.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.750+0000 7fa244c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2400b9100 0x7fa240160a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.750+0000 7fa244c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa2400d2800 con 0x7fa2400b4a50 2024-04-25T19:23:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.750+0000 7fa244c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa2400b52a0 con 0x7fa2400b55c0 2024-04-25T19:23:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.750+0000 7fa244c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa2400b4e60 con 0x7fa2400b9100 2024-04-25T19:23:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.750+0000 7fa23f400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2400b4a50 0x7fa2400cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.750+0000 7fa23f400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2400b4a50 0x7fa2400cd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38486/0 (socket says 172.21.15.131:38486) 2024-04-25T19:23:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.750+0000 7fa23f400640 1 -- 172.21.15.131:0/311931604 learned_addr learned my addr 172.21.15.131:0/311931604 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.751+0000 7fa23fe00640 1 --2- 172.21.15.131:0/311931604 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2400b9100 0x7fa240160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.751+0000 7fa23ea00640 1 --2- 172.21.15.131:0/311931604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2400b55c0 0x7fa240155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.751+0000 7fa23f400640 1 -- 172.21.15.131:0/311931604 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2400b9100 msgr2=0x7fa240160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.751+0000 7fa23f400640 1 --2- 172.21.15.131:0/311931604 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2400b9100 0x7fa240160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.751+0000 7fa23f400640 1 -- 172.21.15.131:0/311931604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2400b55c0 msgr2=0x7fa240155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.751+0000 7fa23f400640 1 --2- 172.21.15.131:0/311931604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2400b55c0 0x7fa240155230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.751+0000 7fa23f400640 1 -- 172.21.15.131:0/311931604 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2400cda00 con 0x7fa2400b4a50 2024-04-25T19:23:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.751+0000 7fa23f400640 1 --2- 172.21.15.131:0/311931604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2400b4a50 0x7fa2400cd4c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa23000d5d0 tx=0x7fa23000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.751+0000 7fa237400640 1 -- 172.21.15.131:0/311931604 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa230004240 con 0x7fa2400b4a50 2024-04-25T19:23:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.751+0000 7fa237400640 1 -- 172.21.15.131:0/311931604 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2300043e0 con 0x7fa2400b4a50 2024-04-25T19:23:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.751+0000 7fa237400640 1 -- 172.21.15.131:0/311931604 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa230003830 con 0x7fa2400b4a50 2024-04-25T19:23:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.751+0000 7fa244c00640 1 -- 172.21.15.131:0/311931604 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2400cf080 con 0x7fa2400b4a50 2024-04-25T19:23:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.752+0000 7fa244c00640 1 -- 172.21.15.131:0/311931604 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2400cf640 con 0x7fa2400b4a50 2024-04-25T19:23:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.753+0000 7fa244c00640 1 -- 172.21.15.131:0/311931604 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa240076c60 con 0x7fa2400b4a50 2024-04-25T19:23:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.754+0000 7fa237400640 1 -- 172.21.15.131:0/311931604 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa2300039d0 con 0x7fa2400b4a50 2024-04-25T19:23:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.755+0000 7fa237400640 1 --2- 172.21.15.131:0/311931604 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa2200744e0 0x7fa2200769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.755+0000 7fa237400640 1 -- 172.21.15.131:0/311931604 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fa230095510 con 0x7fa2400b4a50 2024-04-25T19:23:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.755+0000 7fa23ea00640 1 --2- 172.21.15.131:0/311931604 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa2200744e0 0x7fa2200769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:05.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.757+0000 7fa23ea00640 1 --2- 172.21.15.131:0/311931604 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa2200744e0 0x7fa2200769f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa22c034000 tx=0x7fa22c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:05.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.760+0000 7fa237400640 1 -- 172.21.15.131:0/311931604 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa23005fca0 con 0x7fa2400b4a50 2024-04-25T19:23:05.913 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:23:05.921 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:23:05.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.958+0000 7fa244c00640 1 -- 172.21.15.131:0/311931604 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa2400d2ed0 con 0x7fa2400b4a50 2024-04-25T19:23:05.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.958+0000 7fa237400640 1 -- 172.21.15.131:0/311931604 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7fa23005f5a0 con 0x7fa2400b4a50 2024-04-25T19:23:05.959 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-25T19:23:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.961+0000 7fa244c00640 1 -- 172.21.15.131:0/311931604 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa2200744e0 msgr2=0x7fa2200769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.961+0000 7fa244c00640 1 --2- 172.21.15.131:0/311931604 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa2200744e0 0x7fa2200769f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa22c034000 tx=0x7fa22c02e000 comp rx=0 tx=0).stop 2024-04-25T19:23:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.961+0000 7fa244c00640 1 -- 172.21.15.131:0/311931604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2400b4a50 msgr2=0x7fa2400cd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.961+0000 7fa244c00640 1 --2- 172.21.15.131:0/311931604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2400b4a50 0x7fa2400cd4c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa23000d5d0 tx=0x7fa23000da90 comp rx=0 tx=0).stop 2024-04-25T19:23:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.961+0000 7fa244c00640 1 -- 172.21.15.131:0/311931604 shutdown_connections 2024-04-25T19:23:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.961+0000 7fa244c00640 1 --2- 172.21.15.131:0/311931604 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa2200744e0 0x7fa2200769f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.961+0000 7fa244c00640 1 --2- 172.21.15.131:0/311931604 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2400b9100 0x7fa240160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.961+0000 7fa244c00640 1 --2- 172.21.15.131:0/311931604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2400b55c0 0x7fa240155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.961+0000 7fa244c00640 1 --2- 172.21.15.131:0/311931604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2400b4a50 0x7fa2400cd4c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.961+0000 7fa244c00640 1 -- 172.21.15.131:0/311931604 >> 172.21.15.131:0/311931604 conn(0x7fa24008d180 msgr2=0x7fa2400b59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.961+0000 7fa244c00640 1 -- 172.21.15.131:0/311931604 shutdown_connections 2024-04-25T19:23:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:05.961+0000 7fa244c00640 1 -- 172.21.15.131:0/311931604 wait complete. 2024-04-25T19:23:05.986 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T19:23:06.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.354+0000 7f8149c00640 1 Processor -- start 2024-04-25T19:23:06.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.354+0000 7f8149c00640 1 -- start start 2024-04-25T19:23:06.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.357+0000 7f8149c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f814415b710 0x7f81440d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:06.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.357+0000 7f8149c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f814415bb20 0x7f814406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:06.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.357+0000 7f8149c00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f814406df20 con 0x7f814406db10 2024-04-25T19:23:06.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.357+0000 7f8149c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f8144169280 con 0x7f814415bb20 2024-04-25T19:23:06.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.357+0000 7f8149c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8144168670 con 0x7f814415b710 2024-04-25T19:23:06.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.357+0000 7f8143400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f814406db10 0x7f8144165100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38700/0 (socket says 172.21.15.131:38700) 2024-04-25T19:23:06.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.357+0000 7f8143400640 1 -- 172.21.15.131:0/1988794372 learned_addr learned my addr 172.21.15.131:0/1988794372 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:06.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.357+0000 7f8142000640 1 --2- 172.21.15.131:0/1988794372 >> v2:172.21.15.195:3300/0 conn(0x7f814415bb20 0x7f814406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:06.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.357+0000 7f8142a00640 1 --2- 172.21.15.131:0/1988794372 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f814415b710 0x7f81440d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:06.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.357+0000 7f8141600640 1 -- 172.21.15.131:0/1988794372 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3802729179 0 0) 0x7f813c001490 con 0x7f814406db10 2024-04-25T19:23:06.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.358+0000 7f8141600640 1 -- 172.21.15.131:0/1988794372 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8128003520 con 0x7f814406db10 2024-04-25T19:23:06.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.358+0000 7f8141600640 1 -- 172.21.15.131:0/1988794372 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1021973740 0 0) 0x7f8128003520 con 0x7f814406db10 2024-04-25T19:23:06.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.358+0000 7f8141600640 1 -- 172.21.15.131:0/1988794372 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f814415b710 msgr2=0x7f81440d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:06.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.358+0000 7f8141600640 1 --2- 172.21.15.131:0/1988794372 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f814415b710 0x7f81440d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:06.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.358+0000 7f8141600640 1 -- 172.21.15.131:0/1988794372 >> v2:172.21.15.195:3300/0 conn(0x7f814415bb20 msgr2=0x7f814406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:06.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.358+0000 7f8141600640 1 --2- 172.21.15.131:0/1988794372 >> v2:172.21.15.195:3300/0 conn(0x7f814415bb20 0x7f814406d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:06.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.358+0000 7f8141600640 1 -- 172.21.15.131:0/1988794372 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8144168950 con 0x7f814406db10 2024-04-25T19:23:06.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.358+0000 7f8141600640 1 -- 172.21.15.131:0/1988794372 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f813c001bc0 con 0x7f814406db10 2024-04-25T19:23:06.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.358+0000 7f8141600640 1 -- 172.21.15.131:0/1988794372 >> v1:172.21.15.131:6789/0 conn(0x7f814406db10 legacy=0x7f8144165100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:06.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.358+0000 7f8141600640 1 --2- 172.21.15.131:0/1988794372 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f814415b710 0x7f81280039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:06.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.358+0000 7f8141600640 1 --2- 172.21.15.131:0/1988794372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8128003f80 0x7f8128004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:06.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.358+0000 7f8141600640 1 --2- 172.21.15.131:0/1988794372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8128004d40 0x7f8128005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:06.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.358+0000 7f8141600640 1 -- 172.21.15.131:0/1988794372 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8144168670 con 0x7f8128004d40 2024-04-25T19:23:06.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.358+0000 7f8141600640 1 -- 172.21.15.131:0/1988794372 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f812800baa0 con 0x7f8128003f80 2024-04-25T19:23:06.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.358+0000 7f8141600640 1 -- 172.21.15.131:0/1988794372 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f812800bca0 con 0x7f814415b710 2024-04-25T19:23:06.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.358+0000 7f8143400640 1 --2- 172.21.15.131:0/1988794372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8128004d40 0x7f8128005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:06.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.359+0000 7f8142a00640 1 --2- 172.21.15.131:0/1988794372 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f814415b710 0x7f81280039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:06.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.359+0000 7f8143400640 1 -- 172.21.15.131:0/1988794372 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f814415b710 msgr2=0x7f81280039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:06.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.359+0000 7f8143400640 1 --2- 172.21.15.131:0/1988794372 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f814415b710 0x7f81280039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:06.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.359+0000 7f8143400640 1 -- 172.21.15.131:0/1988794372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8128003f80 msgr2=0x7f8128004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:06.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.359+0000 7f8142000640 1 --2- 172.21.15.131:0/1988794372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8128003f80 0x7f8128004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:06.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.359+0000 7f8143400640 1 --2- 172.21.15.131:0/1988794372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8128003f80 0x7f8128004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:06.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.359+0000 7f8143400640 1 -- 172.21.15.131:0/1988794372 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8128003520 con 0x7f8128004d40 2024-04-25T19:23:06.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.360+0000 7f8143400640 1 --2- 172.21.15.131:0/1988794372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8128004d40 0x7f8128005150 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f813c00a970 tx=0x7f8128005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b469e27a563a48 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:06.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.360+0000 7f8141600640 1 -- 172.21.15.131:0/1988794372 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813c00a5c0 con 0x7f8128004d40 2024-04-25T19:23:06.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.360+0000 7f8141600640 1 -- 172.21.15.131:0/1988794372 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f813c02f070 con 0x7f8128004d40 2024-04-25T19:23:06.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.360+0000 7f8141600640 1 -- 172.21.15.131:0/1988794372 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813c02be20 con 0x7f8128004d40 2024-04-25T19:23:06.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.361+0000 7f8149c00640 1 -- 172.21.15.131:0/1988794372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8128004d40 msgr2=0x7f8128005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:06.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.361+0000 7f8149c00640 1 --2- 172.21.15.131:0/1988794372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8128004d40 0x7f8128005150 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f813c00a970 tx=0x7f8128005830 comp rx=0 tx=0).stop 2024-04-25T19:23:06.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.361+0000 7f8143400640 1 -- 172.21.15.131:0/1988794372 reap_dead start 2024-04-25T19:23:06.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.361+0000 7f8149c00640 1 -- 172.21.15.131:0/1988794372 shutdown_connections 2024-04-25T19:23:06.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.361+0000 7f8149c00640 1 -- 172.21.15.131:0/1988794372 >> 172.21.15.131:0/1988794372 conn(0x7f8144073090 msgr2=0x7f81440734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:06.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.361+0000 7f8149c00640 1 -- 172.21.15.131:0/1988794372 shutdown_connections 2024-04-25T19:23:06.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.361+0000 7f8149c00640 1 -- 172.21.15.131:0/1988794372 wait complete. 2024-04-25T19:23:06.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.364+0000 7f8149c00640 1 Processor -- start 2024-04-25T19:23:06.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.364+0000 7f8149c00640 1 -- start start 2024-04-25T19:23:06.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.366+0000 7f8149c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8128004d40 0x7f814415f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:06.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.366+0000 7f8149c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f814414b9d0 0x7f8144162a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:06.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.366+0000 7f8149c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8144162fb0 0x7f81441633c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:06.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.366+0000 7f8149c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f81440b6180 con 0x7f8128004d40 2024-04-25T19:23:06.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.366+0000 7f8149c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8144168f10 con 0x7f8144162fb0 2024-04-25T19:23:06.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.366+0000 7f8149c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8144165810 con 0x7f814414b9d0 2024-04-25T19:23:06.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.366+0000 7f8142a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8128004d40 0x7f814415f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:06.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.366+0000 7f8142a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8128004d40 0x7f814415f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38498/0 (socket says 172.21.15.131:38498) 2024-04-25T19:23:06.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.366+0000 7f8142a00640 1 -- 172.21.15.131:0/4177911213 learned_addr learned my addr 172.21.15.131:0/4177911213 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:06.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.366+0000 7f8142000640 1 --2- 172.21.15.131:0/4177911213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f814414b9d0 0x7f8144162a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:06.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.366+0000 7f8142a00640 1 -- 172.21.15.131:0/4177911213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f814414b9d0 msgr2=0x7f8144162a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:06.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.366+0000 7f8143400640 1 --2- 172.21.15.131:0/4177911213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8144162fb0 0x7f81441633c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:06.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.366+0000 7f8142a00640 1 --2- 172.21.15.131:0/4177911213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f814414b9d0 0x7f8144162a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:06.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.366+0000 7f8142a00640 1 -- 172.21.15.131:0/4177911213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8144162fb0 msgr2=0x7f81441633c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:06.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.366+0000 7f8142a00640 1 --2- 172.21.15.131:0/4177911213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8144162fb0 0x7f81441633c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:06.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.366+0000 7f8142a00640 1 -- 172.21.15.131:0/4177911213 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81441ee5d0 con 0x7f8128004d40 2024-04-25T19:23:06.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.366+0000 7f8142000640 1 --2- 172.21.15.131:0/4177911213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f814414b9d0 0x7f8144162a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:06.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.367+0000 7f8142a00640 1 --2- 172.21.15.131:0/4177911213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8128004d40 0x7f814415f4f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f813400f580 tx=0x7f813400fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:06.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.367+0000 7f813aa00640 1 -- 172.21.15.131:0/4177911213 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8134019020 con 0x7f8128004d40 2024-04-25T19:23:06.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.367+0000 7f813aa00640 1 -- 172.21.15.131:0/4177911213 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8134014870 con 0x7f8128004d40 2024-04-25T19:23:06.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.367+0000 7f813aa00640 1 -- 172.21.15.131:0/4177911213 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8134014c60 con 0x7f8128004d40 2024-04-25T19:23:06.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.367+0000 7f8149c00640 1 -- 172.21.15.131:0/4177911213 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8144162170 con 0x7f8128004d40 2024-04-25T19:23:06.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.367+0000 7f8149c00640 1 -- 172.21.15.131:0/4177911213 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81441ee890 con 0x7f8128004d40 2024-04-25T19:23:06.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.368+0000 7f8149c00640 1 -- 172.21.15.131:0/4177911213 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8144162690 con 0x7f8128004d40 2024-04-25T19:23:06.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.370+0000 7f813aa00640 1 -- 172.21.15.131:0/4177911213 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f813401c020 con 0x7f8128004d40 2024-04-25T19:23:06.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.371+0000 7f813aa00640 1 --2- 172.21.15.131:0/4177911213 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f81240744b0 0x7f81240769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:06.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.371+0000 7f813aa00640 1 -- 172.21.15.131:0/4177911213 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f8134095a60 con 0x7f8128004d40 2024-04-25T19:23:06.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.371+0000 7f8142000640 1 --2- 172.21.15.131:0/4177911213 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f81240744b0 0x7f81240769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:06.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.373+0000 7f8142000640 1 --2- 172.21.15.131:0/4177911213 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f81240744b0 0x7f81240769c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f814414c270 tx=0x7f8130008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:06.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.375+0000 7f813aa00640 1 -- 172.21.15.131:0/4177911213 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8134023020 con 0x7f8128004d40 2024-04-25T19:23:06.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.579+0000 7f8149c00640 1 -- 172.21.15.131:0/4177911213 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8144050740 con 0x7f8128004d40 2024-04-25T19:23:06.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.580+0000 7f813aa00640 1 -- 172.21.15.131:0/4177911213 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f8134068030 con 0x7f8128004d40 2024-04-25T19:23:06.581 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 64 2024-04-25T19:23:06.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.583+0000 7f8149c00640 1 -- 172.21.15.131:0/4177911213 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f81240744b0 msgr2=0x7f81240769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:06.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.583+0000 7f8149c00640 1 --2- 172.21.15.131:0/4177911213 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f81240744b0 0x7f81240769c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f814414c270 tx=0x7f8130008040 comp rx=0 tx=0).stop 2024-04-25T19:23:06.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.583+0000 7f8149c00640 1 -- 172.21.15.131:0/4177911213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8128004d40 msgr2=0x7f814415f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:06.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.583+0000 7f8149c00640 1 --2- 172.21.15.131:0/4177911213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8128004d40 0x7f814415f4f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f813400f580 tx=0x7f813400fa40 comp rx=0 tx=0).stop 2024-04-25T19:23:06.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.583+0000 7f8149c00640 1 -- 172.21.15.131:0/4177911213 shutdown_connections 2024-04-25T19:23:06.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.583+0000 7f8149c00640 1 --2- 172.21.15.131:0/4177911213 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f81240744b0 0x7f81240769c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:06.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.583+0000 7f8149c00640 1 --2- 172.21.15.131:0/4177911213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f814414b9d0 0x7f8144162a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:06.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.583+0000 7f8149c00640 1 --2- 172.21.15.131:0/4177911213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8144162fb0 0x7f81441633c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:06.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.583+0000 7f8149c00640 1 --2- 172.21.15.131:0/4177911213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8128004d40 0x7f814415f4f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:06.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.583+0000 7f8149c00640 1 -- 172.21.15.131:0/4177911213 >> 172.21.15.131:0/4177911213 conn(0x7f8144073090 msgr2=0x7f81440734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:06.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.583+0000 7f8149c00640 1 -- 172.21.15.131:0/4177911213 shutdown_connections 2024-04-25T19:23:06.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.583+0000 7f8149c00640 1 -- 172.21.15.131:0/4177911213 wait complete. 2024-04-25T19:23:06.610 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T19:23:06.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.873+0000 7f179b800640 1 Processor -- start 2024-04-25T19:23:06.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.874+0000 7f179b800640 1 -- start start 2024-04-25T19:23:06.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.876+0000 7f179b800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f17940d0a00 0x7f1794167ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:06.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.876+0000 7f179b800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1794070940 con 0x7f1794143440 2024-04-25T19:23:06.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.876+0000 7f179b800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1794143850 con 0x7f1794161270 2024-04-25T19:23:06.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.876+0000 7f179b800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f179406f4a0 con 0x7f17940d0a00 2024-04-25T19:23:06.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.876+0000 7f1798e00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f1794143440 0x7f1794160b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38702/0 (socket says 172.21.15.131:38702) 2024-04-25T19:23:06.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.876+0000 7f1798e00640 1 -- 172.21.15.131:0/967460492 learned_addr learned my addr 172.21.15.131:0/967460492 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:06.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.877+0000 7f1799800640 1 --2- 172.21.15.131:0/967460492 >> v2:172.21.15.195:3300/0 conn(0x7f17940d0a00 0x7f1794167ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:06.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.877+0000 7f1793400640 1 -- 172.21.15.131:0/967460492 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1072902101 0 0) 0x7f1794070940 con 0x7f1794143440 2024-04-25T19:23:06.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.877+0000 7f1793400640 1 -- 172.21.15.131:0/967460492 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f177c003520 con 0x7f1794143440 2024-04-25T19:23:06.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.877+0000 7f1793400640 1 -- 172.21.15.131:0/967460492 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3457403142 0 0) 0x7f177c003520 con 0x7f1794143440 2024-04-25T19:23:06.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.877+0000 7f1793400640 1 -- 172.21.15.131:0/967460492 >> v2:172.21.15.195:3300/0 conn(0x7f17940d0a00 msgr2=0x7f1794167ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:06.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.877+0000 7f1793400640 1 --2- 172.21.15.131:0/967460492 >> v2:172.21.15.195:3300/0 conn(0x7f17940d0a00 0x7f1794167ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:06.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.877+0000 7f1793400640 1 -- 172.21.15.131:0/967460492 >> v1:172.21.15.195:6789/0 conn(0x7f1794161270 legacy=0x7f17940d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:06.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.877+0000 7f1793400640 1 -- 172.21.15.131:0/967460492 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17940d16e0 con 0x7f1794143440 2024-04-25T19:23:06.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.877+0000 7f1793400640 1 -- 172.21.15.131:0/967460492 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f1788001690 con 0x7f1794143440 2024-04-25T19:23:06.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.877+0000 7f1793400640 1 -- 172.21.15.131:0/967460492 >> v1:172.21.15.131:6789/0 conn(0x7f1794143440 legacy=0x7f1794160b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:06.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.877+0000 7f1793400640 1 --2- 172.21.15.131:0/967460492 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c003a00 0x7f177c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:06.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.877+0000 7f1793400640 1 --2- 172.21.15.131:0/967460492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f177c004800 0x7f177c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:06.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.878+0000 7f1793400640 1 --2- 172.21.15.131:0/967460492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f177c005270 0x7f177c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:06.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.878+0000 7f1793400640 1 -- 172.21.15.131:0/967460492 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f179406f4a0 con 0x7f177c005270 2024-04-25T19:23:06.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.878+0000 7f1793400640 1 -- 172.21.15.131:0/967460492 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f177c00c190 con 0x7f177c004800 2024-04-25T19:23:06.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.878+0000 7f1793400640 1 -- 172.21.15.131:0/967460492 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f177c00c390 con 0x7f177c003a00 2024-04-25T19:23:06.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.878+0000 7f1799800640 1 --2- 172.21.15.131:0/967460492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f177c005270 0x7f177c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:06.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.878+0000 7f1799800640 1 -- 172.21.15.131:0/967460492 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c003a00 msgr2=0x7f177c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:06.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.878+0000 7f1799800640 1 --2- 172.21.15.131:0/967460492 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c003a00 0x7f177c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:06.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.878+0000 7f1799800640 1 -- 172.21.15.131:0/967460492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f177c004800 msgr2=0x7f177c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:06.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.878+0000 7f1799800640 1 --2- 172.21.15.131:0/967460492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f177c004800 0x7f177c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:06.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.878+0000 7f1799800640 1 -- 172.21.15.131:0/967460492 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f177c003520 con 0x7f177c005270 2024-04-25T19:23:06.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.879+0000 7f1799800640 1 -- 172.21.15.131:0/967460492 reap_dead start 2024-04-25T19:23:06.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.879+0000 7f1799800640 1 --2- 172.21.15.131:0/967460492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f177c005270 0x7f177c00b9c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f178c009fc0 tx=0x7f177c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639286c543537253 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:06.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.880+0000 7f1793400640 1 -- 172.21.15.131:0/967460492 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c035020 con 0x7f177c005270 2024-04-25T19:23:06.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.880+0000 7f1793400640 1 -- 172.21.15.131:0/967460492 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f178c003bd0 con 0x7f177c005270 2024-04-25T19:23:06.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.880+0000 7f1793400640 1 -- 172.21.15.131:0/967460492 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c009c10 con 0x7f177c005270 2024-04-25T19:23:06.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.880+0000 7f179b800640 1 -- 172.21.15.131:0/967460492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f177c005270 msgr2=0x7f177c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:06.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.880+0000 7f179b800640 1 --2- 172.21.15.131:0/967460492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f177c005270 0x7f177c00b9c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f178c009fc0 tx=0x7f177c005830 comp rx=0 tx=0).stop 2024-04-25T19:23:06.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.881+0000 7f179b800640 1 -- 172.21.15.131:0/967460492 shutdown_connections 2024-04-25T19:23:06.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.881+0000 7f179b800640 1 --2- 172.21.15.131:0/967460492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f177c005270 0x7f177c00b9c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:06.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.881+0000 7f179b800640 1 -- 172.21.15.131:0/967460492 >> 172.21.15.131:0/967460492 conn(0x7f17940d1ae0 msgr2=0x7f17940d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:06.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.881+0000 7f179b800640 1 -- 172.21.15.131:0/967460492 shutdown_connections 2024-04-25T19:23:06.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.881+0000 7f179b800640 1 -- 172.21.15.131:0/967460492 wait complete. 2024-04-25T19:23:06.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.883+0000 7f179b800640 1 Processor -- start 2024-04-25T19:23:06.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.883+0000 7f179b800640 1 -- start start 2024-04-25T19:23:06.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.885+0000 7f179b800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c005270 0x7f179414e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:06.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.885+0000 7f179b800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1794140b80 0x7f179414bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:06.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.885+0000 7f179b800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f179415a240 0x7f179415a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:06.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.885+0000 7f179b800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f179406f130 con 0x7f1794140b80 2024-04-25T19:23:06.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.885+0000 7f179b800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f17940d1180 con 0x7f179415a240 2024-04-25T19:23:06.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.885+0000 7f179b800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f17940d0e10 con 0x7f177c005270 2024-04-25T19:23:06.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.885+0000 7f1793e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1794140b80 0x7f179414bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:06.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.885+0000 7f1793e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1794140b80 0x7f179414bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38520/0 (socket says 172.21.15.131:38520) 2024-04-25T19:23:06.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.885+0000 7f1793e00640 1 -- 172.21.15.131:0/933179428 learned_addr learned my addr 172.21.15.131:0/933179428 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:06.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.886+0000 7f1798e00640 1 --2- 172.21.15.131:0/933179428 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c005270 0x7f179414e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:06.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.886+0000 7f1799800640 1 --2- 172.21.15.131:0/933179428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f179415a240 0x7f179415a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:06.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.886+0000 7f1793e00640 1 -- 172.21.15.131:0/933179428 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c005270 msgr2=0x7f179414e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:06.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.886+0000 7f1793e00640 1 --2- 172.21.15.131:0/933179428 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c005270 0x7f179414e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:06.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.886+0000 7f1793e00640 1 -- 172.21.15.131:0/933179428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f179415a240 msgr2=0x7f179415a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:06.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.886+0000 7f1793e00640 1 --2- 172.21.15.131:0/933179428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f179415a240 0x7f179415a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:06.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.886+0000 7f1793e00640 1 -- 172.21.15.131:0/933179428 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f179415ab90 con 0x7f1794140b80 2024-04-25T19:23:06.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.886+0000 7f1793e00640 1 --2- 172.21.15.131:0/933179428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1794140b80 0x7f179414bed0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f178000c530 tx=0x7f178000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:06.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.886+0000 7f1790c00640 1 -- 172.21.15.131:0/933179428 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17800052d0 con 0x7f1794140b80 2024-04-25T19:23:06.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.886+0000 7f1790c00640 1 -- 172.21.15.131:0/933179428 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1780005470 con 0x7f1794140b80 2024-04-25T19:23:06.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.886+0000 7f1790c00640 1 -- 172.21.15.131:0/933179428 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1780012850 con 0x7f1794140b80 2024-04-25T19:23:06.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.886+0000 7f179b800640 1 -- 172.21.15.131:0/933179428 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f179414f080 con 0x7f1794140b80 2024-04-25T19:23:06.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.887+0000 7f179b800640 1 -- 172.21.15.131:0/933179428 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17940cae20 con 0x7f1794140b80 2024-04-25T19:23:06.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.888+0000 7f179b800640 1 -- 172.21.15.131:0/933179428 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1794050740 con 0x7f1794140b80 2024-04-25T19:23:06.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.889+0000 7f1790c00640 1 -- 172.21.15.131:0/933179428 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f17800129f0 con 0x7f1794140b80 2024-04-25T19:23:06.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.890+0000 7f1790c00640 1 --2- 172.21.15.131:0/933179428 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f17740744b0 0x7f17740769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:06.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.890+0000 7f1790c00640 1 -- 172.21.15.131:0/933179428 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f1780094df0 con 0x7f1794140b80 2024-04-25T19:23:06.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.891+0000 7f1798e00640 1 --2- 172.21.15.131:0/933179428 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f17740744b0 0x7f17740769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:06.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.892+0000 7f1798e00640 1 --2- 172.21.15.131:0/933179428 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f17740744b0 0x7f17740769c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f17880018c0 tx=0x7f1788009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:06.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:06.894+0000 7f1790c00640 1 -- 172.21.15.131:0/933179428 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f179415ab90 con 0x7f1794140b80 2024-04-25T19:23:07.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.121+0000 7f179b800640 1 -- 172.21.15.131:0/933179428 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1794142c80 con 0x7f1794140b80 2024-04-25T19:23:07.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.121+0000 7f1790c00640 1 -- 172.21.15.131:0/933179428 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f178005f620 con 0x7f1794140b80 2024-04-25T19:23:07.122 INFO:teuthology.orchestra.run.smithi131.stderr:listed 0 entries 2024-04-25T19:23:07.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.123+0000 7f179b800640 1 -- 172.21.15.131:0/933179428 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f17740744b0 msgr2=0x7f17740769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:07.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.123+0000 7f179b800640 1 --2- 172.21.15.131:0/933179428 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f17740744b0 0x7f17740769c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f17880018c0 tx=0x7f1788009040 comp rx=0 tx=0).stop 2024-04-25T19:23:07.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.123+0000 7f179b800640 1 -- 172.21.15.131:0/933179428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1794140b80 msgr2=0x7f179414bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:07.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.123+0000 7f179b800640 1 --2- 172.21.15.131:0/933179428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1794140b80 0x7f179414bed0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f178000c530 tx=0x7f178000c9f0 comp rx=0 tx=0).stop 2024-04-25T19:23:07.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.124+0000 7f179b800640 1 -- 172.21.15.131:0/933179428 shutdown_connections 2024-04-25T19:23:07.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.124+0000 7f179b800640 1 --2- 172.21.15.131:0/933179428 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f17740744b0 0x7f17740769c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:07.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.124+0000 7f179b800640 1 --2- 172.21.15.131:0/933179428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f179415a240 0x7f179415a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:07.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.124+0000 7f179b800640 1 --2- 172.21.15.131:0/933179428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1794140b80 0x7f179414bed0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:07.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.124+0000 7f179b800640 1 --2- 172.21.15.131:0/933179428 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c005270 0x7f179414e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:07.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.124+0000 7f179b800640 1 -- 172.21.15.131:0/933179428 >> 172.21.15.131:0/933179428 conn(0x7f17940d1ae0 msgr2=0x7f17940b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:07.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.124+0000 7f179b800640 1 -- 172.21.15.131:0/933179428 shutdown_connections 2024-04-25T19:23:07.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.124+0000 7f179b800640 1 -- 172.21.15.131:0/933179428 wait complete. 2024-04-25T19:23:07.149 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T19:23:07.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:23:07.149 DEBUG:teuthology.orchestra.run.smithi131:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-25T19:23:07.223 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2024-04-25T19:23:07.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:23:07.223 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T19:23:07.272 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:23:07.272 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:23:07.329 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:23:07.329 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:23:07.379 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:23:07.379 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:23:07.480 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:23:07.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.729+0000 7f4843200640 1 Processor -- start 2024-04-25T19:23:07.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.729+0000 7f4843200640 1 -- start start 2024-04-25T19:23:07.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.731+0000 7f4843200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f484406c5c0 0x7f48440cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:07.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.731+0000 7f4843200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48440d1230 con 0x7f48440b4ea0 2024-04-25T19:23:07.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.731+0000 7f4843200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48440d06b0 con 0x7f4844144370 2024-04-25T19:23:07.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.731+0000 7f4843200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f48440d0990 con 0x7f484406c5c0 2024-04-25T19:23:07.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.732+0000 7f4841e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f484406c5c0 0x7f48440cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:07.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.732+0000 7f4842800640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f48440b4ea0 0x7f484415e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38716/0 (socket says 172.21.15.131:38716) 2024-04-25T19:23:07.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.732+0000 7f4841e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f484406c5c0 0x7f48440cfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38526/0 (socket says 172.21.15.131:38526) 2024-04-25T19:23:07.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.732+0000 7f4842800640 1 -- 172.21.15.131:0/1810074525 learned_addr learned my addr 172.21.15.131:0/1810074525 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:07.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.732+0000 7f4841e00640 1 -- 172.21.15.131:0/1810074525 >> v1:172.21.15.195:6789/0 conn(0x7f4844144370 legacy=0x7f48440b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:07.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.732+0000 7f4841e00640 1 -- 172.21.15.131:0/1810074525 >> v1:172.21.15.131:6789/0 conn(0x7f48440b4ea0 legacy=0x7f484415e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:07.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.732+0000 7f4841e00640 1 -- 172.21.15.131:0/1810074525 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48440d0c70 con 0x7f484406c5c0 2024-04-25T19:23:07.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.733+0000 7f4841e00640 1 --2- 172.21.15.131:0/1810074525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f484406c5c0 0x7f48440cfa70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f48340097a0 tx=0x7f483402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2e8842b330cfba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:07.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.733+0000 7f4841400640 1 -- 172.21.15.131:0/1810074525 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4834037070 con 0x7f484406c5c0 2024-04-25T19:23:07.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.734+0000 7f4841400640 1 -- 172.21.15.131:0/1810074525 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4834032440 con 0x7f484406c5c0 2024-04-25T19:23:07.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.734+0000 7f4841400640 1 -- 172.21.15.131:0/1810074525 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4834032810 con 0x7f484406c5c0 2024-04-25T19:23:07.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.734+0000 7f4843200640 1 -- 172.21.15.131:0/1810074525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f484406c5c0 msgr2=0x7f48440cfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:07.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.734+0000 7f4843200640 1 --2- 172.21.15.131:0/1810074525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f484406c5c0 0x7f48440cfa70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f48340097a0 tx=0x7f483402a1e0 comp rx=0 tx=0).stop 2024-04-25T19:23:07.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.734+0000 7f4843200640 1 -- 172.21.15.131:0/1810074525 shutdown_connections 2024-04-25T19:23:07.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.734+0000 7f4843200640 1 --2- 172.21.15.131:0/1810074525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f484406c5c0 0x7f48440cfa70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:07.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.734+0000 7f4843200640 1 -- 172.21.15.131:0/1810074525 >> 172.21.15.131:0/1810074525 conn(0x7f48440d1720 msgr2=0x7f48440d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:07.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.734+0000 7f4843200640 1 -- 172.21.15.131:0/1810074525 shutdown_connections 2024-04-25T19:23:07.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.734+0000 7f4843200640 1 -- 172.21.15.131:0/1810074525 wait complete. 2024-04-25T19:23:07.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.737+0000 7f4843200640 1 Processor -- start 2024-04-25T19:23:07.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.737+0000 7f4843200640 1 -- start start 2024-04-25T19:23:07.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.738+0000 7f4843200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f484406c5c0 0x7f48440ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:07.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.738+0000 7f4843200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4844144370 0x7f4844130a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:07.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.738+0000 7f4843200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f484415b720 0x7f4844162250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:07.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.738+0000 7f4843200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f48440d0450 con 0x7f4844144370 2024-04-25T19:23:07.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.738+0000 7f4843200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f48440d02d0 con 0x7f484406c5c0 2024-04-25T19:23:07.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.738+0000 7f4843200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4844147760 con 0x7f484415b720 2024-04-25T19:23:07.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.739+0000 7f483be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4844144370 0x7f4844130a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:07.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.739+0000 7f483be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4844144370 0x7f4844130a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38534/0 (socket says 172.21.15.131:38534) 2024-04-25T19:23:07.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.739+0000 7f483be00640 1 -- 172.21.15.131:0/318764064 learned_addr learned my addr 172.21.15.131:0/318764064 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:07.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.739+0000 7f4841e00640 1 --2- 172.21.15.131:0/318764064 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f484406c5c0 0x7f48440ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:07.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.739+0000 7f483be00640 1 -- 172.21.15.131:0/318764064 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f484415b720 msgr2=0x7f4844162250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:07.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.739+0000 7f4842800640 1 --2- 172.21.15.131:0/318764064 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f484415b720 0x7f4844162250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:07.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.739+0000 7f483be00640 1 --2- 172.21.15.131:0/318764064 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f484415b720 0x7f4844162250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:07.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.739+0000 7f483be00640 1 -- 172.21.15.131:0/318764064 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f484406c5c0 msgr2=0x7f48440ab390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:07.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.739+0000 7f483be00640 1 --2- 172.21.15.131:0/318764064 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f484406c5c0 0x7f48440ab390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:07.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.739+0000 7f483be00640 1 -- 172.21.15.131:0/318764064 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48441611b0 con 0x7f4844144370 2024-04-25T19:23:07.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.740+0000 7f483be00640 1 --2- 172.21.15.131:0/318764064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4844144370 0x7f4844130a80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f482c00b450 tx=0x7f482c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:07.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.740+0000 7f483a000640 1 -- 172.21.15.131:0/318764064 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482c015020 con 0x7f4844144370 2024-04-25T19:23:07.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.740+0000 7f483a000640 1 -- 172.21.15.131:0/318764064 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f482c011890 con 0x7f4844144370 2024-04-25T19:23:07.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.740+0000 7f483a000640 1 -- 172.21.15.131:0/318764064 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482c011c80 con 0x7f4844144370 2024-04-25T19:23:07.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.740+0000 7f4843200640 1 -- 172.21.15.131:0/318764064 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4844161490 con 0x7f4844144370 2024-04-25T19:23:07.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.740+0000 7f4843200640 1 -- 172.21.15.131:0/318764064 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4844161a50 con 0x7f4844144370 2024-04-25T19:23:07.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.741+0000 7f4843200640 1 -- 172.21.15.131:0/318764064 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48440aba70 con 0x7f4844144370 2024-04-25T19:23:07.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.744+0000 7f483a000640 1 -- 172.21.15.131:0/318764064 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f482c018020 con 0x7f4844144370 2024-04-25T19:23:07.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.744+0000 7f483a000640 1 --2- 172.21.15.131:0/318764064 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f48200744e0 0x7f48200769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:07.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.745+0000 7f483a000640 1 -- 172.21.15.131:0/318764064 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f482c0950b0 con 0x7f4844144370 2024-04-25T19:23:07.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.745+0000 7f4841e00640 1 --2- 172.21.15.131:0/318764064 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f48200744e0 0x7f48200769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:07.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.746+0000 7f4841e00640 1 --2- 172.21.15.131:0/318764064 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f48200744e0 0x7f48200769f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4834034000 tx=0x7f483402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:07.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.750+0000 7f483a000640 1 -- 172.21.15.131:0/318764064 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f482c01f030 con 0x7f4844144370 2024-04-25T19:23:07.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.947+0000 7f4843200640 1 -- 172.21.15.131:0/318764064 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4844050740 con 0x7f4844144370 2024-04-25T19:23:07.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.949+0000 7f483a000640 1 -- 172.21.15.131:0/318764064 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16878 (secure 0 0 0) 0x7f482c00d040 con 0x7f4844144370 2024-04-25T19:23:07.950 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:07.950 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":22,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:22:57.347297+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:22:14.779716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T19:22:15.552027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:23:07.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.952+0000 7f4843200640 1 -- 172.21.15.131:0/318764064 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f48200744e0 msgr2=0x7f48200769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:07.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.952+0000 7f4843200640 1 --2- 172.21.15.131:0/318764064 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f48200744e0 0x7f48200769f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4834034000 tx=0x7f483402e000 comp rx=0 tx=0).stop 2024-04-25T19:23:07.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.952+0000 7f4843200640 1 -- 172.21.15.131:0/318764064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4844144370 msgr2=0x7f4844130a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:07.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.952+0000 7f4843200640 1 --2- 172.21.15.131:0/318764064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4844144370 0x7f4844130a80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f482c00b450 tx=0x7f482c00b910 comp rx=0 tx=0).stop 2024-04-25T19:23:07.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.952+0000 7f4843200640 1 -- 172.21.15.131:0/318764064 shutdown_connections 2024-04-25T19:23:07.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.952+0000 7f4843200640 1 --2- 172.21.15.131:0/318764064 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f48200744e0 0x7f48200769f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:07.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.952+0000 7f4843200640 1 --2- 172.21.15.131:0/318764064 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f484415b720 0x7f4844162250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:07.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.952+0000 7f4843200640 1 --2- 172.21.15.131:0/318764064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4844144370 0x7f4844130a80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:07.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.952+0000 7f4843200640 1 --2- 172.21.15.131:0/318764064 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f484406c5c0 0x7f48440ab390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:07.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.952+0000 7f4843200640 1 -- 172.21.15.131:0/318764064 >> 172.21.15.131:0/318764064 conn(0x7f48440d1720 msgr2=0x7f484406d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:07.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.952+0000 7f4843200640 1 -- 172.21.15.131:0/318764064 shutdown_connections 2024-04-25T19:23:07.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:07.952+0000 7f4843200640 1 -- 172.21.15.131:0/318764064 wait complete. 2024-04-25T19:23:07.979 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T19:22:04.178847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T19:22:14.779716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T19:22:15.552027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T19:23:07.979 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T19:23:08.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.230+0000 7f1c39e00640 1 Processor -- start 2024-04-25T19:23:08.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.231+0000 7f1c39e00640 1 -- start start 2024-04-25T19:23:08.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.233+0000 7f1c39e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1c34164d50 0x7f1c340cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:08.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.233+0000 7f1c39e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1c340b7cb0 0x7f1c340b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:08.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.233+0000 7f1c39e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c341642e0 con 0x7f1c340cd050 2024-04-25T19:23:08.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.233+0000 7f1c39e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f1c34165160 con 0x7f1c34164d50 2024-04-25T19:23:08.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.233+0000 7f1c39e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f1c341648c0 con 0x7f1c340b7cb0 2024-04-25T19:23:08.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.233+0000 7f1c32a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1c34164d50 0x7f1c340cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:08.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.233+0000 7f1c32a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1c34164d50 0x7f1c340cec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55806/0 (socket says 172.21.15.131:55806) 2024-04-25T19:23:08.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.233+0000 7f1c32a00640 1 -- 172.21.15.131:0/81399638 learned_addr learned my addr 172.21.15.131:0/81399638 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:08.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.234+0000 7f1c32000640 1 --2- 172.21.15.131:0/81399638 >> v2:172.21.15.195:3300/0 conn(0x7f1c340b7cb0 0x7f1c340b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:08.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.234+0000 7f1c32a00640 1 -- 172.21.15.131:0/81399638 >> v2:172.21.15.195:3300/0 conn(0x7f1c340b7cb0 msgr2=0x7f1c340b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:08.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.234+0000 7f1c32a00640 1 --2- 172.21.15.131:0/81399638 >> v2:172.21.15.195:3300/0 conn(0x7f1c340b7cb0 0x7f1c340b3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:08.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.234+0000 7f1c32a00640 1 -- 172.21.15.131:0/81399638 >> v1:172.21.15.195:6789/0 conn(0x7f1c340cd050 legacy=0x7f1c340cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:08.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.234+0000 7f1c32a00640 1 -- 172.21.15.131:0/81399638 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c340cf350 con 0x7f1c34164d50 2024-04-25T19:23:08.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.234+0000 7f1c32000640 1 --2- 172.21.15.131:0/81399638 >> v2:172.21.15.195:3300/0 conn(0x7f1c340b7cb0 0x7f1c340b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:08.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.235+0000 7f1c32a00640 1 --2- 172.21.15.131:0/81399638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c34164d50 0x7f1c340cec70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1c340cea30 tx=0x7f1c2402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109f9b62faa6e652 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:08.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.235+0000 7f1c31600640 1 -- 172.21.15.131:0/81399638 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c24037070 con 0x7f1c34164d50 2024-04-25T19:23:08.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.235+0000 7f1c31600640 1 -- 172.21.15.131:0/81399638 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c24032440 con 0x7f1c34164d50 2024-04-25T19:23:08.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.235+0000 7f1c31600640 1 -- 172.21.15.131:0/81399638 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c24032810 con 0x7f1c34164d50 2024-04-25T19:23:08.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.236+0000 7f1c39e00640 1 -- 172.21.15.131:0/81399638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c34164d50 msgr2=0x7f1c340cec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:08.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.236+0000 7f1c39e00640 1 --2- 172.21.15.131:0/81399638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c34164d50 0x7f1c340cec70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1c340cea30 tx=0x7f1c2402a2c0 comp rx=0 tx=0).stop 2024-04-25T19:23:08.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.236+0000 7f1c39e00640 1 -- 172.21.15.131:0/81399638 shutdown_connections 2024-04-25T19:23:08.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.236+0000 7f1c39e00640 1 --2- 172.21.15.131:0/81399638 >> v2:172.21.15.195:3300/0 conn(0x7f1c340b7cb0 0x7f1c340b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:08.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.236+0000 7f1c39e00640 1 --2- 172.21.15.131:0/81399638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c34164d50 0x7f1c340cec70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:08.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.236+0000 7f1c39e00640 1 -- 172.21.15.131:0/81399638 >> 172.21.15.131:0/81399638 conn(0x7f1c3409b7d0 msgr2=0x7f1c3409bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:08.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.236+0000 7f1c39e00640 1 -- 172.21.15.131:0/81399638 shutdown_connections 2024-04-25T19:23:08.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.236+0000 7f1c39e00640 1 -- 172.21.15.131:0/81399638 wait complete. 2024-04-25T19:23:08.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.239+0000 7f1c39e00640 1 Processor -- start 2024-04-25T19:23:08.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.239+0000 7f1c39e00640 1 -- start start 2024-04-25T19:23:08.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.240+0000 7f1c39e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c340b7cb0 0x7f1c34154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:08.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.240+0000 7f1c39e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c340cd050 0x7f1c341615f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:08.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.240+0000 7f1c39e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c34164d50 0x7f1c3406de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:08.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.240+0000 7f1c39e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1c340b80c0 con 0x7f1c340b7cb0 2024-04-25T19:23:08.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.240+0000 7f1c39e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1c340b43c0 con 0x7f1c340cd050 2024-04-25T19:23:08.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.240+0000 7f1c39e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1c340cf630 con 0x7f1c34164d50 2024-04-25T19:23:08.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.240+0000 7f1c32a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c340b7cb0 0x7f1c34154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:08.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.241+0000 7f1c32a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c340b7cb0 0x7f1c34154ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55820/0 (socket says 172.21.15.131:55820) 2024-04-25T19:23:08.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.241+0000 7f1c32a00640 1 -- 172.21.15.131:0/255710678 learned_addr learned my addr 172.21.15.131:0/255710678 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:08.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.241+0000 7f1c32a00640 1 -- 172.21.15.131:0/255710678 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c34164d50 msgr2=0x7f1c3406de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:08.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.241+0000 7f1c32a00640 1 --2- 172.21.15.131:0/255710678 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c34164d50 0x7f1c3406de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:08.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.241+0000 7f1c32a00640 1 -- 172.21.15.131:0/255710678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c340cd050 msgr2=0x7f1c341615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:08.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.241+0000 7f1c32a00640 1 --2- 172.21.15.131:0/255710678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c340cd050 0x7f1c341615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:08.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.241+0000 7f1c32a00640 1 -- 172.21.15.131:0/255710678 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c34162270 con 0x7f1c340b7cb0 2024-04-25T19:23:08.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.241+0000 7f1c32a00640 1 --2- 172.21.15.131:0/255710678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c340b7cb0 0x7f1c34154ec0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1c2402a300 tx=0x7f1c240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:08.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.241+0000 7f1c2b400640 1 -- 172.21.15.131:0/255710678 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c24037040 con 0x7f1c340b7cb0 2024-04-25T19:23:08.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.242+0000 7f1c2b400640 1 -- 172.21.15.131:0/255710678 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c24042070 con 0x7f1c340b7cb0 2024-04-25T19:23:08.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.242+0000 7f1c39e00640 1 -- 172.21.15.131:0/255710678 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c34162550 con 0x7f1c340b7cb0 2024-04-25T19:23:08.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.242+0000 7f1c2b400640 1 -- 172.21.15.131:0/255710678 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c24030bb0 con 0x7f1c340b7cb0 2024-04-25T19:23:08.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.242+0000 7f1c39e00640 1 -- 172.21.15.131:0/255710678 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c340c9f30 con 0x7f1c340b7cb0 2024-04-25T19:23:08.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.243+0000 7f1c39e00640 1 -- 172.21.15.131:0/255710678 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c340c8520 con 0x7f1c340b7cb0 2024-04-25T19:23:08.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.244+0000 7f1c2b400640 1 -- 172.21.15.131:0/255710678 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1c24047460 con 0x7f1c340b7cb0 2024-04-25T19:23:08.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.245+0000 7f1c2b400640 1 --2- 172.21.15.131:0/255710678 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1c140744e0 0x7f1c140769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:08.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.245+0000 7f1c2b400640 1 -- 172.21.15.131:0/255710678 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f1c240b6060 con 0x7f1c340b7cb0 2024-04-25T19:23:08.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.246+0000 7f1c32000640 1 --2- 172.21.15.131:0/255710678 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1c140744e0 0x7f1c140769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:08.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.247+0000 7f1c32000640 1 --2- 172.21.15.131:0/255710678 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1c140744e0 0x7f1c140769f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1c20006fd0 tx=0x7f1c20008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:08.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.250+0000 7f1c2b400640 1 -- 172.21.15.131:0/255710678 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1c24080080 con 0x7f1c340b7cb0 2024-04-25T19:23:08.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.434+0000 7f1c39e00640 1 -- 172.21.15.131:0/255710678 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1c34050740 con 0x7f1c340b7cb0 2024-04-25T19:23:08.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.435+0000 7f1c2b400640 1 -- 172.21.15.131:0/255710678 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f1c24084380 con 0x7f1c340b7cb0 2024-04-25T19:23:08.436 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-25T19:23:08.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.437+0000 7f1c39e00640 1 -- 172.21.15.131:0/255710678 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1c140744e0 msgr2=0x7f1c140769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:08.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.437+0000 7f1c39e00640 1 --2- 172.21.15.131:0/255710678 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1c140744e0 0x7f1c140769f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1c20006fd0 tx=0x7f1c20008040 comp rx=0 tx=0).stop 2024-04-25T19:23:08.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.437+0000 7f1c39e00640 1 -- 172.21.15.131:0/255710678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c340b7cb0 msgr2=0x7f1c34154ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:08.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.437+0000 7f1c39e00640 1 --2- 172.21.15.131:0/255710678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c340b7cb0 0x7f1c34154ec0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1c2402a300 tx=0x7f1c240046c0 comp rx=0 tx=0).stop 2024-04-25T19:23:08.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.438+0000 7f1c39e00640 1 -- 172.21.15.131:0/255710678 shutdown_connections 2024-04-25T19:23:08.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.438+0000 7f1c39e00640 1 --2- 172.21.15.131:0/255710678 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1c140744e0 0x7f1c140769f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:08.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.438+0000 7f1c39e00640 1 --2- 172.21.15.131:0/255710678 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c34164d50 0x7f1c3406de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:08.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.438+0000 7f1c39e00640 1 --2- 172.21.15.131:0/255710678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c340cd050 0x7f1c341615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:08.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.438+0000 7f1c39e00640 1 --2- 172.21.15.131:0/255710678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c340b7cb0 0x7f1c34154ec0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:08.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.438+0000 7f1c39e00640 1 -- 172.21.15.131:0/255710678 >> 172.21.15.131:0/255710678 conn(0x7f1c3409b7d0 msgr2=0x7f1c340cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:08.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.438+0000 7f1c39e00640 1 -- 172.21.15.131:0/255710678 shutdown_connections 2024-04-25T19:23:08.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.438+0000 7f1c39e00640 1 -- 172.21.15.131:0/255710678 wait complete. 2024-04-25T19:23:08.463 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T19:23:08.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.731+0000 7f2a8fe00640 1 Processor -- start 2024-04-25T19:23:08.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.731+0000 7f2a8fe00640 1 -- start start 2024-04-25T19:23:08.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.733+0000 7f2a8fe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2a900b4f70 0x7f2a90163c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:08.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.733+0000 7f2a8fe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a9015f760 0x7f2a9015fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:08.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.733+0000 7f2a8fe00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a90164ad0 con 0x7f2a9006db30 2024-04-25T19:23:08.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.733+0000 7f2a8fe00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f2a900b5380 con 0x7f2a900b4f70 2024-04-25T19:23:08.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.733+0000 7f2a8fe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2a90164510 con 0x7f2a9015f760 2024-04-25T19:23:08.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.734+0000 7f2a8ea00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2a900b4f70 0x7f2a90163c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:08.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.734+0000 7f2a8ea00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2a900b4f70 0x7f2a90163c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55828/0 (socket says 172.21.15.131:55828) 2024-04-25T19:23:08.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.734+0000 7f2a8ea00640 1 -- 172.21.15.131:0/2111975358 learned_addr learned my addr 172.21.15.131:0/2111975358 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:08.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.734+0000 7f2a8f400640 1 --2- 172.21.15.131:0/2111975358 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a9015f760 0x7f2a9015fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:08.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.734+0000 7f2a8ea00640 1 -- 172.21.15.131:0/2111975358 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a9015f760 msgr2=0x7f2a9015fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:08.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.734+0000 7f2a8ea00640 1 --2- 172.21.15.131:0/2111975358 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a9015f760 0x7f2a9015fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:08.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.734+0000 7f2a8ea00640 1 -- 172.21.15.131:0/2111975358 >> v1:172.21.15.195:6789/0 conn(0x7f2a9006db30 legacy=0x7f2a9006df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:08.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.734+0000 7f2a8ea00640 1 -- 172.21.15.131:0/2111975358 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a901647f0 con 0x7f2a900b4f70 2024-04-25T19:23:08.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.734+0000 7f2a8f400640 1 --2- 172.21.15.131:0/2111975358 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a9015f760 0x7f2a9015fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:08.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.736+0000 7f2a8ea00640 1 --2- 172.21.15.131:0/2111975358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a900b4f70 0x7f2a90163c10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009870 tx=0x7f2a8002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2516f03bf590ceb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:08.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.736+0000 7f2a8d600640 1 -- 172.21.15.131:0/2111975358 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a80037070 con 0x7f2a900b4f70 2024-04-25T19:23:08.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.736+0000 7f2a8d600640 1 -- 172.21.15.131:0/2111975358 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a80032440 con 0x7f2a900b4f70 2024-04-25T19:23:08.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.736+0000 7f2a8d600640 1 -- 172.21.15.131:0/2111975358 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a80032810 con 0x7f2a900b4f70 2024-04-25T19:23:08.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.737+0000 7f2a8fe00640 1 -- 172.21.15.131:0/2111975358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a900b4f70 msgr2=0x7f2a90163c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:08.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.737+0000 7f2a8fe00640 1 --2- 172.21.15.131:0/2111975358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a900b4f70 0x7f2a90163c10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009870 tx=0x7f2a8002a180 comp rx=0 tx=0).stop 2024-04-25T19:23:08.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.737+0000 7f2a8fe00640 1 -- 172.21.15.131:0/2111975358 shutdown_connections 2024-04-25T19:23:08.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.737+0000 7f2a8fe00640 1 --2- 172.21.15.131:0/2111975358 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a9015f760 0x7f2a9015fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:08.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.737+0000 7f2a8fe00640 1 --2- 172.21.15.131:0/2111975358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a900b4f70 0x7f2a90163c10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:08.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.737+0000 7f2a8fe00640 1 -- 172.21.15.131:0/2111975358 >> 172.21.15.131:0/2111975358 conn(0x7f2a900d6140 msgr2=0x7f2a900b7600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:08.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.737+0000 7f2a8fe00640 1 -- 172.21.15.131:0/2111975358 shutdown_connections 2024-04-25T19:23:08.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.737+0000 7f2a8fe00640 1 -- 172.21.15.131:0/2111975358 wait complete. 2024-04-25T19:23:08.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.739+0000 7f2a8fe00640 1 Processor -- start 2024-04-25T19:23:08.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.740+0000 7f2a8fe00640 1 -- start start 2024-04-25T19:23:08.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.741+0000 7f2a8fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a9006db30 0x7f2a900c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:08.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.741+0000 7f2a8fe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a900b4f70 0x7f2a901f7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:08.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.741+0000 7f2a8fe00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a9015f760 0x7f2a901ebe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:08.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.741+0000 7f2a8fe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2a90164150 con 0x7f2a9006db30 2024-04-25T19:23:08.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.741+0000 7f2a8fe00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2a900d3af0 con 0x7f2a9015f760 2024-04-25T19:23:08.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.741+0000 7f2a8fe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2a901642d0 con 0x7f2a900b4f70 2024-04-25T19:23:08.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.741+0000 7f2a8ea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a9006db30 0x7f2a900c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:08.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.741+0000 7f2a8ea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a9006db30 0x7f2a900c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55830/0 (socket says 172.21.15.131:55830) 2024-04-25T19:23:08.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.741+0000 7f2a8ea00640 1 -- 172.21.15.131:0/1106986622 learned_addr learned my addr 172.21.15.131:0/1106986622 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:08.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.742+0000 7f2a8ea00640 1 -- 172.21.15.131:0/1106986622 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a900b4f70 msgr2=0x7f2a901f7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:08.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.742+0000 7f2a8ea00640 1 --2- 172.21.15.131:0/1106986622 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a900b4f70 0x7f2a901f7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:08.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.742+0000 7f2a8ea00640 1 -- 172.21.15.131:0/1106986622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a9015f760 msgr2=0x7f2a901ebe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:08.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.742+0000 7f2a8ea00640 1 --2- 172.21.15.131:0/1106986622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a9015f760 0x7f2a901ebe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:08.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.742+0000 7f2a8ea00640 1 -- 172.21.15.131:0/1106986622 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a901ead60 con 0x7f2a9006db30 2024-04-25T19:23:08.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.742+0000 7f2a8ea00640 1 --2- 172.21.15.131:0/1106986622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a9006db30 0x7f2a900c8810 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009870 tx=0x7f2a800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:08.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.742+0000 7f2a86a00640 1 -- 172.21.15.131:0/1106986622 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a80041070 con 0x7f2a9006db30 2024-04-25T19:23:08.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.742+0000 7f2a86a00640 1 -- 172.21.15.131:0/1106986622 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a8003c870 con 0x7f2a9006db30 2024-04-25T19:23:08.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.743+0000 7f2a86a00640 1 -- 172.21.15.131:0/1106986622 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a80037040 con 0x7f2a9006db30 2024-04-25T19:23:08.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.743+0000 7f2a8fe00640 1 -- 172.21.15.131:0/1106986622 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a901eb040 con 0x7f2a9006db30 2024-04-25T19:23:08.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.743+0000 7f2a8fe00640 1 -- 172.21.15.131:0/1106986622 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a901eb600 con 0x7f2a9006db30 2024-04-25T19:23:08.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.744+0000 7f2a8fe00640 1 -- 172.21.15.131:0/1106986622 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a90076c60 con 0x7f2a9006db30 2024-04-25T19:23:08.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.745+0000 7f2a86a00640 1 -- 172.21.15.131:0/1106986622 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2a80044070 con 0x7f2a9006db30 2024-04-25T19:23:08.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.746+0000 7f2a86a00640 1 --2- 172.21.15.131:0/1106986622 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2a6c0744b0 0x7f2a6c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:08.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.746+0000 7f2a86a00640 1 -- 172.21.15.131:0/1106986622 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f2a800b5ec0 con 0x7f2a9006db30 2024-04-25T19:23:08.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.747+0000 7f2a8e000640 1 --2- 172.21.15.131:0/1106986622 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2a6c0744b0 0x7f2a6c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:08.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.748+0000 7f2a8e000640 1 --2- 172.21.15.131:0/1106986622 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2a6c0744b0 0x7f2a6c0769c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2a78006fd0 tx=0x7f2a78006bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:08.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.750+0000 7f2a86a00640 1 -- 172.21.15.131:0/1106986622 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2a90164ad0 con 0x7f2a9006db30 2024-04-25T19:23:08.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.936+0000 7f2a8fe00640 1 -- 172.21.15.131:0/1106986622 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2a900b5cf0 con 0x7f2a9006db30 2024-04-25T19:23:08.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.936+0000 7f2a86a00640 1 -- 172.21.15.131:0/1106986622 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f2a80080660 con 0x7f2a9006db30 2024-04-25T19:23:08.937 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-25T19:23:08.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.939+0000 7f2a8fe00640 1 -- 172.21.15.131:0/1106986622 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2a6c0744b0 msgr2=0x7f2a6c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:08.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.939+0000 7f2a8fe00640 1 --2- 172.21.15.131:0/1106986622 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2a6c0744b0 0x7f2a6c0769c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2a78006fd0 tx=0x7f2a78006bc0 comp rx=0 tx=0).stop 2024-04-25T19:23:08.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.939+0000 7f2a8fe00640 1 -- 172.21.15.131:0/1106986622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a9006db30 msgr2=0x7f2a900c8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:08.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.939+0000 7f2a8fe00640 1 --2- 172.21.15.131:0/1106986622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a9006db30 0x7f2a900c8810 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009870 tx=0x7f2a800046c0 comp rx=0 tx=0).stop 2024-04-25T19:23:08.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.939+0000 7f2a8fe00640 1 -- 172.21.15.131:0/1106986622 shutdown_connections 2024-04-25T19:23:08.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.939+0000 7f2a8fe00640 1 --2- 172.21.15.131:0/1106986622 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2a6c0744b0 0x7f2a6c0769c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:08.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.939+0000 7f2a8fe00640 1 --2- 172.21.15.131:0/1106986622 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a900b4f70 0x7f2a901f7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:08.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.939+0000 7f2a8fe00640 1 --2- 172.21.15.131:0/1106986622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a9015f760 0x7f2a901ebe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:08.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.939+0000 7f2a8fe00640 1 --2- 172.21.15.131:0/1106986622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a9006db30 0x7f2a900c8810 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:08.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.939+0000 7f2a8fe00640 1 -- 172.21.15.131:0/1106986622 >> 172.21.15.131:0/1106986622 conn(0x7f2a900d6140 msgr2=0x7f2a90162e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:08.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.939+0000 7f2a8fe00640 1 -- 172.21.15.131:0/1106986622 shutdown_connections 2024-04-25T19:23:08.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:08.939+0000 7f2a8fe00640 1 -- 172.21.15.131:0/1106986622 wait complete. 2024-04-25T19:23:08.966 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T19:23:09.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.333+0000 7f84e7000640 1 Processor -- start 2024-04-25T19:23:09.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.333+0000 7f84e7000640 1 -- start start 2024-04-25T19:23:09.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.335+0000 7f84e7000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f84e0070d20 0x7f84e0161b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:09.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.335+0000 7f84e7000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84e006f930 0x7f84e006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:09.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.335+0000 7f84e7000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f84e006fd40 0x7f84e006db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:09.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.335+0000 7f84e7000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f84e01623f0 con 0x7f84e0070d20 2024-04-25T19:23:09.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.335+0000 7f84e7000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f84e01626d0 con 0x7f84e006fd40 2024-04-25T19:23:09.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.335+0000 7f84e7000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f84e006f130 con 0x7f84e006f930 2024-04-25T19:23:09.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.335+0000 7f84e5c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f84e0070d20 0x7f84e0161b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:09.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.336+0000 7f84e5c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f84e0070d20 0x7f84e0161b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55836/0 (socket says 172.21.15.131:55836) 2024-04-25T19:23:09.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.336+0000 7f84e5c00640 1 -- 172.21.15.131:0/1007114326 learned_addr learned my addr 172.21.15.131:0/1007114326 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:09.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.336+0000 7f84e6600640 1 --2- 172.21.15.131:0/1007114326 >> v2:172.21.15.195:3300/0 conn(0x7f84e006fd40 0x7f84e006db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:09.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.336+0000 7f84e5200640 1 --2- 172.21.15.131:0/1007114326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84e006f930 0x7f84e006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:09.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.336+0000 7f84e5c00640 1 -- 172.21.15.131:0/1007114326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84e006f930 msgr2=0x7f84e006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:09.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.336+0000 7f84e5c00640 1 --2- 172.21.15.131:0/1007114326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84e006f930 0x7f84e006d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:09.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.336+0000 7f84e5c00640 1 -- 172.21.15.131:0/1007114326 >> v2:172.21.15.195:3300/0 conn(0x7f84e006fd40 msgr2=0x7f84e006db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:09.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.336+0000 7f84e5c00640 1 --2- 172.21.15.131:0/1007114326 >> v2:172.21.15.195:3300/0 conn(0x7f84e006fd40 0x7f84e006db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:09.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.336+0000 7f84e5c00640 1 -- 172.21.15.131:0/1007114326 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e006f410 con 0x7f84e0070d20 2024-04-25T19:23:09.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.336+0000 7f84e5200640 1 --2- 172.21.15.131:0/1007114326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84e006f930 0x7f84e006d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:09.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.336+0000 7f84e6600640 1 --2- 172.21.15.131:0/1007114326 >> v2:172.21.15.195:3300/0 conn(0x7f84e006fd40 0x7f84e006db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:09.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.338+0000 7f84e5c00640 1 --2- 172.21.15.131:0/1007114326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84e0070d20 0x7f84e0161b30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f84e0072f60 tx=0x7f84d402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1bb88e69746edc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:09.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.338+0000 7f84dfe00640 1 -- 172.21.15.131:0/1007114326 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4037070 con 0x7f84e0070d20 2024-04-25T19:23:09.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.338+0000 7f84dfe00640 1 -- 172.21.15.131:0/1007114326 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d4032440 con 0x7f84e0070d20 2024-04-25T19:23:09.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.338+0000 7f84dfe00640 1 -- 172.21.15.131:0/1007114326 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4032810 con 0x7f84e0070d20 2024-04-25T19:23:09.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.339+0000 7f84e7000640 1 -- 172.21.15.131:0/1007114326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84e0070d20 msgr2=0x7f84e0161b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:09.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.339+0000 7f84e7000640 1 --2- 172.21.15.131:0/1007114326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84e0070d20 0x7f84e0161b30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f84e0072f60 tx=0x7f84d402a140 comp rx=0 tx=0).stop 2024-04-25T19:23:09.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.339+0000 7f84e7000640 1 -- 172.21.15.131:0/1007114326 shutdown_connections 2024-04-25T19:23:09.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.339+0000 7f84e7000640 1 --2- 172.21.15.131:0/1007114326 >> v2:172.21.15.195:3300/0 conn(0x7f84e006fd40 0x7f84e006db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:09.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.339+0000 7f84e7000640 1 --2- 172.21.15.131:0/1007114326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84e006f930 0x7f84e006d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:09.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.339+0000 7f84e7000640 1 --2- 172.21.15.131:0/1007114326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84e0070d20 0x7f84e0161b30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:09.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.339+0000 7f84e7000640 1 -- 172.21.15.131:0/1007114326 >> 172.21.15.131:0/1007114326 conn(0x7f84e0073160 msgr2=0x7f84e0073570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:09.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.339+0000 7f84e7000640 1 -- 172.21.15.131:0/1007114326 shutdown_connections 2024-04-25T19:23:09.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.339+0000 7f84e7000640 1 -- 172.21.15.131:0/1007114326 wait complete. 2024-04-25T19:23:09.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.341+0000 7f84e7000640 1 Processor -- start 2024-04-25T19:23:09.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.341+0000 7f84e7000640 1 -- start start 2024-04-25T19:23:09.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.343+0000 7f84e7000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84e006f930 0x7f84e0153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:09.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.343+0000 7f84e7000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84e006fd40 0x7f84e0157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:09.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.343+0000 7f84e7000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84e0070d20 0x7f84e01596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:09.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.343+0000 7f84e7000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f84e015e2f0 con 0x7f84e0070d20 2024-04-25T19:23:09.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.343+0000 7f84e7000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f84e0162070 con 0x7f84e006f930 2024-04-25T19:23:09.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.343+0000 7f84e7000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f84e015e470 con 0x7f84e006fd40 2024-04-25T19:23:09.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.343+0000 7f84e6600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84e0070d20 0x7f84e01596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:09.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.343+0000 7f84e6600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84e0070d20 0x7f84e01596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55838/0 (socket says 172.21.15.131:55838) 2024-04-25T19:23:09.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.343+0000 7f84e6600640 1 -- 172.21.15.131:0/1111640115 learned_addr learned my addr 172.21.15.131:0/1111640115 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:09.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.343+0000 7f84e6600640 1 -- 172.21.15.131:0/1111640115 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84e006fd40 msgr2=0x7f84e0157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:09.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.343+0000 7f84e5200640 1 --2- 172.21.15.131:0/1111640115 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84e006fd40 0x7f84e0157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:09.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.343+0000 7f84e5c00640 1 --2- 172.21.15.131:0/1111640115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84e006f930 0x7f84e0153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:09.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.343+0000 7f84e6600640 1 --2- 172.21.15.131:0/1111640115 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84e006fd40 0x7f84e0157760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:09.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.343+0000 7f84e6600640 1 -- 172.21.15.131:0/1111640115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84e006f930 msgr2=0x7f84e0153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:09.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.343+0000 7f84e6600640 1 --2- 172.21.15.131:0/1111640115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84e006f930 0x7f84e0153310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:09.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.344+0000 7f84e6600640 1 -- 172.21.15.131:0/1111640115 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e0159be0 con 0x7f84e0070d20 2024-04-25T19:23:09.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.344+0000 7f84e6600640 1 --2- 172.21.15.131:0/1111640115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84e0070d20 0x7f84e01596a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f84d800cce0 tx=0x7f84d800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:09.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.344+0000 7f84dd600640 1 -- 172.21.15.131:0/1111640115 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8003b90 con 0x7f84e0070d20 2024-04-25T19:23:09.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.344+0000 7f84dd600640 1 -- 172.21.15.131:0/1111640115 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d8003d50 con 0x7f84e0070d20 2024-04-25T19:23:09.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.344+0000 7f84e7000640 1 -- 172.21.15.131:0/1111640115 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e0153b40 con 0x7f84e0070d20 2024-04-25T19:23:09.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.344+0000 7f84dd600640 1 -- 172.21.15.131:0/1111640115 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8004260 con 0x7f84e0070d20 2024-04-25T19:23:09.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.344+0000 7f84e7000640 1 -- 172.21.15.131:0/1111640115 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e0154100 con 0x7f84e0070d20 2024-04-25T19:23:09.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.345+0000 7f84e7000640 1 -- 172.21.15.131:0/1111640115 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84e0076c60 con 0x7f84e0070d20 2024-04-25T19:23:09.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.347+0000 7f84dd600640 1 -- 172.21.15.131:0/1111640115 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f84d8004400 con 0x7f84e0070d20 2024-04-25T19:23:09.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.348+0000 7f84dd600640 1 --2- 172.21.15.131:0/1111640115 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f84c00744b0 0x7f84c00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:09.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.348+0000 7f84dd600640 1 -- 172.21.15.131:0/1111640115 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f84d8095d20 con 0x7f84e0070d20 2024-04-25T19:23:09.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.348+0000 7f84e5c00640 1 --2- 172.21.15.131:0/1111640115 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f84c00744b0 0x7f84c00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:09.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.350+0000 7f84e5c00640 1 --2- 172.21.15.131:0/1111640115 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f84c00744b0 0x7f84c00769c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f84d4034000 tx=0x7f84d402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:09.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.353+0000 7f84dd600640 1 -- 172.21.15.131:0/1111640115 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f84d8014030 con 0x7f84e0070d20 2024-04-25T19:23:09.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.536+0000 7f84e7000640 1 -- 172.21.15.131:0/1111640115 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f84e00cddf0 con 0x7f84e0070d20 2024-04-25T19:23:09.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.537+0000 7f84dd600640 1 -- 172.21.15.131:0/1111640115 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f84d8060390 con 0x7f84e0070d20 2024-04-25T19:23:09.538 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 64 2024-04-25T19:23:09.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.540+0000 7f84e7000640 1 -- 172.21.15.131:0/1111640115 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f84c00744b0 msgr2=0x7f84c00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:09.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.540+0000 7f84e7000640 1 --2- 172.21.15.131:0/1111640115 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f84c00744b0 0x7f84c00769c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f84d4034000 tx=0x7f84d402e000 comp rx=0 tx=0).stop 2024-04-25T19:23:09.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.540+0000 7f84e7000640 1 -- 172.21.15.131:0/1111640115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84e0070d20 msgr2=0x7f84e01596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:09.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.540+0000 7f84e7000640 1 --2- 172.21.15.131:0/1111640115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84e0070d20 0x7f84e01596a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f84d800cce0 tx=0x7f84d800a650 comp rx=0 tx=0).stop 2024-04-25T19:23:09.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.540+0000 7f84e7000640 1 -- 172.21.15.131:0/1111640115 shutdown_connections 2024-04-25T19:23:09.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.540+0000 7f84e7000640 1 --2- 172.21.15.131:0/1111640115 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f84c00744b0 0x7f84c00769c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:09.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.540+0000 7f84e7000640 1 --2- 172.21.15.131:0/1111640115 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84e006fd40 0x7f84e0157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:09.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.540+0000 7f84e7000640 1 --2- 172.21.15.131:0/1111640115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84e0070d20 0x7f84e01596a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:09.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.540+0000 7f84e7000640 1 --2- 172.21.15.131:0/1111640115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84e006f930 0x7f84e0153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:09.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.540+0000 7f84e7000640 1 -- 172.21.15.131:0/1111640115 >> 172.21.15.131:0/1111640115 conn(0x7f84e0073160 msgr2=0x7f84e00aeb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:09.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.540+0000 7f84e7000640 1 -- 172.21.15.131:0/1111640115 shutdown_connections 2024-04-25T19:23:09.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.540+0000 7f84e7000640 1 -- 172.21.15.131:0/1111640115 wait complete. 2024-04-25T19:23:09.566 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T19:23:09.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.830+0000 7f0064a00640 1 Processor -- start 2024-04-25T19:23:09.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.830+0000 7f0064a00640 1 -- start start 2024-04-25T19:23:09.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.832+0000 7f0064a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0060160fe0 0x7f006015a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:09.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.832+0000 7f0064a00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00600b7220 con 0x7f00600cf2f0 2024-04-25T19:23:09.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.832+0000 7f0064a00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00600b74d0 con 0x7f00600b6e10 2024-04-25T19:23:09.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.832+0000 7f0064a00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f006006f870 con 0x7f0060160fe0 2024-04-25T19:23:09.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.832+0000 7f005e800640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f00600cf2f0 0x7f00600b4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53268/0 (socket says 172.21.15.131:53268) 2024-04-25T19:23:09.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.832+0000 7f005e800640 1 -- 172.21.15.131:0/3017965700 learned_addr learned my addr 172.21.15.131:0/3017965700 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:09.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.832+0000 7f005f200640 1 --2- 172.21.15.131:0/3017965700 >> v2:172.21.15.131:3300/0 conn(0x7f0060160fe0 0x7f006015a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:09.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.833+0000 7f005de00640 1 -- 172.21.15.131:0/3017965700 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 116762087 0 0) 0x7f00600b7220 con 0x7f00600cf2f0 2024-04-25T19:23:09.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.833+0000 7f005de00640 1 -- 172.21.15.131:0/3017965700 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0040003520 con 0x7f00600cf2f0 2024-04-25T19:23:09.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.833+0000 7f005f200640 1 -- 172.21.15.131:0/3017965700 >> v1:172.21.15.195:6789/0 conn(0x7f00600b6e10 legacy=0x7f00601608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:09.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.833+0000 7f005f200640 1 -- 172.21.15.131:0/3017965700 >> v1:172.21.15.131:6789/0 conn(0x7f00600cf2f0 legacy=0x7f00600b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:09.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.833+0000 7f005f200640 1 -- 172.21.15.131:0/3017965700 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00600b77b0 con 0x7f0060160fe0 2024-04-25T19:23:09.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.834+0000 7f005f200640 1 --2- 172.21.15.131:0/3017965700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0060160fe0 0x7f006015a810 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0058009d90 tx=0x7f005802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2c2c9395950cb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:09.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.834+0000 7f005de00640 1 -- 172.21.15.131:0/3017965700 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0058007740 con 0x7f0060160fe0 2024-04-25T19:23:09.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.834+0000 7f005de00640 1 -- 172.21.15.131:0/3017965700 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00580078e0 con 0x7f0060160fe0 2024-04-25T19:23:09.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.834+0000 7f005de00640 1 -- 172.21.15.131:0/3017965700 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0058007cb0 con 0x7f0060160fe0 2024-04-25T19:23:09.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.835+0000 7f0064a00640 1 -- 172.21.15.131:0/3017965700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0060160fe0 msgr2=0x7f006015a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:09.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.835+0000 7f0064a00640 1 --2- 172.21.15.131:0/3017965700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0060160fe0 0x7f006015a810 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0058009d90 tx=0x7f005802a6a0 comp rx=0 tx=0).stop 2024-04-25T19:23:09.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.835+0000 7f0064a00640 1 -- 172.21.15.131:0/3017965700 shutdown_connections 2024-04-25T19:23:09.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.835+0000 7f0064a00640 1 --2- 172.21.15.131:0/3017965700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0060160fe0 0x7f006015a810 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:09.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.835+0000 7f0064a00640 1 -- 172.21.15.131:0/3017965700 >> 172.21.15.131:0/3017965700 conn(0x7f00600d1720 msgr2=0x7f00600d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:09.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.835+0000 7f0064a00640 1 -- 172.21.15.131:0/3017965700 shutdown_connections 2024-04-25T19:23:09.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.835+0000 7f0064a00640 1 -- 172.21.15.131:0/3017965700 wait complete. 2024-04-25T19:23:09.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.838+0000 7f0064a00640 1 Processor -- start 2024-04-25T19:23:09.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.838+0000 7f0064a00640 1 -- start start 2024-04-25T19:23:09.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.839+0000 7f0064a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00600b6e10 0x7f006015f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:09.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.839+0000 7f0064a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00600cf2f0 0x7f00601595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:09.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.839+0000 7f0064a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f006015c0b0 0x7f006015c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:09.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.839+0000 7f0064a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f006006fd00 con 0x7f006015c0b0 2024-04-25T19:23:09.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.839+0000 7f0064a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f006006f500 con 0x7f00600cf2f0 2024-04-25T19:23:09.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.839+0000 7f0064a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f006006fe80 con 0x7f00600b6e10 2024-04-25T19:23:09.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.840+0000 7f005f200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f006015c0b0 0x7f006015c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:09.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.840+0000 7f005f200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f006015c0b0 0x7f006015c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55862/0 (socket says 172.21.15.131:55862) 2024-04-25T19:23:09.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.840+0000 7f005f200640 1 -- 172.21.15.131:0/3459270491 learned_addr learned my addr 172.21.15.131:0/3459270491 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:09.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.840+0000 7f005e800640 1 --2- 172.21.15.131:0/3459270491 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00600b6e10 0x7f006015f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:09.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.840+0000 7f0055e00640 1 --2- 172.21.15.131:0/3459270491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00600cf2f0 0x7f00601595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:09.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.840+0000 7f005f200640 1 -- 172.21.15.131:0/3459270491 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00600b6e10 msgr2=0x7f006015f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:09.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.840+0000 7f005f200640 1 --2- 172.21.15.131:0/3459270491 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00600b6e10 0x7f006015f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:09.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.840+0000 7f005f200640 1 -- 172.21.15.131:0/3459270491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00600cf2f0 msgr2=0x7f00601595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:09.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.840+0000 7f005f200640 1 --2- 172.21.15.131:0/3459270491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00600cf2f0 0x7f00601595f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:09.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.840+0000 7f005f200640 1 -- 172.21.15.131:0/3459270491 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006015e4b0 con 0x7f006015c0b0 2024-04-25T19:23:09.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.840+0000 7f005f200640 1 --2- 172.21.15.131:0/3459270491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f006015c0b0 0x7f006015c4c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0058009d90 tx=0x7f0058004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:09.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.841+0000 7f0057400640 1 -- 172.21.15.131:0/3459270491 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005803f070 con 0x7f006015c0b0 2024-04-25T19:23:09.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.841+0000 7f0057400640 1 -- 172.21.15.131:0/3459270491 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0058031bc0 con 0x7f006015c0b0 2024-04-25T19:23:09.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.841+0000 7f0064a00640 1 -- 172.21.15.131:0/3459270491 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f006015e790 con 0x7f006015c0b0 2024-04-25T19:23:09.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.841+0000 7f0057400640 1 -- 172.21.15.131:0/3459270491 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0058009450 con 0x7f006015c0b0 2024-04-25T19:23:09.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.841+0000 7f0064a00640 1 -- 172.21.15.131:0/3459270491 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00601f6880 con 0x7f006015c0b0 2024-04-25T19:23:09.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.842+0000 7f0064a00640 1 -- 172.21.15.131:0/3459270491 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00601f6ae0 con 0x7f006015c0b0 2024-04-25T19:23:09.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.843+0000 7f0057400640 1 -- 172.21.15.131:0/3459270491 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f005803b410 con 0x7f006015c0b0 2024-04-25T19:23:09.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.844+0000 7f0057400640 1 --2- 172.21.15.131:0/3459270491 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f003c0744e0 0x7f003c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:09.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.844+0000 7f0057400640 1 -- 172.21.15.131:0/3459270491 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f00580b67e0 con 0x7f006015c0b0 2024-04-25T19:23:09.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.845+0000 7f005e800640 1 --2- 172.21.15.131:0/3459270491 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f003c0744e0 0x7f003c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:09.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.846+0000 7f005e800640 1 --2- 172.21.15.131:0/3459270491 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f003c0744e0 0x7f003c0769f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0050005880 tx=0x7f0050009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:09.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:09.852+0000 7f0057400640 1 -- 172.21.15.131:0/3459270491 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0058080800 con 0x7f006015c0b0 2024-04-25T19:23:10.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.047+0000 7f0064a00640 1 -- 172.21.15.131:0/3459270491 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0060050740 con 0x7f006015c0b0 2024-04-25T19:23:10.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.048+0000 7f0057400640 1 -- 172.21.15.131:0/3459270491 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f0058084b00 con 0x7f006015c0b0 2024-04-25T19:23:10.049 INFO:teuthology.orchestra.run.smithi131.stderr:listed 0 entries 2024-04-25T19:23:10.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.051+0000 7f0064a00640 1 -- 172.21.15.131:0/3459270491 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f003c0744e0 msgr2=0x7f003c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:10.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.051+0000 7f0064a00640 1 --2- 172.21.15.131:0/3459270491 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f003c0744e0 0x7f003c0769f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0050005880 tx=0x7f0050009040 comp rx=0 tx=0).stop 2024-04-25T19:23:10.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.051+0000 7f0064a00640 1 -- 172.21.15.131:0/3459270491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f006015c0b0 msgr2=0x7f006015c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:10.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.051+0000 7f0064a00640 1 --2- 172.21.15.131:0/3459270491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f006015c0b0 0x7f006015c4c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0058009d90 tx=0x7f0058004a40 comp rx=0 tx=0).stop 2024-04-25T19:23:10.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.051+0000 7f0064a00640 1 -- 172.21.15.131:0/3459270491 shutdown_connections 2024-04-25T19:23:10.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.051+0000 7f0064a00640 1 --2- 172.21.15.131:0/3459270491 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f003c0744e0 0x7f003c0769f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:10.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.051+0000 7f0064a00640 1 --2- 172.21.15.131:0/3459270491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f006015c0b0 0x7f006015c4c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:10.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.051+0000 7f0064a00640 1 --2- 172.21.15.131:0/3459270491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00600cf2f0 0x7f00601595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:10.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.051+0000 7f0064a00640 1 --2- 172.21.15.131:0/3459270491 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00600b6e10 0x7f006015f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:10.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.051+0000 7f0064a00640 1 -- 172.21.15.131:0/3459270491 >> 172.21.15.131:0/3459270491 conn(0x7f00600d1720 msgr2=0x7f00600b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:10.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.051+0000 7f0064a00640 1 -- 172.21.15.131:0/3459270491 shutdown_connections 2024-04-25T19:23:10.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.051+0000 7f0064a00640 1 -- 172.21.15.131:0/3459270491 wait complete. 2024-04-25T19:23:10.076 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-25T19:23:10.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:23:10.076 DEBUG:teuthology.orchestra.run.smithi195:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-25T19:23:10.172 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T19:23:10.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:23:10.173 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T19:23:10.234 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:23:10.234 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:23:10.291 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:23:10.291 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:23:10.342 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:23:10.342 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:23:10.439 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:23:10.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.709+0000 7fb9c9000640 1 Processor -- start 2024-04-25T19:23:10.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.709+0000 7fb9c9000640 1 -- start start 2024-04-25T19:23:10.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.712+0000 7fb9c9000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9c41434d0 0x7fb9c4070480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:10.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.712+0000 7fb9c9000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb9c40d0ed0 0x7fb9c40d12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:10.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.712+0000 7fb9c9000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9c40709c0 con 0x7fb9c4160be0 2024-04-25T19:23:10.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.712+0000 7fb9c9000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb9c41438e0 con 0x7fb9c40d0ed0 2024-04-25T19:23:10.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.712+0000 7fb9c9000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c406f3e0 con 0x7fb9c41434d0 2024-04-25T19:23:10.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.712+0000 7fb9c2800640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fb9c4160be0 0x7fb9c4160ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.131:45710/0 (socket says 172.21.15.131:45710) 2024-04-25T19:23:10.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.712+0000 7fb9c2800640 1 -- 172.21.15.131:0/1112984717 learned_addr learned my addr 172.21.15.131:0/1112984717 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:10.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.712+0000 7fb9b9400640 1 --2- 172.21.15.131:0/1112984717 >> v2:172.21.15.195:3300/0 conn(0x7fb9c40d0ed0 0x7fb9c40d12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:10.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.713+0000 7fb9c1e00640 1 --2- 172.21.15.131:0/1112984717 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9c41434d0 0x7fb9c4070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:10.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.713+0000 7fb9c1400640 1 -- 172.21.15.131:0/1112984717 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1016315012 0 0) 0x7fb9c40709c0 con 0x7fb9c4160be0 2024-04-25T19:23:10.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.713+0000 7fb9c1400640 1 -- 172.21.15.131:0/1112984717 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9a8003520 con 0x7fb9c4160be0 2024-04-25T19:23:10.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.713+0000 7fb9b9400640 1 -- 172.21.15.131:0/1112984717 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9c41434d0 msgr2=0x7fb9c4070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:10.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.713+0000 7fb9b9400640 1 --2- 172.21.15.131:0/1112984717 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9c41434d0 0x7fb9c4070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:10.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.713+0000 7fb9b9400640 1 -- 172.21.15.131:0/1112984717 >> v1:172.21.15.195:6789/0 conn(0x7fb9c4160be0 legacy=0x7fb9c4160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:10.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.713+0000 7fb9b9400640 1 -- 172.21.15.131:0/1112984717 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c406f6c0 con 0x7fb9c40d0ed0 2024-04-25T19:23:10.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.714+0000 7fb9b9400640 1 --2- 172.21.15.131:0/1112984717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9c40d0ed0 0x7fb9c40d12e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0097a0 tx=0x7fb9ac02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b173ddf596158cad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:10.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.715+0000 7fb9c1400640 1 -- 172.21.15.131:0/1112984717 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac037070 con 0x7fb9c40d0ed0 2024-04-25T19:23:10.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.715+0000 7fb9c1400640 1 -- 172.21.15.131:0/1112984717 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9ac032440 con 0x7fb9c40d0ed0 2024-04-25T19:23:10.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.715+0000 7fb9c1400640 1 -- 172.21.15.131:0/1112984717 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac0327f0 con 0x7fb9c40d0ed0 2024-04-25T19:23:10.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.716+0000 7fb9c9000640 1 -- 172.21.15.131:0/1112984717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9c40d0ed0 msgr2=0x7fb9c40d12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:10.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.716+0000 7fb9c9000640 1 --2- 172.21.15.131:0/1112984717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9c40d0ed0 0x7fb9c40d12e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0097a0 tx=0x7fb9ac02a180 comp rx=0 tx=0).stop 2024-04-25T19:23:10.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.716+0000 7fb9c9000640 1 -- 172.21.15.131:0/1112984717 shutdown_connections 2024-04-25T19:23:10.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.716+0000 7fb9c9000640 1 --2- 172.21.15.131:0/1112984717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9c40d0ed0 0x7fb9c40d12e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:10.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.716+0000 7fb9c9000640 1 --2- 172.21.15.131:0/1112984717 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9c41434d0 0x7fb9c4070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:10.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.716+0000 7fb9c9000640 1 -- 172.21.15.131:0/1112984717 >> 172.21.15.131:0/1112984717 conn(0x7fb9c40d1ae0 msgr2=0x7fb9c40d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:10.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.716+0000 7fb9c9000640 1 -- 172.21.15.131:0/1112984717 shutdown_connections 2024-04-25T19:23:10.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.716+0000 7fb9c9000640 1 -- 172.21.15.131:0/1112984717 wait complete. 2024-04-25T19:23:10.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.718+0000 7fb9c9000640 1 Processor -- start 2024-04-25T19:23:10.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.718+0000 7fb9c9000640 1 -- start start 2024-04-25T19:23:10.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.720+0000 7fb9c9000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9c40d0ed0 0x7fb9c41f9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:10.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.720+0000 7fb9c9000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9c41434d0 0x7fb9c40ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:10.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.720+0000 7fb9c9000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9c4160be0 0x7fb9c4140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:10.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.720+0000 7fb9c9000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c406f090 con 0x7fb9c40d0ed0 2024-04-25T19:23:10.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.720+0000 7fb9c9000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c406fc80 con 0x7fb9c4160be0 2024-04-25T19:23:10.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.720+0000 7fb9c9000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c40b51a0 con 0x7fb9c41434d0 2024-04-25T19:23:10.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.720+0000 7fb9c1e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9c40d0ed0 0x7fb9c41f9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:10.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.720+0000 7fb9c1e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9c40d0ed0 0x7fb9c41f9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55870/0 (socket says 172.21.15.131:55870) 2024-04-25T19:23:10.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.720+0000 7fb9c1e00640 1 -- 172.21.15.131:0/902194204 learned_addr learned my addr 172.21.15.131:0/902194204 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:10.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.720+0000 7fb9c2800640 1 --2- 172.21.15.131:0/902194204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9c4160be0 0x7fb9c4140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:10.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.721+0000 7fb9b9400640 1 --2- 172.21.15.131:0/902194204 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9c41434d0 0x7fb9c40ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:10.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.721+0000 7fb9c1e00640 1 -- 172.21.15.131:0/902194204 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9c41434d0 msgr2=0x7fb9c40ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:10.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.721+0000 7fb9c1e00640 1 --2- 172.21.15.131:0/902194204 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9c41434d0 0x7fb9c40ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:10.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.721+0000 7fb9c1e00640 1 -- 172.21.15.131:0/902194204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9c4160be0 msgr2=0x7fb9c4140ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:10.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.721+0000 7fb9c1e00640 1 --2- 172.21.15.131:0/902194204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9c4160be0 0x7fb9c4140ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:10.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.721+0000 7fb9c1e00640 1 -- 172.21.15.131:0/902194204 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c40b04f0 con 0x7fb9c40d0ed0 2024-04-25T19:23:10.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.721+0000 7fb9b9400640 1 --2- 172.21.15.131:0/902194204 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9c41434d0 0x7fb9c40ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T19:23:10.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.721+0000 7fb9c1e00640 1 --2- 172.21.15.131:0/902194204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9c40d0ed0 0x7fb9c41f9210 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400e8a0 tx=0x7fb9b400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:10.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.721+0000 7fb9baa00640 1 -- 172.21.15.131:0/902194204 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4017070 con 0x7fb9c40d0ed0 2024-04-25T19:23:10.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.721+0000 7fb9baa00640 1 -- 172.21.15.131:0/902194204 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b400c940 con 0x7fb9c40d0ed0 2024-04-25T19:23:10.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.722+0000 7fb9baa00640 1 -- 172.21.15.131:0/902194204 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b400cd30 con 0x7fb9c40d0ed0 2024-04-25T19:23:10.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.722+0000 7fb9c9000640 1 -- 172.21.15.131:0/902194204 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9c40af1b0 con 0x7fb9c40d0ed0 2024-04-25T19:23:10.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.722+0000 7fb9c9000640 1 -- 172.21.15.131:0/902194204 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9c40af770 con 0x7fb9c40d0ed0 2024-04-25T19:23:10.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.723+0000 7fb9c9000640 1 -- 172.21.15.131:0/902194204 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9c41606b0 con 0x7fb9c40d0ed0 2024-04-25T19:23:10.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.724+0000 7fb9baa00640 1 -- 172.21.15.131:0/902194204 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb9b401a070 con 0x7fb9c40d0ed0 2024-04-25T19:23:10.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.725+0000 7fb9baa00640 1 --2- 172.21.15.131:0/902194204 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb9a00744b0 0x7fb9a00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:10.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.725+0000 7fb9baa00640 1 -- 172.21.15.131:0/902194204 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fb9b40950d0 con 0x7fb9c40d0ed0 2024-04-25T19:23:10.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.726+0000 7fb9b9400640 1 --2- 172.21.15.131:0/902194204 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb9a00744b0 0x7fb9a00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:10.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.727+0000 7fb9b9400640 1 --2- 172.21.15.131:0/902194204 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb9a00744b0 0x7fb9a00769c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac034000 tx=0x7fb9ac02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:10.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.729+0000 7fb9baa00640 1 -- 172.21.15.131:0/902194204 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb9b405f180 con 0x7fb9c40d0ed0 2024-04-25T19:23:10.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.916+0000 7fb9c9000640 1 -- 172.21.15.131:0/902194204 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9c4073fd0 con 0x7fb9c40d0ed0 2024-04-25T19:23:10.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.917+0000 7fb9baa00640 1 -- 172.21.15.131:0/902194204 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16878 (secure 0 0 0) 0x7fb9b4063480 con 0x7fb9c40d0ed0 2024-04-25T19:23:10.919 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:10.919 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":22,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:22:57.347297+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:22:14.779716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T19:22:15.552027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:23:10.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.920+0000 7fb9c9000640 1 -- 172.21.15.131:0/902194204 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb9a00744b0 msgr2=0x7fb9a00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:10.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.920+0000 7fb9c9000640 1 --2- 172.21.15.131:0/902194204 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb9a00744b0 0x7fb9a00769c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac034000 tx=0x7fb9ac02e000 comp rx=0 tx=0).stop 2024-04-25T19:23:10.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.920+0000 7fb9c9000640 1 -- 172.21.15.131:0/902194204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9c40d0ed0 msgr2=0x7fb9c41f9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:10.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.920+0000 7fb9c9000640 1 --2- 172.21.15.131:0/902194204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9c40d0ed0 0x7fb9c41f9210 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400e8a0 tx=0x7fb9b400ed60 comp rx=0 tx=0).stop 2024-04-25T19:23:10.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.920+0000 7fb9c9000640 1 -- 172.21.15.131:0/902194204 shutdown_connections 2024-04-25T19:23:10.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.920+0000 7fb9c9000640 1 --2- 172.21.15.131:0/902194204 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb9a00744b0 0x7fb9a00769c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:10.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.920+0000 7fb9c9000640 1 --2- 172.21.15.131:0/902194204 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9c41434d0 0x7fb9c40ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:10.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.920+0000 7fb9c9000640 1 --2- 172.21.15.131:0/902194204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9c4160be0 0x7fb9c4140ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:10.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.920+0000 7fb9c9000640 1 --2- 172.21.15.131:0/902194204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9c40d0ed0 0x7fb9c41f9210 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:10.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.920+0000 7fb9c9000640 1 -- 172.21.15.131:0/902194204 >> 172.21.15.131:0/902194204 conn(0x7fb9c40d1ae0 msgr2=0x7fb9c4070380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:10.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.920+0000 7fb9c9000640 1 -- 172.21.15.131:0/902194204 shutdown_connections 2024-04-25T19:23:10.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:10.921+0000 7fb9c9000640 1 -- 172.21.15.131:0/902194204 wait complete. 2024-04-25T19:23:10.945 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T19:22:04.178847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T19:22:14.779716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T19:22:15.552027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T19:23:10.945 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T19:23:11.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.212+0000 7f2a0de00640 1 Processor -- start 2024-04-25T19:23:11.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.212+0000 7f2a0de00640 1 -- start start 2024-04-25T19:23:11.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.215+0000 7f2a0de00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a080cd9a0 0x7f2a0815f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:11.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.215+0000 7f2a0de00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2a0806dce0 0x7f2a0815faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:11.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.215+0000 7f2a0de00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a080cdea0 con 0x7f2a080b0af0 2024-04-25T19:23:11.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.215+0000 7f2a0de00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f2a080ceab0 con 0x7f2a0806dce0 2024-04-25T19:23:11.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.215+0000 7f2a0de00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2a080ce180 con 0x7f2a080cd9a0 2024-04-25T19:23:11.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.215+0000 7f2a07400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2a0806dce0 0x7f2a0815faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:11.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.215+0000 7f2a07400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2a0806dce0 0x7f2a0815faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55884/0 (socket says 172.21.15.131:55884) 2024-04-25T19:23:11.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.215+0000 7f2a07400640 1 -- 172.21.15.131:0/948583074 learned_addr learned my addr 172.21.15.131:0/948583074 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:11.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.215+0000 7f2a06a00640 1 --2- 172.21.15.131:0/948583074 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a080cd9a0 0x7f2a0815f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:11.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.216+0000 7f2a07400640 1 -- 172.21.15.131:0/948583074 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a080cd9a0 msgr2=0x7f2a0815f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:11.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.216+0000 7f2a07400640 1 --2- 172.21.15.131:0/948583074 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a080cd9a0 0x7f2a0815f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:11.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.216+0000 7f2a07400640 1 -- 172.21.15.131:0/948583074 >> v1:172.21.15.195:6789/0 conn(0x7f2a080b0af0 legacy=0x7f2a0806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:11.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.216+0000 7f2a07400640 1 -- 172.21.15.131:0/948583074 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a080ce460 con 0x7f2a0806dce0 2024-04-25T19:23:11.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.217+0000 7f2a07400640 1 --2- 172.21.15.131:0/948583074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a0806dce0 0x7f2a0815faa0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009e50 tx=0x7f2a0002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4872ec75c066289 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:11.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.217+0000 7f2a06000640 1 -- 172.21.15.131:0/948583074 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00036070 con 0x7f2a0806dce0 2024-04-25T19:23:11.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.217+0000 7f2a06000640 1 -- 172.21.15.131:0/948583074 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a00031600 con 0x7f2a0806dce0 2024-04-25T19:23:11.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.217+0000 7f2a06000640 1 -- 172.21.15.131:0/948583074 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a000319d0 con 0x7f2a0806dce0 2024-04-25T19:23:11.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.218+0000 7f2a0de00640 1 -- 172.21.15.131:0/948583074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a0806dce0 msgr2=0x7f2a0815faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:11.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.218+0000 7f2a0de00640 1 --2- 172.21.15.131:0/948583074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a0806dce0 0x7f2a0815faa0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009e50 tx=0x7f2a0002a710 comp rx=0 tx=0).stop 2024-04-25T19:23:11.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.218+0000 7f2a0de00640 1 -- 172.21.15.131:0/948583074 shutdown_connections 2024-04-25T19:23:11.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.218+0000 7f2a0de00640 1 --2- 172.21.15.131:0/948583074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a0806dce0 0x7f2a0815faa0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:11.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.218+0000 7f2a0de00640 1 --2- 172.21.15.131:0/948583074 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a080cd9a0 0x7f2a0815f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:11.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.218+0000 7f2a0de00640 1 -- 172.21.15.131:0/948583074 >> 172.21.15.131:0/948583074 conn(0x7f2a08073090 msgr2=0x7f2a080734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:11.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.218+0000 7f2a0de00640 1 -- 172.21.15.131:0/948583074 shutdown_connections 2024-04-25T19:23:11.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.218+0000 7f2a0de00640 1 -- 172.21.15.131:0/948583074 wait complete. 2024-04-25T19:23:11.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.221+0000 7f2a0de00640 1 Processor -- start 2024-04-25T19:23:11.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.221+0000 7f2a0de00640 1 -- start start 2024-04-25T19:23:11.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.222+0000 7f2a0de00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a080b0af0 0x7f2a08157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:11.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.222+0000 7f2a0de00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a080cd9a0 0x7f2a081f4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:11.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.222+0000 7f2a0de00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a08155a00 0x7f2a080b2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:11.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.222+0000 7f2a0de00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2a080cef40 con 0x7f2a08155a00 2024-04-25T19:23:11.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.222+0000 7f2a0de00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2a080b0f00 con 0x7f2a080b0af0 2024-04-25T19:23:11.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.222+0000 7f2a0de00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2a080cf0c0 con 0x7f2a080cd9a0 2024-04-25T19:23:11.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.223+0000 7f2a07400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a08155a00 0x7f2a080b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:11.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.223+0000 7f2a07400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a08155a00 0x7f2a080b2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55896/0 (socket says 172.21.15.131:55896) 2024-04-25T19:23:11.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.223+0000 7f2a07400640 1 -- 172.21.15.131:0/935563835 learned_addr learned my addr 172.21.15.131:0/935563835 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:11.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.223+0000 7f2a06a00640 1 --2- 172.21.15.131:0/935563835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a080b0af0 0x7f2a08157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:11.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.223+0000 7f2a07400640 1 -- 172.21.15.131:0/935563835 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a080cd9a0 msgr2=0x7f2a081f4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:11.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.223+0000 7f29fe000640 1 --2- 172.21.15.131:0/935563835 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a080cd9a0 0x7f2a081f4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:11.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.223+0000 7f2a07400640 1 --2- 172.21.15.131:0/935563835 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a080cd9a0 0x7f2a081f4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:11.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.223+0000 7f2a07400640 1 -- 172.21.15.131:0/935563835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a080b0af0 msgr2=0x7f2a08157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:11.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.223+0000 7f2a07400640 1 --2- 172.21.15.131:0/935563835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a080b0af0 0x7f2a08157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:11.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.223+0000 7f2a07400640 1 -- 172.21.15.131:0/935563835 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a081561e0 con 0x7f2a08155a00 2024-04-25T19:23:11.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.223+0000 7f2a06a00640 1 --2- 172.21.15.131:0/935563835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a080b0af0 0x7f2a08157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:11.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.224+0000 7f2a07400640 1 --2- 172.21.15.131:0/935563835 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a08155a00 0x7f2a080b2670 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2a00034040 tx=0x7f2a00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:11.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.224+0000 7f29ffe00640 1 -- 172.21.15.131:0/935563835 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00036050 con 0x7f2a08155a00 2024-04-25T19:23:11.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.224+0000 7f29ffe00640 1 -- 172.21.15.131:0/935563835 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a00042070 con 0x7f2a08155a00 2024-04-25T19:23:11.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.224+0000 7f2a0de00640 1 -- 172.21.15.131:0/935563835 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a081564c0 con 0x7f2a08155a00 2024-04-25T19:23:11.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.224+0000 7f29ffe00640 1 -- 172.21.15.131:0/935563835 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00009510 con 0x7f2a08155a00 2024-04-25T19:23:11.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.224+0000 7f2a0de00640 1 -- 172.21.15.131:0/935563835 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a08156a80 con 0x7f2a08155a00 2024-04-25T19:23:11.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.225+0000 7f2a0de00640 1 -- 172.21.15.131:0/935563835 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a08155f50 con 0x7f2a08155a00 2024-04-25T19:23:11.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.227+0000 7f29ffe00640 1 -- 172.21.15.131:0/935563835 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2a00007bd0 con 0x7f2a08155a00 2024-04-25T19:23:11.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.228+0000 7f29ffe00640 1 --2- 172.21.15.131:0/935563835 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f29e40744e0 0x7f29e40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:11.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.228+0000 7f29ffe00640 1 -- 172.21.15.131:0/935563835 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f2a000b61e0 con 0x7f2a08155a00 2024-04-25T19:23:11.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.228+0000 7f2a06a00640 1 --2- 172.21.15.131:0/935563835 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f29e40744e0 0x7f29e40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:11.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.230+0000 7f2a06a00640 1 --2- 172.21.15.131:0/935563835 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f29e40744e0 0x7f29e40769f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f29f8006fd0 tx=0x7f29f8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:11.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.233+0000 7f29ffe00640 1 -- 172.21.15.131:0/935563835 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2a00080850 con 0x7f2a08155a00 2024-04-25T19:23:11.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.434+0000 7f2a0de00640 1 -- 172.21.15.131:0/935563835 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2a08050740 con 0x7f2a08155a00 2024-04-25T19:23:11.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.435+0000 7f29ffe00640 1 -- 172.21.15.131:0/935563835 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f2a00080150 con 0x7f2a08155a00 2024-04-25T19:23:11.436 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-25T19:23:11.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.438+0000 7f2a0de00640 1 -- 172.21.15.131:0/935563835 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f29e40744e0 msgr2=0x7f29e40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:11.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.438+0000 7f2a0de00640 1 --2- 172.21.15.131:0/935563835 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f29e40744e0 0x7f29e40769f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f29f8006fd0 tx=0x7f29f8008040 comp rx=0 tx=0).stop 2024-04-25T19:23:11.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.438+0000 7f2a0de00640 1 -- 172.21.15.131:0/935563835 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a08155a00 msgr2=0x7f2a080b2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:11.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.438+0000 7f2a0de00640 1 --2- 172.21.15.131:0/935563835 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a08155a00 0x7f2a080b2670 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2a00034040 tx=0x7f2a00004a40 comp rx=0 tx=0).stop 2024-04-25T19:23:11.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.438+0000 7f2a0de00640 1 -- 172.21.15.131:0/935563835 shutdown_connections 2024-04-25T19:23:11.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.438+0000 7f2a0de00640 1 --2- 172.21.15.131:0/935563835 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f29e40744e0 0x7f29e40769f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:11.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.438+0000 7f2a0de00640 1 --2- 172.21.15.131:0/935563835 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a080cd9a0 0x7f2a081f4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:11.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.438+0000 7f2a0de00640 1 --2- 172.21.15.131:0/935563835 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a08155a00 0x7f2a080b2670 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:11.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.438+0000 7f2a0de00640 1 --2- 172.21.15.131:0/935563835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a080b0af0 0x7f2a08157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:11.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.438+0000 7f2a0de00640 1 -- 172.21.15.131:0/935563835 >> 172.21.15.131:0/935563835 conn(0x7f2a08073090 msgr2=0x7f2a0815ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:11.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.439+0000 7f2a0de00640 1 -- 172.21.15.131:0/935563835 shutdown_connections 2024-04-25T19:23:11.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.439+0000 7f2a0de00640 1 -- 172.21.15.131:0/935563835 wait complete. 2024-04-25T19:23:11.469 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T19:23:11.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.741+0000 7f9bd5600640 1 Processor -- start 2024-04-25T19:23:11.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.742+0000 7f9bd5600640 1 -- start start 2024-04-25T19:23:11.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.744+0000 7f9bd5600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9bd0144340 0x7f9bd006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:11.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.744+0000 7f9bd5600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd006df20 con 0x7f9bd015ee60 2024-04-25T19:23:11.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.744+0000 7f9bd5600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd0070000 con 0x7f9bd006db10 2024-04-25T19:23:11.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.744+0000 7f9bd5600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd015f270 con 0x7f9bd0144340 2024-04-25T19:23:11.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.744+0000 7f9bd4c00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f9bd015ee60 0x7f9bd015f4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53282/0 (socket says 172.21.15.131:53282) 2024-04-25T19:23:11.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.744+0000 7f9bd4c00640 1 -- 172.21.15.131:0/3523666822 learned_addr learned my addr 172.21.15.131:0/3523666822 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:11.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.745+0000 7f9bcfe00640 1 --2- 172.21.15.131:0/3523666822 >> v2:172.21.15.195:3300/0 conn(0x7f9bd0144340 0x7f9bd006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:11.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.745+0000 7f9bcea00640 1 -- 172.21.15.131:0/3523666822 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 105253928 0 0) 0x7f9bc8001110 con 0x7f9bd015ee60 2024-04-25T19:23:11.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.745+0000 7f9bcea00640 1 -- 172.21.15.131:0/3523666822 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bb4003520 con 0x7f9bd015ee60 2024-04-25T19:23:11.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.745+0000 7f9bcea00640 1 -- 172.21.15.131:0/3523666822 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2429914788 0 0) 0x7f9bb4003520 con 0x7f9bd015ee60 2024-04-25T19:23:11.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.745+0000 7f9bcea00640 1 -- 172.21.15.131:0/3523666822 >> v2:172.21.15.195:3300/0 conn(0x7f9bd0144340 msgr2=0x7f9bd006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:11.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.745+0000 7f9bcea00640 1 --2- 172.21.15.131:0/3523666822 >> v2:172.21.15.195:3300/0 conn(0x7f9bd0144340 0x7f9bd006d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:11.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.745+0000 7f9bcea00640 1 -- 172.21.15.131:0/3523666822 >> v1:172.21.15.195:6789/0 conn(0x7f9bd006db10 legacy=0x7f9bd015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:11.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.745+0000 7f9bcea00640 1 -- 172.21.15.131:0/3523666822 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd006f240 con 0x7f9bd015ee60 2024-04-25T19:23:11.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.745+0000 7f9bcea00640 1 -- 172.21.15.131:0/3523666822 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f9bc8001840 con 0x7f9bd015ee60 2024-04-25T19:23:11.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.745+0000 7f9bcea00640 1 -- 172.21.15.131:0/3523666822 >> v1:172.21.15.131:6789/0 conn(0x7f9bd015ee60 legacy=0x7f9bd015f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:11.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.745+0000 7f9bcea00640 1 --2- 172.21.15.131:0/3523666822 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9bb40039b0 0x7f9bb4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:11.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.745+0000 7f9bcea00640 1 --2- 172.21.15.131:0/3523666822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bb4004800 0x7f9bb4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:11.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.745+0000 7f9bcea00640 1 --2- 172.21.15.131:0/3523666822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bb40051c0 0x7f9bb400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:11.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.745+0000 7f9bcea00640 1 -- 172.21.15.131:0/3523666822 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb400c130 con 0x7f9bb40051c0 2024-04-25T19:23:11.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.745+0000 7f9bcea00640 1 -- 172.21.15.131:0/3523666822 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb400c2e0 con 0x7f9bb4004800 2024-04-25T19:23:11.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.745+0000 7f9bcea00640 1 -- 172.21.15.131:0/3523666822 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9bb400c4e0 con 0x7f9bb40039b0 2024-04-25T19:23:11.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.746+0000 7f9bd4c00640 1 --2- 172.21.15.131:0/3523666822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bb40051c0 0x7f9bb400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:11.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.746+0000 7f9bcfe00640 1 --2- 172.21.15.131:0/3523666822 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9bb40039b0 0x7f9bb4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:11.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.746+0000 7f9bcf400640 1 --2- 172.21.15.131:0/3523666822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bb4004800 0x7f9bb4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:11.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.746+0000 7f9bd4c00640 1 -- 172.21.15.131:0/3523666822 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9bb40039b0 msgr2=0x7f9bb4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:11.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.746+0000 7f9bd4c00640 1 --2- 172.21.15.131:0/3523666822 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9bb40039b0 0x7f9bb4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:11.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.746+0000 7f9bd4c00640 1 -- 172.21.15.131:0/3523666822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bb4004800 msgr2=0x7f9bb4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:11.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.746+0000 7f9bd4c00640 1 --2- 172.21.15.131:0/3523666822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bb4004800 0x7f9bb4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:11.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.746+0000 7f9bd4c00640 1 -- 172.21.15.131:0/3523666822 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb4003520 con 0x7f9bb40051c0 2024-04-25T19:23:11.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.747+0000 7f9bd4c00640 1 -- 172.21.15.131:0/3523666822 reap_dead start 2024-04-25T19:23:11.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.747+0000 7f9bd4c00640 1 --2- 172.21.15.131:0/3523666822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bb40051c0 0x7f9bb400b9c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9bc800c490 tx=0x7f9bb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be01186cfbd3a698 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:11.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.747+0000 7f9bcea00640 1 -- 172.21.15.131:0/3523666822 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8036070 con 0x7f9bb40051c0 2024-04-25T19:23:11.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.748+0000 7f9bcea00640 1 -- 172.21.15.131:0/3523666822 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc8005af0 con 0x7f9bb40051c0 2024-04-25T19:23:11.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.748+0000 7f9bcea00640 1 -- 172.21.15.131:0/3523666822 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc800c0e0 con 0x7f9bb40051c0 2024-04-25T19:23:11.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.748+0000 7f9bd5600640 1 -- 172.21.15.131:0/3523666822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bb40051c0 msgr2=0x7f9bb400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:11.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.748+0000 7f9bd5600640 1 --2- 172.21.15.131:0/3523666822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bb40051c0 0x7f9bb400b9c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9bc800c490 tx=0x7f9bb4005830 comp rx=0 tx=0).stop 2024-04-25T19:23:11.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.748+0000 7f9bd5600640 1 -- 172.21.15.131:0/3523666822 shutdown_connections 2024-04-25T19:23:11.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.748+0000 7f9bd5600640 1 --2- 172.21.15.131:0/3523666822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bb40051c0 0x7f9bb400b9c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:11.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.748+0000 7f9bd5600640 1 -- 172.21.15.131:0/3523666822 >> 172.21.15.131:0/3523666822 conn(0x7f9bd0072f40 msgr2=0x7f9bd0073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:11.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.748+0000 7f9bd5600640 1 -- 172.21.15.131:0/3523666822 shutdown_connections 2024-04-25T19:23:11.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.749+0000 7f9bd5600640 1 -- 172.21.15.131:0/3523666822 wait complete. 2024-04-25T19:23:11.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.751+0000 7f9bd5600640 1 Processor -- start 2024-04-25T19:23:11.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.751+0000 7f9bd5600640 1 -- start start 2024-04-25T19:23:11.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.753+0000 7f9bd5600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9bb40051c0 0x7f9bd01f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:11.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.753+0000 7f9bd5600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bd00b6400 0x7f9bd013eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:11.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.753+0000 7f9bd5600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bd01463a0 0x7f9bd01467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:11.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.753+0000 7f9bd5600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd006f800 con 0x7f9bd01463a0 2024-04-25T19:23:11.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.753+0000 7f9bd5600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd0144750 con 0x7f9bd00b6400 2024-04-25T19:23:11.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.753+0000 7f9bd5600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd006fae0 con 0x7f9bb40051c0 2024-04-25T19:23:11.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.753+0000 7f9bd4c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bd01463a0 0x7f9bd01467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:11.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.753+0000 7f9bd4c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bd01463a0 0x7f9bd01467b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55916/0 (socket says 172.21.15.131:55916) 2024-04-25T19:23:11.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.753+0000 7f9bd4c00640 1 -- 172.21.15.131:0/1545234988 learned_addr learned my addr 172.21.15.131:0/1545234988 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:11.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.753+0000 7f9bcf400640 1 --2- 172.21.15.131:0/1545234988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bd00b6400 0x7f9bd013eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:11.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.753+0000 7f9bcfe00640 1 --2- 172.21.15.131:0/1545234988 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9bb40051c0 0x7f9bd01f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:11.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.753+0000 7f9bd4c00640 1 -- 172.21.15.131:0/1545234988 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9bb40051c0 msgr2=0x7f9bd01f5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:11.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.753+0000 7f9bd4c00640 1 --2- 172.21.15.131:0/1545234988 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9bb40051c0 0x7f9bd01f5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:11.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.753+0000 7f9bd4c00640 1 -- 172.21.15.131:0/1545234988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bd00b6400 msgr2=0x7f9bd013eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:11.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.753+0000 7f9bd4c00640 1 --2- 172.21.15.131:0/1545234988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bd00b6400 0x7f9bd013eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:11.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.753+0000 7f9bd4c00640 1 -- 172.21.15.131:0/1545234988 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd0146cf0 con 0x7f9bd01463a0 2024-04-25T19:23:11.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.754+0000 7f9bd4c00640 1 --2- 172.21.15.131:0/1545234988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bd01463a0 0x7f9bd01467b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8034040 tx=0x7f9bd006f410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:11.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.754+0000 7f9bc7e00640 1 -- 172.21.15.131:0/1545234988 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8036040 con 0x7f9bd01463a0 2024-04-25T19:23:11.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.754+0000 7f9bc7e00640 1 -- 172.21.15.131:0/1545234988 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc8041070 con 0x7f9bd01463a0 2024-04-25T19:23:11.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.754+0000 7f9bd5600640 1 -- 172.21.15.131:0/1545234988 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bd0161fa0 con 0x7f9bd01463a0 2024-04-25T19:23:11.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.754+0000 7f9bc7e00640 1 -- 172.21.15.131:0/1545234988 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc80074d0 con 0x7f9bd01463a0 2024-04-25T19:23:11.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.754+0000 7f9bd5600640 1 -- 172.21.15.131:0/1545234988 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bd01f2560 con 0x7f9bd01463a0 2024-04-25T19:23:11.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.755+0000 7f9bd5600640 1 -- 172.21.15.131:0/1545234988 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bd00b68e0 con 0x7f9bd01463a0 2024-04-25T19:23:11.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.757+0000 7f9bc7e00640 1 -- 172.21.15.131:0/1545234988 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9bc8007670 con 0x7f9bd01463a0 2024-04-25T19:23:11.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.758+0000 7f9bc7e00640 1 --2- 172.21.15.131:0/1545234988 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9bac0744b0 0x7f9bac0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:11.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.758+0000 7f9bc7e00640 1 -- 172.21.15.131:0/1545234988 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f9bc80b53d0 con 0x7f9bd01463a0 2024-04-25T19:23:11.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.759+0000 7f9bcfe00640 1 --2- 172.21.15.131:0/1545234988 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9bac0744b0 0x7f9bac0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:11.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.760+0000 7f9bcfe00640 1 --2- 172.21.15.131:0/1545234988 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9bac0744b0 0x7f9bac0769c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8009990 tx=0x7f9bb8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:11.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.763+0000 7f9bc7e00640 1 -- 172.21.15.131:0/1545234988 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9bd0146cf0 con 0x7f9bd01463a0 2024-04-25T19:23:11.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.962+0000 7f9bd5600640 1 -- 172.21.15.131:0/1545234988 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9bd0076c60 con 0x7f9bd01463a0 2024-04-25T19:23:11.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.963+0000 7f9bc7e00640 1 -- 172.21.15.131:0/1545234988 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f9bd006df20 con 0x7f9bd01463a0 2024-04-25T19:23:11.964 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-25T19:23:11.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.966+0000 7f9bd5600640 1 -- 172.21.15.131:0/1545234988 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9bac0744b0 msgr2=0x7f9bac0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:11.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.966+0000 7f9bd5600640 1 --2- 172.21.15.131:0/1545234988 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9bac0744b0 0x7f9bac0769c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8009990 tx=0x7f9bb8008040 comp rx=0 tx=0).stop 2024-04-25T19:23:11.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.966+0000 7f9bd5600640 1 -- 172.21.15.131:0/1545234988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bd01463a0 msgr2=0x7f9bd01467b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:11.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.966+0000 7f9bd5600640 1 --2- 172.21.15.131:0/1545234988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bd01463a0 0x7f9bd01467b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8034040 tx=0x7f9bd006f410 comp rx=0 tx=0).stop 2024-04-25T19:23:11.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.966+0000 7f9bd5600640 1 -- 172.21.15.131:0/1545234988 shutdown_connections 2024-04-25T19:23:11.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.966+0000 7f9bd5600640 1 --2- 172.21.15.131:0/1545234988 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9bac0744b0 0x7f9bac0769c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:11.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.966+0000 7f9bd5600640 1 --2- 172.21.15.131:0/1545234988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bd01463a0 0x7f9bd01467b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:11.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.966+0000 7f9bd5600640 1 --2- 172.21.15.131:0/1545234988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bd00b6400 0x7f9bd013eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:11.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.966+0000 7f9bd5600640 1 --2- 172.21.15.131:0/1545234988 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9bb40051c0 0x7f9bd01f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:11.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.966+0000 7f9bd5600640 1 -- 172.21.15.131:0/1545234988 >> 172.21.15.131:0/1545234988 conn(0x7f9bd0072f40 msgr2=0x7f9bd00b14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:11.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.966+0000 7f9bd5600640 1 -- 172.21.15.131:0/1545234988 shutdown_connections 2024-04-25T19:23:11.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:11.966+0000 7f9bd5600640 1 -- 172.21.15.131:0/1545234988 wait complete. 2024-04-25T19:23:11.991 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T19:23:12.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.264+0000 7f9002200640 1 Processor -- start 2024-04-25T19:23:12.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.264+0000 7f9002200640 1 -- start start 2024-04-25T19:23:12.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.267+0000 7f9002200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ffc070d20 0x7f8ffc161b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:12.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.267+0000 7f9002200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8ffc06f930 0x7f8ffc06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:12.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.267+0000 7f9002200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ffc1623f0 con 0x7f8ffc06fd40 2024-04-25T19:23:12.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.267+0000 7f9002200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f8ffc1626d0 con 0x7f8ffc06f930 2024-04-25T19:23:12.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.267+0000 7f9002200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8ffc06f130 con 0x7f8ffc070d20 2024-04-25T19:23:12.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.267+0000 7f9000e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ffc070d20 0x7f8ffc161b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:12.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.267+0000 7f8ffbe00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8ffc06f930 0x7f8ffc06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:12.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.268+0000 7f9001800640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f8ffc06fd40 0x7f8ffc0ce7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.131:45746/0 (socket says 172.21.15.131:45746) 2024-04-25T19:23:12.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.268+0000 7f8ffbe00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8ffc06f930 0x7f8ffc06d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.131:59228/0 (socket says 172.21.15.131:59228) 2024-04-25T19:23:12.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.268+0000 7f9001800640 1 -- 172.21.15.131:0/3325826338 learned_addr learned my addr 172.21.15.131:0/3325826338 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:12.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.268+0000 7f8ffbe00640 1 -- 172.21.15.131:0/3325826338 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ffc070d20 msgr2=0x7f8ffc161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:12.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.268+0000 7f8ffbe00640 1 --2- 172.21.15.131:0/3325826338 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ffc070d20 0x7f8ffc161b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:12.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.268+0000 7f8ffbe00640 1 -- 172.21.15.131:0/3325826338 >> v1:172.21.15.195:6789/0 conn(0x7f8ffc06fd40 legacy=0x7f8ffc0ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:12.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.268+0000 7f8ffbe00640 1 -- 172.21.15.131:0/3325826338 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ffc06f410 con 0x7f8ffc06f930 2024-04-25T19:23:12.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.268+0000 7f9000e00640 1 --2- 172.21.15.131:0/3325826338 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ffc070d20 0x7f8ffc161b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T19:23:12.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.270+0000 7f8ffbe00640 1 --2- 172.21.15.131:0/3325826338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ffc06f930 0x7f8ffc06d5d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80097a0 tx=0x7f8fe802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8017914b1662d21 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:12.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.270+0000 7f8ffb400640 1 -- 172.21.15.131:0/3325826338 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8037070 con 0x7f8ffc06f930 2024-04-25T19:23:12.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.270+0000 7f8ffb400640 1 -- 172.21.15.131:0/3325826338 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe802ae50 con 0x7f8ffc06f930 2024-04-25T19:23:12.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.270+0000 7f8ffb400640 1 -- 172.21.15.131:0/3325826338 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8032660 con 0x7f8ffc06f930 2024-04-25T19:23:12.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.271+0000 7f9002200640 1 -- 172.21.15.131:0/3325826338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ffc06f930 msgr2=0x7f8ffc06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:12.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.271+0000 7f9002200640 1 --2- 172.21.15.131:0/3325826338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ffc06f930 0x7f8ffc06d5d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80097a0 tx=0x7f8fe802a100 comp rx=0 tx=0).stop 2024-04-25T19:23:12.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.271+0000 7f9002200640 1 -- 172.21.15.131:0/3325826338 shutdown_connections 2024-04-25T19:23:12.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.271+0000 7f9002200640 1 --2- 172.21.15.131:0/3325826338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ffc06f930 0x7f8ffc06d5d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:12.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.271+0000 7f9002200640 1 --2- 172.21.15.131:0/3325826338 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ffc070d20 0x7f8ffc161b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:12.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.271+0000 7f9002200640 1 -- 172.21.15.131:0/3325826338 >> 172.21.15.131:0/3325826338 conn(0x7f8ffc073160 msgr2=0x7f8ffc073570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:12.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.271+0000 7f9002200640 1 -- 172.21.15.131:0/3325826338 shutdown_connections 2024-04-25T19:23:12.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.271+0000 7f9002200640 1 -- 172.21.15.131:0/3325826338 wait complete. 2024-04-25T19:23:12.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.274+0000 7f9002200640 1 Processor -- start 2024-04-25T19:23:12.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.275+0000 7f9002200640 1 -- start start 2024-04-25T19:23:12.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.277+0000 7f9002200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ffc06f930 0x7f8ffc1f6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:12.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.277+0000 7f9002200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ffc06fd40 0x7f8ffc153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:12.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.277+0000 7f9002200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ffc070d20 0x7f8ffc0cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:12.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.277+0000 7f9002200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc15e2f0 con 0x7f8ffc070d20 2024-04-25T19:23:12.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.277+0000 7f9002200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc162070 con 0x7f8ffc06fd40 2024-04-25T19:23:12.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.277+0000 7f9002200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8ffc15e470 con 0x7f8ffc06f930 2024-04-25T19:23:12.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.277+0000 7f9001800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ffc070d20 0x7f8ffc0cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:12.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.277+0000 7f9001800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ffc070d20 0x7f8ffc0cacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55926/0 (socket says 172.21.15.131:55926) 2024-04-25T19:23:12.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.277+0000 7f9001800640 1 -- 172.21.15.131:0/4111413197 learned_addr learned my addr 172.21.15.131:0/4111413197 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:12.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.277+0000 7f8ffbe00640 1 --2- 172.21.15.131:0/4111413197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ffc06fd40 0x7f8ffc153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:12.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.277+0000 7f9000e00640 1 --2- 172.21.15.131:0/4111413197 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ffc06f930 0x7f8ffc1f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:12.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.278+0000 7f9001800640 1 -- 172.21.15.131:0/4111413197 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ffc06f930 msgr2=0x7f8ffc1f6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:12.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.278+0000 7f9001800640 1 --2- 172.21.15.131:0/4111413197 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ffc06f930 0x7f8ffc1f6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:12.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.278+0000 7f9001800640 1 -- 172.21.15.131:0/4111413197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ffc06fd40 msgr2=0x7f8ffc153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:12.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.278+0000 7f9001800640 1 --2- 172.21.15.131:0/4111413197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ffc06fd40 0x7f8ffc153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:12.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.278+0000 7f9001800640 1 -- 172.21.15.131:0/4111413197 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ffc1f6cf0 con 0x7f8ffc070d20 2024-04-25T19:23:12.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.278+0000 7f9000e00640 1 --2- 172.21.15.131:0/4111413197 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ffc06f930 0x7f8ffc1f6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:12.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.278+0000 7f9001800640 1 --2- 172.21.15.131:0/4111413197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ffc070d20 0x7f8ffc0cacd0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400cad0 tx=0x7f8ff400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:12.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.278+0000 7f8ff8c00640 1 -- 172.21.15.131:0/4111413197 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4017070 con 0x7f8ffc070d20 2024-04-25T19:23:12.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.278+0000 7f8ff8c00640 1 -- 172.21.15.131:0/4111413197 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff400abd0 con 0x7f8ffc070d20 2024-04-25T19:23:12.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.278+0000 7f8ff8c00640 1 -- 172.21.15.131:0/4111413197 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4012400 con 0x7f8ffc070d20 2024-04-25T19:23:12.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.278+0000 7f9002200640 1 -- 172.21.15.131:0/4111413197 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ffc1f6fd0 con 0x7f8ffc070d20 2024-04-25T19:23:12.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.278+0000 7f9002200640 1 -- 172.21.15.131:0/4111413197 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ffc1f7590 con 0x7f8ffc070d20 2024-04-25T19:23:12.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.279+0000 7f9002200640 1 -- 172.21.15.131:0/4111413197 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ffc1f6a60 con 0x7f8ffc070d20 2024-04-25T19:23:12.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.281+0000 7f8ff8c00640 1 -- 172.21.15.131:0/4111413197 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8ff401a070 con 0x7f8ffc070d20 2024-04-25T19:23:12.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.282+0000 7f8ff8c00640 1 --2- 172.21.15.131:0/4111413197 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8fdc0744b0 0x7f8fdc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:12.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.282+0000 7f8ff8c00640 1 -- 172.21.15.131:0/4111413197 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f8ff4094e70 con 0x7f8ffc070d20 2024-04-25T19:23:12.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.283+0000 7f9000e00640 1 --2- 172.21.15.131:0/4111413197 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8fdc0744b0 0x7f8fdc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:12.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.284+0000 7f9000e00640 1 --2- 172.21.15.131:0/4111413197 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8fdc0744b0 0x7f8fdc0769c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0b1350 tx=0x7f8ff0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:12.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.287+0000 7f8ff8c00640 1 -- 172.21.15.131:0/4111413197 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8ff405ef20 con 0x7f8ffc070d20 2024-04-25T19:23:12.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.489+0000 7f9002200640 1 -- 172.21.15.131:0/4111413197 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8ffc076c60 con 0x7f8ffc070d20 2024-04-25T19:23:12.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.490+0000 7f8ff8c00640 1 -- 172.21.15.131:0/4111413197 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f8ff4063220 con 0x7f8ffc070d20 2024-04-25T19:23:12.491 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 64 2024-04-25T19:23:12.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.493+0000 7f9002200640 1 -- 172.21.15.131:0/4111413197 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8fdc0744b0 msgr2=0x7f8fdc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:12.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.493+0000 7f9002200640 1 --2- 172.21.15.131:0/4111413197 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8fdc0744b0 0x7f8fdc0769c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0b1350 tx=0x7f8ff0008040 comp rx=0 tx=0).stop 2024-04-25T19:23:12.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.493+0000 7f9002200640 1 -- 172.21.15.131:0/4111413197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ffc070d20 msgr2=0x7f8ffc0cacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:12.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.493+0000 7f9002200640 1 --2- 172.21.15.131:0/4111413197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ffc070d20 0x7f8ffc0cacd0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400cad0 tx=0x7f8ff400cf90 comp rx=0 tx=0).stop 2024-04-25T19:23:12.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.493+0000 7f9002200640 1 -- 172.21.15.131:0/4111413197 shutdown_connections 2024-04-25T19:23:12.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.493+0000 7f9002200640 1 --2- 172.21.15.131:0/4111413197 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8fdc0744b0 0x7f8fdc0769c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:12.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.493+0000 7f9002200640 1 --2- 172.21.15.131:0/4111413197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ffc070d20 0x7f8ffc0cacd0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:12.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.493+0000 7f9002200640 1 --2- 172.21.15.131:0/4111413197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ffc06fd40 0x7f8ffc153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:12.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.493+0000 7f9002200640 1 --2- 172.21.15.131:0/4111413197 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ffc06f930 0x7f8ffc1f6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:12.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.493+0000 7f9002200640 1 -- 172.21.15.131:0/4111413197 >> 172.21.15.131:0/4111413197 conn(0x7f8ffc073160 msgr2=0x7f8ffc160600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:12.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.493+0000 7f9002200640 1 -- 172.21.15.131:0/4111413197 shutdown_connections 2024-04-25T19:23:12.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.493+0000 7f9002200640 1 -- 172.21.15.131:0/4111413197 wait complete. 2024-04-25T19:23:12.518 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T19:23:12.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.784+0000 7f0b31a00640 1 Processor -- start 2024-04-25T19:23:12.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.784+0000 7f0b31a00640 1 -- start start 2024-04-25T19:23:12.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.786+0000 7f0b31a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b2c14ad60 0x7f0b2c070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:12.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.786+0000 7f0b31a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0b2c0b5e40 0x7f0b2c0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:12.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.786+0000 7f0b31a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0b2c1681d0 0x7f0b2c1685e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:12.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.786+0000 7f0b31a00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f0b2c0b6790 con 0x7f0b2c0b5e40 2024-04-25T19:23:12.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.786+0000 7f0b31a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f0b2c0b4af0 con 0x7f0b2c1681d0 2024-04-25T19:23:12.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.786+0000 7f0b31a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0b2c0b4dd0 con 0x7f0b2c14ad60 2024-04-25T19:23:12.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.787+0000 7f0b22000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0b2c0b5e40 0x7f0b2c0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:12.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.787+0000 7f0b22000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0b2c0b5e40 0x7f0b2c0b6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55942/0 (socket says 172.21.15.131:55942) 2024-04-25T19:23:12.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.787+0000 7f0b22000640 1 -- 172.21.15.131:0/927311547 learned_addr learned my addr 172.21.15.131:0/927311547 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:12.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.787+0000 7f0b2aa00640 1 --2- 172.21.15.131:0/927311547 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b2c14ad60 0x7f0b2c070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:12.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.787+0000 7f0b22000640 1 -- 172.21.15.131:0/927311547 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b2c14ad60 msgr2=0x7f0b2c070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:12.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.787+0000 7f0b22000640 1 --2- 172.21.15.131:0/927311547 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b2c14ad60 0x7f0b2c070010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:12.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.787+0000 7f0b22000640 1 -- 172.21.15.131:0/927311547 >> v2:172.21.15.195:3300/0 conn(0x7f0b2c1681d0 msgr2=0x7f0b2c1685e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:12.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.787+0000 7f0b22000640 1 --2- 172.21.15.131:0/927311547 >> v2:172.21.15.195:3300/0 conn(0x7f0b2c1681d0 0x7f0b2c1685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:12.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.787+0000 7f0b22000640 1 -- 172.21.15.131:0/927311547 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b2c0b50b0 con 0x7f0b2c0b5e40 2024-04-25T19:23:12.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.788+0000 7f0b22000640 1 --2- 172.21.15.131:0/927311547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b2c0b5e40 0x7f0b2c0b6250 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c0ce2f0 tx=0x7f0b1402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465abb6cc42401a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:12.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.788+0000 7f0b2a000640 1 -- 172.21.15.131:0/927311547 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b14037070 con 0x7f0b2c0b5e40 2024-04-25T19:23:12.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.788+0000 7f0b2a000640 1 -- 172.21.15.131:0/927311547 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b14032440 con 0x7f0b2c0b5e40 2024-04-25T19:23:12.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.788+0000 7f0b2a000640 1 -- 172.21.15.131:0/927311547 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b14032810 con 0x7f0b2c0b5e40 2024-04-25T19:23:12.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.789+0000 7f0b31a00640 1 -- 172.21.15.131:0/927311547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b2c0b5e40 msgr2=0x7f0b2c0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:12.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.789+0000 7f0b31a00640 1 --2- 172.21.15.131:0/927311547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b2c0b5e40 0x7f0b2c0b6250 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c0ce2f0 tx=0x7f0b1402a140 comp rx=0 tx=0).stop 2024-04-25T19:23:12.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.789+0000 7f0b31a00640 1 -- 172.21.15.131:0/927311547 shutdown_connections 2024-04-25T19:23:12.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.789+0000 7f0b31a00640 1 --2- 172.21.15.131:0/927311547 >> v2:172.21.15.195:3300/0 conn(0x7f0b2c1681d0 0x7f0b2c1685e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:12.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.789+0000 7f0b31a00640 1 --2- 172.21.15.131:0/927311547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b2c0b5e40 0x7f0b2c0b6250 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:12.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.789+0000 7f0b31a00640 1 --2- 172.21.15.131:0/927311547 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b2c14ad60 0x7f0b2c070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:12.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.789+0000 7f0b31a00640 1 -- 172.21.15.131:0/927311547 >> 172.21.15.131:0/927311547 conn(0x7f0b2c0d1ae0 msgr2=0x7f0b2c0d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:12.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.789+0000 7f0b31a00640 1 -- 172.21.15.131:0/927311547 shutdown_connections 2024-04-25T19:23:12.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.789+0000 7f0b31a00640 1 -- 172.21.15.131:0/927311547 wait complete. 2024-04-25T19:23:12.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.792+0000 7f0b31a00640 1 Processor -- start 2024-04-25T19:23:12.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.792+0000 7f0b31a00640 1 -- start start 2024-04-25T19:23:12.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.793+0000 7f0b31a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b2c0b5e40 0x7f0b2c1484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:12.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.793+0000 7f0b31a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b2c14ad60 0x7f0b2c152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:12.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.793+0000 7f0b31a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b2c1681d0 0x7f0b2c1fa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:12.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.793+0000 7f0b31a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2c070550 con 0x7f0b2c0b5e40 2024-04-25T19:23:12.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.793+0000 7f0b31a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2c0b5670 con 0x7f0b2c14ad60 2024-04-25T19:23:12.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.793+0000 7f0b31a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0b2c0706d0 con 0x7f0b2c1681d0 2024-04-25T19:23:12.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.794+0000 7f0b2aa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b2c0b5e40 0x7f0b2c1484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:12.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.794+0000 7f0b2aa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b2c0b5e40 0x7f0b2c1484c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55944/0 (socket says 172.21.15.131:55944) 2024-04-25T19:23:12.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.794+0000 7f0b2aa00640 1 -- 172.21.15.131:0/3258362346 learned_addr learned my addr 172.21.15.131:0/3258362346 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:12.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.794+0000 7f0b2aa00640 1 -- 172.21.15.131:0/3258362346 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b2c1681d0 msgr2=0x7f0b2c1fa5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:12.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.794+0000 7f0b2aa00640 1 --2- 172.21.15.131:0/3258362346 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b2c1681d0 0x7f0b2c1fa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:12.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.794+0000 7f0b2aa00640 1 -- 172.21.15.131:0/3258362346 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b2c14ad60 msgr2=0x7f0b2c152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:12.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.794+0000 7f0b2aa00640 1 --2- 172.21.15.131:0/3258362346 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b2c14ad60 0x7f0b2c152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:12.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.794+0000 7f0b2aa00640 1 -- 172.21.15.131:0/3258362346 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b2c1faae0 con 0x7f0b2c0b5e40 2024-04-25T19:23:12.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.795+0000 7f0b2aa00640 1 --2- 172.21.15.131:0/3258362346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b2c0b5e40 0x7f0b2c1484c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c00c7f0 tx=0x7f0b1c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:12.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.795+0000 7f0b23400640 1 -- 172.21.15.131:0/3258362346 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c004230 con 0x7f0b2c0b5e40 2024-04-25T19:23:12.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.795+0000 7f0b23400640 1 -- 172.21.15.131:0/3258362346 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b1c0043d0 con 0x7f0b2c0b5e40 2024-04-25T19:23:12.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.795+0000 7f0b31a00640 1 -- 172.21.15.131:0/3258362346 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b2c166460 con 0x7f0b2c0b5e40 2024-04-25T19:23:12.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.795+0000 7f0b23400640 1 -- 172.21.15.131:0/3258362346 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c007860 con 0x7f0b2c0b5e40 2024-04-25T19:23:12.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.795+0000 7f0b31a00640 1 -- 172.21.15.131:0/3258362346 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b2c166a20 con 0x7f0b2c0b5e40 2024-04-25T19:23:12.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.796+0000 7f0b31a00640 1 -- 172.21.15.131:0/3258362346 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b2c06fb80 con 0x7f0b2c0b5e40 2024-04-25T19:23:12.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.797+0000 7f0b23400640 1 -- 172.21.15.131:0/3258362346 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0b1c007c10 con 0x7f0b2c0b5e40 2024-04-25T19:23:12.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.798+0000 7f0b23400640 1 --2- 172.21.15.131:0/3258362346 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0b080744e0 0x7f0b080769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:12.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.798+0000 7f0b23400640 1 -- 172.21.15.131:0/3258362346 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f0b1c095370 con 0x7f0b2c0b5e40 2024-04-25T19:23:12.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.799+0000 7f0b22000640 1 --2- 172.21.15.131:0/3258362346 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0b080744e0 0x7f0b080769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:12.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.800+0000 7f0b22000640 1 --2- 172.21.15.131:0/3258362346 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0b080744e0 0x7f0b080769f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0b14034000 tx=0x7f0b1402c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:12.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:12.803+0000 7f0b23400640 1 -- 172.21.15.131:0/3258362346 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0b2c06fb80 con 0x7f0b2c0b5e40 2024-04-25T19:23:13.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.014+0000 7f0b31a00640 1 -- 172.21.15.131:0/3258362346 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0b2c050740 con 0x7f0b2c0b5e40 2024-04-25T19:23:13.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.015+0000 7f0b23400640 1 -- 172.21.15.131:0/3258362346 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f0b1c015020 con 0x7f0b2c0b5e40 2024-04-25T19:23:13.016 INFO:teuthology.orchestra.run.smithi131.stderr:listed 0 entries 2024-04-25T19:23:13.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.018+0000 7f0b31a00640 1 -- 172.21.15.131:0/3258362346 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0b080744e0 msgr2=0x7f0b080769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:13.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.018+0000 7f0b31a00640 1 --2- 172.21.15.131:0/3258362346 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0b080744e0 0x7f0b080769f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0b14034000 tx=0x7f0b1402c000 comp rx=0 tx=0).stop 2024-04-25T19:23:13.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.018+0000 7f0b31a00640 1 -- 172.21.15.131:0/3258362346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b2c0b5e40 msgr2=0x7f0b2c1484c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:13.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.018+0000 7f0b31a00640 1 --2- 172.21.15.131:0/3258362346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b2c0b5e40 0x7f0b2c1484c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c00c7f0 tx=0x7f0b1c00ccb0 comp rx=0 tx=0).stop 2024-04-25T19:23:13.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.018+0000 7f0b31a00640 1 -- 172.21.15.131:0/3258362346 shutdown_connections 2024-04-25T19:23:13.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.018+0000 7f0b31a00640 1 --2- 172.21.15.131:0/3258362346 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0b080744e0 0x7f0b080769f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:13.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.018+0000 7f0b31a00640 1 --2- 172.21.15.131:0/3258362346 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b2c1681d0 0x7f0b2c1fa5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:13.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.018+0000 7f0b31a00640 1 --2- 172.21.15.131:0/3258362346 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b2c14ad60 0x7f0b2c152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:13.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.018+0000 7f0b31a00640 1 --2- 172.21.15.131:0/3258362346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b2c0b5e40 0x7f0b2c1484c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:13.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.018+0000 7f0b31a00640 1 -- 172.21.15.131:0/3258362346 >> 172.21.15.131:0/3258362346 conn(0x7f0b2c0d1ae0 msgr2=0x7f0b2c161010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:13.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.018+0000 7f0b31a00640 1 -- 172.21.15.131:0/3258362346 shutdown_connections 2024-04-25T19:23:13.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.018+0000 7f0b31a00640 1 -- 172.21.15.131:0/3258362346 wait complete. 2024-04-25T19:23:13.046 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-25T19:23:13.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:23:13.046 DEBUG:teuthology.orchestra.run.smithi131:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-25T19:23:13.133 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2024-04-25T19:23:13.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:23:13.133 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-25T19:23:13.182 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:23:13.182 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:23:13.241 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:23:13.241 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:23:13.294 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:23:13.294 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:23:13.344 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:23:13.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.625+0000 7f3513200640 1 Processor -- start 2024-04-25T19:23:13.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.626+0000 7f3513200640 1 -- start start 2024-04-25T19:23:13.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.628+0000 7f3513200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35140cf9e0 0x7f3514161090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:13.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.628+0000 7f3513200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f35140b0800 0x7f3514070290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:13.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.628+0000 7f3513200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35141615d0 con 0x7f35140707d0 2024-04-25T19:23:13.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.628+0000 7f3513200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f3514070be0 con 0x7f35140b0800 2024-04-25T19:23:13.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.628+0000 7f3513200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f35140cffc0 con 0x7f35140cf9e0 2024-04-25T19:23:13.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.628+0000 7f3509400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f35140b0800 0x7f3514070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:13.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.628+0000 7f3512800640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f35140707d0 0x7f35141569b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53290/0 (socket says 172.21.15.131:53290) 2024-04-25T19:23:13.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.628+0000 7f3512800640 1 -- 172.21.15.131:0/2538625411 learned_addr learned my addr 172.21.15.131:0/2538625411 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:13.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.629+0000 7f3511e00640 1 --2- 172.21.15.131:0/2538625411 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35140cf9e0 0x7f3514161090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:13.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.629+0000 7f3509400640 1 -- 172.21.15.131:0/2538625411 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35140cf9e0 msgr2=0x7f3514161090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:13.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.629+0000 7f3509400640 1 --2- 172.21.15.131:0/2538625411 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35140cf9e0 0x7f3514161090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:13.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.629+0000 7f3509400640 1 -- 172.21.15.131:0/2538625411 >> v1:172.21.15.131:6789/0 conn(0x7f35140707d0 legacy=0x7f35141569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:13.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.629+0000 7f3511400640 1 -- 172.21.15.131:0/2538625411 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1229522427 0 0) 0x7f350c001110 con 0x7f35140707d0 2024-04-25T19:23:13.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.629+0000 7f3509400640 1 -- 172.21.15.131:0/2538625411 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35140d02a0 con 0x7f35140b0800 2024-04-25T19:23:13.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.630+0000 7f3509400640 1 --2- 172.21.15.131:0/2538625411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35140b0800 0x7f3514070290 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0097a0 tx=0x7f34fc02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ff0c2fbef82938 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:13.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.630+0000 7f3511400640 1 -- 172.21.15.131:0/2538625411 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc037070 con 0x7f35140b0800 2024-04-25T19:23:13.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.630+0000 7f3511400640 1 -- 172.21.15.131:0/2538625411 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34fc02ae50 con 0x7f35140b0800 2024-04-25T19:23:13.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.630+0000 7f3511400640 1 -- 172.21.15.131:0/2538625411 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc032660 con 0x7f35140b0800 2024-04-25T19:23:13.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.631+0000 7f3513200640 1 -- 172.21.15.131:0/2538625411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35140b0800 msgr2=0x7f3514070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:13.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.631+0000 7f3513200640 1 --2- 172.21.15.131:0/2538625411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35140b0800 0x7f3514070290 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0097a0 tx=0x7f34fc02a100 comp rx=0 tx=0).stop 2024-04-25T19:23:13.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.631+0000 7f3513200640 1 -- 172.21.15.131:0/2538625411 shutdown_connections 2024-04-25T19:23:13.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.631+0000 7f3513200640 1 --2- 172.21.15.131:0/2538625411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35140b0800 0x7f3514070290 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:13.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.631+0000 7f3513200640 1 --2- 172.21.15.131:0/2538625411 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35140cf9e0 0x7f3514161090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:13.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.631+0000 7f3513200640 1 -- 172.21.15.131:0/2538625411 >> 172.21.15.131:0/2538625411 conn(0x7f35140d1720 msgr2=0x7f35140d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:13.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.631+0000 7f3513200640 1 -- 172.21.15.131:0/2538625411 shutdown_connections 2024-04-25T19:23:13.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.631+0000 7f3513200640 1 -- 172.21.15.131:0/2538625411 wait complete. 2024-04-25T19:23:13.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.633+0000 7f3513200640 1 Processor -- start 2024-04-25T19:23:13.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.634+0000 7f3513200640 1 -- start start 2024-04-25T19:23:13.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.635+0000 7f3513200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35140707d0 0x7f351414f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:13.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.635+0000 7f3513200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35140b0800 0x7f35141ea7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:13.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.635+0000 7f3513200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35140cf9e0 0x7f3514157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:13.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.635+0000 7f3513200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f35140b0c10 con 0x7f35140707d0 2024-04-25T19:23:13.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.635+0000 7f3513200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f35140d0860 con 0x7f35140b0800 2024-04-25T19:23:13.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.635+0000 7f3513200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f35140b0d90 con 0x7f35140cf9e0 2024-04-25T19:23:13.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.635+0000 7f3511e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35140707d0 0x7f351414f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:13.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.635+0000 7f3511e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35140707d0 0x7f351414f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55970/0 (socket says 172.21.15.131:55970) 2024-04-25T19:23:13.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.635+0000 7f3511e00640 1 -- 172.21.15.131:0/2742495138 learned_addr learned my addr 172.21.15.131:0/2742495138 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:13.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.636+0000 7f3509400640 1 --2- 172.21.15.131:0/2742495138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35140b0800 0x7f35141ea7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:13.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.636+0000 7f3512800640 1 --2- 172.21.15.131:0/2742495138 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35140cf9e0 0x7f3514157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:13.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.636+0000 7f3511e00640 1 -- 172.21.15.131:0/2742495138 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35140cf9e0 msgr2=0x7f3514157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:13.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.636+0000 7f3511e00640 1 --2- 172.21.15.131:0/2742495138 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35140cf9e0 0x7f3514157b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:13.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.636+0000 7f3511e00640 1 -- 172.21.15.131:0/2742495138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35140b0800 msgr2=0x7f35141ea7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:13.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.636+0000 7f3511e00640 1 --2- 172.21.15.131:0/2742495138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35140b0800 0x7f35141ea7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:13.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.636+0000 7f3511e00640 1 -- 172.21.15.131:0/2742495138 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35140b5b30 con 0x7f35140707d0 2024-04-25T19:23:13.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.636+0000 7f3511e00640 1 --2- 172.21.15.131:0/2742495138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35140707d0 0x7f351414f7e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3504007e60 tx=0x7f350400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:13.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.636+0000 7f350aa00640 1 -- 172.21.15.131:0/2742495138 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350401a070 con 0x7f35140707d0 2024-04-25T19:23:13.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.637+0000 7f350aa00640 1 -- 172.21.15.131:0/2742495138 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3504003b90 con 0x7f35140707d0 2024-04-25T19:23:13.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.637+0000 7f350aa00640 1 -- 172.21.15.131:0/2742495138 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3504004030 con 0x7f35140707d0 2024-04-25T19:23:13.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.637+0000 7f3513200640 1 -- 172.21.15.131:0/2742495138 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35140b5e10 con 0x7f35140707d0 2024-04-25T19:23:13.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.637+0000 7f3513200640 1 -- 172.21.15.131:0/2742495138 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35140b63d0 con 0x7f35140707d0 2024-04-25T19:23:13.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.638+0000 7f3513200640 1 -- 172.21.15.131:0/2742495138 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3514050740 con 0x7f35140707d0 2024-04-25T19:23:13.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.639+0000 7f350aa00640 1 -- 172.21.15.131:0/2742495138 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f350401d070 con 0x7f35140707d0 2024-04-25T19:23:13.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.640+0000 7f350aa00640 1 --2- 172.21.15.131:0/2742495138 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f34f00744b0 0x7f34f00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:13.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.640+0000 7f350aa00640 1 -- 172.21.15.131:0/2742495138 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f35040953d0 con 0x7f35140707d0 2024-04-25T19:23:13.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.641+0000 7f3509400640 1 --2- 172.21.15.131:0/2742495138 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f34f00744b0 0x7f34f00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:13.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.642+0000 7f3509400640 1 --2- 172.21.15.131:0/2742495138 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f34f00744b0 0x7f34f00769c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f34fc034000 tx=0x7f34fc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:13.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.645+0000 7f350aa00640 1 -- 172.21.15.131:0/2742495138 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f350405f490 con 0x7f35140707d0 2024-04-25T19:23:13.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.849+0000 7f3513200640 1 -- 172.21.15.131:0/2742495138 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f351406fb60 con 0x7f35140707d0 2024-04-25T19:23:13.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.851+0000 7f350aa00640 1 -- 172.21.15.131:0/2742495138 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16878 (secure 0 0 0) 0x7f3504063790 con 0x7f35140707d0 2024-04-25T19:23:13.853 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:13.853 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":22,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:22:57.347297+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:22:14.779716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T19:22:15.552027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:23:13.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.854+0000 7f3513200640 1 -- 172.21.15.131:0/2742495138 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f34f00744b0 msgr2=0x7f34f00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:13.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.854+0000 7f3513200640 1 --2- 172.21.15.131:0/2742495138 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f34f00744b0 0x7f34f00769c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f34fc034000 tx=0x7f34fc02e000 comp rx=0 tx=0).stop 2024-04-25T19:23:13.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.854+0000 7f3513200640 1 -- 172.21.15.131:0/2742495138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35140707d0 msgr2=0x7f351414f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:13.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.854+0000 7f3513200640 1 --2- 172.21.15.131:0/2742495138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35140707d0 0x7f351414f7e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3504007e60 tx=0x7f350400e4b0 comp rx=0 tx=0).stop 2024-04-25T19:23:13.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.855+0000 7f3513200640 1 -- 172.21.15.131:0/2742495138 shutdown_connections 2024-04-25T19:23:13.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.855+0000 7f3513200640 1 --2- 172.21.15.131:0/2742495138 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f34f00744b0 0x7f34f00769c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:13.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.855+0000 7f3513200640 1 --2- 172.21.15.131:0/2742495138 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35140cf9e0 0x7f3514157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:13.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.855+0000 7f3513200640 1 --2- 172.21.15.131:0/2742495138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35140b0800 0x7f35141ea7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:13.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.855+0000 7f3513200640 1 --2- 172.21.15.131:0/2742495138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35140707d0 0x7f351414f7e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:13.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.855+0000 7f3513200640 1 -- 172.21.15.131:0/2742495138 >> 172.21.15.131:0/2742495138 conn(0x7f35140d1720 msgr2=0x7f351406c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:13.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.855+0000 7f3513200640 1 -- 172.21.15.131:0/2742495138 shutdown_connections 2024-04-25T19:23:13.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:13.855+0000 7f3513200640 1 -- 172.21.15.131:0/2742495138 wait complete. 2024-04-25T19:23:13.882 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T19:22:04.178847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T19:22:14.779716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T19:22:15.552027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T19:23:13.882 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T19:23:14.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.158+0000 7fa39fe00640 1 Processor -- start 2024-04-25T19:23:14.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.159+0000 7fa39fe00640 1 -- start start 2024-04-25T19:23:14.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.160+0000 7fa39fe00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa3a006dce0 0x7fa3a015e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:14.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.160+0000 7fa39fe00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3a0070000 con 0x7fa3a0144340 2024-04-25T19:23:14.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.161+0000 7fa39fe00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3a006f240 con 0x7fa3a015ec90 2024-04-25T19:23:14.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.161+0000 7fa39fe00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fa3a0144750 con 0x7fa3a006dce0 2024-04-25T19:23:14.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.161+0000 7fa39ea00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fa3a0144340 0x7fa3a006d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53300/0 (socket says 172.21.15.131:53300) 2024-04-25T19:23:14.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.161+0000 7fa39ea00640 1 -- 172.21.15.131:0/1703461310 learned_addr learned my addr 172.21.15.131:0/1703461310 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:14.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.161+0000 7fa39d600640 1 -- 172.21.15.131:0/1703461310 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3515417102 0 0) 0x7fa3a0070000 con 0x7fa3a0144340 2024-04-25T19:23:14.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.161+0000 7fa39d600640 1 -- 172.21.15.131:0/1703461310 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa384003520 con 0x7fa3a0144340 2024-04-25T19:23:14.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.161+0000 7fa39e000640 1 --2- 172.21.15.131:0/1703461310 >> v2:172.21.15.195:3300/0 conn(0x7fa3a006dce0 0x7fa3a015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:14.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.162+0000 7fa39d600640 1 -- 172.21.15.131:0/1703461310 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 260517067 0 0) 0x7fa384003520 con 0x7fa3a0144340 2024-04-25T19:23:14.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.162+0000 7fa39d600640 1 -- 172.21.15.131:0/1703461310 >> v2:172.21.15.195:3300/0 conn(0x7fa3a006dce0 msgr2=0x7fa3a015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:14.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.162+0000 7fa39d600640 1 --2- 172.21.15.131:0/1703461310 >> v2:172.21.15.195:3300/0 conn(0x7fa3a006dce0 0x7fa3a015e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:14.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.162+0000 7fa39d600640 1 -- 172.21.15.131:0/1703461310 >> v1:172.21.15.195:6789/0 conn(0x7fa3a015ec90 legacy=0x7fa3a015f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:14.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.162+0000 7fa39d600640 1 -- 172.21.15.131:0/1703461310 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a006f520 con 0x7fa3a0144340 2024-04-25T19:23:14.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.162+0000 7fa39d600640 1 -- 172.21.15.131:0/1703461310 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7fa3900019f0 con 0x7fa3a0144340 2024-04-25T19:23:14.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.162+0000 7fa39d600640 1 -- 172.21.15.131:0/1703461310 >> v1:172.21.15.131:6789/0 conn(0x7fa3a0144340 legacy=0x7fa3a006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:14.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.162+0000 7fa39d600640 1 --2- 172.21.15.131:0/1703461310 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa384003a00 0x7fa384003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:14.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.162+0000 7fa39d600640 1 --2- 172.21.15.131:0/1703461310 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa384004800 0x7fa384004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:14.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.162+0000 7fa39d600640 1 --2- 172.21.15.131:0/1703461310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa384005350 0x7fa38400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:14.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.162+0000 7fa39d600640 1 -- 172.21.15.131:0/1703461310 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a0144750 con 0x7fa384004800 2024-04-25T19:23:14.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.162+0000 7fa39d600640 1 -- 172.21.15.131:0/1703461310 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa38400c250 con 0x7fa384005350 2024-04-25T19:23:14.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.162+0000 7fa39d600640 1 -- 172.21.15.131:0/1703461310 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa38400c450 con 0x7fa384003a00 2024-04-25T19:23:14.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.162+0000 7fa39e000640 1 --2- 172.21.15.131:0/1703461310 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa384004800 0x7fa384004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:14.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.163+0000 7fa39f400640 1 --2- 172.21.15.131:0/1703461310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa384005350 0x7fa38400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:14.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.163+0000 7fa39ea00640 1 --2- 172.21.15.131:0/1703461310 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa384003a00 0x7fa384003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:14.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.163+0000 7fa39e000640 1 -- 172.21.15.131:0/1703461310 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa384003a00 msgr2=0x7fa384003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:14.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.163+0000 7fa39e000640 1 --2- 172.21.15.131:0/1703461310 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa384003a00 0x7fa384003e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:14.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.163+0000 7fa39e000640 1 -- 172.21.15.131:0/1703461310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa384005350 msgr2=0x7fa38400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:14.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.163+0000 7fa39e000640 1 --2- 172.21.15.131:0/1703461310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa384005350 0x7fa38400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:14.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.163+0000 7fa39e000640 1 -- 172.21.15.131:0/1703461310 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa384003520 con 0x7fa384004800 2024-04-25T19:23:14.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.163+0000 7fa39f400640 1 --2- 172.21.15.131:0/1703461310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa384005350 0x7fa38400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:14.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.163+0000 7fa39f400640 1 -- 172.21.15.131:0/1703461310 reap_dead start 2024-04-25T19:23:14.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.164+0000 7fa39e000640 1 --2- 172.21.15.131:0/1703461310 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa384004800 0x7fa384004c10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa38c00ba00 tx=0x7fa384005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba7244d45e6f494 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:14.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.164+0000 7fa39d600640 1 -- 172.21.15.131:0/1703461310 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c030070 con 0x7fa384004800 2024-04-25T19:23:14.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.164+0000 7fa39d600640 1 -- 172.21.15.131:0/1703461310 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa38c02adb0 con 0x7fa384004800 2024-04-25T19:23:14.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.164+0000 7fa39d600640 1 -- 172.21.15.131:0/1703461310 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c00b600 con 0x7fa384004800 2024-04-25T19:23:14.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.165+0000 7fa39fe00640 1 -- 172.21.15.131:0/1703461310 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa384004800 msgr2=0x7fa384004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:14.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.165+0000 7fa39fe00640 1 --2- 172.21.15.131:0/1703461310 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa384004800 0x7fa384004c10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa38c00ba00 tx=0x7fa384005830 comp rx=0 tx=0).stop 2024-04-25T19:23:14.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.165+0000 7fa39fe00640 1 -- 172.21.15.131:0/1703461310 shutdown_connections 2024-04-25T19:23:14.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.165+0000 7fa39fe00640 1 --2- 172.21.15.131:0/1703461310 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa384004800 0x7fa384004c10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:14.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.165+0000 7fa39fe00640 1 -- 172.21.15.131:0/1703461310 >> 172.21.15.131:0/1703461310 conn(0x7fa3a0072f40 msgr2=0x7fa3a0073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:14.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.165+0000 7fa39fe00640 1 -- 172.21.15.131:0/1703461310 shutdown_connections 2024-04-25T19:23:14.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.165+0000 7fa39fe00640 1 -- 172.21.15.131:0/1703461310 wait complete. 2024-04-25T19:23:14.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.168+0000 7fa39fe00640 1 Processor -- start 2024-04-25T19:23:14.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.168+0000 7fa39fe00640 1 -- start start 2024-04-25T19:23:14.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.169+0000 7fa39fe00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa384004800 0x7fa3a013eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:14.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.169+0000 7fa39fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3a00b00a0 0x7fa3a0160450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:14.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.169+0000 7fa39fe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3a0160990 0x7fa3a00b5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:14.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.169+0000 7fa39fe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a015f0a0 con 0x7fa3a00b00a0 2024-04-25T19:23:14.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.169+0000 7fa39fe00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a006fae0 con 0x7fa384004800 2024-04-25T19:23:14.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.169+0000 7fa39fe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa3a015f220 con 0x7fa3a0160990 2024-04-25T19:23:14.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.170+0000 7fa39e000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3a00b00a0 0x7fa3a0160450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:14.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.170+0000 7fa39e000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3a00b00a0 0x7fa3a0160450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55992/0 (socket says 172.21.15.131:55992) 2024-04-25T19:23:14.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.170+0000 7fa39e000640 1 -- 172.21.15.131:0/3029774871 learned_addr learned my addr 172.21.15.131:0/3029774871 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:14.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.170+0000 7fa39f400640 1 --2- 172.21.15.131:0/3029774871 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3a0160990 0x7fa3a00b5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:14.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.170+0000 7fa39ea00640 1 --2- 172.21.15.131:0/3029774871 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa384004800 0x7fa3a013eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:14.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.170+0000 7fa39e000640 1 -- 172.21.15.131:0/3029774871 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3a0160990 msgr2=0x7fa3a00b5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:14.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.170+0000 7fa39e000640 1 --2- 172.21.15.131:0/3029774871 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3a0160990 0x7fa3a00b5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:14.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.170+0000 7fa39e000640 1 -- 172.21.15.131:0/3029774871 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa384004800 msgr2=0x7fa3a013eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:14.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.170+0000 7fa39e000640 1 --2- 172.21.15.131:0/3029774871 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa384004800 0x7fa3a013eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:14.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.170+0000 7fa39e000640 1 -- 172.21.15.131:0/3029774871 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a0160da0 con 0x7fa3a00b00a0 2024-04-25T19:23:14.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.170+0000 7fa39e000640 1 --2- 172.21.15.131:0/3029774871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3a00b00a0 0x7fa3a0160450 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa38c02a8a0 tx=0x7fa38c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:14.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.171+0000 7fa396a00640 1 -- 172.21.15.131:0/3029774871 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c043020 con 0x7fa3a00b00a0 2024-04-25T19:23:14.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.171+0000 7fa396a00640 1 -- 172.21.15.131:0/3029774871 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa38c03f680 con 0x7fa3a00b00a0 2024-04-25T19:23:14.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.171+0000 7fa396a00640 1 -- 172.21.15.131:0/3029774871 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c00b600 con 0x7fa3a00b00a0 2024-04-25T19:23:14.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.171+0000 7fa39fe00640 1 -- 172.21.15.131:0/3029774871 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a01f95a0 con 0x7fa3a00b00a0 2024-04-25T19:23:14.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.171+0000 7fa39fe00640 1 -- 172.21.15.131:0/3029774871 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a01f9b60 con 0x7fa3a00b00a0 2024-04-25T19:23:14.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.172+0000 7fa39fe00640 1 -- 172.21.15.131:0/3029774871 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3a0076c60 con 0x7fa3a00b00a0 2024-04-25T19:23:14.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.173+0000 7fa396a00640 1 -- 172.21.15.131:0/3029774871 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa38c046020 con 0x7fa3a00b00a0 2024-04-25T19:23:14.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.174+0000 7fa396a00640 1 --2- 172.21.15.131:0/3029774871 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa3800744b0 0x7fa3800769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:14.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.174+0000 7fa396a00640 1 -- 172.21.15.131:0/3029774871 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fa38c0b5fe0 con 0x7fa3a00b00a0 2024-04-25T19:23:14.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.175+0000 7fa39ea00640 1 --2- 172.21.15.131:0/3029774871 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa3800744b0 0x7fa3800769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:14.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.176+0000 7fa39ea00640 1 --2- 172.21.15.131:0/3029774871 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa3800744b0 0x7fa3800769c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa390001370 tx=0x7fa390009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:14.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.179+0000 7fa396a00640 1 -- 172.21.15.131:0/3029774871 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa38c04d030 con 0x7fa3a00b00a0 2024-04-25T19:23:14.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.378+0000 7fa39fe00640 1 -- 172.21.15.131:0/3029774871 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa3a00b7920 con 0x7fa3a00b00a0 2024-04-25T19:23:14.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.379+0000 7fa396a00640 1 -- 172.21.15.131:0/3029774871 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fa3a0160da0 con 0x7fa3a00b00a0 2024-04-25T19:23:14.379 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-25T19:23:14.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.381+0000 7fa39fe00640 1 -- 172.21.15.131:0/3029774871 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa3800744b0 msgr2=0x7fa3800769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:14.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.381+0000 7fa39fe00640 1 --2- 172.21.15.131:0/3029774871 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa3800744b0 0x7fa3800769c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa390001370 tx=0x7fa390009040 comp rx=0 tx=0).stop 2024-04-25T19:23:14.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.381+0000 7fa39fe00640 1 -- 172.21.15.131:0/3029774871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3a00b00a0 msgr2=0x7fa3a0160450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:14.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.381+0000 7fa39fe00640 1 --2- 172.21.15.131:0/3029774871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3a00b00a0 0x7fa3a0160450 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa38c02a8a0 tx=0x7fa38c004730 comp rx=0 tx=0).stop 2024-04-25T19:23:14.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.381+0000 7fa39fe00640 1 -- 172.21.15.131:0/3029774871 shutdown_connections 2024-04-25T19:23:14.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.382+0000 7fa39fe00640 1 --2- 172.21.15.131:0/3029774871 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa3800744b0 0x7fa3800769c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:14.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.382+0000 7fa39fe00640 1 --2- 172.21.15.131:0/3029774871 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3a0160990 0x7fa3a00b5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:14.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.382+0000 7fa39fe00640 1 --2- 172.21.15.131:0/3029774871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3a00b00a0 0x7fa3a0160450 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:14.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.382+0000 7fa39fe00640 1 --2- 172.21.15.131:0/3029774871 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa384004800 0x7fa3a013eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:14.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.382+0000 7fa39fe00640 1 -- 172.21.15.131:0/3029774871 >> 172.21.15.131:0/3029774871 conn(0x7fa3a0072f40 msgr2=0x7fa3a0141090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:14.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.382+0000 7fa39fe00640 1 -- 172.21.15.131:0/3029774871 shutdown_connections 2024-04-25T19:23:14.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.382+0000 7fa39fe00640 1 -- 172.21.15.131:0/3029774871 wait complete. 2024-04-25T19:23:14.412 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T19:23:14.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.692+0000 7f01f1a00640 1 Processor -- start 2024-04-25T19:23:14.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.692+0000 7f01f1a00640 1 -- start start 2024-04-25T19:23:14.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.694+0000 7f01f1a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f01ec06d5d0 0x7f01ec06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:14.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.694+0000 7f01f1a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f01ec0b50b0 0x7f01ec0b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:14.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.694+0000 7f01f1a00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01ec06df20 con 0x7f01ec14aac0 2024-04-25T19:23:14.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.694+0000 7f01f1a00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f01ec14aed0 con 0x7f01ec06d5d0 2024-04-25T19:23:14.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.694+0000 7f01f1a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f01ec06f460 con 0x7f01ec0b50b0 2024-04-25T19:23:14.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.694+0000 7f01eb400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f01ec06d5d0 0x7f01ec06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:14.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.694+0000 7f01eb400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f01ec06d5d0 0x7f01ec06d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56006/0 (socket says 172.21.15.131:56006) 2024-04-25T19:23:14.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.695+0000 7f01eb400640 1 -- 172.21.15.131:0/1147087373 learned_addr learned my addr 172.21.15.131:0/1147087373 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:14.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.694+0000 7f01ebe00640 1 --1- 172.21.15.131:0/1147087373 >> v1:172.21.15.131:6789/0 conn(0x7f01ec14aac0 0x7f01ec1655a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53304/0 (socket says 172.21.15.131:53304) 2024-04-25T19:23:14.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.695+0000 7f01f1000640 1 --2- 172.21.15.131:0/1147087373 >> v2:172.21.15.195:3300/0 conn(0x7f01ec0b50b0 0x7f01ec0b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:14.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.695+0000 7f01eb400640 1 -- 172.21.15.131:0/1147087373 >> v2:172.21.15.195:3300/0 conn(0x7f01ec0b50b0 msgr2=0x7f01ec0b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:14.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.695+0000 7f01eb400640 1 --2- 172.21.15.131:0/1147087373 >> v2:172.21.15.195:3300/0 conn(0x7f01ec0b50b0 0x7f01ec0b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:14.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.695+0000 7f01eb400640 1 -- 172.21.15.131:0/1147087373 >> v1:172.21.15.131:6789/0 conn(0x7f01ec14aac0 legacy=0x7f01ec1655a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:14.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.695+0000 7f01eb400640 1 -- 172.21.15.131:0/1147087373 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01ec06f740 con 0x7f01ec06d5d0 2024-04-25T19:23:14.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.695+0000 7f01f1000640 1 --2- 172.21.15.131:0/1147087373 >> v2:172.21.15.195:3300/0 conn(0x7f01ec0b50b0 0x7f01ec0b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:14.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.696+0000 7f01eb400640 1 --2- 172.21.15.131:0/1147087373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01ec06d5d0 0x7f01ec06d9e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0b7530 tx=0x7f01dc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a764fa640f5445cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:14.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.696+0000 7f01eaa00640 1 -- 172.21.15.131:0/1147087373 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01dc036070 con 0x7f01ec06d5d0 2024-04-25T19:23:14.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.696+0000 7f01eaa00640 1 -- 172.21.15.131:0/1147087373 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01dc031600 con 0x7f01ec06d5d0 2024-04-25T19:23:14.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.696+0000 7f01eaa00640 1 -- 172.21.15.131:0/1147087373 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01dc0319d0 con 0x7f01ec06d5d0 2024-04-25T19:23:14.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.697+0000 7f01f1a00640 1 -- 172.21.15.131:0/1147087373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01ec06d5d0 msgr2=0x7f01ec06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:14.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.697+0000 7f01f1a00640 1 --2- 172.21.15.131:0/1147087373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01ec06d5d0 0x7f01ec06d9e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0b7530 tx=0x7f01dc02a610 comp rx=0 tx=0).stop 2024-04-25T19:23:14.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.697+0000 7f01f1a00640 1 -- 172.21.15.131:0/1147087373 shutdown_connections 2024-04-25T19:23:14.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.697+0000 7f01f1a00640 1 --2- 172.21.15.131:0/1147087373 >> v2:172.21.15.195:3300/0 conn(0x7f01ec0b50b0 0x7f01ec0b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:14.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.697+0000 7f01f1a00640 1 --2- 172.21.15.131:0/1147087373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01ec06d5d0 0x7f01ec06d9e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:14.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.697+0000 7f01f1a00640 1 -- 172.21.15.131:0/1147087373 >> 172.21.15.131:0/1147087373 conn(0x7f01ec072f40 msgr2=0x7f01ec073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:14.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.697+0000 7f01f1a00640 1 -- 172.21.15.131:0/1147087373 shutdown_connections 2024-04-25T19:23:14.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.697+0000 7f01f1a00640 1 -- 172.21.15.131:0/1147087373 wait complete. 2024-04-25T19:23:14.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.700+0000 7f01f1a00640 1 Processor -- start 2024-04-25T19:23:14.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.700+0000 7f01f1a00640 1 -- start start 2024-04-25T19:23:14.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.701+0000 7f01f1a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec06d5d0 0x7f01ec1660c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:14.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.702+0000 7f01f1a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01ec0b50b0 0x7f01ec147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:14.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.702+0000 7f01f1a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01ec14aac0 0x7f01ec1edf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:14.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.702+0000 7f01f1a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f01ec06ffe0 con 0x7f01ec14aac0 2024-04-25T19:23:14.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.702+0000 7f01f1a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f01ec06fd00 con 0x7f01ec0b50b0 2024-04-25T19:23:14.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.702+0000 7f01f1a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f01ec0b4a90 con 0x7f01ec06d5d0 2024-04-25T19:23:14.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.702+0000 7f01f1000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01ec14aac0 0x7f01ec1edf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:14.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.702+0000 7f01f1000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01ec14aac0 0x7f01ec1edf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56012/0 (socket says 172.21.15.131:56012) 2024-04-25T19:23:14.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.702+0000 7f01f1000640 1 -- 172.21.15.131:0/1133629400 learned_addr learned my addr 172.21.15.131:0/1133629400 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:14.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.702+0000 7f01ebe00640 1 --2- 172.21.15.131:0/1133629400 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec06d5d0 0x7f01ec1660c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:14.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.702+0000 7f01eb400640 1 --2- 172.21.15.131:0/1133629400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01ec0b50b0 0x7f01ec147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:14.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.702+0000 7f01f1000640 1 -- 172.21.15.131:0/1133629400 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec06d5d0 msgr2=0x7f01ec1660c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:14.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.702+0000 7f01f1000640 1 --2- 172.21.15.131:0/1133629400 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec06d5d0 0x7f01ec1660c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:14.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.702+0000 7f01f1000640 1 -- 172.21.15.131:0/1133629400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01ec0b50b0 msgr2=0x7f01ec147870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:14.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.702+0000 7f01f1000640 1 --2- 172.21.15.131:0/1133629400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01ec0b50b0 0x7f01ec147870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:14.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.702+0000 7f01f1000640 1 -- 172.21.15.131:0/1133629400 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01ec1fbe00 con 0x7f01ec14aac0 2024-04-25T19:23:14.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.702+0000 7f01ebe00640 1 --2- 172.21.15.131:0/1133629400 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec06d5d0 0x7f01ec1660c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:14.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.702+0000 7f01eb400640 1 --2- 172.21.15.131:0/1133629400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01ec0b50b0 0x7f01ec147870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:14.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.703+0000 7f01f1000640 1 --2- 172.21.15.131:0/1133629400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01ec14aac0 0x7f01ec1edf50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f01e400c5f0 tx=0x7f01e400cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:14.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.703+0000 7f01e3e00640 1 -- 172.21.15.131:0/1133629400 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e4015070 con 0x7f01ec14aac0 2024-04-25T19:23:14.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.703+0000 7f01e3e00640 1 -- 172.21.15.131:0/1133629400 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e4011820 con 0x7f01ec14aac0 2024-04-25T19:23:14.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.703+0000 7f01f1a00640 1 -- 172.21.15.131:0/1133629400 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01ec166600 con 0x7f01ec14aac0 2024-04-25T19:23:14.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.703+0000 7f01e3e00640 1 -- 172.21.15.131:0/1133629400 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e4011c10 con 0x7f01ec14aac0 2024-04-25T19:23:14.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.703+0000 7f01f1a00640 1 -- 172.21.15.131:0/1133629400 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01ec166df0 con 0x7f01ec14aac0 2024-04-25T19:23:14.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.704+0000 7f01f1a00640 1 -- 172.21.15.131:0/1133629400 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01ec166fc0 con 0x7f01ec14aac0 2024-04-25T19:23:14.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.706+0000 7f01e3e00640 1 -- 172.21.15.131:0/1133629400 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f01e4018070 con 0x7f01ec14aac0 2024-04-25T19:23:14.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.706+0000 7f01e3e00640 1 --2- 172.21.15.131:0/1133629400 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f01c80744e0 0x7f01c80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:14.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.707+0000 7f01e3e00640 1 -- 172.21.15.131:0/1133629400 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f01e4095210 con 0x7f01ec14aac0 2024-04-25T19:23:14.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.707+0000 7f01ebe00640 1 --2- 172.21.15.131:0/1133629400 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f01c80744e0 0x7f01c80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:14.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.708+0000 7f01ebe00640 1 --2- 172.21.15.131:0/1133629400 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f01c80744e0 0x7f01c80769f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f01d4000f60 tx=0x7f01d4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:14.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.711+0000 7f01e3e00640 1 -- 172.21.15.131:0/1133629400 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f01e405f890 con 0x7f01ec14aac0 2024-04-25T19:23:14.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.908+0000 7f01f1a00640 1 -- 172.21.15.131:0/1133629400 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f01ec076c60 con 0x7f01ec14aac0 2024-04-25T19:23:14.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.910+0000 7f01e3e00640 1 -- 172.21.15.131:0/1133629400 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f01e405f190 con 0x7f01ec14aac0 2024-04-25T19:23:14.911 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-25T19:23:14.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.912+0000 7f01f1a00640 1 -- 172.21.15.131:0/1133629400 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f01c80744e0 msgr2=0x7f01c80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:14.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.912+0000 7f01f1a00640 1 --2- 172.21.15.131:0/1133629400 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f01c80744e0 0x7f01c80769f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f01d4000f60 tx=0x7f01d4009040 comp rx=0 tx=0).stop 2024-04-25T19:23:14.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.912+0000 7f01f1a00640 1 -- 172.21.15.131:0/1133629400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01ec14aac0 msgr2=0x7f01ec1edf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:14.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.912+0000 7f01f1a00640 1 --2- 172.21.15.131:0/1133629400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01ec14aac0 0x7f01ec1edf50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f01e400c5f0 tx=0x7f01e400cab0 comp rx=0 tx=0).stop 2024-04-25T19:23:14.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.913+0000 7f01f1a00640 1 -- 172.21.15.131:0/1133629400 shutdown_connections 2024-04-25T19:23:14.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.913+0000 7f01f1a00640 1 --2- 172.21.15.131:0/1133629400 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f01c80744e0 0x7f01c80769f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:14.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.913+0000 7f01f1a00640 1 --2- 172.21.15.131:0/1133629400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01ec14aac0 0x7f01ec1edf50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:14.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.913+0000 7f01f1a00640 1 --2- 172.21.15.131:0/1133629400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01ec0b50b0 0x7f01ec147870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:14.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.913+0000 7f01f1a00640 1 --2- 172.21.15.131:0/1133629400 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec06d5d0 0x7f01ec1660c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:14.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.913+0000 7f01f1a00640 1 -- 172.21.15.131:0/1133629400 >> 172.21.15.131:0/1133629400 conn(0x7f01ec072f40 msgr2=0x7f01ec163ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:14.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.913+0000 7f01f1a00640 1 -- 172.21.15.131:0/1133629400 shutdown_connections 2024-04-25T19:23:14.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:14.913+0000 7f01f1a00640 1 -- 172.21.15.131:0/1133629400 wait complete. 2024-04-25T19:23:14.943 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T19:23:15.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.210+0000 7f0013400640 1 Processor -- start 2024-04-25T19:23:15.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.210+0000 7f0013400640 1 -- start start 2024-04-25T19:23:15.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.212+0000 7f0013400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f000c0cd9a0 0x7f000c15f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:15.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.212+0000 7f0013400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f000c06dce0 0x7f000c15faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:15.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.212+0000 7f0013400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f000c0cdea0 con 0x7f000c0b0af0 2024-04-25T19:23:15.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.212+0000 7f0013400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f000c0ceab0 con 0x7f000c0cd9a0 2024-04-25T19:23:15.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.212+0000 7f0013400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f000c0ce180 con 0x7f000c06dce0 2024-04-25T19:23:15.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.213+0000 7f000be00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f000c0b0af0 0x7f000c06d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53308/0 (socket says 172.21.15.131:53308) 2024-04-25T19:23:15.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.213+0000 7f000be00640 1 -- 172.21.15.131:0/260250398 learned_addr learned my addr 172.21.15.131:0/260250398 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:15.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.213+0000 7f0011400640 1 --2- 172.21.15.131:0/260250398 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f000c06dce0 0x7f000c15faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:15.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.213+0000 7f0010a00640 1 --2- 172.21.15.131:0/260250398 >> v2:172.21.15.195:3300/0 conn(0x7f000c0cd9a0 0x7f000c15f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:15.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.213+0000 7f000b400640 1 -- 172.21.15.131:0/260250398 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3023823943 0 0) 0x7f000c0cdea0 con 0x7f000c0b0af0 2024-04-25T19:23:15.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.213+0000 7f000b400640 1 -- 172.21.15.131:0/260250398 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efff4003520 con 0x7f000c0b0af0 2024-04-25T19:23:15.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.213+0000 7f000b400640 1 -- 172.21.15.131:0/260250398 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3429667164 0 0) 0x7efff4003520 con 0x7f000c0b0af0 2024-04-25T19:23:15.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.214+0000 7f000b400640 1 -- 172.21.15.131:0/260250398 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f000c06dce0 msgr2=0x7f000c15faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:15.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.214+0000 7f000b400640 1 --2- 172.21.15.131:0/260250398 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f000c06dce0 0x7f000c15faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:15.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.214+0000 7f000b400640 1 -- 172.21.15.131:0/260250398 >> v2:172.21.15.195:3300/0 conn(0x7f000c0cd9a0 msgr2=0x7f000c15f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:15.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.214+0000 7f000b400640 1 --2- 172.21.15.131:0/260250398 >> v2:172.21.15.195:3300/0 conn(0x7f000c0cd9a0 0x7f000c15f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:15.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.214+0000 7f000b400640 1 -- 172.21.15.131:0/260250398 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000c0ce460 con 0x7f000c0b0af0 2024-04-25T19:23:15.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.214+0000 7f000b400640 1 -- 172.21.15.131:0/260250398 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7efff8001670 con 0x7f000c0b0af0 2024-04-25T19:23:15.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.214+0000 7f000b400640 1 -- 172.21.15.131:0/260250398 >> v1:172.21.15.131:6789/0 conn(0x7f000c0b0af0 legacy=0x7f000c06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:15.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.214+0000 7f000b400640 1 --2- 172.21.15.131:0/260250398 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efff40039b0 0x7efff4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:15.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.214+0000 7f000b400640 1 --2- 172.21.15.131:0/260250398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efff4004390 0x7efff40048c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:15.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.214+0000 7f000b400640 1 --2- 172.21.15.131:0/260250398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff4004f30 0x7efff400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:15.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.214+0000 7f000b400640 1 -- 172.21.15.131:0/260250398 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f000c0ceab0 con 0x7efff4004f30 2024-04-25T19:23:15.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.214+0000 7f000b400640 1 -- 172.21.15.131:0/260250398 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f000c0ce180 con 0x7efff4004390 2024-04-25T19:23:15.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.214+0000 7f000b400640 1 -- 172.21.15.131:0/260250398 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7efff400bf00 con 0x7efff40039b0 2024-04-25T19:23:15.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.214+0000 7f0011400640 1 --2- 172.21.15.131:0/260250398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff4004f30 0x7efff400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:15.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.214+0000 7f0010a00640 1 --2- 172.21.15.131:0/260250398 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efff40039b0 0x7efff4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:15.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.214+0000 7f000be00640 1 --2- 172.21.15.131:0/260250398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efff4004390 0x7efff40048c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:15.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.214+0000 7f0011400640 1 -- 172.21.15.131:0/260250398 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efff40039b0 msgr2=0x7efff4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:15.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.214+0000 7f0011400640 1 --2- 172.21.15.131:0/260250398 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efff40039b0 0x7efff4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:15.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.214+0000 7f0011400640 1 -- 172.21.15.131:0/260250398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efff4004390 msgr2=0x7efff40048c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:15.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.214+0000 7f0011400640 1 --2- 172.21.15.131:0/260250398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efff4004390 0x7efff40048c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:15.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.215+0000 7f0011400640 1 -- 172.21.15.131:0/260250398 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff4003520 con 0x7efff4004f30 2024-04-25T19:23:15.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.215+0000 7f000be00640 1 --2- 172.21.15.131:0/260250398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efff4004390 0x7efff40048c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:15.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.216+0000 7f0011400640 1 --2- 172.21.15.131:0/260250398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff4004f30 0x7efff400b9c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0004009f90 tx=0x7efff4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ce16e62b4c5751 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:15.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.216+0000 7f000b400640 1 -- 172.21.15.131:0/260250398 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0004009c10 con 0x7efff4004f30 2024-04-25T19:23:15.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.216+0000 7f000b400640 1 -- 172.21.15.131:0/260250398 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0004036070 con 0x7efff4004f30 2024-04-25T19:23:15.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.216+0000 7f000b400640 1 -- 172.21.15.131:0/260250398 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0004031810 con 0x7efff4004f30 2024-04-25T19:23:15.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.216+0000 7f0013400640 1 -- 172.21.15.131:0/260250398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff4004f30 msgr2=0x7efff400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:15.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.216+0000 7f0013400640 1 --2- 172.21.15.131:0/260250398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff4004f30 0x7efff400b9c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0004009f90 tx=0x7efff4005830 comp rx=0 tx=0).stop 2024-04-25T19:23:15.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.217+0000 7f0011400640 1 -- 172.21.15.131:0/260250398 reap_dead start 2024-04-25T19:23:15.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.217+0000 7f0013400640 1 -- 172.21.15.131:0/260250398 shutdown_connections 2024-04-25T19:23:15.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.217+0000 7f0013400640 1 -- 172.21.15.131:0/260250398 >> 172.21.15.131:0/260250398 conn(0x7f000c073090 msgr2=0x7f000c0734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:15.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.217+0000 7f0013400640 1 -- 172.21.15.131:0/260250398 shutdown_connections 2024-04-25T19:23:15.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.217+0000 7f0013400640 1 -- 172.21.15.131:0/260250398 wait complete. 2024-04-25T19:23:15.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.219+0000 7f0013400640 1 Processor -- start 2024-04-25T19:23:15.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.219+0000 7f0013400640 1 -- start start 2024-04-25T19:23:15.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.221+0000 7f0013400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff4004f30 0x7f000c154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:15.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.221+0000 7f0013400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f000c156490 0x7f000c0b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:15.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.221+0000 7f0013400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f000c1568a0 0x7f000c0b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:15.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.221+0000 7f0013400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f000c0cef40 con 0x7efff4004f30 2024-04-25T19:23:15.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.221+0000 7f0013400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f000c0b0f00 con 0x7f000c1568a0 2024-04-25T19:23:15.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.221+0000 7f0013400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f000c0cf0c0 con 0x7f000c156490 2024-04-25T19:23:15.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.221+0000 7f0010a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff4004f30 0x7f000c154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:15.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.221+0000 7f0010a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff4004f30 0x7f000c154230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56034/0 (socket says 172.21.15.131:56034) 2024-04-25T19:23:15.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.221+0000 7f0010a00640 1 -- 172.21.15.131:0/2836750713 learned_addr learned my addr 172.21.15.131:0/2836750713 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:15.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.222+0000 7f0011400640 1 --2- 172.21.15.131:0/2836750713 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f000c1568a0 0x7f000c0b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:15.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.222+0000 7f0010a00640 1 -- 172.21.15.131:0/2836750713 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f000c156490 msgr2=0x7f000c0b20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:15.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.222+0000 7f000be00640 1 --2- 172.21.15.131:0/2836750713 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f000c156490 0x7f000c0b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:15.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.222+0000 7f0010a00640 1 --2- 172.21.15.131:0/2836750713 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f000c156490 0x7f000c0b20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:15.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.222+0000 7f0010a00640 1 -- 172.21.15.131:0/2836750713 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f000c1568a0 msgr2=0x7f000c0b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:15.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.222+0000 7f0010a00640 1 --2- 172.21.15.131:0/2836750713 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f000c1568a0 0x7f000c0b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:15.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.222+0000 7f0010a00640 1 -- 172.21.15.131:0/2836750713 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000c154770 con 0x7efff4004f30 2024-04-25T19:23:15.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.222+0000 7f0010a00640 1 --2- 172.21.15.131:0/2836750713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff4004f30 0x7f000c154230 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0000011700 tx=0x7f0000011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:15.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.222+0000 7f0008c00640 1 -- 172.21.15.131:0/2836750713 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000000f9c0 con 0x7efff4004f30 2024-04-25T19:23:15.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.222+0000 7f0008c00640 1 -- 172.21.15.131:0/2836750713 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f000000fb60 con 0x7efff4004f30 2024-04-25T19:23:15.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.222+0000 7f0008c00640 1 -- 172.21.15.131:0/2836750713 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0000015460 con 0x7efff4004f30 2024-04-25T19:23:15.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.222+0000 7f0013400640 1 -- 172.21.15.131:0/2836750713 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f000c13c580 con 0x7efff4004f30 2024-04-25T19:23:15.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.223+0000 7f0013400640 1 -- 172.21.15.131:0/2836750713 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f000c13d010 con 0x7efff4004f30 2024-04-25T19:23:15.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.224+0000 7f0013400640 1 -- 172.21.15.131:0/2836750713 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f000c050740 con 0x7efff4004f30 2024-04-25T19:23:15.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.225+0000 7f0008c00640 1 -- 172.21.15.131:0/2836750713 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0000015600 con 0x7efff4004f30 2024-04-25T19:23:15.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.226+0000 7f0008c00640 1 --2- 172.21.15.131:0/2836750713 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7effec0744e0 0x7effec0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:15.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.226+0000 7f0008c00640 1 -- 172.21.15.131:0/2836750713 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f0000095b90 con 0x7efff4004f30 2024-04-25T19:23:15.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.227+0000 7f000be00640 1 --2- 172.21.15.131:0/2836750713 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7effec0744e0 0x7effec0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:15.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.228+0000 7f000be00640 1 --2- 172.21.15.131:0/2836750713 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7effec0744e0 0x7effec0769f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efff8001200 tx=0x7efff8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:15.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.231+0000 7f0008c00640 1 -- 172.21.15.131:0/2836750713 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f000c154770 con 0x7efff4004f30 2024-04-25T19:23:15.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.425+0000 7f0013400640 1 -- 172.21.15.131:0/2836750713 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f000c1430c0 con 0x7efff4004f30 2024-04-25T19:23:15.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.426+0000 7f0008c00640 1 -- 172.21.15.131:0/2836750713 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f0000019030 con 0x7efff4004f30 2024-04-25T19:23:15.431 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 64 2024-04-25T19:23:15.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.429+0000 7f0013400640 1 -- 172.21.15.131:0/2836750713 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7effec0744e0 msgr2=0x7effec0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:15.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.429+0000 7f0013400640 1 --2- 172.21.15.131:0/2836750713 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7effec0744e0 0x7effec0769f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efff8001200 tx=0x7efff8009040 comp rx=0 tx=0).stop 2024-04-25T19:23:15.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.429+0000 7f0013400640 1 -- 172.21.15.131:0/2836750713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff4004f30 msgr2=0x7f000c154230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:15.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.429+0000 7f0013400640 1 --2- 172.21.15.131:0/2836750713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff4004f30 0x7f000c154230 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0000011700 tx=0x7f0000011bc0 comp rx=0 tx=0).stop 2024-04-25T19:23:15.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.429+0000 7f0013400640 1 -- 172.21.15.131:0/2836750713 shutdown_connections 2024-04-25T19:23:15.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.429+0000 7f0013400640 1 --2- 172.21.15.131:0/2836750713 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7effec0744e0 0x7effec0769f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:15.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.429+0000 7f0013400640 1 --2- 172.21.15.131:0/2836750713 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f000c156490 0x7f000c0b20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:15.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.429+0000 7f0013400640 1 --2- 172.21.15.131:0/2836750713 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f000c1568a0 0x7f000c0b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:15.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.429+0000 7f0013400640 1 --2- 172.21.15.131:0/2836750713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff4004f30 0x7f000c154230 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:15.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.429+0000 7f0013400640 1 -- 172.21.15.131:0/2836750713 >> 172.21.15.131:0/2836750713 conn(0x7f000c073090 msgr2=0x7f000c15ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:15.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.429+0000 7f0013400640 1 -- 172.21.15.131:0/2836750713 shutdown_connections 2024-04-25T19:23:15.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.429+0000 7f0013400640 1 -- 172.21.15.131:0/2836750713 wait complete. 2024-04-25T19:23:15.457 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T19:23:15.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.717+0000 7ff9a9200640 1 Processor -- start 2024-04-25T19:23:15.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.718+0000 7ff9a9200640 1 -- start start 2024-04-25T19:23:15.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.720+0000 7ff9a9200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9a40b4ea0 0x7ff9a40cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:15.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.720+0000 7ff9a9200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff9a4144370 0x7ff9a415e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:15.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.720+0000 7ff9a9200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9a40d1230 con 0x7ff9a406c5c0 2024-04-25T19:23:15.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.720+0000 7ff9a9200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ff9a40d06b0 con 0x7ff9a4144370 2024-04-25T19:23:15.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.720+0000 7ff9a9200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff9a40d0990 con 0x7ff9a40b4ea0 2024-04-25T19:23:15.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.720+0000 7ff9a3e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff9a4144370 0x7ff9a415e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:15.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.720+0000 7ff9a3e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff9a4144370 0x7ff9a415e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56042/0 (socket says 172.21.15.131:56042) 2024-04-25T19:23:15.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.720+0000 7ff9a3e00640 1 -- 172.21.15.131:0/867761523 learned_addr learned my addr 172.21.15.131:0/867761523 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:15.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.721+0000 7ff9a2a00640 1 --2- 172.21.15.131:0/867761523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9a40b4ea0 0x7ff9a40cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:15.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.721+0000 7ff9a3e00640 1 -- 172.21.15.131:0/867761523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9a40b4ea0 msgr2=0x7ff9a40cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:15.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.721+0000 7ff9a3e00640 1 --2- 172.21.15.131:0/867761523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9a40b4ea0 0x7ff9a40cfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:15.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.721+0000 7ff9a3e00640 1 -- 172.21.15.131:0/867761523 >> v1:172.21.15.195:6789/0 conn(0x7ff9a406c5c0 legacy=0x7ff9a40b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:15.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.721+0000 7ff9a3e00640 1 -- 172.21.15.131:0/867761523 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a40d0c70 con 0x7ff9a4144370 2024-04-25T19:23:15.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.722+0000 7ff9a3e00640 1 --2- 172.21.15.131:0/867761523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9a4144370 0x7ff9a415e770 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009870 tx=0x7ff99c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e7e00886ade4c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:15.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.722+0000 7ff9a2000640 1 -- 172.21.15.131:0/867761523 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c037070 con 0x7ff9a4144370 2024-04-25T19:23:15.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.722+0000 7ff9a2000640 1 -- 172.21.15.131:0/867761523 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff99c032440 con 0x7ff9a4144370 2024-04-25T19:23:15.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.722+0000 7ff9a2000640 1 -- 172.21.15.131:0/867761523 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c032810 con 0x7ff9a4144370 2024-04-25T19:23:15.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.723+0000 7ff9a9200640 1 -- 172.21.15.131:0/867761523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9a4144370 msgr2=0x7ff9a415e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:15.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.723+0000 7ff9a9200640 1 --2- 172.21.15.131:0/867761523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9a4144370 0x7ff9a415e770 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009870 tx=0x7ff99c02a210 comp rx=0 tx=0).stop 2024-04-25T19:23:15.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.723+0000 7ff9a9200640 1 -- 172.21.15.131:0/867761523 shutdown_connections 2024-04-25T19:23:15.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.723+0000 7ff9a9200640 1 --2- 172.21.15.131:0/867761523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9a4144370 0x7ff9a415e770 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:15.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.723+0000 7ff9a9200640 1 --2- 172.21.15.131:0/867761523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9a40b4ea0 0x7ff9a40cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:15.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.723+0000 7ff9a9200640 1 -- 172.21.15.131:0/867761523 >> 172.21.15.131:0/867761523 conn(0x7ff9a40d1720 msgr2=0x7ff9a40d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:15.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.723+0000 7ff9a9200640 1 -- 172.21.15.131:0/867761523 shutdown_connections 2024-04-25T19:23:15.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.723+0000 7ff9a9200640 1 -- 172.21.15.131:0/867761523 wait complete. 2024-04-25T19:23:15.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.725+0000 7ff9a9200640 1 Processor -- start 2024-04-25T19:23:15.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.726+0000 7ff9a9200640 1 -- start start 2024-04-25T19:23:15.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.727+0000 7ff9a9200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9a406c5c0 0x7ff9a41f7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:15.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.727+0000 7ff9a9200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9a4144370 0x7ff9a413f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:15.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.727+0000 7ff9a9200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9a41457d0 0x7ff9a4145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:15.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.727+0000 7ff9a9200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a40d0450 con 0x7ff9a41457d0 2024-04-25T19:23:15.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.727+0000 7ff9a9200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a40d02d0 con 0x7ff9a406c5c0 2024-04-25T19:23:15.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.727+0000 7ff9a9200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff9a4147760 con 0x7ff9a4144370 2024-04-25T19:23:15.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.727+0000 7ff9a3e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9a41457d0 0x7ff9a4145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:15.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.728+0000 7ff9a3e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9a41457d0 0x7ff9a4145be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56048/0 (socket says 172.21.15.131:56048) 2024-04-25T19:23:15.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.728+0000 7ff9a3e00640 1 -- 172.21.15.131:0/3524527060 learned_addr learned my addr 172.21.15.131:0/3524527060 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:15.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.728+0000 7ff9a2a00640 1 --2- 172.21.15.131:0/3524527060 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9a4144370 0x7ff9a413f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:15.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.728+0000 7ff9a3400640 1 --2- 172.21.15.131:0/3524527060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9a406c5c0 0x7ff9a41f7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:15.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.728+0000 7ff9a3e00640 1 -- 172.21.15.131:0/3524527060 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9a4144370 msgr2=0x7ff9a413f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:15.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.728+0000 7ff9a3e00640 1 --2- 172.21.15.131:0/3524527060 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9a4144370 0x7ff9a413f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:15.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.728+0000 7ff9a3e00640 1 -- 172.21.15.131:0/3524527060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9a406c5c0 msgr2=0x7ff9a41f7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:15.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.728+0000 7ff9a3e00640 1 --2- 172.21.15.131:0/3524527060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9a406c5c0 0x7ff9a41f7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:15.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.728+0000 7ff9a3e00640 1 -- 172.21.15.131:0/3524527060 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a4146120 con 0x7ff9a41457d0 2024-04-25T19:23:15.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.728+0000 7ff9a3e00640 1 --2- 172.21.15.131:0/3524527060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9a41457d0 0x7ff9a4145be0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009870 tx=0x7ff99c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:15.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.729+0000 7ff99b400640 1 -- 172.21.15.131:0/3524527060 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c037040 con 0x7ff9a41457d0 2024-04-25T19:23:15.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.729+0000 7ff99b400640 1 -- 172.21.15.131:0/3524527060 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff99c042070 con 0x7ff9a41457d0 2024-04-25T19:23:15.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.729+0000 7ff9a9200640 1 -- 172.21.15.131:0/3524527060 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9a413fd80 con 0x7ff9a41457d0 2024-04-25T19:23:15.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.729+0000 7ff99b400640 1 -- 172.21.15.131:0/3524527060 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c030c90 con 0x7ff9a41457d0 2024-04-25T19:23:15.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.729+0000 7ff9a9200640 1 -- 172.21.15.131:0/3524527060 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9a40aae50 con 0x7ff9a41457d0 2024-04-25T19:23:15.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.730+0000 7ff9a9200640 1 -- 172.21.15.131:0/3524527060 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9a40aa8c0 con 0x7ff9a41457d0 2024-04-25T19:23:15.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.731+0000 7ff99b400640 1 -- 172.21.15.131:0/3524527060 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff99c047460 con 0x7ff9a41457d0 2024-04-25T19:23:15.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.732+0000 7ff99b400640 1 --2- 172.21.15.131:0/3524527060 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff9800744b0 0x7ff9800769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:15.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.732+0000 7ff99b400640 1 -- 172.21.15.131:0/3524527060 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7ff99c0b5f50 con 0x7ff9a41457d0 2024-04-25T19:23:15.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.733+0000 7ff9a3400640 1 --2- 172.21.15.131:0/3524527060 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff9800744b0 0x7ff9800769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:15.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.734+0000 7ff9a3400640 1 --2- 172.21.15.131:0/3524527060 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff9800744b0 0x7ff9800769c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff994006fd0 tx=0x7ff994008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:15.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.737+0000 7ff99b400640 1 -- 172.21.15.131:0/3524527060 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff9a4146120 con 0x7ff9a41457d0 2024-04-25T19:23:15.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.943+0000 7ff9a9200640 1 -- 172.21.15.131:0/3524527060 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff9a4050740 con 0x7ff9a41457d0 2024-04-25T19:23:15.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.945+0000 7ff99b400640 1 -- 172.21.15.131:0/3524527060 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7ff99c0800a0 con 0x7ff9a41457d0 2024-04-25T19:23:15.945 INFO:teuthology.orchestra.run.smithi131.stderr:listed 0 entries 2024-04-25T19:23:15.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.947+0000 7ff9a9200640 1 -- 172.21.15.131:0/3524527060 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff9800744b0 msgr2=0x7ff9800769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:15.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.947+0000 7ff9a9200640 1 --2- 172.21.15.131:0/3524527060 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff9800744b0 0x7ff9800769c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff994006fd0 tx=0x7ff994008040 comp rx=0 tx=0).stop 2024-04-25T19:23:15.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.947+0000 7ff9a9200640 1 -- 172.21.15.131:0/3524527060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9a41457d0 msgr2=0x7ff9a4145be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:15.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.947+0000 7ff9a9200640 1 --2- 172.21.15.131:0/3524527060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9a41457d0 0x7ff9a4145be0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009870 tx=0x7ff99c0046c0 comp rx=0 tx=0).stop 2024-04-25T19:23:15.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.947+0000 7ff9a9200640 1 -- 172.21.15.131:0/3524527060 shutdown_connections 2024-04-25T19:23:15.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.947+0000 7ff9a9200640 1 --2- 172.21.15.131:0/3524527060 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff9800744b0 0x7ff9800769c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:15.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.948+0000 7ff9a9200640 1 --2- 172.21.15.131:0/3524527060 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9a4144370 0x7ff9a413f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:15.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.948+0000 7ff9a9200640 1 --2- 172.21.15.131:0/3524527060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9a41457d0 0x7ff9a4145be0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:15.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.948+0000 7ff9a9200640 1 --2- 172.21.15.131:0/3524527060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9a406c5c0 0x7ff9a41f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:15.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.948+0000 7ff9a9200640 1 -- 172.21.15.131:0/3524527060 >> 172.21.15.131:0/3524527060 conn(0x7ff9a40d1720 msgr2=0x7ff9a40d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:15.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.948+0000 7ff9a9200640 1 -- 172.21.15.131:0/3524527060 shutdown_connections 2024-04-25T19:23:15.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:15.948+0000 7ff9a9200640 1 -- 172.21.15.131:0/3524527060 wait complete. 2024-04-25T19:23:15.972 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-25T19:23:15.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:23:15.973 DEBUG:teuthology.orchestra.run.smithi195:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-25T19:23:16.071 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T19:23:16.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:23:16.072 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-25T19:23:16.120 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T19:23:16.120 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:23:16.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.402+0000 7f0d05400640 1 Processor -- start 2024-04-25T19:23:16.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.403+0000 7f0d05400640 1 -- start start 2024-04-25T19:23:16.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.404+0000 7f0d05400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0d00070e20 0x7f0d0015c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:16.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.404+0000 7f0d05400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d0006d560 0x7f0d000b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:16.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.404+0000 7f0d05400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d00071230 con 0x7f0d0006f180 2024-04-25T19:23:16.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.404+0000 7f0d05400640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f0d0006f8f0 con 0x7f0d00070e20 2024-04-25T19:23:16.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.404+0000 7f0d05400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0d0006fbd0 con 0x7f0d0006d560 2024-04-25T19:23:16.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.405+0000 7f0cffe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0d00070e20 0x7f0d0015c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:16.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.405+0000 7f0cffe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0d00070e20 0x7f0d0015c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56056/0 (socket says 172.21.15.131:56056) 2024-04-25T19:23:16.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.405+0000 7f0cffe00640 1 -- 172.21.15.131:0/1425329 learned_addr learned my addr 172.21.15.131:0/1425329 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:16.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.405+0000 7f0d04a00640 1 --2- 172.21.15.131:0/1425329 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d0006d560 0x7f0d000b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:16.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.405+0000 7f0cffe00640 1 -- 172.21.15.131:0/1425329 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d0006d560 msgr2=0x7f0d000b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:16.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.405+0000 7f0cffe00640 1 --2- 172.21.15.131:0/1425329 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d0006d560 0x7f0d000b5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:16.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.405+0000 7f0cffe00640 1 -- 172.21.15.131:0/1425329 >> v1:172.21.15.195:6789/0 conn(0x7f0d0006f180 legacy=0x7f0d0006ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:16.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.405+0000 7f0cffe00640 1 -- 172.21.15.131:0/1425329 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0006feb0 con 0x7f0d00070e20 2024-04-25T19:23:16.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.406+0000 7f0cffe00640 1 --2- 172.21.15.131:0/1425329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d00070e20 0x7f0d0015c800 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0009870 tx=0x7f0cf002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3058c7a16a1e96 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:16.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.407+0000 7f0cff400640 1 -- 172.21.15.131:0/1425329 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0037070 con 0x7f0d00070e20 2024-04-25T19:23:16.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.407+0000 7f0cff400640 1 -- 172.21.15.131:0/1425329 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cf0032440 con 0x7f0d00070e20 2024-04-25T19:23:16.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.407+0000 7f0cff400640 1 -- 172.21.15.131:0/1425329 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0032810 con 0x7f0d00070e20 2024-04-25T19:23:16.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.407+0000 7f0d05400640 1 -- 172.21.15.131:0/1425329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d00070e20 msgr2=0x7f0d0015c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:16.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.407+0000 7f0d05400640 1 --2- 172.21.15.131:0/1425329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d00070e20 0x7f0d0015c800 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0009870 tx=0x7f0cf002a210 comp rx=0 tx=0).stop 2024-04-25T19:23:16.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.408+0000 7f0d05400640 1 -- 172.21.15.131:0/1425329 shutdown_connections 2024-04-25T19:23:16.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.408+0000 7f0d05400640 1 --2- 172.21.15.131:0/1425329 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d0006d560 0x7f0d000b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:16.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.408+0000 7f0d05400640 1 --2- 172.21.15.131:0/1425329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d00070e20 0x7f0d0015c800 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:16.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.408+0000 7f0d05400640 1 -- 172.21.15.131:0/1425329 >> 172.21.15.131:0/1425329 conn(0x7f0d000d1720 msgr2=0x7f0d000d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:16.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.408+0000 7f0d05400640 1 -- 172.21.15.131:0/1425329 shutdown_connections 2024-04-25T19:23:16.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.408+0000 7f0d05400640 1 -- 172.21.15.131:0/1425329 wait complete. 2024-04-25T19:23:16.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.410+0000 7f0d05400640 1 Processor -- start 2024-04-25T19:23:16.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.410+0000 7f0d05400640 1 -- start start 2024-04-25T19:23:16.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.412+0000 7f0d05400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d0006f180 0x7f0d000c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:16.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.412+0000 7f0d05400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d00070e20 0x7f0d000c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:16.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.412+0000 7f0d05400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d0014c1d0 0x7f0d000b6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:16.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.412+0000 7f0d05400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0006c5c0 con 0x7f0d0014c1d0 2024-04-25T19:23:16.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.412+0000 7f0d05400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0006f590 con 0x7f0d0006f180 2024-04-25T19:23:16.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.412+0000 7f0d05400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0d0006c740 con 0x7f0d00070e20 2024-04-25T19:23:16.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.412+0000 7f0d04a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d0014c1d0 0x7f0d000b6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:16.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.412+0000 7f0d04a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d0014c1d0 0x7f0d000b6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56066/0 (socket says 172.21.15.131:56066) 2024-04-25T19:23:16.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.412+0000 7f0d04a00640 1 -- 172.21.15.131:0/4144422815 learned_addr learned my addr 172.21.15.131:0/4144422815 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:16.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.412+0000 7f0cf7400640 1 --2- 172.21.15.131:0/4144422815 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d00070e20 0x7f0d000c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:16.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.412+0000 7f0cffe00640 1 --2- 172.21.15.131:0/4144422815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d0006f180 0x7f0d000c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:16.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.412+0000 7f0d04a00640 1 -- 172.21.15.131:0/4144422815 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d00070e20 msgr2=0x7f0d000c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:16.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.413+0000 7f0d04a00640 1 --2- 172.21.15.131:0/4144422815 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d00070e20 0x7f0d000c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:16.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.413+0000 7f0d04a00640 1 -- 172.21.15.131:0/4144422815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d0006f180 msgr2=0x7f0d000c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:16.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.413+0000 7f0d04a00640 1 --2- 172.21.15.131:0/4144422815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d0006f180 0x7f0d000c7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:16.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.413+0000 7f0d04a00640 1 -- 172.21.15.131:0/4144422815 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d000c7960 con 0x7f0d0014c1d0 2024-04-25T19:23:16.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.413+0000 7f0cf7400640 1 --2- 172.21.15.131:0/4144422815 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d00070e20 0x7f0d000c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:16.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.413+0000 7f0d04a00640 1 --2- 172.21.15.131:0/4144422815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d0014c1d0 0x7f0d000b6d70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800cc30 tx=0x7f0cf800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:16.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.413+0000 7f0cfcc00640 1 -- 172.21.15.131:0/4144422815 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf800ce40 con 0x7f0d0014c1d0 2024-04-25T19:23:16.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.413+0000 7f0cfcc00640 1 -- 172.21.15.131:0/4144422815 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cf8003990 con 0x7f0d0014c1d0 2024-04-25T19:23:16.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.413+0000 7f0cfcc00640 1 -- 172.21.15.131:0/4144422815 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8003d40 con 0x7f0d0014c1d0 2024-04-25T19:23:16.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.413+0000 7f0d05400640 1 -- 172.21.15.131:0/4144422815 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d000c7c40 con 0x7f0d0014c1d0 2024-04-25T19:23:16.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.413+0000 7f0d05400640 1 -- 172.21.15.131:0/4144422815 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d000c8200 con 0x7f0d0014c1d0 2024-04-25T19:23:16.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.415+0000 7f0d05400640 1 -- 172.21.15.131:0/4144422815 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d000c76d0 con 0x7f0d0014c1d0 2024-04-25T19:23:16.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.416+0000 7f0cfcc00640 1 -- 172.21.15.131:0/4144422815 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0cf8003ee0 con 0x7f0d0014c1d0 2024-04-25T19:23:16.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.417+0000 7f0cfcc00640 1 --2- 172.21.15.131:0/4144422815 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0cdc0744b0 0x7f0cdc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:16.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.417+0000 7f0cfcc00640 1 -- 172.21.15.131:0/4144422815 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f0cf80956c0 con 0x7f0d0014c1d0 2024-04-25T19:23:16.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.417+0000 7f0cffe00640 1 --2- 172.21.15.131:0/4144422815 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0cdc0744b0 0x7f0cdc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:16.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.419+0000 7f0cffe00640 1 --2- 172.21.15.131:0/4144422815 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0cdc0744b0 0x7f0cdc0769c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0034000 tx=0x7f0cf002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:16.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.422+0000 7f0cfcc00640 1 -- 172.21.15.131:0/4144422815 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0cf8014030 con 0x7f0d0014c1d0 2024-04-25T19:23:16.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.645+0000 7f0d05400640 1 -- 172.21.15.131:0/4144422815 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d00050740 con 0x7f0d0014c1d0 2024-04-25T19:23:16.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.646+0000 7f0cfcc00640 1 -- 172.21.15.131:0/4144422815 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5187 (secure 0 0 0) 0x7f0cf805fe50 con 0x7f0d0014c1d0 2024-04-25T19:23:16.647 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:16.647 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/1570319410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":1570319410},{"type":"v1","addr":"172.21.15.195:6837","nonce":1570319410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/4072860882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4072860882},{"type":"v1","addr":"172.21.15.131:6834","nonce":4072860882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2207155444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2207155444},{"type":"v1","addr":"172.21.15.131:6835","nonce":2207155444}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T19:22:16.578438+0000","modified":"2024-04-25T19:22:19.648009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6836/1898121552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1898121552},{"type":"v1","addr":"172.21.15.195:6836","nonce":1898121552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T19:23:16.647 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 8 2024-04-25T19:23:16.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.649+0000 7f0d05400640 1 -- 172.21.15.131:0/4144422815 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0cdc0744b0 msgr2=0x7f0cdc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:16.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.649+0000 7f0d05400640 1 --2- 172.21.15.131:0/4144422815 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0cdc0744b0 0x7f0cdc0769c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0034000 tx=0x7f0cf002e000 comp rx=0 tx=0).stop 2024-04-25T19:23:16.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.649+0000 7f0d05400640 1 -- 172.21.15.131:0/4144422815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d0014c1d0 msgr2=0x7f0d000b6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:16.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.649+0000 7f0d05400640 1 --2- 172.21.15.131:0/4144422815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d0014c1d0 0x7f0d000b6d70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800cc30 tx=0x7f0cf800a5c0 comp rx=0 tx=0).stop 2024-04-25T19:23:16.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.649+0000 7f0d05400640 1 -- 172.21.15.131:0/4144422815 shutdown_connections 2024-04-25T19:23:16.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.649+0000 7f0d05400640 1 --2- 172.21.15.131:0/4144422815 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0cdc0744b0 0x7f0cdc0769c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:16.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.649+0000 7f0d05400640 1 --2- 172.21.15.131:0/4144422815 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d00070e20 0x7f0d000c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:16.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.649+0000 7f0d05400640 1 --2- 172.21.15.131:0/4144422815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d0014c1d0 0x7f0d000b6d70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:16.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.649+0000 7f0d05400640 1 --2- 172.21.15.131:0/4144422815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d0006f180 0x7f0d000c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:16.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.649+0000 7f0d05400640 1 -- 172.21.15.131:0/4144422815 >> 172.21.15.131:0/4144422815 conn(0x7f0d000d1720 msgr2=0x7f0d00072ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:16.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.649+0000 7f0d05400640 1 -- 172.21.15.131:0/4144422815 shutdown_connections 2024-04-25T19:23:16.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.649+0000 7f0d05400640 1 -- 172.21.15.131:0/4144422815 wait complete. 2024-04-25T19:23:16.677 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:23:16.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.948+0000 7fd714e00640 1 Processor -- start 2024-04-25T19:23:16.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.949+0000 7fd714e00640 1 -- start start 2024-04-25T19:23:16.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.951+0000 7fd714e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd7101434d0 0x7fd710070480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:16.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.951+0000 7fd714e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd7100d0ed0 0x7fd7100d12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:16.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.951+0000 7fd714e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd710160be0 0x7fd710160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:16.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.951+0000 7fd714e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd7101438e0 con 0x7fd7101434d0 2024-04-25T19:23:16.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.951+0000 7fd714e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd710161530 con 0x7fd7100d0ed0 2024-04-25T19:23:16.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.951+0000 7fd714e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd7100709c0 con 0x7fd710160be0 2024-04-25T19:23:16.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.951+0000 7fd70de00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd7101434d0 0x7fd710070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:16.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.951+0000 7fd70de00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd7101434d0 0x7fd710070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56072/0 (socket says 172.21.15.131:56072) 2024-04-25T19:23:16.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.951+0000 7fd70de00640 1 -- 172.21.15.131:0/1782434715 learned_addr learned my addr 172.21.15.131:0/1782434715 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:16.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.952+0000 7fd707e00640 1 --2- 172.21.15.131:0/1782434715 >> v2:172.21.15.195:3300/0 conn(0x7fd7100d0ed0 0x7fd7100d12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:16.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.952+0000 7fd70e800640 1 --2- 172.21.15.131:0/1782434715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd710160be0 0x7fd710160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:16.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.952+0000 7fd70de00640 1 -- 172.21.15.131:0/1782434715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd710160be0 msgr2=0x7fd710160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:16.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.952+0000 7fd70de00640 1 --2- 172.21.15.131:0/1782434715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd710160be0 0x7fd710160ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:16.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.952+0000 7fd70de00640 1 -- 172.21.15.131:0/1782434715 >> v2:172.21.15.195:3300/0 conn(0x7fd7100d0ed0 msgr2=0x7fd7100d12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:16.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.952+0000 7fd70de00640 1 --2- 172.21.15.131:0/1782434715 >> v2:172.21.15.195:3300/0 conn(0x7fd7100d0ed0 0x7fd7100d12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:16.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.952+0000 7fd70de00640 1 -- 172.21.15.131:0/1782434715 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd71006f3e0 con 0x7fd7101434d0 2024-04-25T19:23:16.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.953+0000 7fd70de00640 1 --2- 172.21.15.131:0/1782434715 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7101434d0 0x7fd710070480 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd7100b3620 tx=0x7fd70002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2185bed1a14f02be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:16.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.953+0000 7fd70d400640 1 -- 172.21.15.131:0/1782434715 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd700037070 con 0x7fd7101434d0 2024-04-25T19:23:16.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.953+0000 7fd70d400640 1 -- 172.21.15.131:0/1782434715 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd700032440 con 0x7fd7101434d0 2024-04-25T19:23:16.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.953+0000 7fd70d400640 1 -- 172.21.15.131:0/1782434715 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd700032810 con 0x7fd7101434d0 2024-04-25T19:23:16.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.954+0000 7fd714e00640 1 -- 172.21.15.131:0/1782434715 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7101434d0 msgr2=0x7fd710070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:16.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.954+0000 7fd714e00640 1 --2- 172.21.15.131:0/1782434715 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7101434d0 0x7fd710070480 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd7100b3620 tx=0x7fd70002a1e0 comp rx=0 tx=0).stop 2024-04-25T19:23:16.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.954+0000 7fd714e00640 1 -- 172.21.15.131:0/1782434715 shutdown_connections 2024-04-25T19:23:16.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.954+0000 7fd714e00640 1 --2- 172.21.15.131:0/1782434715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd710160be0 0x7fd710160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:16.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.954+0000 7fd714e00640 1 --2- 172.21.15.131:0/1782434715 >> v2:172.21.15.195:3300/0 conn(0x7fd7100d0ed0 0x7fd7100d12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:16.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.954+0000 7fd714e00640 1 --2- 172.21.15.131:0/1782434715 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7101434d0 0x7fd710070480 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:16.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.954+0000 7fd714e00640 1 -- 172.21.15.131:0/1782434715 >> 172.21.15.131:0/1782434715 conn(0x7fd7100d1ae0 msgr2=0x7fd7100d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:16.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.954+0000 7fd714e00640 1 -- 172.21.15.131:0/1782434715 shutdown_connections 2024-04-25T19:23:16.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.954+0000 7fd714e00640 1 -- 172.21.15.131:0/1782434715 wait complete. 2024-04-25T19:23:16.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.956+0000 7fd714e00640 1 Processor -- start 2024-04-25T19:23:16.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.956+0000 7fd714e00640 1 -- start start 2024-04-25T19:23:16.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.958+0000 7fd714e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7100d0ed0 0x7fd7101fa170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:16.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.958+0000 7fd714e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7101434d0 0x7fd71013d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:16.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.958+0000 7fd714e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd710160be0 0x7fd71015c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:16.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.958+0000 7fd714e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd71006fc80 con 0x7fd7101434d0 2024-04-25T19:23:16.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.958+0000 7fd714e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd71006f9a0 con 0x7fd7100d0ed0 2024-04-25T19:23:16.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.958+0000 7fd714e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd71006f090 con 0x7fd710160be0 2024-04-25T19:23:16.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.958+0000 7fd707e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7101434d0 0x7fd71013d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:16.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.958+0000 7fd707e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7101434d0 0x7fd71013d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56088/0 (socket says 172.21.15.131:56088) 2024-04-25T19:23:16.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.958+0000 7fd707e00640 1 -- 172.21.15.131:0/1305619775 learned_addr learned my addr 172.21.15.131:0/1305619775 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:16.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.959+0000 7fd707e00640 1 -- 172.21.15.131:0/1305619775 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd710160be0 msgr2=0x7fd71015c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:16.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.959+0000 7fd707e00640 1 --2- 172.21.15.131:0/1305619775 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd710160be0 0x7fd71015c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:16.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.959+0000 7fd70de00640 1 --2- 172.21.15.131:0/1305619775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7100d0ed0 0x7fd7101fa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:16.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.959+0000 7fd707e00640 1 -- 172.21.15.131:0/1305619775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7100d0ed0 msgr2=0x7fd7101fa170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:16.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.959+0000 7fd707e00640 1 --2- 172.21.15.131:0/1305619775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7100d0ed0 0x7fd7101fa170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:16.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.959+0000 7fd707e00640 1 -- 172.21.15.131:0/1305619775 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7101fa6b0 con 0x7fd7101434d0 2024-04-25T19:23:16.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.959+0000 7fd707e00640 1 --2- 172.21.15.131:0/1305619775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7101434d0 0x7fd71013d350 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800d800 tx=0x7fd6f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:16.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.959+0000 7fd706000640 1 -- 172.21.15.131:0/1305619775 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8018020 con 0x7fd7101434d0 2024-04-25T19:23:16.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.959+0000 7fd706000640 1 -- 172.21.15.131:0/1305619775 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6f80096a0 con 0x7fd7101434d0 2024-04-25T19:23:16.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.959+0000 7fd706000640 1 -- 172.21.15.131:0/1305619775 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8009a90 con 0x7fd7101434d0 2024-04-25T19:23:16.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.959+0000 7fd714e00640 1 -- 172.21.15.131:0/1305619775 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd710144e40 con 0x7fd7101434d0 2024-04-25T19:23:16.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.959+0000 7fd714e00640 1 -- 172.21.15.131:0/1305619775 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7100b1d60 con 0x7fd7101434d0 2024-04-25T19:23:16.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.961+0000 7fd714e00640 1 -- 172.21.15.131:0/1305619775 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7100b17f0 con 0x7fd7101434d0 2024-04-25T19:23:16.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.962+0000 7fd706000640 1 -- 172.21.15.131:0/1305619775 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd6f801b020 con 0x7fd7101434d0 2024-04-25T19:23:16.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.963+0000 7fd706000640 1 --2- 172.21.15.131:0/1305619775 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd6ec0744e0 0x7fd6ec0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:16.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.963+0000 7fd706000640 1 -- 172.21.15.131:0/1305619775 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fd6f8095860 con 0x7fd7101434d0 2024-04-25T19:23:16.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.963+0000 7fd70de00640 1 --2- 172.21.15.131:0/1305619775 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd6ec0744e0 0x7fd6ec0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:16.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.965+0000 7fd70de00640 1 --2- 172.21.15.131:0/1305619775 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd6ec0744e0 0x7fd6ec0769f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd700034000 tx=0x7fd70002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:16.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:16.968+0000 7fd706000640 1 -- 172.21.15.131:0/1305619775 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd6f8022020 con 0x7fd7101434d0 2024-04-25T19:23:17.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.164+0000 7fd714e00640 1 -- 172.21.15.131:0/1305619775 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd710050740 con 0x7fd7101434d0 2024-04-25T19:23:17.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.167+0000 7fd706000640 1 -- 172.21.15.131:0/1305619775 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16878 (secure 0 0 0) 0x7fd7101fa6b0 con 0x7fd7101434d0 2024-04-25T19:23:17.168 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:17.168 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":22,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:22:57.347297+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:22:14.779716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T19:22:15.552027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:23:17.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.169+0000 7fd714e00640 1 -- 172.21.15.131:0/1305619775 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd6ec0744e0 msgr2=0x7fd6ec0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:17.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.169+0000 7fd714e00640 1 --2- 172.21.15.131:0/1305619775 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd6ec0744e0 0x7fd6ec0769f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd700034000 tx=0x7fd70002e000 comp rx=0 tx=0).stop 2024-04-25T19:23:17.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.169+0000 7fd714e00640 1 -- 172.21.15.131:0/1305619775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7101434d0 msgr2=0x7fd71013d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:17.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.169+0000 7fd714e00640 1 --2- 172.21.15.131:0/1305619775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7101434d0 0x7fd71013d350 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800d800 tx=0x7fd6f800dcc0 comp rx=0 tx=0).stop 2024-04-25T19:23:17.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.170+0000 7fd714e00640 1 -- 172.21.15.131:0/1305619775 shutdown_connections 2024-04-25T19:23:17.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.170+0000 7fd714e00640 1 --2- 172.21.15.131:0/1305619775 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd6ec0744e0 0x7fd6ec0769f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:17.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.170+0000 7fd714e00640 1 --2- 172.21.15.131:0/1305619775 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd710160be0 0x7fd71015c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:17.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.170+0000 7fd714e00640 1 --2- 172.21.15.131:0/1305619775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7101434d0 0x7fd71013d350 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:17.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.170+0000 7fd714e00640 1 --2- 172.21.15.131:0/1305619775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7100d0ed0 0x7fd7101fa170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:17.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.170+0000 7fd714e00640 1 -- 172.21.15.131:0/1305619775 >> 172.21.15.131:0/1305619775 conn(0x7fd7100d1ae0 msgr2=0x7fd71006cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:17.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.170+0000 7fd714e00640 1 -- 172.21.15.131:0/1305619775 shutdown_connections 2024-04-25T19:23:17.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.170+0000 7fd714e00640 1 -- 172.21.15.131:0/1305619775 wait complete. 2024-04-25T19:23:17.198 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T19:22:04.178847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T19:22:14.779716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T19:22:15.552027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T19:23:17.199 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T19:23:17.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.474+0000 7fc1e9400640 1 Processor -- start 2024-04-25T19:23:17.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.474+0000 7fc1e9400640 1 -- start start 2024-04-25T19:23:17.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.476+0000 7fc1e9400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc1e40ce1c0 0x7fc1e40cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:17.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.476+0000 7fc1e9400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc1e40d2580 0x7fc1e40d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:17.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.476+0000 7fc1e9400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1e40d2ed0 0x7fc1e40ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:17.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.476+0000 7fc1e9400640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fc1e40d32e0 con 0x7fc1e40d2580 2024-04-25T19:23:17.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.476+0000 7fc1e9400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fc1e40ce5d0 con 0x7fc1e40ce1c0 2024-04-25T19:23:17.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.476+0000 7fc1e9400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc1e40cf3c0 con 0x7fc1e40d2ed0 2024-04-25T19:23:17.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.477+0000 7fc1dbe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc1e40d2580 0x7fc1e40d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:17.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.477+0000 7fc1dbe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc1e40d2580 0x7fc1e40d2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56096/0 (socket says 172.21.15.131:56096) 2024-04-25T19:23:17.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.477+0000 7fc1dbe00640 1 -- 172.21.15.131:0/1870291869 learned_addr learned my addr 172.21.15.131:0/1870291869 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:17.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.477+0000 7fc1e2800640 1 --2- 172.21.15.131:0/1870291869 >> v2:172.21.15.195:3300/0 conn(0x7fc1e40ce1c0 0x7fc1e40cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:17.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.477+0000 7fc1e3200640 1 --2- 172.21.15.131:0/1870291869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1e40d2ed0 0x7fc1e40ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:17.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.477+0000 7fc1dbe00640 1 -- 172.21.15.131:0/1870291869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1e40d2ed0 msgr2=0x7fc1e40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:17.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.477+0000 7fc1dbe00640 1 --2- 172.21.15.131:0/1870291869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1e40d2ed0 0x7fc1e40ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:17.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.477+0000 7fc1dbe00640 1 -- 172.21.15.131:0/1870291869 >> v2:172.21.15.195:3300/0 conn(0x7fc1e40ce1c0 msgr2=0x7fc1e40cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:17.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.477+0000 7fc1dbe00640 1 --2- 172.21.15.131:0/1870291869 >> v2:172.21.15.195:3300/0 conn(0x7fc1e40ce1c0 0x7fc1e40cec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:17.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.477+0000 7fc1dbe00640 1 -- 172.21.15.131:0/1870291869 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e40cf6a0 con 0x7fc1e40d2580 2024-04-25T19:23:17.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.478+0000 7fc1dbe00640 1 --2- 172.21.15.131:0/1870291869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1e40d2580 0x7fc1e40d2990 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4163fd0 tx=0x7fc1cc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e61846a8ef5e8e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:17.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.479+0000 7fc1e1e00640 1 -- 172.21.15.131:0/1870291869 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc037070 con 0x7fc1e40d2580 2024-04-25T19:23:17.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.479+0000 7fc1e1e00640 1 -- 172.21.15.131:0/1870291869 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1cc032440 con 0x7fc1e40d2580 2024-04-25T19:23:17.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.479+0000 7fc1e1e00640 1 -- 172.21.15.131:0/1870291869 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc032810 con 0x7fc1e40d2580 2024-04-25T19:23:17.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.480+0000 7fc1e9400640 1 -- 172.21.15.131:0/1870291869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1e40d2580 msgr2=0x7fc1e40d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:17.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.480+0000 7fc1e9400640 1 --2- 172.21.15.131:0/1870291869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1e40d2580 0x7fc1e40d2990 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4163fd0 tx=0x7fc1cc02a140 comp rx=0 tx=0).stop 2024-04-25T19:23:17.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.480+0000 7fc1e9400640 1 -- 172.21.15.131:0/1870291869 shutdown_connections 2024-04-25T19:23:17.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.480+0000 7fc1e9400640 1 --2- 172.21.15.131:0/1870291869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1e40d2ed0 0x7fc1e40ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:17.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.480+0000 7fc1e9400640 1 --2- 172.21.15.131:0/1870291869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1e40d2580 0x7fc1e40d2990 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:17.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.480+0000 7fc1e9400640 1 --2- 172.21.15.131:0/1870291869 >> v2:172.21.15.195:3300/0 conn(0x7fc1e40ce1c0 0x7fc1e40cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:17.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.480+0000 7fc1e9400640 1 -- 172.21.15.131:0/1870291869 >> 172.21.15.131:0/1870291869 conn(0x7fc1e409b7d0 msgr2=0x7fc1e409bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:17.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.480+0000 7fc1e9400640 1 -- 172.21.15.131:0/1870291869 shutdown_connections 2024-04-25T19:23:17.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.480+0000 7fc1e9400640 1 -- 172.21.15.131:0/1870291869 wait complete. 2024-04-25T19:23:17.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.483+0000 7fc1e9400640 1 Processor -- start 2024-04-25T19:23:17.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.483+0000 7fc1e9400640 1 -- start start 2024-04-25T19:23:17.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.484+0000 7fc1e9400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1e40ce1c0 0x7fc1e40cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:17.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.484+0000 7fc1e9400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1e40d2580 0x7fc1e4152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:17.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.484+0000 7fc1e9400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1e40d2ed0 0x7fc1e40b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:17.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.484+0000 7fc1e9400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e40cd530 con 0x7fc1e40ce1c0 2024-04-25T19:23:17.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.484+0000 7fc1e9400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e40cfc60 con 0x7fc1e40d2ed0 2024-04-25T19:23:17.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.484+0000 7fc1e9400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc1e40cd6b0 con 0x7fc1e40d2580 2024-04-25T19:23:17.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.485+0000 7fc1e2800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1e40ce1c0 0x7fc1e40cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:17.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.485+0000 7fc1e2800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1e40ce1c0 0x7fc1e40cc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56110/0 (socket says 172.21.15.131:56110) 2024-04-25T19:23:17.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.485+0000 7fc1e2800640 1 -- 172.21.15.131:0/2067677442 learned_addr learned my addr 172.21.15.131:0/2067677442 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:17.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.485+0000 7fc1e2800640 1 -- 172.21.15.131:0/2067677442 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1e40d2580 msgr2=0x7fc1e4152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:17.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.485+0000 7fc1e2800640 1 --2- 172.21.15.131:0/2067677442 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1e40d2580 0x7fc1e4152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:17.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.485+0000 7fc1e2800640 1 -- 172.21.15.131:0/2067677442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1e40d2ed0 msgr2=0x7fc1e40b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:17.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.485+0000 7fc1e2800640 1 --2- 172.21.15.131:0/2067677442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1e40d2ed0 0x7fc1e40b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:17.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.485+0000 7fc1e2800640 1 -- 172.21.15.131:0/2067677442 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e40c6a70 con 0x7fc1e40ce1c0 2024-04-25T19:23:17.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.485+0000 7fc1e2800640 1 --2- 172.21.15.131:0/2067677442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1e40ce1c0 0x7fc1e40cc420 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400d5d0 tx=0x7fc1d400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:17.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.487+0000 7fc1daa00640 1 -- 172.21.15.131:0/2067677442 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4018020 con 0x7fc1e40ce1c0 2024-04-25T19:23:17.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.487+0000 7fc1daa00640 1 -- 172.21.15.131:0/2067677442 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d4014620 con 0x7fc1e40ce1c0 2024-04-25T19:23:17.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.487+0000 7fc1daa00640 1 -- 172.21.15.131:0/2067677442 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4014a10 con 0x7fc1e40ce1c0 2024-04-25T19:23:17.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.487+0000 7fc1e9400640 1 -- 172.21.15.131:0/2067677442 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e40c6d50 con 0x7fc1e40ce1c0 2024-04-25T19:23:17.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.487+0000 7fc1e9400640 1 -- 172.21.15.131:0/2067677442 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e40c7310 con 0x7fc1e40ce1c0 2024-04-25T19:23:17.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.488+0000 7fc1e9400640 1 -- 172.21.15.131:0/2067677442 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e4050740 con 0x7fc1e40ce1c0 2024-04-25T19:23:17.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.489+0000 7fc1daa00640 1 -- 172.21.15.131:0/2067677442 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc1d401b020 con 0x7fc1e40ce1c0 2024-04-25T19:23:17.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.491+0000 7fc1daa00640 1 --2- 172.21.15.131:0/2067677442 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc1c00744b0 0x7fc1c00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:17.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.491+0000 7fc1daa00640 1 -- 172.21.15.131:0/2067677442 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fc1d4095530 con 0x7fc1e40ce1c0 2024-04-25T19:23:17.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.492+0000 7fc1dbe00640 1 --2- 172.21.15.131:0/2067677442 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc1c00744b0 0x7fc1c00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:17.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.493+0000 7fc1dbe00640 1 --2- 172.21.15.131:0/2067677442 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc1c00744b0 0x7fc1c00769c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc034000 tx=0x7fc1cc02c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:17.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.496+0000 7fc1daa00640 1 -- 172.21.15.131:0/2067677442 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc1d4022030 con 0x7fc1e40ce1c0 2024-04-25T19:23:17.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.693+0000 7fc1e9400640 1 -- 172.21.15.131:0/2067677442 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc1e4163980 con 0x7fc1e40ce1c0 2024-04-25T19:23:17.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.694+0000 7fc1daa00640 1 -- 172.21.15.131:0/2067677442 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fc1d405fba0 con 0x7fc1e40ce1c0 2024-04-25T19:23:17.695 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-25T19:23:17.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.696+0000 7fc1e9400640 1 -- 172.21.15.131:0/2067677442 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc1c00744b0 msgr2=0x7fc1c00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:17.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.696+0000 7fc1e9400640 1 --2- 172.21.15.131:0/2067677442 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc1c00744b0 0x7fc1c00769c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc034000 tx=0x7fc1cc02c000 comp rx=0 tx=0).stop 2024-04-25T19:23:17.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.696+0000 7fc1e9400640 1 -- 172.21.15.131:0/2067677442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1e40ce1c0 msgr2=0x7fc1e40cc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:17.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.696+0000 7fc1e9400640 1 --2- 172.21.15.131:0/2067677442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1e40ce1c0 0x7fc1e40cc420 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400d5d0 tx=0x7fc1d400da90 comp rx=0 tx=0).stop 2024-04-25T19:23:17.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.696+0000 7fc1e9400640 1 -- 172.21.15.131:0/2067677442 shutdown_connections 2024-04-25T19:23:17.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.697+0000 7fc1e9400640 1 --2- 172.21.15.131:0/2067677442 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc1c00744b0 0x7fc1c00769c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:17.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.697+0000 7fc1e9400640 1 --2- 172.21.15.131:0/2067677442 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1e40d2580 0x7fc1e4152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:17.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.697+0000 7fc1e9400640 1 --2- 172.21.15.131:0/2067677442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1e40d2ed0 0x7fc1e40b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:17.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.697+0000 7fc1e9400640 1 --2- 172.21.15.131:0/2067677442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1e40ce1c0 0x7fc1e40cc420 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:17.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.697+0000 7fc1e9400640 1 -- 172.21.15.131:0/2067677442 >> 172.21.15.131:0/2067677442 conn(0x7fc1e409b7d0 msgr2=0x7fc1e4071030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:17.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.697+0000 7fc1e9400640 1 -- 172.21.15.131:0/2067677442 shutdown_connections 2024-04-25T19:23:17.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.697+0000 7fc1e9400640 1 -- 172.21.15.131:0/2067677442 wait complete. 2024-04-25T19:23:17.722 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T19:23:17.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.975+0000 7fedd8a00640 1 Processor -- start 2024-04-25T19:23:17.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.975+0000 7fedd8a00640 1 -- start start 2024-04-25T19:23:17.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.976+0000 7fedd8a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fedd41647c0 0x7fedd40b7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:17.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.976+0000 7fedd8a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fedd40b7e90 0x7fedd40d44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:17.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.976+0000 7fedd8a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fedd40d49e0 0x7fedd40d4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:17.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.976+0000 7fedd8a00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fedd4164330 con 0x7fedd40d49e0 2024-04-25T19:23:17.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.976+0000 7fedd8a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fedd40d0b40 con 0x7fedd40b7e90 2024-04-25T19:23:17.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.976+0000 7fedd8a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fedd4164bd0 con 0x7fedd41647c0 2024-04-25T19:23:17.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.977+0000 7fedd3e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fedd40d49e0 0x7fedd40d4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:17.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.977+0000 7fedd3e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fedd40d49e0 0x7fedd40d4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56300/0 (socket says 172.21.15.131:56300) 2024-04-25T19:23:17.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.977+0000 7fedd3e00640 1 -- 172.21.15.131:0/1829178072 learned_addr learned my addr 172.21.15.131:0/1829178072 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:17.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.977+0000 7fedd3400640 1 --2- 172.21.15.131:0/1829178072 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fedd41647c0 0x7fedd40b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:17.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.977+0000 7fedd2a00640 1 --2- 172.21.15.131:0/1829178072 >> v2:172.21.15.195:3300/0 conn(0x7fedd40b7e90 0x7fedd40d44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:17.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.977+0000 7fedd3e00640 1 -- 172.21.15.131:0/1829178072 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fedd41647c0 msgr2=0x7fedd40b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:17.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.977+0000 7fedd3e00640 1 --2- 172.21.15.131:0/1829178072 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fedd41647c0 0x7fedd40b7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:17.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.977+0000 7fedd3e00640 1 -- 172.21.15.131:0/1829178072 >> v2:172.21.15.195:3300/0 conn(0x7fedd40b7e90 msgr2=0x7fedd40d44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:17.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.977+0000 7fedd3e00640 1 --2- 172.21.15.131:0/1829178072 >> v2:172.21.15.195:3300/0 conn(0x7fedd40b7e90 0x7fedd40d44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:17.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.977+0000 7fedd3e00640 1 -- 172.21.15.131:0/1829178072 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd40b82a0 con 0x7fedd40d49e0 2024-04-25T19:23:17.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.978+0000 7fedd3e00640 1 --2- 172.21.15.131:0/1829178072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd40d49e0 0x7fedd40d4df0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fedd40b85f0 tx=0x7fedcc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1091344997bb0c64 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:17.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.979+0000 7fedd2000640 1 -- 172.21.15.131:0/1829178072 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedcc037070 con 0x7fedd40d49e0 2024-04-25T19:23:17.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.979+0000 7fedd2000640 1 -- 172.21.15.131:0/1829178072 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedcc032440 con 0x7fedd40d49e0 2024-04-25T19:23:17.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.979+0000 7fedd2000640 1 -- 172.21.15.131:0/1829178072 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedcc032810 con 0x7fedd40d49e0 2024-04-25T19:23:17.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.979+0000 7fedd8a00640 1 -- 172.21.15.131:0/1829178072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd40d49e0 msgr2=0x7fedd40d4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:17.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.979+0000 7fedd8a00640 1 --2- 172.21.15.131:0/1829178072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd40d49e0 0x7fedd40d4df0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fedd40b85f0 tx=0x7fedcc02a210 comp rx=0 tx=0).stop 2024-04-25T19:23:17.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.980+0000 7fedd8a00640 1 -- 172.21.15.131:0/1829178072 shutdown_connections 2024-04-25T19:23:17.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.980+0000 7fedd8a00640 1 --2- 172.21.15.131:0/1829178072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd40d49e0 0x7fedd40d4df0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:17.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.980+0000 7fedd8a00640 1 --2- 172.21.15.131:0/1829178072 >> v2:172.21.15.195:3300/0 conn(0x7fedd40b7e90 0x7fedd40d44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:17.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.980+0000 7fedd8a00640 1 --2- 172.21.15.131:0/1829178072 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fedd41647c0 0x7fedd40b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:17.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.980+0000 7fedd8a00640 1 -- 172.21.15.131:0/1829178072 >> 172.21.15.131:0/1829178072 conn(0x7fedd40d2a10 msgr2=0x7fedd40d2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:17.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.980+0000 7fedd8a00640 1 -- 172.21.15.131:0/1829178072 shutdown_connections 2024-04-25T19:23:17.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.980+0000 7fedd8a00640 1 -- 172.21.15.131:0/1829178072 wait complete. 2024-04-25T19:23:17.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.982+0000 7fedd8a00640 1 Processor -- start 2024-04-25T19:23:17.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.982+0000 7fedd8a00640 1 -- start start 2024-04-25T19:23:17.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.984+0000 7fedd8a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd40b7e90 0x7fedd41f5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:17.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.984+0000 7fedd8a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fedd40d49e0 0x7fedd40cded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:17.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.984+0000 7fedd8a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedd41647c0 0x7fedd40ce410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:17.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.984+0000 7fedd8a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fedd4163ce0 con 0x7fedd40b7e90 2024-04-25T19:23:17.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.984+0000 7fedd8a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fedd4161580 con 0x7fedd41647c0 2024-04-25T19:23:17.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.984+0000 7fedd8a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fedd4163fc0 con 0x7fedd40d49e0 2024-04-25T19:23:17.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.984+0000 7fedd3400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd40b7e90 0x7fedd41f5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:17.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.984+0000 7fedd3400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd40b7e90 0x7fedd41f5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56308/0 (socket says 172.21.15.131:56308) 2024-04-25T19:23:17.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.984+0000 7fedd3400640 1 -- 172.21.15.131:0/2483376788 learned_addr learned my addr 172.21.15.131:0/2483376788 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:17.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.984+0000 7fedd3400640 1 -- 172.21.15.131:0/2483376788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fedd40d49e0 msgr2=0x7fedd40cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:17.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.984+0000 7fedd3400640 1 --2- 172.21.15.131:0/2483376788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fedd40d49e0 0x7fedd40cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:17.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.984+0000 7fedd3400640 1 -- 172.21.15.131:0/2483376788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedd41647c0 msgr2=0x7fedd40ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:17.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.984+0000 7fedd3400640 1 --2- 172.21.15.131:0/2483376788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedd41647c0 0x7fedd40ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:17.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.984+0000 7fedd3400640 1 -- 172.21.15.131:0/2483376788 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd41ec200 con 0x7fedd40b7e90 2024-04-25T19:23:17.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.985+0000 7fedd3400640 1 --2- 172.21.15.131:0/2483376788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd40b7e90 0x7fedd41f5f00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fedc4007e40 tx=0x7fedc400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:17.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.985+0000 7fedcb400640 1 -- 172.21.15.131:0/2483376788 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc4014620 con 0x7fedd40b7e90 2024-04-25T19:23:17.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.985+0000 7fedcb400640 1 -- 172.21.15.131:0/2483376788 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc4019070 con 0x7fedd40b7e90 2024-04-25T19:23:17.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.985+0000 7fedcb400640 1 -- 172.21.15.131:0/2483376788 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc4014a00 con 0x7fedd40b7e90 2024-04-25T19:23:17.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.985+0000 7fedd8a00640 1 -- 172.21.15.131:0/2483376788 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedd40cd3f0 con 0x7fedd40b7e90 2024-04-25T19:23:17.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.985+0000 7fedd8a00640 1 -- 172.21.15.131:0/2483376788 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedd40cef50 con 0x7fedd40b7e90 2024-04-25T19:23:17.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.986+0000 7fedd8a00640 1 -- 172.21.15.131:0/2483376788 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedd40b8ca0 con 0x7fedd40b7e90 2024-04-25T19:23:17.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.987+0000 7fedcb400640 1 -- 172.21.15.131:0/2483376788 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fedc4014ba0 con 0x7fedd40b7e90 2024-04-25T19:23:17.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.988+0000 7fedcb400640 1 --2- 172.21.15.131:0/2483376788 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fedb00744e0 0x7fedb00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:17.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.988+0000 7fedcb400640 1 -- 172.21.15.131:0/2483376788 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fedc4095ac0 con 0x7fedd40b7e90 2024-04-25T19:23:17.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.989+0000 7fedd2a00640 1 --2- 172.21.15.131:0/2483376788 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fedb00744e0 0x7fedb00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:17.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.991+0000 7fedd2a00640 1 --2- 172.21.15.131:0/2483376788 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fedb00744e0 0x7fedb00769f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fedd40b6ea0 tx=0x7fedbc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:17.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:17.993+0000 7fedcb400640 1 -- 172.21.15.131:0/2483376788 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fedd40b8ca0 con 0x7fedd40b7e90 2024-04-25T19:23:18.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.193+0000 7fedd8a00640 1 -- 172.21.15.131:0/2483376788 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fedd40cf1b0 con 0x7fedd40b7e90 2024-04-25T19:23:18.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.194+0000 7fedcb400640 1 -- 172.21.15.131:0/2483376788 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7fedc40601e0 con 0x7fedd40b7e90 2024-04-25T19:23:18.196 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-25T19:23:18.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.197+0000 7fedd8a00640 1 -- 172.21.15.131:0/2483376788 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fedb00744e0 msgr2=0x7fedb00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:18.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.197+0000 7fedd8a00640 1 --2- 172.21.15.131:0/2483376788 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fedb00744e0 0x7fedb00769f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fedd40b6ea0 tx=0x7fedbc008040 comp rx=0 tx=0).stop 2024-04-25T19:23:18.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.197+0000 7fedd8a00640 1 -- 172.21.15.131:0/2483376788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd40b7e90 msgr2=0x7fedd41f5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:18.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.197+0000 7fedd8a00640 1 --2- 172.21.15.131:0/2483376788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd40b7e90 0x7fedd41f5f00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fedc4007e40 tx=0x7fedc400e4b0 comp rx=0 tx=0).stop 2024-04-25T19:23:18.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.197+0000 7fedd8a00640 1 -- 172.21.15.131:0/2483376788 shutdown_connections 2024-04-25T19:23:18.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.197+0000 7fedd8a00640 1 --2- 172.21.15.131:0/2483376788 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fedb00744e0 0x7fedb00769f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:18.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.197+0000 7fedd8a00640 1 --2- 172.21.15.131:0/2483376788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fedd40d49e0 0x7fedd40cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:18.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.197+0000 7fedd8a00640 1 --2- 172.21.15.131:0/2483376788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedd41647c0 0x7fedd40ce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:18.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.197+0000 7fedd8a00640 1 --2- 172.21.15.131:0/2483376788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd40b7e90 0x7fedd41f5f00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:18.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.197+0000 7fedd8a00640 1 -- 172.21.15.131:0/2483376788 >> 172.21.15.131:0/2483376788 conn(0x7fedd40d2a10 msgr2=0x7fedd40d2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:18.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.197+0000 7fedd8a00640 1 -- 172.21.15.131:0/2483376788 shutdown_connections 2024-04-25T19:23:18.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.197+0000 7fedd8a00640 1 -- 172.21.15.131:0/2483376788 wait complete. 2024-04-25T19:23:18.225 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T19:23:18.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.503+0000 7f59d9600640 1 Processor -- start 2024-04-25T19:23:18.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.503+0000 7f59d9600640 1 -- start start 2024-04-25T19:23:18.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.505+0000 7f59d9600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59d40ce820 0x7f59d40cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:18.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.505+0000 7f59d9600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59d4075e80 con 0x7f59d406c5c0 2024-04-25T19:23:18.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.505+0000 7f59d9600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59d40cf730 con 0x7f59d40cf170 2024-04-25T19:23:18.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.505+0000 7f59d9600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f59d4076140 con 0x7f59d40ce820 2024-04-25T19:23:18.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.505+0000 7f59d3e00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f59d406c5c0 0x7f59d41602e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:47818/0 (socket says 172.21.15.131:47818) 2024-04-25T19:23:18.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.505+0000 7f59d3e00640 1 -- 172.21.15.131:0/983203206 learned_addr learned my addr 172.21.15.131:0/983203206 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:18.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.505+0000 7f59d3400640 1 -- 172.21.15.131:0/983203206 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1868026307 0 0) 0x7f59d4075e80 con 0x7f59d406c5c0 2024-04-25T19:23:18.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.506+0000 7f59d3400640 1 -- 172.21.15.131:0/983203206 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59b8003520 con 0x7f59d406c5c0 2024-04-25T19:23:18.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.506+0000 7f59cb400640 1 --2- 172.21.15.131:0/983203206 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59d40ce820 0x7f59d40cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:18.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.506+0000 7f59d3400640 1 -- 172.21.15.131:0/983203206 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3570050714 0 0) 0x7f59b8003520 con 0x7f59d406c5c0 2024-04-25T19:23:18.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.506+0000 7f59d3400640 1 -- 172.21.15.131:0/983203206 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59d40ce820 msgr2=0x7f59d40cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:18.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.506+0000 7f59d3400640 1 --2- 172.21.15.131:0/983203206 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59d40ce820 0x7f59d40cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:18.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.506+0000 7f59d3400640 1 -- 172.21.15.131:0/983203206 >> v1:172.21.15.195:6789/0 conn(0x7f59d40cf170 legacy=0x7f59d4169f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:18.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.506+0000 7f59d3400640 1 -- 172.21.15.131:0/983203206 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d40b7800 con 0x7f59d406c5c0 2024-04-25T19:23:18.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.506+0000 7f59d3400640 1 -- 172.21.15.131:0/983203206 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f59c40019f0 con 0x7f59d406c5c0 2024-04-25T19:23:18.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.506+0000 7f59d3400640 1 -- 172.21.15.131:0/983203206 >> v1:172.21.15.131:6789/0 conn(0x7f59d406c5c0 legacy=0x7f59d41602e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:18.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.506+0000 7f59d3400640 1 --2- 172.21.15.131:0/983203206 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59d40ce820 0x7f59b80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:18.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.506+0000 7f59d3400640 1 --2- 172.21.15.131:0/983203206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59b8004060 0x7f59b8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:18.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.506+0000 7f59d3400640 1 --2- 172.21.15.131:0/983203206 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b8004d90 0x7f59b8005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:18.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.506+0000 7f59d3400640 1 -- 172.21.15.131:0/983203206 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f59d4076140 con 0x7f59b8004060 2024-04-25T19:23:18.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.506+0000 7f59d3400640 1 -- 172.21.15.131:0/983203206 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f59b800bc50 con 0x7f59b8004d90 2024-04-25T19:23:18.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.506+0000 7f59d3400640 1 -- 172.21.15.131:0/983203206 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f59b800be50 con 0x7f59d40ce820 2024-04-25T19:23:18.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.506+0000 7f59cb400640 1 --2- 172.21.15.131:0/983203206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59b8004060 0x7f59b8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:18.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.507+0000 7f59d3e00640 1 --2- 172.21.15.131:0/983203206 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59d40ce820 0x7f59b80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:18.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.507+0000 7f59cb400640 1 -- 172.21.15.131:0/983203206 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59d40ce820 msgr2=0x7f59b80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:18.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.507+0000 7f59cb400640 1 --2- 172.21.15.131:0/983203206 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59d40ce820 0x7f59b80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:18.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.507+0000 7f59cb400640 1 -- 172.21.15.131:0/983203206 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b8004d90 msgr2=0x7f59b8005260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:18.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.507+0000 7f59d8c00640 1 --2- 172.21.15.131:0/983203206 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b8004d90 0x7f59b8005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:18.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.507+0000 7f59cb400640 1 --2- 172.21.15.131:0/983203206 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b8004d90 0x7f59b8005260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:18.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.507+0000 7f59cb400640 1 -- 172.21.15.131:0/983203206 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b8003520 con 0x7f59b8004060 2024-04-25T19:23:18.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.507+0000 7f59d3e00640 1 --2- 172.21.15.131:0/983203206 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59d40ce820 0x7f59b80039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:18.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.507+0000 7f59d8c00640 1 --2- 172.21.15.131:0/983203206 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b8004d90 0x7f59b8005260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:18.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.508+0000 7f59cb400640 1 --2- 172.21.15.131:0/983203206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59b8004060 0x7f59b8004800 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f59d4074070 tx=0x7f59b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbfff0ba5057a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:18.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.508+0000 7f59d3400640 1 -- 172.21.15.131:0/983203206 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc030070 con 0x7f59b8004060 2024-04-25T19:23:18.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.508+0000 7f59d3400640 1 -- 172.21.15.131:0/983203206 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59bc02ad80 con 0x7f59b8004060 2024-04-25T19:23:18.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.508+0000 7f59d3400640 1 -- 172.21.15.131:0/983203206 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc00b600 con 0x7f59b8004060 2024-04-25T19:23:18.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.509+0000 7f59d9600640 1 -- 172.21.15.131:0/983203206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59b8004060 msgr2=0x7f59b8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:18.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.509+0000 7f59d9600640 1 --2- 172.21.15.131:0/983203206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59b8004060 0x7f59b8004800 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f59d4074070 tx=0x7f59b8005830 comp rx=0 tx=0).stop 2024-04-25T19:23:18.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.509+0000 7f59d8c00640 1 -- 172.21.15.131:0/983203206 reap_dead start 2024-04-25T19:23:18.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.509+0000 7f59d9600640 1 -- 172.21.15.131:0/983203206 shutdown_connections 2024-04-25T19:23:18.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.509+0000 7f59d9600640 1 -- 172.21.15.131:0/983203206 >> 172.21.15.131:0/983203206 conn(0x7f59d409b7d0 msgr2=0x7f59d40b6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:18.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.509+0000 7f59d9600640 1 -- 172.21.15.131:0/983203206 shutdown_connections 2024-04-25T19:23:18.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.509+0000 7f59d9600640 1 -- 172.21.15.131:0/983203206 wait complete. 2024-04-25T19:23:18.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.512+0000 7f59d9600640 1 Processor -- start 2024-04-25T19:23:18.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.512+0000 7f59d9600640 1 -- start start 2024-04-25T19:23:18.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.513+0000 7f59d9600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b8004060 0x7f59d414da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:18.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.513+0000 7f59d9600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59d40b2550 0x7f59d40d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:18.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.513+0000 7f59d9600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59d41f9b80 0x7f59d41f9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:18.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.513+0000 7f59d9600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f59d40cc350 con 0x7f59d40b2550 2024-04-25T19:23:18.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.513+0000 7f59d9600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f59d40cc1d0 con 0x7f59b8004060 2024-04-25T19:23:18.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.513+0000 7f59d9600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f59d40cc5f0 con 0x7f59d41f9b80 2024-04-25T19:23:18.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.513+0000 7f59cb400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59d40b2550 0x7f59d40d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:18.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.513+0000 7f59cb400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59d40b2550 0x7f59d40d1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56314/0 (socket says 172.21.15.131:56314) 2024-04-25T19:23:18.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.514+0000 7f59cb400640 1 -- 172.21.15.131:0/4168611691 learned_addr learned my addr 172.21.15.131:0/4168611691 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:18.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.514+0000 7f59d3e00640 1 --2- 172.21.15.131:0/4168611691 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b8004060 0x7f59d414da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:18.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.514+0000 7f59d8c00640 1 --2- 172.21.15.131:0/4168611691 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59d41f9b80 0x7f59d41f9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:18.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.514+0000 7f59cb400640 1 -- 172.21.15.131:0/4168611691 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59d41f9b80 msgr2=0x7f59d41f9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:18.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.514+0000 7f59cb400640 1 --2- 172.21.15.131:0/4168611691 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59d41f9b80 0x7f59d41f9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:18.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.514+0000 7f59cb400640 1 -- 172.21.15.131:0/4168611691 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b8004060 msgr2=0x7f59d414da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:18.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.514+0000 7f59cb400640 1 --2- 172.21.15.131:0/4168611691 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b8004060 0x7f59d414da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:18.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.514+0000 7f59cb400640 1 -- 172.21.15.131:0/4168611691 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d414dfb0 con 0x7f59d40b2550 2024-04-25T19:23:18.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.514+0000 7f59d3e00640 1 --2- 172.21.15.131:0/4168611691 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b8004060 0x7f59d414da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:18.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.514+0000 7f59cb400640 1 --2- 172.21.15.131:0/4168611691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59d40b2550 0x7f59d40d1f40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f59bc02a870 tx=0x7f59bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:18.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.515+0000 7f59d0c00640 1 -- 172.21.15.131:0/4168611691 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc043020 con 0x7f59d40b2550 2024-04-25T19:23:18.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.515+0000 7f59d0c00640 1 -- 172.21.15.131:0/4168611691 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59bc03f680 con 0x7f59d40b2550 2024-04-25T19:23:18.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.515+0000 7f59d0c00640 1 -- 172.21.15.131:0/4168611691 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc00b600 con 0x7f59d40b2550 2024-04-25T19:23:18.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.515+0000 7f59d9600640 1 -- 172.21.15.131:0/4168611691 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d41fa4d0 con 0x7f59d40b2550 2024-04-25T19:23:18.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.515+0000 7f59d9600640 1 -- 172.21.15.131:0/4168611691 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d40d1180 con 0x7f59d40b2550 2024-04-25T19:23:18.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.516+0000 7f59d9600640 1 -- 172.21.15.131:0/4168611691 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d4064200 con 0x7f59d40b2550 2024-04-25T19:23:18.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.517+0000 7f59d0c00640 1 -- 172.21.15.131:0/4168611691 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f59bc046020 con 0x7f59d40b2550 2024-04-25T19:23:18.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.518+0000 7f59d0c00640 1 --2- 172.21.15.131:0/4168611691 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f59b00744b0 0x7f59b00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:18.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.518+0000 7f59d0c00640 1 -- 172.21.15.131:0/4168611691 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f59bc0b5f00 con 0x7f59d40b2550 2024-04-25T19:23:18.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.519+0000 7f59d3e00640 1 --2- 172.21.15.131:0/4168611691 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f59b00744b0 0x7f59b00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:18.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.520+0000 7f59d3e00640 1 --2- 172.21.15.131:0/4168611691 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f59b00744b0 0x7f59b00769c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f59c4007c40 tx=0x7f59c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:18.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.523+0000 7f59d0c00640 1 -- 172.21.15.131:0/4168611691 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f59d4064200 con 0x7f59d40b2550 2024-04-25T19:23:18.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.713+0000 7f59d9600640 1 -- 172.21.15.131:0/4168611691 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f59d4076c60 con 0x7f59d40b2550 2024-04-25T19:23:18.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.714+0000 7f59d0c00640 1 -- 172.21.15.131:0/4168611691 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f59bc04d030 con 0x7f59d40b2550 2024-04-25T19:23:18.716 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 64 2024-04-25T19:23:18.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.717+0000 7f59d9600640 1 -- 172.21.15.131:0/4168611691 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f59b00744b0 msgr2=0x7f59b00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:18.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.717+0000 7f59d9600640 1 --2- 172.21.15.131:0/4168611691 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f59b00744b0 0x7f59b00769c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f59c4007c40 tx=0x7f59c4009040 comp rx=0 tx=0).stop 2024-04-25T19:23:18.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.717+0000 7f59d9600640 1 -- 172.21.15.131:0/4168611691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59d40b2550 msgr2=0x7f59d40d1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:18.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.717+0000 7f59d9600640 1 --2- 172.21.15.131:0/4168611691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59d40b2550 0x7f59d40d1f40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f59bc02a870 tx=0x7f59bc004730 comp rx=0 tx=0).stop 2024-04-25T19:23:18.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.717+0000 7f59d9600640 1 -- 172.21.15.131:0/4168611691 shutdown_connections 2024-04-25T19:23:18.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.717+0000 7f59d9600640 1 --2- 172.21.15.131:0/4168611691 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f59b00744b0 0x7f59b00769c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:18.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.717+0000 7f59d9600640 1 --2- 172.21.15.131:0/4168611691 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59d41f9b80 0x7f59d41f9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:18.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.717+0000 7f59d9600640 1 --2- 172.21.15.131:0/4168611691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59d40b2550 0x7f59d40d1f40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:18.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.717+0000 7f59d9600640 1 --2- 172.21.15.131:0/4168611691 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b8004060 0x7f59d414da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:18.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.717+0000 7f59d9600640 1 -- 172.21.15.131:0/4168611691 >> 172.21.15.131:0/4168611691 conn(0x7f59d409b7d0 msgr2=0x7f59d4070fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:18.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.717+0000 7f59d9600640 1 -- 172.21.15.131:0/4168611691 shutdown_connections 2024-04-25T19:23:18.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:18.717+0000 7f59d9600640 1 -- 172.21.15.131:0/4168611691 wait complete. 2024-04-25T19:23:18.745 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:23:19.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.017+0000 7f2105e00640 1 Processor -- start 2024-04-25T19:23:19.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.017+0000 7f2105e00640 1 -- start start 2024-04-25T19:23:19.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.019+0000 7f2105e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f21000cf2f0 0x7f21000b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:19.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.019+0000 7f2105e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f210015a810 0x7f21000b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:19.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.019+0000 7f2105e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21000b4e90 con 0x7f21001608d0 2024-04-25T19:23:19.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.019+0000 7f2105e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f210006f870 con 0x7f210015a810 2024-04-25T19:23:19.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.019+0000 7f2105e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f21000b74d0 con 0x7f21000cf2f0 2024-04-25T19:23:19.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.019+0000 7f20f7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f210015a810 0x7f21000b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:19.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.019+0000 7f20f7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f210015a810 0x7f21000b4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56326/0 (socket says 172.21.15.131:56326) 2024-04-25T19:23:19.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.019+0000 7f20f7e00640 1 -- 172.21.15.131:0/3591500342 learned_addr learned my addr 172.21.15.131:0/3591500342 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:19.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.019+0000 7f2104a00640 1 --2- 172.21.15.131:0/3591500342 >> v2:172.21.15.195:3300/0 conn(0x7f21000cf2f0 0x7f21000b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:19.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.020+0000 7f20f7e00640 1 -- 172.21.15.131:0/3591500342 >> v2:172.21.15.195:3300/0 conn(0x7f21000cf2f0 msgr2=0x7f21000b6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:19.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.020+0000 7f20f7e00640 1 --2- 172.21.15.131:0/3591500342 >> v2:172.21.15.195:3300/0 conn(0x7f21000cf2f0 0x7f21000b6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:19.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.020+0000 7f20f7e00640 1 -- 172.21.15.131:0/3591500342 >> v1:172.21.15.195:6789/0 conn(0x7f21001608d0 legacy=0x7f2100160ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:19.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.020+0000 7f20f7e00640 1 -- 172.21.15.131:0/3591500342 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21000b77b0 con 0x7f210015a810 2024-04-25T19:23:19.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.021+0000 7f20f7e00640 1 --2- 172.21.15.131:0/3591500342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f210015a810 0x7f21000b4950 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f21000d26d0 tx=0x7f20e802c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49871dc6e54cc28b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:19.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.021+0000 7f20ffe00640 1 -- 172.21.15.131:0/3591500342 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e8036020 con 0x7f210015a810 2024-04-25T19:23:19.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.021+0000 7f20ffe00640 1 -- 172.21.15.131:0/3591500342 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20e8032640 con 0x7f210015a810 2024-04-25T19:23:19.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.021+0000 7f20ffe00640 1 -- 172.21.15.131:0/3591500342 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e8032a10 con 0x7f210015a810 2024-04-25T19:23:19.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.022+0000 7f2105e00640 1 -- 172.21.15.131:0/3591500342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f210015a810 msgr2=0x7f21000b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:19.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.022+0000 7f2105e00640 1 --2- 172.21.15.131:0/3591500342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f210015a810 0x7f21000b4950 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f21000d26d0 tx=0x7f20e802c940 comp rx=0 tx=0).stop 2024-04-25T19:23:19.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.022+0000 7f2105e00640 1 -- 172.21.15.131:0/3591500342 shutdown_connections 2024-04-25T19:23:19.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.022+0000 7f2105e00640 1 --2- 172.21.15.131:0/3591500342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f210015a810 0x7f21000b4950 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:19.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.022+0000 7f2105e00640 1 --2- 172.21.15.131:0/3591500342 >> v2:172.21.15.195:3300/0 conn(0x7f21000cf2f0 0x7f21000b6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:19.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.022+0000 7f2105e00640 1 -- 172.21.15.131:0/3591500342 >> 172.21.15.131:0/3591500342 conn(0x7f21000d1720 msgr2=0x7f21000d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:19.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.022+0000 7f2105e00640 1 -- 172.21.15.131:0/3591500342 shutdown_connections 2024-04-25T19:23:19.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.022+0000 7f2105e00640 1 -- 172.21.15.131:0/3591500342 wait complete. 2024-04-25T19:23:19.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.025+0000 7f2105e00640 1 Processor -- start 2024-04-25T19:23:19.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.025+0000 7f2105e00640 1 -- start start 2024-04-25T19:23:19.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.026+0000 7f2105e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f21000cf2f0 0x7f21000ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:19.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.026+0000 7f2105e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f210015a810 0x7f210013a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:19.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.026+0000 7f2105e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21001608d0 0x7f210015be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:19.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.026+0000 7f2105e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f210015ac20 con 0x7f21001608d0 2024-04-25T19:23:19.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.026+0000 7f2105e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f210006f500 con 0x7f210015a810 2024-04-25T19:23:19.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.026+0000 7f2105e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f210006fd00 con 0x7f21000cf2f0 2024-04-25T19:23:19.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.027+0000 7f2105400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21001608d0 0x7f210015be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:19.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.027+0000 7f2105400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21001608d0 0x7f210015be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56334/0 (socket says 172.21.15.131:56334) 2024-04-25T19:23:19.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.027+0000 7f2105400640 1 -- 172.21.15.131:0/1699185213 learned_addr learned my addr 172.21.15.131:0/1699185213 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:19.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.027+0000 7f2104a00640 1 --2- 172.21.15.131:0/1699185213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f21000cf2f0 0x7f21000ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:19.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.027+0000 7f20f7e00640 1 --2- 172.21.15.131:0/1699185213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f210015a810 0x7f210013a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:19.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.027+0000 7f2105400640 1 -- 172.21.15.131:0/1699185213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f21000cf2f0 msgr2=0x7f21000ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:19.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.027+0000 7f2105400640 1 --2- 172.21.15.131:0/1699185213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f21000cf2f0 0x7f21000ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:19.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.027+0000 7f2105400640 1 -- 172.21.15.131:0/1699185213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f210015a810 msgr2=0x7f210013a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:19.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.027+0000 7f2105400640 1 --2- 172.21.15.131:0/1699185213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f210015a810 0x7f210013a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:19.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.027+0000 7f2105400640 1 -- 172.21.15.131:0/1699185213 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21000aeb80 con 0x7f21001608d0 2024-04-25T19:23:19.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.027+0000 7f2105400640 1 --2- 172.21.15.131:0/1699185213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21001608d0 0x7f210015be60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f20f800c6b0 tx=0x7f20f800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:19.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.028+0000 7f20fd600640 1 -- 172.21.15.131:0/1699185213 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f8003b70 con 0x7f21001608d0 2024-04-25T19:23:19.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.028+0000 7f20fd600640 1 -- 172.21.15.131:0/1699185213 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f8003d30 con 0x7f21001608d0 2024-04-25T19:23:19.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.028+0000 7f20fd600640 1 -- 172.21.15.131:0/1699185213 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f8005310 con 0x7f21001608d0 2024-04-25T19:23:19.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.028+0000 7f2105e00640 1 -- 172.21.15.131:0/1699185213 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f210013a8f0 con 0x7f21001608d0 2024-04-25T19:23:19.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.028+0000 7f2105e00640 1 -- 172.21.15.131:0/1699185213 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21000af2e0 con 0x7f21001608d0 2024-04-25T19:23:19.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.029+0000 7f2105e00640 1 -- 172.21.15.131:0/1699185213 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21000aed50 con 0x7f21001608d0 2024-04-25T19:23:19.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.030+0000 7f20fd600640 1 -- 172.21.15.131:0/1699185213 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f20f80054b0 con 0x7f21001608d0 2024-04-25T19:23:19.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.031+0000 7f20fd600640 1 --2- 172.21.15.131:0/1699185213 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f20dc0744b0 0x7f20dc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:19.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.031+0000 7f20fd600640 1 -- 172.21.15.131:0/1699185213 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f20f8095170 con 0x7f21001608d0 2024-04-25T19:23:19.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.032+0000 7f2104a00640 1 --2- 172.21.15.131:0/1699185213 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f20dc0744b0 0x7f20dc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:19.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.033+0000 7f2104a00640 1 --2- 172.21.15.131:0/1699185213 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f20dc0744b0 0x7f20dc0769c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f20f0006fd0 tx=0x7f20f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:19.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.036+0000 7f20fd600640 1 -- 172.21.15.131:0/1699185213 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f20f805f860 con 0x7f21001608d0 2024-04-25T19:23:19.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.257+0000 7f2105e00640 1 -- 172.21.15.131:0/1699185213 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2100050740 con 0x7f21001608d0 2024-04-25T19:23:19.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.258+0000 7f20fd600640 1 -- 172.21.15.131:0/1699185213 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5187 (secure 0 0 0) 0x7f20f805f160 con 0x7f21001608d0 2024-04-25T19:23:19.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:19.260 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/1570319410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":1570319410},{"type":"v1","addr":"172.21.15.195:6837","nonce":1570319410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/4072860882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4072860882},{"type":"v1","addr":"172.21.15.131:6834","nonce":4072860882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2207155444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2207155444},{"type":"v1","addr":"172.21.15.131:6835","nonce":2207155444}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T19:22:16.578438+0000","modified":"2024-04-25T19:22:19.648009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6836/1898121552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1898121552},{"type":"v1","addr":"172.21.15.195:6836","nonce":1898121552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T19:23:19.261 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 8 2024-04-25T19:23:19.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.261+0000 7f2105e00640 1 -- 172.21.15.131:0/1699185213 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f20dc0744b0 msgr2=0x7f20dc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:19.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.261+0000 7f2105e00640 1 --2- 172.21.15.131:0/1699185213 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f20dc0744b0 0x7f20dc0769c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f20f0006fd0 tx=0x7f20f0008040 comp rx=0 tx=0).stop 2024-04-25T19:23:19.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.261+0000 7f2105e00640 1 -- 172.21.15.131:0/1699185213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21001608d0 msgr2=0x7f210015be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:19.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.261+0000 7f2105e00640 1 --2- 172.21.15.131:0/1699185213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21001608d0 0x7f210015be60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f20f800c6b0 tx=0x7f20f800cb70 comp rx=0 tx=0).stop 2024-04-25T19:23:19.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.261+0000 7f2105e00640 1 -- 172.21.15.131:0/1699185213 shutdown_connections 2024-04-25T19:23:19.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.261+0000 7f2105e00640 1 --2- 172.21.15.131:0/1699185213 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f20dc0744b0 0x7f20dc0769c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:19.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.261+0000 7f2105e00640 1 --2- 172.21.15.131:0/1699185213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21001608d0 0x7f210015be60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:19.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.261+0000 7f2105e00640 1 --2- 172.21.15.131:0/1699185213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f210015a810 0x7f210013a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:19.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.261+0000 7f2105e00640 1 --2- 172.21.15.131:0/1699185213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f21000cf2f0 0x7f21000ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:19.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.261+0000 7f2105e00640 1 -- 172.21.15.131:0/1699185213 >> 172.21.15.131:0/1699185213 conn(0x7f21000d1720 msgr2=0x7f2100070000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:19.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.261+0000 7f2105e00640 1 -- 172.21.15.131:0/1699185213 shutdown_connections 2024-04-25T19:23:19.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.261+0000 7f2105e00640 1 -- 172.21.15.131:0/1699185213 wait complete. 2024-04-25T19:23:19.288 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:23:19.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.556+0000 7f8594200640 1 Processor -- start 2024-04-25T19:23:19.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.556+0000 7f8594200640 1 -- start start 2024-04-25T19:23:19.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.559+0000 7f8594200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f858c1434d0 0x7f858c070480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:19.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.559+0000 7f8594200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f858c1612f0 0x7f858c0d12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:19.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.559+0000 7f8594200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f858c0709c0 con 0x7f858c0d0ed0 2024-04-25T19:23:19.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.559+0000 7f8594200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f858c1438e0 con 0x7f858c1612f0 2024-04-25T19:23:19.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.559+0000 7f8594200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f858c06f3e0 con 0x7f858c1434d0 2024-04-25T19:23:19.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.559+0000 7f8590e00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f858c0d0ed0 0x7f858c160be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:47822/0 (socket says 172.21.15.131:47822) 2024-04-25T19:23:19.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.559+0000 7f8590e00640 1 -- 172.21.15.131:0/3441620092 learned_addr learned my addr 172.21.15.131:0/3441620092 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:19.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.559+0000 7f8591800640 1 --2- 172.21.15.131:0/3441620092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f858c1434d0 0x7f858c070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:19.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.559+0000 7f858be00640 1 -- 172.21.15.131:0/3441620092 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1662557678 0 0) 0x7f858c0709c0 con 0x7f858c0d0ed0 2024-04-25T19:23:19.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.560+0000 7f8592200640 1 --2- 172.21.15.131:0/3441620092 >> v2:172.21.15.195:3300/0 conn(0x7f858c1612f0 0x7f858c0d12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:19.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.560+0000 7f858be00640 1 -- 172.21.15.131:0/3441620092 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8574003520 con 0x7f858c0d0ed0 2024-04-25T19:23:19.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.560+0000 7f858be00640 1 -- 172.21.15.131:0/3441620092 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2939289988 0 0) 0x7f8574003520 con 0x7f858c0d0ed0 2024-04-25T19:23:19.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.560+0000 7f858be00640 1 -- 172.21.15.131:0/3441620092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f858c1434d0 msgr2=0x7f858c070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:19.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.560+0000 7f858be00640 1 --2- 172.21.15.131:0/3441620092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f858c1434d0 0x7f858c070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:19.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.560+0000 7f858be00640 1 -- 172.21.15.131:0/3441620092 >> v2:172.21.15.195:3300/0 conn(0x7f858c1612f0 msgr2=0x7f858c0d12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:19.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.560+0000 7f858be00640 1 --2- 172.21.15.131:0/3441620092 >> v2:172.21.15.195:3300/0 conn(0x7f858c1612f0 0x7f858c0d12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:19.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.560+0000 7f858be00640 1 -- 172.21.15.131:0/3441620092 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858c06f6c0 con 0x7f858c0d0ed0 2024-04-25T19:23:19.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.560+0000 7f858be00640 1 -- 172.21.15.131:0/3441620092 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f8578001670 con 0x7f858c0d0ed0 2024-04-25T19:23:19.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.560+0000 7f858be00640 1 -- 172.21.15.131:0/3441620092 >> v1:172.21.15.131:6789/0 conn(0x7f858c0d0ed0 legacy=0x7f858c160be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:19.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.560+0000 7f858be00640 1 --2- 172.21.15.131:0/3441620092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f858c1434d0 0x7f85740039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:19.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.560+0000 7f858be00640 1 --2- 172.21.15.131:0/3441620092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8574003f30 0x7f8574004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:19.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.560+0000 7f858be00640 1 --2- 172.21.15.131:0/3441620092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8574004d40 0x7f8574005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:19.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.560+0000 7f858be00640 1 -- 172.21.15.131:0/3441620092 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f858c1438e0 con 0x7f8574003f30 2024-04-25T19:23:19.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.560+0000 7f858be00640 1 -- 172.21.15.131:0/3441620092 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f858c06f3e0 con 0x7f8574004d40 2024-04-25T19:23:19.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.560+0000 7f858be00640 1 -- 172.21.15.131:0/3441620092 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f857400ba10 con 0x7f858c1434d0 2024-04-25T19:23:19.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.561+0000 7f8590e00640 1 --2- 172.21.15.131:0/3441620092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8574003f30 0x7f8574004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:19.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.561+0000 7f8591800640 1 --2- 172.21.15.131:0/3441620092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f858c1434d0 0x7f85740039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:19.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.561+0000 7f8592200640 1 --2- 172.21.15.131:0/3441620092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8574004d40 0x7f8574005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:19.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.561+0000 7f8590e00640 1 -- 172.21.15.131:0/3441620092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f858c1434d0 msgr2=0x7f85740039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:19.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.561+0000 7f8590e00640 1 --2- 172.21.15.131:0/3441620092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f858c1434d0 0x7f85740039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:19.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.561+0000 7f8590e00640 1 -- 172.21.15.131:0/3441620092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8574004d40 msgr2=0x7f8574005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:19.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.561+0000 7f8590e00640 1 --2- 172.21.15.131:0/3441620092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8574004d40 0x7f8574005150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:19.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.561+0000 7f8590e00640 1 -- 172.21.15.131:0/3441620092 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8574003520 con 0x7f8574003f30 2024-04-25T19:23:19.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.562+0000 7f8590e00640 1 --2- 172.21.15.131:0/3441620092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8574003f30 0x7f8574004800 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f858c0d00b0 tx=0x7f8574005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0ecd139b39e6c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:19.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.562+0000 7f858be00640 1 -- 172.21.15.131:0/3441620092 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8578007d90 con 0x7f8574003f30 2024-04-25T19:23:19.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.562+0000 7f858be00640 1 -- 172.21.15.131:0/3441620092 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8578005ad0 con 0x7f8574003f30 2024-04-25T19:23:19.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.562+0000 7f858be00640 1 -- 172.21.15.131:0/3441620092 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8578007070 con 0x7f8574003f30 2024-04-25T19:23:19.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.563+0000 7f8594200640 1 -- 172.21.15.131:0/3441620092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8574003f30 msgr2=0x7f8574004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:19.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.563+0000 7f8594200640 1 --2- 172.21.15.131:0/3441620092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8574003f30 0x7f8574004800 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f858c0d00b0 tx=0x7f8574005830 comp rx=0 tx=0).stop 2024-04-25T19:23:19.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.563+0000 7f8592200640 1 -- 172.21.15.131:0/3441620092 reap_dead start 2024-04-25T19:23:19.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.563+0000 7f8594200640 1 -- 172.21.15.131:0/3441620092 shutdown_connections 2024-04-25T19:23:19.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.563+0000 7f8594200640 1 -- 172.21.15.131:0/3441620092 >> 172.21.15.131:0/3441620092 conn(0x7f858c0d1ae0 msgr2=0x7f858c0d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:19.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.563+0000 7f8594200640 1 -- 172.21.15.131:0/3441620092 shutdown_connections 2024-04-25T19:23:19.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.563+0000 7f8594200640 1 -- 172.21.15.131:0/3441620092 wait complete. 2024-04-25T19:23:19.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.566+0000 7f8594200640 1 Processor -- start 2024-04-25T19:23:19.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.566+0000 7f8594200640 1 -- start start 2024-04-25T19:23:19.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.567+0000 7f8594200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8574003f30 0x7f858c15b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:19.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.567+0000 7f8594200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f858c144370 0x7f858c0d0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:19.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.567+0000 7f8594200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f858c0d07c0 0x7f858c0b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:19.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.567+0000 7f8594200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f858c06f090 con 0x7f8574003f30 2024-04-25T19:23:19.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.567+0000 7f8594200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f858c06fc80 con 0x7f858c144370 2024-04-25T19:23:19.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.567+0000 7f8594200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f858c070480 con 0x7f858c0d07c0 2024-04-25T19:23:19.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.568+0000 7f8591800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8574003f30 0x7f858c15b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:19.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.568+0000 7f8591800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8574003f30 0x7f858c15b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56354/0 (socket says 172.21.15.131:56354) 2024-04-25T19:23:19.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.568+0000 7f8591800640 1 -- 172.21.15.131:0/952875698 learned_addr learned my addr 172.21.15.131:0/952875698 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:19.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.568+0000 7f8590e00640 1 --2- 172.21.15.131:0/952875698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f858c144370 0x7f858c0d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:19.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.568+0000 7f8591800640 1 -- 172.21.15.131:0/952875698 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f858c0d07c0 msgr2=0x7f858c0b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:19.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.568+0000 7f8591800640 1 --2- 172.21.15.131:0/952875698 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f858c0d07c0 0x7f858c0b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:19.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.568+0000 7f8591800640 1 -- 172.21.15.131:0/952875698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f858c144370 msgr2=0x7f858c0d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:19.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.568+0000 7f8591800640 1 --2- 172.21.15.131:0/952875698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f858c144370 0x7f858c0d0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:19.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.568+0000 7f8591800640 1 -- 172.21.15.131:0/952875698 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858c0d0bd0 con 0x7f8574003f30 2024-04-25T19:23:19.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.568+0000 7f8590e00640 1 --2- 172.21.15.131:0/952875698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f858c144370 0x7f858c0d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:19.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.568+0000 7f8591800640 1 --2- 172.21.15.131:0/952875698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8574003f30 0x7f858c15b8e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f85800114f0 tx=0x7f85800119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:19.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.569+0000 7f8589600640 1 -- 172.21.15.131:0/952875698 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580015930 con 0x7f8574003f30 2024-04-25T19:23:19.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.569+0000 7f8589600640 1 -- 172.21.15.131:0/952875698 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8580015ad0 con 0x7f8574003f30 2024-04-25T19:23:19.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.569+0000 7f8594200640 1 -- 172.21.15.131:0/952875698 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f858c15c130 con 0x7f8574003f30 2024-04-25T19:23:19.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.569+0000 7f8589600640 1 -- 172.21.15.131:0/952875698 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858001d400 con 0x7f8574003f30 2024-04-25T19:23:19.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.569+0000 7f8594200640 1 -- 172.21.15.131:0/952875698 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f858c15c6f0 con 0x7f8574003f30 2024-04-25T19:23:19.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.570+0000 7f8594200640 1 -- 172.21.15.131:0/952875698 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f858c050740 con 0x7f8574003f30 2024-04-25T19:23:19.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.571+0000 7f8589600640 1 -- 172.21.15.131:0/952875698 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f858001d5a0 con 0x7f8574003f30 2024-04-25T19:23:19.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.573+0000 7f8589600640 1 --2- 172.21.15.131:0/952875698 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f856c0744e0 0x7f856c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:19.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.573+0000 7f8589600640 1 -- 172.21.15.131:0/952875698 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f85800959d0 con 0x7f8574003f30 2024-04-25T19:23:19.575 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.573+0000 7f8590e00640 1 --2- 172.21.15.131:0/952875698 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f856c0744e0 0x7f856c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:19.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.574+0000 7f8590e00640 1 --2- 172.21.15.131:0/952875698 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f856c0744e0 0x7f856c0769f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8578032000 tx=0x7f8578007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:19.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.578+0000 7f8589600640 1 -- 172.21.15.131:0/952875698 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f858c0d0bd0 con 0x7f8574003f30 2024-04-25T19:23:19.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.780+0000 7f8594200640 1 -- 172.21.15.131:0/952875698 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f858c13cdd0 con 0x7f8574003f30 2024-04-25T19:23:19.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.782+0000 7f8589600640 1 -- 172.21.15.131:0/952875698 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16878 (secure 0 0 0) 0x7f8580019030 con 0x7f8574003f30 2024-04-25T19:23:19.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:19.785 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":22,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:22:57.347297+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:22:14.779716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T19:22:15.552027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:23:19.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.785+0000 7f8594200640 1 -- 172.21.15.131:0/952875698 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f856c0744e0 msgr2=0x7f856c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:19.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.785+0000 7f8594200640 1 --2- 172.21.15.131:0/952875698 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f856c0744e0 0x7f856c0769f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8578032000 tx=0x7f8578007000 comp rx=0 tx=0).stop 2024-04-25T19:23:19.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.785+0000 7f8594200640 1 -- 172.21.15.131:0/952875698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8574003f30 msgr2=0x7f858c15b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:19.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.785+0000 7f8594200640 1 --2- 172.21.15.131:0/952875698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8574003f30 0x7f858c15b8e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f85800114f0 tx=0x7f85800119b0 comp rx=0 tx=0).stop 2024-04-25T19:23:19.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.785+0000 7f8594200640 1 -- 172.21.15.131:0/952875698 shutdown_connections 2024-04-25T19:23:19.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.785+0000 7f8594200640 1 --2- 172.21.15.131:0/952875698 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f856c0744e0 0x7f856c0769f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:19.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.785+0000 7f8594200640 1 --2- 172.21.15.131:0/952875698 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f858c0d07c0 0x7f858c0b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:19.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.785+0000 7f8594200640 1 --2- 172.21.15.131:0/952875698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f858c144370 0x7f858c0d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:19.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.785+0000 7f8594200640 1 --2- 172.21.15.131:0/952875698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8574003f30 0x7f858c15b8e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:19.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.785+0000 7f8594200640 1 -- 172.21.15.131:0/952875698 >> 172.21.15.131:0/952875698 conn(0x7f858c0d1ae0 msgr2=0x7f858c13f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:19.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.786+0000 7f8594200640 1 -- 172.21.15.131:0/952875698 shutdown_connections 2024-04-25T19:23:19.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:19.786+0000 7f8594200640 1 -- 172.21.15.131:0/952875698 wait complete. 2024-04-25T19:23:19.813 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T19:23:19.814 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:23:20.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.084+0000 7fd77da00640 1 Processor -- start 2024-04-25T19:23:20.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.084+0000 7fd77da00640 1 -- start start 2024-04-25T19:23:20.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.086+0000 7fd77da00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd778070690 0x7fd778161c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:20.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.086+0000 7fd77da00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd778162140 0x7fd7780ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:20.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.086+0000 7fd77da00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd778162550 con 0x7fd778144500 2024-04-25T19:23:20.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.086+0000 7fd77da00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd778070aa0 con 0x7fd778070690 2024-04-25T19:23:20.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.086+0000 7fd77da00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd778070200 con 0x7fd778162140 2024-04-25T19:23:20.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.086+0000 7fd776a00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fd778144500 0x7fd7780cdb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:47834/0 (socket says 172.21.15.131:47834) 2024-04-25T19:23:20.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.086+0000 7fd776a00640 1 -- 172.21.15.131:0/3494261267 learned_addr learned my addr 172.21.15.131:0/3494261267 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:20.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.086+0000 7fd776000640 1 --2- 172.21.15.131:0/3494261267 >> v2:172.21.15.131:3300/0 conn(0x7fd778070690 0x7fd778161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:20.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.087+0000 7fd777400640 1 --2- 172.21.15.131:0/3494261267 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd778162140 0x7fd7780ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:20.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.087+0000 7fd776000640 1 -- 172.21.15.131:0/3494261267 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd778162140 msgr2=0x7fd7780ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:20.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.087+0000 7fd776000640 1 --2- 172.21.15.131:0/3494261267 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd778162140 0x7fd7780ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:20.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.087+0000 7fd776000640 1 -- 172.21.15.131:0/3494261267 >> v1:172.21.15.131:6789/0 conn(0x7fd778144500 legacy=0x7fd7780cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:20.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.087+0000 7fd776000640 1 -- 172.21.15.131:0/3494261267 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd77806f5f0 con 0x7fd778070690 2024-04-25T19:23:20.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.087+0000 7fd775600640 1 -- 172.21.15.131:0/3494261267 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1795618179 0 0) 0x7fd760001110 con 0x7fd778144500 2024-04-25T19:23:20.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.088+0000 7fd776000640 1 --2- 172.21.15.131:0/3494261267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd778070690 0x7fd778161c00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd768009d90 tx=0x7fd76802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9445ce78968fc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:20.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.088+0000 7fd775600640 1 -- 172.21.15.131:0/3494261267 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd768007740 con 0x7fd778070690 2024-04-25T19:23:20.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.088+0000 7fd775600640 1 -- 172.21.15.131:0/3494261267 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7680078e0 con 0x7fd778070690 2024-04-25T19:23:20.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.088+0000 7fd775600640 1 -- 172.21.15.131:0/3494261267 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd768007cb0 con 0x7fd778070690 2024-04-25T19:23:20.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.089+0000 7fd77da00640 1 -- 172.21.15.131:0/3494261267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd778070690 msgr2=0x7fd778161c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:20.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.089+0000 7fd77da00640 1 --2- 172.21.15.131:0/3494261267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd778070690 0x7fd778161c00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd768009d90 tx=0x7fd76802a660 comp rx=0 tx=0).stop 2024-04-25T19:23:20.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.089+0000 7fd77da00640 1 -- 172.21.15.131:0/3494261267 shutdown_connections 2024-04-25T19:23:20.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.089+0000 7fd77da00640 1 --2- 172.21.15.131:0/3494261267 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd778162140 0x7fd7780ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:20.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.089+0000 7fd77da00640 1 --2- 172.21.15.131:0/3494261267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd778070690 0x7fd778161c00 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:20.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.089+0000 7fd77da00640 1 -- 172.21.15.131:0/3494261267 >> 172.21.15.131:0/3494261267 conn(0x7fd778073050 msgr2=0x7fd778073460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:20.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.089+0000 7fd77da00640 1 -- 172.21.15.131:0/3494261267 shutdown_connections 2024-04-25T19:23:20.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.090+0000 7fd77da00640 1 -- 172.21.15.131:0/3494261267 wait complete. 2024-04-25T19:23:20.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.092+0000 7fd77da00640 1 Processor -- start 2024-04-25T19:23:20.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.092+0000 7fd77da00640 1 -- start start 2024-04-25T19:23:20.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.094+0000 7fd77da00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd778070690 0x7fd778159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:20.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.094+0000 7fd77da00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd778144500 0x7fd778143580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:20.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.094+0000 7fd77da00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd778162140 0x7fd778158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:20.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.094+0000 7fd77da00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd77806fe90 con 0x7fd778162140 2024-04-25T19:23:20.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.094+0000 7fd77da00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd77806fbb0 con 0x7fd778144500 2024-04-25T19:23:20.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.094+0000 7fd77da00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd77806f160 con 0x7fd778070690 2024-04-25T19:23:20.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.094+0000 7fd777400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd778162140 0x7fd778158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:20.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.094+0000 7fd777400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd778162140 0x7fd778158050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56380/0 (socket says 172.21.15.131:56380) 2024-04-25T19:23:20.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.094+0000 7fd777400640 1 -- 172.21.15.131:0/3093058177 learned_addr learned my addr 172.21.15.131:0/3093058177 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:20.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.094+0000 7fd776a00640 1 --2- 172.21.15.131:0/3093058177 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd778070690 0x7fd778159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:20.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.094+0000 7fd776000640 1 --2- 172.21.15.131:0/3093058177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd778144500 0x7fd778143580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:20.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.094+0000 7fd777400640 1 -- 172.21.15.131:0/3093058177 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd778070690 msgr2=0x7fd778159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:20.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.094+0000 7fd777400640 1 --2- 172.21.15.131:0/3093058177 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd778070690 0x7fd778159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:20.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.094+0000 7fd777400640 1 -- 172.21.15.131:0/3093058177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd778144500 msgr2=0x7fd778143580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:20.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.094+0000 7fd777400640 1 --2- 172.21.15.131:0/3093058177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd778144500 0x7fd778143580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:20.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.094+0000 7fd777400640 1 -- 172.21.15.131:0/3093058177 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd778143ac0 con 0x7fd778162140 2024-04-25T19:23:20.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.095+0000 7fd776a00640 1 --2- 172.21.15.131:0/3093058177 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd778070690 0x7fd778159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:20.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.095+0000 7fd777400640 1 --2- 172.21.15.131:0/3093058177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd778162140 0x7fd778158050 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd77000d5d0 tx=0x7fd77000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:20.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.095+0000 7fd76ea00640 1 -- 172.21.15.131:0/3093058177 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7700125f0 con 0x7fd778162140 2024-04-25T19:23:20.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.095+0000 7fd76ea00640 1 -- 172.21.15.131:0/3093058177 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd770019070 con 0x7fd778162140 2024-04-25T19:23:20.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.095+0000 7fd77da00640 1 -- 172.21.15.131:0/3093058177 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7780c7390 con 0x7fd778162140 2024-04-25T19:23:20.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.095+0000 7fd76ea00640 1 -- 172.21.15.131:0/3093058177 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7700129b0 con 0x7fd778162140 2024-04-25T19:23:20.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.095+0000 7fd77da00640 1 -- 172.21.15.131:0/3093058177 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7780c7950 con 0x7fd778162140 2024-04-25T19:23:20.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.096+0000 7fd77da00640 1 -- 172.21.15.131:0/3093058177 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7780c7b90 con 0x7fd778162140 2024-04-25T19:23:20.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.098+0000 7fd76ea00640 1 -- 172.21.15.131:0/3093058177 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd770012b50 con 0x7fd778162140 2024-04-25T19:23:20.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.099+0000 7fd76ea00640 1 --2- 172.21.15.131:0/3093058177 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd7540744b0 0x7fd7540769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:20.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.099+0000 7fd76ea00640 1 -- 172.21.15.131:0/3093058177 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fd7700956f0 con 0x7fd778162140 2024-04-25T19:23:20.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.099+0000 7fd776a00640 1 --2- 172.21.15.131:0/3093058177 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd7540744b0 0x7fd7540769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:20.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.101+0000 7fd776a00640 1 --2- 172.21.15.131:0/3093058177 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd7540744b0 0x7fd7540769c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd760000f60 tx=0x7fd760009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:20.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.104+0000 7fd76ea00640 1 -- 172.21.15.131:0/3093058177 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd77005fe00 con 0x7fd778162140 2024-04-25T19:23:20.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.340+0000 7fd77da00640 1 -- 172.21.15.131:0/3093058177 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd778050740 con 0x7fd778162140 2024-04-25T19:23:20.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.342+0000 7fd76ea00640 1 -- 172.21.15.131:0/3093058177 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5187 (secure 0 0 0) 0x7fd77005f700 con 0x7fd778162140 2024-04-25T19:23:20.344 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:20.344 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/1570319410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":1570319410},{"type":"v1","addr":"172.21.15.195:6837","nonce":1570319410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/4072860882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4072860882},{"type":"v1","addr":"172.21.15.131:6834","nonce":4072860882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2207155444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2207155444},{"type":"v1","addr":"172.21.15.131:6835","nonce":2207155444}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T19:22:16.578438+0000","modified":"2024-04-25T19:22:19.648009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6836/1898121552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1898121552},{"type":"v1","addr":"172.21.15.195:6836","nonce":1898121552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T19:23:20.345 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 8 2024-04-25T19:23:20.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.345+0000 7fd77da00640 1 -- 172.21.15.131:0/3093058177 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd7540744b0 msgr2=0x7fd7540769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:20.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.345+0000 7fd77da00640 1 --2- 172.21.15.131:0/3093058177 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd7540744b0 0x7fd7540769c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd760000f60 tx=0x7fd760009040 comp rx=0 tx=0).stop 2024-04-25T19:23:20.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.345+0000 7fd77da00640 1 -- 172.21.15.131:0/3093058177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd778162140 msgr2=0x7fd778158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:20.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.345+0000 7fd77da00640 1 --2- 172.21.15.131:0/3093058177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd778162140 0x7fd778158050 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd77000d5d0 tx=0x7fd77000da90 comp rx=0 tx=0).stop 2024-04-25T19:23:20.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.345+0000 7fd77da00640 1 -- 172.21.15.131:0/3093058177 shutdown_connections 2024-04-25T19:23:20.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.345+0000 7fd77da00640 1 --2- 172.21.15.131:0/3093058177 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd7540744b0 0x7fd7540769c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:20.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.345+0000 7fd77da00640 1 --2- 172.21.15.131:0/3093058177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd778162140 0x7fd778158050 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:20.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.345+0000 7fd77da00640 1 --2- 172.21.15.131:0/3093058177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd778144500 0x7fd778143580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:20.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.345+0000 7fd77da00640 1 --2- 172.21.15.131:0/3093058177 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd778070690 0x7fd778159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:20.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.345+0000 7fd77da00640 1 -- 172.21.15.131:0/3093058177 >> 172.21.15.131:0/3093058177 conn(0x7fd778073050 msgr2=0x7fd778160060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:20.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.345+0000 7fd77da00640 1 -- 172.21.15.131:0/3093058177 shutdown_connections 2024-04-25T19:23:20.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.345+0000 7fd77da00640 1 -- 172.21.15.131:0/3093058177 wait complete. 2024-04-25T19:23:20.371 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:23:20.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.639+0000 7ff901a00640 1 Processor -- start 2024-04-25T19:23:20.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.639+0000 7ff901a00640 1 -- start start 2024-04-25T19:23:20.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.641+0000 7ff901a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff8fc1443c0 0x7ff8fc06fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:20.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.641+0000 7ff901a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8fc0cfcf0 0x7ff8fc06c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:20.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.641+0000 7ff901a00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8fc15f5f0 con 0x7ff8fc070370 2024-04-25T19:23:20.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.641+0000 7ff901a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7ff8fc0708d0 con 0x7ff8fc1443c0 2024-04-25T19:23:20.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.641+0000 7ff901a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff8fc15f160 con 0x7ff8fc0cfcf0 2024-04-25T19:23:20.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.641+0000 7ff8fa000640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7ff8fc070370 0x7ff8fc0cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:47838/0 (socket says 172.21.15.131:47838) 2024-04-25T19:23:20.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.641+0000 7ff8fa000640 1 -- 172.21.15.131:0/3478859480 learned_addr learned my addr 172.21.15.131:0/3478859480 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:20.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.642+0000 7ff8faa00640 1 --2- 172.21.15.131:0/3478859480 >> v2:172.21.15.195:3300/0 conn(0x7ff8fc1443c0 0x7ff8fc06fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:20.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.642+0000 7ff8fb400640 1 --2- 172.21.15.131:0/3478859480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8fc0cfcf0 0x7ff8fc06c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:20.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.642+0000 7ff8f9600640 1 -- 172.21.15.131:0/3478859480 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3454064232 0 0) 0x7ff8fc15f5f0 con 0x7ff8fc070370 2024-04-25T19:23:20.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.642+0000 7ff8f9600640 1 -- 172.21.15.131:0/3478859480 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8e0003520 con 0x7ff8fc070370 2024-04-25T19:23:20.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.642+0000 7ff8f9600640 1 -- 172.21.15.131:0/3478859480 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1920611344 0 0) 0x7ff8e0003520 con 0x7ff8fc070370 2024-04-25T19:23:20.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.642+0000 7ff8f9600640 1 -- 172.21.15.131:0/3478859480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8fc0cfcf0 msgr2=0x7ff8fc06c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:20.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.642+0000 7ff8f9600640 1 --2- 172.21.15.131:0/3478859480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8fc0cfcf0 0x7ff8fc06c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:20.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.642+0000 7ff8f9600640 1 -- 172.21.15.131:0/3478859480 >> v2:172.21.15.195:3300/0 conn(0x7ff8fc1443c0 msgr2=0x7ff8fc06fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:20.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.642+0000 7ff8f9600640 1 --2- 172.21.15.131:0/3478859480 >> v2:172.21.15.195:3300/0 conn(0x7ff8fc1443c0 0x7ff8fc06fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:20.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.642+0000 7ff8f9600640 1 -- 172.21.15.131:0/3478859480 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8fc15e830 con 0x7ff8fc070370 2024-04-25T19:23:20.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.643+0000 7ff8f9600640 1 -- 172.21.15.131:0/3478859480 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7ff8e8001670 con 0x7ff8fc070370 2024-04-25T19:23:20.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.643+0000 7ff8f9600640 1 -- 172.21.15.131:0/3478859480 >> v1:172.21.15.131:6789/0 conn(0x7ff8fc070370 legacy=0x7ff8fc0cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:20.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.643+0000 7ff8f9600640 1 --2- 172.21.15.131:0/3478859480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e00039b0 0x7ff8e0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:20.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.643+0000 7ff8f9600640 1 --2- 172.21.15.131:0/3478859480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8e0004390 0x7ff8e00048c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:20.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.643+0000 7ff8f9600640 1 --2- 172.21.15.131:0/3478859480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8e0004f30 0x7ff8e000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:20.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.643+0000 7ff8f9600640 1 -- 172.21.15.131:0/3478859480 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc0708d0 con 0x7ff8e0004390 2024-04-25T19:23:20.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.643+0000 7ff8f9600640 1 -- 172.21.15.131:0/3478859480 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc15f160 con 0x7ff8e0004f30 2024-04-25T19:23:20.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.643+0000 7ff8f9600640 1 -- 172.21.15.131:0/3478859480 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff8e000bf00 con 0x7ff8e00039b0 2024-04-25T19:23:20.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.643+0000 7ff8fa000640 1 --2- 172.21.15.131:0/3478859480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8e0004390 0x7ff8e00048c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:20.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.643+0000 7ff8faa00640 1 --2- 172.21.15.131:0/3478859480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e00039b0 0x7ff8e0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:20.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.643+0000 7ff8fa000640 1 -- 172.21.15.131:0/3478859480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e00039b0 msgr2=0x7ff8e0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:20.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.643+0000 7ff8fa000640 1 --2- 172.21.15.131:0/3478859480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e00039b0 0x7ff8e0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:20.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.643+0000 7ff8fa000640 1 -- 172.21.15.131:0/3478859480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8e0004f30 msgr2=0x7ff8e000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:20.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.643+0000 7ff8fa000640 1 --2- 172.21.15.131:0/3478859480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8e0004f30 0x7ff8e000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:20.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.643+0000 7ff8fa000640 1 -- 172.21.15.131:0/3478859480 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e0003520 con 0x7ff8e0004390 2024-04-25T19:23:20.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.645+0000 7ff8fa000640 1 --2- 172.21.15.131:0/3478859480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8e0004390 0x7ff8e00048c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800c160 tx=0x7ff8e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be23a91735e12df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:20.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.645+0000 7ff8f9600640 1 -- 172.21.15.131:0/3478859480 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8007c60 con 0x7ff8e0004390 2024-04-25T19:23:20.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.645+0000 7ff8f9600640 1 -- 172.21.15.131:0/3478859480 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8e8005af0 con 0x7ff8e0004390 2024-04-25T19:23:20.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.645+0000 7ff8f9600640 1 -- 172.21.15.131:0/3478859480 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8007070 con 0x7ff8e0004390 2024-04-25T19:23:20.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.646+0000 7ff901a00640 1 -- 172.21.15.131:0/3478859480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8e0004390 msgr2=0x7ff8e00048c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:20.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.646+0000 7ff901a00640 1 --2- 172.21.15.131:0/3478859480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8e0004390 0x7ff8e00048c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800c160 tx=0x7ff8e0005830 comp rx=0 tx=0).stop 2024-04-25T19:23:20.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.646+0000 7ff8fb400640 1 -- 172.21.15.131:0/3478859480 reap_dead start 2024-04-25T19:23:20.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.646+0000 7ff901a00640 1 -- 172.21.15.131:0/3478859480 shutdown_connections 2024-04-25T19:23:20.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.646+0000 7ff901a00640 1 -- 172.21.15.131:0/3478859480 >> 172.21.15.131:0/3478859480 conn(0x7ff8fc0d1ae0 msgr2=0x7ff8fc0d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:20.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.646+0000 7ff901a00640 1 -- 172.21.15.131:0/3478859480 shutdown_connections 2024-04-25T19:23:20.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.646+0000 7ff901a00640 1 -- 172.21.15.131:0/3478859480 wait complete. 2024-04-25T19:23:20.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.648+0000 7ff901a00640 1 Processor -- start 2024-04-25T19:23:20.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.649+0000 7ff901a00640 1 -- start start 2024-04-25T19:23:20.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.650+0000 7ff901a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8fc14ea60 0x7ff8fc0aa230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:20.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.650+0000 7ff901a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8fc14d7e0 0x7ff8fc14dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:20.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.650+0000 7ff901a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8fc14e130 0x7ff8fc13eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:20.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.650+0000 7ff901a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc1447d0 con 0x7ff8fc14e130 2024-04-25T19:23:20.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.650+0000 7ff901a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc15edf0 con 0x7ff8fc14ea60 2024-04-25T19:23:20.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.650+0000 7ff901a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff8fc162b00 con 0x7ff8fc14d7e0 2024-04-25T19:23:20.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.650+0000 7ff8fb400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8fc14e130 0x7ff8fc13eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:20.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.650+0000 7ff8fb400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8fc14e130 0x7ff8fc13eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56400/0 (socket says 172.21.15.131:56400) 2024-04-25T19:23:20.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.650+0000 7ff8fb400640 1 -- 172.21.15.131:0/520974516 learned_addr learned my addr 172.21.15.131:0/520974516 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:20.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.651+0000 7ff8fa000640 1 --2- 172.21.15.131:0/520974516 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8fc14d7e0 0x7ff8fc14dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:20.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.651+0000 7ff8faa00640 1 --2- 172.21.15.131:0/520974516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8fc14ea60 0x7ff8fc0aa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:20.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.651+0000 7ff8fb400640 1 -- 172.21.15.131:0/520974516 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8fc14d7e0 msgr2=0x7ff8fc14dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:20.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.651+0000 7ff8fb400640 1 --2- 172.21.15.131:0/520974516 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8fc14d7e0 0x7ff8fc14dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:20.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.651+0000 7ff8fb400640 1 -- 172.21.15.131:0/520974516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8fc14ea60 msgr2=0x7ff8fc0aa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:20.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.651+0000 7ff8fb400640 1 --2- 172.21.15.131:0/520974516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8fc14ea60 0x7ff8fc0aa230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:20.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.651+0000 7ff8fb400640 1 -- 172.21.15.131:0/520974516 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8fc14b6f0 con 0x7ff8fc14e130 2024-04-25T19:23:20.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.651+0000 7ff8fb400640 1 --2- 172.21.15.131:0/520974516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8fc14e130 0x7ff8fc13eb70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc06f2d0 tx=0x7ff8f400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:20.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.651+0000 7ff8f2a00640 1 -- 172.21.15.131:0/520974516 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4018020 con 0x7ff8fc14e130 2024-04-25T19:23:20.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.651+0000 7ff8f2a00640 1 -- 172.21.15.131:0/520974516 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8f400bce0 con 0x7ff8fc14e130 2024-04-25T19:23:20.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.652+0000 7ff8f2a00640 1 -- 172.21.15.131:0/520974516 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4014640 con 0x7ff8fc14e130 2024-04-25T19:23:20.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.652+0000 7ff901a00640 1 -- 172.21.15.131:0/520974516 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8fc14b9d0 con 0x7ff8fc14e130 2024-04-25T19:23:20.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.652+0000 7ff901a00640 1 -- 172.21.15.131:0/520974516 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8fc1517e0 con 0x7ff8fc14e130 2024-04-25T19:23:20.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.653+0000 7ff901a00640 1 -- 172.21.15.131:0/520974516 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8fc050740 con 0x7ff8fc14e130 2024-04-25T19:23:20.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.654+0000 7ff8f2a00640 1 -- 172.21.15.131:0/520974516 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff8f4005d10 con 0x7ff8fc14e130 2024-04-25T19:23:20.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.656+0000 7ff8f2a00640 1 --2- 172.21.15.131:0/520974516 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff8dc0744e0 0x7ff8dc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:20.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.656+0000 7ff8f2a00640 1 -- 172.21.15.131:0/520974516 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7ff8f4095940 con 0x7ff8fc14e130 2024-04-25T19:23:20.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.656+0000 7ff8faa00640 1 --2- 172.21.15.131:0/520974516 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff8dc0744e0 0x7ff8dc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:20.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.658+0000 7ff8faa00640 1 --2- 172.21.15.131:0/520974516 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff8dc0744e0 0x7ff8dc0769f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc15bb00 tx=0x7ff8ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:20.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.661+0000 7ff8f2a00640 1 -- 172.21.15.131:0/520974516 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff8f4022030 con 0x7ff8fc14e130 2024-04-25T19:23:20.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.898+0000 7ff901a00640 1 -- 172.21.15.131:0/520974516 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8fc06f950 con 0x7ff8fc14e130 2024-04-25T19:23:20.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.899+0000 7ff8f2a00640 1 -- 172.21.15.131:0/520974516 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5187 (secure 0 0 0) 0x7ff8f4095090 con 0x7ff8fc14e130 2024-04-25T19:23:20.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:20.902 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/1570319410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":1570319410},{"type":"v1","addr":"172.21.15.195:6837","nonce":1570319410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/4072860882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4072860882},{"type":"v1","addr":"172.21.15.131:6834","nonce":4072860882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2207155444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2207155444},{"type":"v1","addr":"172.21.15.131:6835","nonce":2207155444}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T19:22:16.578438+0000","modified":"2024-04-25T19:22:19.648009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6836/1898121552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1898121552},{"type":"v1","addr":"172.21.15.195:6836","nonce":1898121552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T19:23:20.902 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 8 2024-04-25T19:23:20.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.902+0000 7ff901a00640 1 -- 172.21.15.131:0/520974516 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff8dc0744e0 msgr2=0x7ff8dc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:20.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.902+0000 7ff901a00640 1 --2- 172.21.15.131:0/520974516 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff8dc0744e0 0x7ff8dc0769f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc15bb00 tx=0x7ff8ec008040 comp rx=0 tx=0).stop 2024-04-25T19:23:20.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.902+0000 7ff901a00640 1 -- 172.21.15.131:0/520974516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8fc14e130 msgr2=0x7ff8fc13eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:20.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.902+0000 7ff901a00640 1 --2- 172.21.15.131:0/520974516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8fc14e130 0x7ff8fc13eb70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc06f2d0 tx=0x7ff8f400b480 comp rx=0 tx=0).stop 2024-04-25T19:23:20.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.902+0000 7ff901a00640 1 -- 172.21.15.131:0/520974516 shutdown_connections 2024-04-25T19:23:20.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.902+0000 7ff901a00640 1 --2- 172.21.15.131:0/520974516 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff8dc0744e0 0x7ff8dc0769f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:20.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.902+0000 7ff901a00640 1 --2- 172.21.15.131:0/520974516 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8fc14d7e0 0x7ff8fc14dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:20.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.902+0000 7ff901a00640 1 --2- 172.21.15.131:0/520974516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8fc14e130 0x7ff8fc13eb70 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:20.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.902+0000 7ff901a00640 1 --2- 172.21.15.131:0/520974516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8fc14ea60 0x7ff8fc0aa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:20.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.902+0000 7ff901a00640 1 -- 172.21.15.131:0/520974516 >> 172.21.15.131:0/520974516 conn(0x7ff8fc0d1ae0 msgr2=0x7ff8fc15ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:20.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.902+0000 7ff901a00640 1 -- 172.21.15.131:0/520974516 shutdown_connections 2024-04-25T19:23:20.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:20.902+0000 7ff901a00640 1 -- 172.21.15.131:0/520974516 wait complete. 2024-04-25T19:23:20.933 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:23:21.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.209+0000 7f0922a00640 1 Processor -- start 2024-04-25T19:23:21.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.209+0000 7f0922a00640 1 -- start start 2024-04-25T19:23:21.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.211+0000 7f0922a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f091c0d1620 0x7f091c0d1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:21.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.211+0000 7f0922a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f091c163130 0x7f091c0b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:21.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.211+0000 7f0922a00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f091c0b0770 con 0x7f091c0ce800 2024-04-25T19:23:21.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.211+0000 7f0922a00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f091c0b10a0 con 0x7f091c0d1620 2024-04-25T19:23:21.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.211+0000 7f0922a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f091c0d2100 con 0x7f091c163130 2024-04-25T19:23:21.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.211+0000 7f091b400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f091c0d1620 0x7f091c0d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:21.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.211+0000 7f091b400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f091c0d1620 0x7f091c0d1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56414/0 (socket says 172.21.15.131:56414) 2024-04-25T19:23:21.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.211+0000 7f091b400640 1 -- 172.21.15.131:0/3552065850 learned_addr learned my addr 172.21.15.131:0/3552065850 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:21.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.212+0000 7f0920a00640 1 --2- 172.21.15.131:0/3552065850 >> v2:172.21.15.195:3300/0 conn(0x7f091c163130 0x7f091c0b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:21.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.212+0000 7f091b400640 1 -- 172.21.15.131:0/3552065850 >> v2:172.21.15.195:3300/0 conn(0x7f091c163130 msgr2=0x7f091c0b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:21.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.212+0000 7f091b400640 1 --2- 172.21.15.131:0/3552065850 >> v2:172.21.15.195:3300/0 conn(0x7f091c163130 0x7f091c0b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:21.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.212+0000 7f091b400640 1 -- 172.21.15.131:0/3552065850 >> v1:172.21.15.195:6789/0 conn(0x7f091c0ce800 legacy=0x7f091c162a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:21.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.212+0000 7f091b400640 1 -- 172.21.15.131:0/3552065850 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f091c0b0a50 con 0x7f091c0d1620 2024-04-25T19:23:21.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.213+0000 7f091b400640 1 --2- 172.21.15.131:0/3552065850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f091c0d1620 0x7f091c0d1bc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f091c08d070 tx=0x7f090802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=effd4a7cfc594770 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:21.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.213+0000 7f091aa00640 1 -- 172.21.15.131:0/3552065850 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0908037070 con 0x7f091c0d1620 2024-04-25T19:23:21.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.213+0000 7f091aa00640 1 -- 172.21.15.131:0/3552065850 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f090802ae20 con 0x7f091c0d1620 2024-04-25T19:23:21.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.213+0000 7f091aa00640 1 -- 172.21.15.131:0/3552065850 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0908032660 con 0x7f091c0d1620 2024-04-25T19:23:21.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.214+0000 7f0922a00640 1 -- 172.21.15.131:0/3552065850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f091c0d1620 msgr2=0x7f091c0d1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:21.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.214+0000 7f0922a00640 1 --2- 172.21.15.131:0/3552065850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f091c0d1620 0x7f091c0d1bc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f091c08d070 tx=0x7f090802a110 comp rx=0 tx=0).stop 2024-04-25T19:23:21.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.214+0000 7f0922a00640 1 -- 172.21.15.131:0/3552065850 shutdown_connections 2024-04-25T19:23:21.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.214+0000 7f0922a00640 1 --2- 172.21.15.131:0/3552065850 >> v2:172.21.15.195:3300/0 conn(0x7f091c163130 0x7f091c0b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:21.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.214+0000 7f0922a00640 1 --2- 172.21.15.131:0/3552065850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f091c0d1620 0x7f091c0d1bc0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:21.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.214+0000 7f0922a00640 1 -- 172.21.15.131:0/3552065850 >> 172.21.15.131:0/3552065850 conn(0x7f091c0d3a50 msgr2=0x7f091c0d3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:21.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.214+0000 7f0922a00640 1 -- 172.21.15.131:0/3552065850 shutdown_connections 2024-04-25T19:23:21.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.214+0000 7f0922a00640 1 -- 172.21.15.131:0/3552065850 wait complete. 2024-04-25T19:23:21.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.217+0000 7f0922a00640 1 Processor -- start 2024-04-25T19:23:21.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.217+0000 7f0922a00640 1 -- start start 2024-04-25T19:23:21.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.218+0000 7f0922a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f091c0ce800 0x7f091c1599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:21.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.218+0000 7f0922a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f091c0d1620 0x7f091c0b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:21.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.218+0000 7f0922a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f091c163130 0x7f091c15b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:21.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.218+0000 7f0922a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f091c163540 con 0x7f091c163130 2024-04-25T19:23:21.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.218+0000 7f0922a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f091c0b51c0 con 0x7f091c0d1620 2024-04-25T19:23:21.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.218+0000 7f0922a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f091c0b3820 con 0x7f091c0ce800 2024-04-25T19:23:21.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.219+0000 7f0920a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f091c163130 0x7f091c15b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:21.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.219+0000 7f0920a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f091c163130 0x7f091c15b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56426/0 (socket says 172.21.15.131:56426) 2024-04-25T19:23:21.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.219+0000 7f0920a00640 1 -- 172.21.15.131:0/1675914711 learned_addr learned my addr 172.21.15.131:0/1675914711 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:21.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.219+0000 7f091be00640 1 --2- 172.21.15.131:0/1675914711 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f091c0ce800 0x7f091c1599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:21.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.219+0000 7f091b400640 1 --2- 172.21.15.131:0/1675914711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f091c0d1620 0x7f091c0b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:21.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.219+0000 7f0920a00640 1 -- 172.21.15.131:0/1675914711 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f091c0ce800 msgr2=0x7f091c1599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:21.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.219+0000 7f0920a00640 1 --2- 172.21.15.131:0/1675914711 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f091c0ce800 0x7f091c1599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:21.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.219+0000 7f0920a00640 1 -- 172.21.15.131:0/1675914711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f091c0d1620 msgr2=0x7f091c0b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:21.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.219+0000 7f0920a00640 1 --2- 172.21.15.131:0/1675914711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f091c0d1620 0x7f091c0b3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:21.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.219+0000 7f0920a00640 1 -- 172.21.15.131:0/1675914711 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f091c15c6b0 con 0x7f091c163130 2024-04-25T19:23:21.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.219+0000 7f0920a00640 1 --2- 172.21.15.131:0/1675914711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f091c163130 0x7f091c15b510 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0914007d40 tx=0x7f091400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:21.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.220+0000 7f0913e00640 1 -- 172.21.15.131:0/1675914711 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0914014420 con 0x7f091c163130 2024-04-25T19:23:21.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.220+0000 7f0913e00640 1 -- 172.21.15.131:0/1675914711 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0914019070 con 0x7f091c163130 2024-04-25T19:23:21.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.220+0000 7f0913e00640 1 -- 172.21.15.131:0/1675914711 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0914014820 con 0x7f091c163130 2024-04-25T19:23:21.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.220+0000 7f0922a00640 1 -- 172.21.15.131:0/1675914711 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f091c15c990 con 0x7f091c163130 2024-04-25T19:23:21.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.220+0000 7f0922a00640 1 -- 172.21.15.131:0/1675914711 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f091c0b1ce0 con 0x7f091c163130 2024-04-25T19:23:21.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.221+0000 7f0922a00640 1 -- 172.21.15.131:0/1675914711 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f091c050740 con 0x7f091c163130 2024-04-25T19:23:21.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.222+0000 7f0913e00640 1 -- 172.21.15.131:0/1675914711 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f09140149c0 con 0x7f091c163130 2024-04-25T19:23:21.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.223+0000 7f0913e00640 1 --2- 172.21.15.131:0/1675914711 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f08fc0744b0 0x7f08fc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:21.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.223+0000 7f0913e00640 1 -- 172.21.15.131:0/1675914711 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f0914095b10 con 0x7f091c163130 2024-04-25T19:23:21.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.224+0000 7f091be00640 1 --2- 172.21.15.131:0/1675914711 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f08fc0744b0 0x7f08fc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:21.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.225+0000 7f091be00640 1 --2- 172.21.15.131:0/1675914711 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f08fc0744b0 0x7f08fc0769c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f090c00b7f0 tx=0x7f090c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:21.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.228+0000 7f0913e00640 1 -- 172.21.15.131:0/1675914711 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f09140601c0 con 0x7f091c163130 2024-04-25T19:23:21.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.429+0000 7f0922a00640 1 -- 172.21.15.131:0/1675914711 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f091c0d1220 con 0x7f091c163130 2024-04-25T19:23:21.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.431+0000 7f0913e00640 1 -- 172.21.15.131:0/1675914711 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16878 (secure 0 0 0) 0x7f091405fac0 con 0x7f091c163130 2024-04-25T19:23:21.434 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:21.434 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":22,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:22:57.347297+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:22:14.779716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T19:22:15.552027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:23:21.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.434+0000 7f0922a00640 1 -- 172.21.15.131:0/1675914711 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f08fc0744b0 msgr2=0x7f08fc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:21.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.434+0000 7f0922a00640 1 --2- 172.21.15.131:0/1675914711 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f08fc0744b0 0x7f08fc0769c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f090c00b7f0 tx=0x7f090c008040 comp rx=0 tx=0).stop 2024-04-25T19:23:21.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.434+0000 7f0922a00640 1 -- 172.21.15.131:0/1675914711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f091c163130 msgr2=0x7f091c15b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:21.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.434+0000 7f0922a00640 1 --2- 172.21.15.131:0/1675914711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f091c163130 0x7f091c15b510 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0914007d40 tx=0x7f091400e4b0 comp rx=0 tx=0).stop 2024-04-25T19:23:21.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.434+0000 7f0922a00640 1 -- 172.21.15.131:0/1675914711 shutdown_connections 2024-04-25T19:23:21.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.434+0000 7f0922a00640 1 --2- 172.21.15.131:0/1675914711 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f08fc0744b0 0x7f08fc0769c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:21.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.434+0000 7f0922a00640 1 --2- 172.21.15.131:0/1675914711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f091c163130 0x7f091c15b510 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:21.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.434+0000 7f0922a00640 1 --2- 172.21.15.131:0/1675914711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f091c0d1620 0x7f091c0b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:21.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.434+0000 7f0922a00640 1 --2- 172.21.15.131:0/1675914711 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f091c0ce800 0x7f091c1599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:21.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.434+0000 7f0922a00640 1 -- 172.21.15.131:0/1675914711 >> 172.21.15.131:0/1675914711 conn(0x7f091c0d3a50 msgr2=0x7f091c0d3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:21.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.434+0000 7f0922a00640 1 -- 172.21.15.131:0/1675914711 shutdown_connections 2024-04-25T19:23:21.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.434+0000 7f0922a00640 1 -- 172.21.15.131:0/1675914711 wait complete. 2024-04-25T19:23:21.463 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T19:23:21.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.723+0000 7f9c26e00640 1 Processor -- start 2024-04-25T19:23:21.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.723+0000 7f9c26e00640 1 -- start start 2024-04-25T19:23:21.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.725+0000 7f9c26e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9c20160360 0x7f9c201647f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:21.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.725+0000 7f9c26e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c2006c7d0 con 0x7f9c20070680 2024-04-25T19:23:21.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.725+0000 7f9c26e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c2006cab0 con 0x7f9c200b5c90 2024-04-25T19:23:21.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.725+0000 7f9c26e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f9c2006d100 con 0x7f9c20160360 2024-04-25T19:23:21.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.725+0000 7f9c1fe00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f9c20070680 0x7f9c200af4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:47848/0 (socket says 172.21.15.131:47848) 2024-04-25T19:23:21.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.725+0000 7f9c1fe00640 1 -- 172.21.15.131:0/4248642377 learned_addr learned my addr 172.21.15.131:0/4248642377 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:21.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.726+0000 7f9c1f400640 1 --2- 172.21.15.131:0/4248642377 >> v2:172.21.15.195:3300/0 conn(0x7f9c20160360 0x7f9c201647f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:21.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.726+0000 7f9c1ea00640 1 -- 172.21.15.131:0/4248642377 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2607900679 0 0) 0x7f9c2006c7d0 con 0x7f9c20070680 2024-04-25T19:23:21.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.726+0000 7f9c1ea00640 1 -- 172.21.15.131:0/4248642377 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c04003520 con 0x7f9c20070680 2024-04-25T19:23:21.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.726+0000 7f9c1ea00640 1 -- 172.21.15.131:0/4248642377 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 45521858 0 0) 0x7f9c04003520 con 0x7f9c20070680 2024-04-25T19:23:21.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.726+0000 7f9c1ea00640 1 -- 172.21.15.131:0/4248642377 >> v2:172.21.15.195:3300/0 conn(0x7f9c20160360 msgr2=0x7f9c201647f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:21.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.726+0000 7f9c1ea00640 1 --2- 172.21.15.131:0/4248642377 >> v2:172.21.15.195:3300/0 conn(0x7f9c20160360 0x7f9c201647f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:21.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.726+0000 7f9c1ea00640 1 -- 172.21.15.131:0/4248642377 >> v1:172.21.15.195:6789/0 conn(0x7f9c200b5c90 legacy=0x7f9c200b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:21.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.726+0000 7f9c1ea00640 1 -- 172.21.15.131:0/4248642377 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2006cd90 con 0x7f9c20070680 2024-04-25T19:23:21.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.726+0000 7f9c1ea00640 1 -- 172.21.15.131:0/4248642377 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f9c10001670 con 0x7f9c20070680 2024-04-25T19:23:21.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.726+0000 7f9c1ea00640 1 -- 172.21.15.131:0/4248642377 >> v1:172.21.15.131:6789/0 conn(0x7f9c20070680 legacy=0x7f9c200af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:21.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.726+0000 7f9c1ea00640 1 --2- 172.21.15.131:0/4248642377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c040039b0 0x7f9c04003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:21.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.727+0000 7f9c1ea00640 1 --2- 172.21.15.131:0/4248642377 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9c04004800 0x7f9c04004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:21.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.727+0000 7f9c1ea00640 1 --2- 172.21.15.131:0/4248642377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c04005270 0x7f9c0400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:21.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.727+0000 7f9c1ea00640 1 -- 172.21.15.131:0/4248642377 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2006d100 con 0x7f9c040039b0 2024-04-25T19:23:21.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.727+0000 7f9c1ea00640 1 -- 172.21.15.131:0/4248642377 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0400c200 con 0x7f9c04005270 2024-04-25T19:23:21.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.727+0000 7f9c1ea00640 1 -- 172.21.15.131:0/4248642377 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9c0400c400 con 0x7f9c04004800 2024-04-25T19:23:21.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.727+0000 7f9c1fe00640 1 --2- 172.21.15.131:0/4248642377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c040039b0 0x7f9c04003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:21.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.727+0000 7f9c24e00640 1 --2- 172.21.15.131:0/4248642377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c04005270 0x7f9c0400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:21.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.727+0000 7f9c1f400640 1 --2- 172.21.15.131:0/4248642377 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9c04004800 0x7f9c04004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:21.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.727+0000 7f9c1fe00640 1 -- 172.21.15.131:0/4248642377 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9c04004800 msgr2=0x7f9c04004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:21.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.727+0000 7f9c1fe00640 1 --2- 172.21.15.131:0/4248642377 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9c04004800 0x7f9c04004c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:21.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.727+0000 7f9c1fe00640 1 -- 172.21.15.131:0/4248642377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c04005270 msgr2=0x7f9c0400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:21.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.727+0000 7f9c1fe00640 1 --2- 172.21.15.131:0/4248642377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c04005270 0x7f9c0400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:21.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.727+0000 7f9c1fe00640 1 -- 172.21.15.131:0/4248642377 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c04003520 con 0x7f9c040039b0 2024-04-25T19:23:21.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.727+0000 7f9c24e00640 1 --2- 172.21.15.131:0/4248642377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c04005270 0x7f9c0400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:21.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.727+0000 7f9c24e00640 1 -- 172.21.15.131:0/4248642377 reap_dead start 2024-04-25T19:23:21.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.729+0000 7f9c1fe00640 1 --2- 172.21.15.131:0/4248642377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c040039b0 0x7f9c04003e40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000c210 tx=0x7f9c04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f523d70c371c16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:21.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.729+0000 7f9c1ea00640 1 -- 172.21.15.131:0/4248642377 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c10007cf0 con 0x7f9c040039b0 2024-04-25T19:23:21.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.729+0000 7f9c1ea00640 1 -- 172.21.15.131:0/4248642377 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c10005af0 con 0x7f9c040039b0 2024-04-25T19:23:21.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.729+0000 7f9c1ea00640 1 -- 172.21.15.131:0/4248642377 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c10007070 con 0x7f9c040039b0 2024-04-25T19:23:21.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.730+0000 7f9c26e00640 1 -- 172.21.15.131:0/4248642377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c040039b0 msgr2=0x7f9c04003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:21.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.730+0000 7f9c26e00640 1 --2- 172.21.15.131:0/4248642377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c040039b0 0x7f9c04003e40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000c210 tx=0x7f9c04005830 comp rx=0 tx=0).stop 2024-04-25T19:23:21.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.730+0000 7f9c26e00640 1 -- 172.21.15.131:0/4248642377 shutdown_connections 2024-04-25T19:23:21.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.730+0000 7f9c26e00640 1 --2- 172.21.15.131:0/4248642377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c040039b0 0x7f9c04003e40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:21.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.730+0000 7f9c26e00640 1 -- 172.21.15.131:0/4248642377 >> 172.21.15.131:0/4248642377 conn(0x7f9c200d1ae0 msgr2=0x7f9c200d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:21.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.730+0000 7f9c26e00640 1 -- 172.21.15.131:0/4248642377 shutdown_connections 2024-04-25T19:23:21.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.730+0000 7f9c26e00640 1 -- 172.21.15.131:0/4248642377 wait complete. 2024-04-25T19:23:21.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.732+0000 7f9c26e00640 1 Processor -- start 2024-04-25T19:23:21.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.732+0000 7f9c26e00640 1 -- start start 2024-04-25T19:23:21.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.734+0000 7f9c26e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c040039b0 0x7f9c20151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:21.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.734+0000 7f9c26e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9c200c68e0 0x7f9c2015e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:21.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.734+0000 7f9c26e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c200c6cf0 0x7f9c2015e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:21.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.734+0000 7f9c26e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9c20164970 con 0x7f9c200c6cf0 2024-04-25T19:23:21.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.734+0000 7f9c26e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9c201647f0 con 0x7f9c040039b0 2024-04-25T19:23:21.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.734+0000 7f9c26e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9c20164af0 con 0x7f9c200c68e0 2024-04-25T19:23:21.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.734+0000 7f9c24e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c200c6cf0 0x7f9c2015e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:21.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.734+0000 7f9c24e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c200c6cf0 0x7f9c2015e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56452/0 (socket says 172.21.15.131:56452) 2024-04-25T19:23:21.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.734+0000 7f9c24e00640 1 -- 172.21.15.131:0/466414788 learned_addr learned my addr 172.21.15.131:0/466414788 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:21.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.735+0000 7f9c1f400640 1 --2- 172.21.15.131:0/466414788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9c200c68e0 0x7f9c2015e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:21.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.735+0000 7f9c1fe00640 1 --2- 172.21.15.131:0/466414788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c040039b0 0x7f9c20151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:21.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.735+0000 7f9c24e00640 1 -- 172.21.15.131:0/466414788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9c200c68e0 msgr2=0x7f9c2015e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:21.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.735+0000 7f9c24e00640 1 --2- 172.21.15.131:0/466414788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9c200c68e0 0x7f9c2015e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:21.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.735+0000 7f9c24e00640 1 -- 172.21.15.131:0/466414788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c040039b0 msgr2=0x7f9c20151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:21.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.735+0000 7f9c24e00640 1 --2- 172.21.15.131:0/466414788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c040039b0 0x7f9c20151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:21.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.735+0000 7f9c24e00640 1 -- 172.21.15.131:0/466414788 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2015b920 con 0x7f9c200c6cf0 2024-04-25T19:23:21.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.735+0000 7f9c24e00640 1 --2- 172.21.15.131:0/466414788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c200c6cf0 0x7f9c2015e7d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9c20163d40 tx=0x7f9c1800d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:21.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.735+0000 7f9c17e00640 1 -- 172.21.15.131:0/466414788 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18018070 con 0x7f9c200c6cf0 2024-04-25T19:23:21.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.735+0000 7f9c17e00640 1 -- 172.21.15.131:0/466414788 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c18003da0 con 0x7f9c200c6cf0 2024-04-25T19:23:21.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.735+0000 7f9c26e00640 1 -- 172.21.15.131:0/466414788 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c20151940 con 0x7f9c200c6cf0 2024-04-25T19:23:21.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.736+0000 7f9c17e00640 1 -- 172.21.15.131:0/466414788 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18005330 con 0x7f9c200c6cf0 2024-04-25T19:23:21.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.736+0000 7f9c26e00640 1 -- 172.21.15.131:0/466414788 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c200c7730 con 0x7f9c200c6cf0 2024-04-25T19:23:21.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.737+0000 7f9c26e00640 1 -- 172.21.15.131:0/466414788 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c20050740 con 0x7f9c200c6cf0 2024-04-25T19:23:21.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.738+0000 7f9c17e00640 1 -- 172.21.15.131:0/466414788 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9c1801b070 con 0x7f9c200c6cf0 2024-04-25T19:23:21.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.740+0000 7f9c17e00640 1 --2- 172.21.15.131:0/466414788 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9bfc0744b0 0x7f9bfc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:21.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.740+0000 7f9c17e00640 1 -- 172.21.15.131:0/466414788 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f9c180949b0 con 0x7f9c200c6cf0 2024-04-25T19:23:21.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.740+0000 7f9c1fe00640 1 --2- 172.21.15.131:0/466414788 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9bfc0744b0 0x7f9bfc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:21.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.741+0000 7f9c1fe00640 1 --2- 172.21.15.131:0/466414788 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9bfc0744b0 0x7f9bfc0769c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9c10032000 tx=0x7f9c10009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:21.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.745+0000 7f9c17e00640 1 -- 172.21.15.131:0/466414788 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9c1805f150 con 0x7f9c200c6cf0 2024-04-25T19:23:21.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.984+0000 7f9c26e00640 1 -- 172.21.15.131:0/466414788 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f9c200b6140 con 0x7f9c200c6cf0 2024-04-25T19:23:21.987 INFO:tasks.ceph.mon.a.smithi131.stderr:2024-04-25T19:23:21.985+0000 7f4e1e400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T19:23:21.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.989+0000 7f9c17e00640 1 -- 172.21.15.131:0/466414788 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f9c18067140 con 0x7f9c200c6cf0 2024-04-25T19:23:21.991 INFO:teuthology.orchestra.run.smithi131.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T19:23:21.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.992+0000 7f9c26e00640 1 -- 172.21.15.131:0/466414788 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9bfc0744b0 msgr2=0x7f9bfc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:21.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.992+0000 7f9c26e00640 1 --2- 172.21.15.131:0/466414788 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9bfc0744b0 0x7f9bfc0769c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9c10032000 tx=0x7f9c10009030 comp rx=0 tx=0).stop 2024-04-25T19:23:21.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.992+0000 7f9c26e00640 1 -- 172.21.15.131:0/466414788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c200c6cf0 msgr2=0x7f9c2015e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:21.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.992+0000 7f9c26e00640 1 --2- 172.21.15.131:0/466414788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c200c6cf0 0x7f9c2015e7d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9c20163d40 tx=0x7f9c1800d9f0 comp rx=0 tx=0).stop 2024-04-25T19:23:21.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.993+0000 7f9c26e00640 1 -- 172.21.15.131:0/466414788 shutdown_connections 2024-04-25T19:23:21.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.993+0000 7f9c26e00640 1 --2- 172.21.15.131:0/466414788 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f9bfc0744b0 0x7f9bfc0769c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:21.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.993+0000 7f9c26e00640 1 --2- 172.21.15.131:0/466414788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9c200c68e0 0x7f9c2015e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:21.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.993+0000 7f9c26e00640 1 --2- 172.21.15.131:0/466414788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c200c6cf0 0x7f9c2015e7d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:21.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.993+0000 7f9c26e00640 1 --2- 172.21.15.131:0/466414788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c040039b0 0x7f9c20151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:21.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.993+0000 7f9c26e00640 1 -- 172.21.15.131:0/466414788 >> 172.21.15.131:0/466414788 conn(0x7f9c200d1ae0 msgr2=0x7f9c200b1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:21.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.993+0000 7f9c26e00640 1 -- 172.21.15.131:0/466414788 shutdown_connections 2024-04-25T19:23:21.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:21.993+0000 7f9c26e00640 1 -- 172.21.15.131:0/466414788 wait complete. 2024-04-25T19:23:22.021 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T19:23:22.029 INFO:tasks.ceph.mds.d.smithi195.stderr: -8335> 2024-04-25T19:22:21.464+0000 7ff1dd000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T19:23:22.185 INFO:tasks.ceph.mds.d.smithi195.stdout:starting mds.d at 2024-04-25T19:23:22.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.289+0000 7f6428c00640 1 Processor -- start 2024-04-25T19:23:22.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.289+0000 7f6428c00640 1 -- start start 2024-04-25T19:23:22.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.291+0000 7f6428c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64240d56c0 0x7f64240b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:22.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.291+0000 7f6428c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6424160440 0x7f642406db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:22.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.291+0000 7f6428c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f642406e0a0 0x7f64240d0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:22.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.291+0000 7f6428c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f64240d43f0 con 0x7f6424160440 2024-04-25T19:23:22.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.291+0000 7f6428c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f642406e4b0 con 0x7f642406e0a0 2024-04-25T19:23:22.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.291+0000 7f6428c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f64240d37e0 con 0x7f64240d56c0 2024-04-25T19:23:22.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.292+0000 7f6422a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6424160440 0x7f642406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:22.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.292+0000 7f6422a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6424160440 0x7f642406db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56464/0 (socket says 172.21.15.131:56464) 2024-04-25T19:23:22.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.292+0000 7f6422a00640 1 -- 172.21.15.131:0/1934692180 learned_addr learned my addr 172.21.15.131:0/1934692180 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:22.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.292+0000 7f6422a00640 1 -- 172.21.15.131:0/1934692180 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64240d56c0 msgr2=0x7f64240b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:22.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.292+0000 7f6422a00640 1 --2- 172.21.15.131:0/1934692180 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64240d56c0 0x7f64240b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:22.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.292+0000 7f6422a00640 1 -- 172.21.15.131:0/1934692180 >> v2:172.21.15.195:3300/0 conn(0x7f642406e0a0 msgr2=0x7f64240d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:22.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.292+0000 7f6422a00640 1 --2- 172.21.15.131:0/1934692180 >> v2:172.21.15.195:3300/0 conn(0x7f642406e0a0 0x7f64240d0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:22.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.292+0000 7f6422a00640 1 -- 172.21.15.131:0/1934692180 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64240d3ac0 con 0x7f6424160440 2024-04-25T19:23:22.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.293+0000 7f6422a00640 1 --2- 172.21.15.131:0/1934692180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6424160440 0x7f642406db60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f642408ee30 tx=0x7f640c02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be810ce11af47f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:22.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.293+0000 7f6422000640 1 -- 172.21.15.131:0/1934692180 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640c037070 con 0x7f6424160440 2024-04-25T19:23:22.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.293+0000 7f6422000640 1 -- 172.21.15.131:0/1934692180 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f640c032440 con 0x7f6424160440 2024-04-25T19:23:22.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.293+0000 7f6422000640 1 -- 172.21.15.131:0/1934692180 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640c032810 con 0x7f6424160440 2024-04-25T19:23:22.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.294+0000 7f6428c00640 1 -- 172.21.15.131:0/1934692180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6424160440 msgr2=0x7f642406db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:22.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.294+0000 7f6428c00640 1 --2- 172.21.15.131:0/1934692180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6424160440 0x7f642406db60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f642408ee30 tx=0x7f640c02a200 comp rx=0 tx=0).stop 2024-04-25T19:23:22.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.294+0000 7f6428c00640 1 -- 172.21.15.131:0/1934692180 shutdown_connections 2024-04-25T19:23:22.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.294+0000 7f6428c00640 1 --2- 172.21.15.131:0/1934692180 >> v2:172.21.15.195:3300/0 conn(0x7f642406e0a0 0x7f64240d0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:22.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.294+0000 7f6428c00640 1 --2- 172.21.15.131:0/1934692180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6424160440 0x7f642406db60 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:22.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.294+0000 7f6428c00640 1 --2- 172.21.15.131:0/1934692180 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64240d56c0 0x7f64240b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:22.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.294+0000 7f6428c00640 1 -- 172.21.15.131:0/1934692180 >> 172.21.15.131:0/1934692180 conn(0x7f64240d2c20 msgr2=0x7f64240d5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:22.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.294+0000 7f6428c00640 1 -- 172.21.15.131:0/1934692180 shutdown_connections 2024-04-25T19:23:22.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.294+0000 7f6428c00640 1 -- 172.21.15.131:0/1934692180 wait complete. 2024-04-25T19:23:22.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.297+0000 7f6428c00640 1 Processor -- start 2024-04-25T19:23:22.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.297+0000 7f6428c00640 1 -- start start 2024-04-25T19:23:22.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.298+0000 7f6428c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f642406e0a0 0x7f64240d09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:22.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.298+0000 7f6428c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6424160440 0x7f6424152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:22.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.298+0000 7f6428c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6424161ec0 0x7f64240ce850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:22.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.298+0000 7f6428c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f64240d4880 con 0x7f642406e0a0 2024-04-25T19:23:22.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.298+0000 7f6428c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f64240d4080 con 0x7f6424161ec0 2024-04-25T19:23:22.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.298+0000 7f6428c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f64240d4a00 con 0x7f6424160440 2024-04-25T19:23:22.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.298+0000 7f6423400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f642406e0a0 0x7f64240d09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:22.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.299+0000 7f6423400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f642406e0a0 0x7f64240d09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56476/0 (socket says 172.21.15.131:56476) 2024-04-25T19:23:22.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.299+0000 7f6423400640 1 -- 172.21.15.131:0/3137598161 learned_addr learned my addr 172.21.15.131:0/3137598161 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:22.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.299+0000 7f6423400640 1 -- 172.21.15.131:0/3137598161 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6424160440 msgr2=0x7f6424152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:22.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.299+0000 7f6423400640 1 --2- 172.21.15.131:0/3137598161 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6424160440 0x7f6424152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:22.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.299+0000 7f6423400640 1 -- 172.21.15.131:0/3137598161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6424161ec0 msgr2=0x7f64240ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:22.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.299+0000 7f6423400640 1 --2- 172.21.15.131:0/3137598161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6424161ec0 0x7f64240ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:22.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.299+0000 7f6423400640 1 -- 172.21.15.131:0/3137598161 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6424153500 con 0x7f642406e0a0 2024-04-25T19:23:22.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.299+0000 7f6423400640 1 --2- 172.21.15.131:0/3137598161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f642406e0a0 0x7f64240d09e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f641400b9f0 tx=0x7f641400beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:22.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.299+0000 7f641b400640 1 -- 172.21.15.131:0/3137598161 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6414019070 con 0x7f642406e0a0 2024-04-25T19:23:22.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.300+0000 7f641b400640 1 -- 172.21.15.131:0/3137598161 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f641400cbd0 con 0x7f642406e0a0 2024-04-25T19:23:22.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.300+0000 7f6428c00640 1 -- 172.21.15.131:0/3137598161 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64241637a0 con 0x7f642406e0a0 2024-04-25T19:23:22.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.300+0000 7f641b400640 1 -- 172.21.15.131:0/3137598161 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6414014440 con 0x7f642406e0a0 2024-04-25T19:23:22.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.300+0000 7f6428c00640 1 -- 172.21.15.131:0/3137598161 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64241616c0 con 0x7f642406e0a0 2024-04-25T19:23:22.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.301+0000 7f6428c00640 1 -- 172.21.15.131:0/3137598161 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6424076c60 con 0x7f642406e0a0 2024-04-25T19:23:22.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.302+0000 7f641b400640 1 -- 172.21.15.131:0/3137598161 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f641401c070 con 0x7f642406e0a0 2024-04-25T19:23:22.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.303+0000 7f641b400640 1 --2- 172.21.15.131:0/3137598161 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f64000744b0 0x7f64000769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:22.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.303+0000 7f641b400640 1 -- 172.21.15.131:0/3137598161 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5911+0+0 (secure 0 0 0) 0x7f6414095080 con 0x7f642406e0a0 2024-04-25T19:23:22.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.303+0000 7f6422a00640 1 --2- 172.21.15.131:0/3137598161 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f64000744b0 0x7f64000769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:22.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.305+0000 7f6422a00640 1 --2- 172.21.15.131:0/3137598161 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f64000744b0 0x7f64000769c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f640c034000 tx=0x7f640c02c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:22.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.307+0000 7f641b400640 1 -- 172.21.15.131:0/3137598161 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f641405f730 con 0x7f642406e0a0 2024-04-25T19:23:22.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:22.531+0000 7f6428c00640 1 -- 172.21.15.131:0/3137598161 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f642408e260 con 0x7f642406e0a0 2024-04-25T19:23:23.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.001+0000 7f641b400640 1 -- 172.21.15.131:0/3137598161 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f641405f030 con 0x7f642406e0a0 2024-04-25T19:23:23.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.004+0000 7f6428c00640 1 -- 172.21.15.131:0/3137598161 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f64000744b0 msgr2=0x7f64000769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:23.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.004+0000 7f6428c00640 1 --2- 172.21.15.131:0/3137598161 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f64000744b0 0x7f64000769c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f640c034000 tx=0x7f640c02c000 comp rx=0 tx=0).stop 2024-04-25T19:23:23.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.005+0000 7f6428c00640 1 -- 172.21.15.131:0/3137598161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f642406e0a0 msgr2=0x7f64240d09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:23.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.005+0000 7f6428c00640 1 --2- 172.21.15.131:0/3137598161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f642406e0a0 0x7f64240d09e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f641400b9f0 tx=0x7f641400beb0 comp rx=0 tx=0).stop 2024-04-25T19:23:23.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.005+0000 7f6428c00640 1 -- 172.21.15.131:0/3137598161 shutdown_connections 2024-04-25T19:23:23.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.005+0000 7f6428c00640 1 --2- 172.21.15.131:0/3137598161 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f64000744b0 0x7f64000769c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:23.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.005+0000 7f6428c00640 1 --2- 172.21.15.131:0/3137598161 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6424160440 0x7f6424152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:23.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.005+0000 7f6428c00640 1 --2- 172.21.15.131:0/3137598161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6424161ec0 0x7f64240ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:23.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.005+0000 7f6428c00640 1 --2- 172.21.15.131:0/3137598161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f642406e0a0 0x7f64240d09e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:23.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.005+0000 7f6428c00640 1 -- 172.21.15.131:0/3137598161 >> 172.21.15.131:0/3137598161 conn(0x7f64240d2c20 msgr2=0x7f64240ba9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:23.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.005+0000 7f6428c00640 1 -- 172.21.15.131:0/3137598161 shutdown_connections 2024-04-25T19:23:23.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.005+0000 7f6428c00640 1 -- 172.21.15.131:0/3137598161 wait complete. 2024-04-25T19:23:23.042 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T19:23:23.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.317+0000 7f491d800640 1 Processor -- start 2024-04-25T19:23:23.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.318+0000 7f491d800640 1 -- start start 2024-04-25T19:23:23.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.320+0000 7f491d800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f491806d5d0 0x7f491806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:23.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.320+0000 7f491d800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f491806df20 con 0x7f49180b0a10 2024-04-25T19:23:23.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.320+0000 7f491d800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49180ce6b0 con 0x7f491815cff0 2024-04-25T19:23:23.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.320+0000 7f491d800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f49180d0480 con 0x7f491806d5d0 2024-04-25T19:23:23.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.320+0000 7f4916a00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f49180b0a10 0x7f49181615e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:47852/0 (socket says 172.21.15.131:47852) 2024-04-25T19:23:23.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.320+0000 7f4916a00640 1 -- 172.21.15.131:0/230546481 learned_addr learned my addr 172.21.15.131:0/230546481 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:23.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.321+0000 7f4916000640 1 -- 172.21.15.131:0/230546481 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2461794675 0 0) 0x7f4908001110 con 0x7f49180b0a10 2024-04-25T19:23:23.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.321+0000 7f4916000640 1 -- 172.21.15.131:0/230546481 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48f8003520 con 0x7f49180b0a10 2024-04-25T19:23:23.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.321+0000 7f4917400640 1 --2- 172.21.15.131:0/230546481 >> v2:172.21.15.195:3300/0 conn(0x7f491806d5d0 0x7f491806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:23.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.321+0000 7f4916000640 1 -- 172.21.15.131:0/230546481 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2609847282 0 0) 0x7f48f8003520 con 0x7f49180b0a10 2024-04-25T19:23:23.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.321+0000 7f4916000640 1 -- 172.21.15.131:0/230546481 >> v2:172.21.15.195:3300/0 conn(0x7f491806d5d0 msgr2=0x7f491806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:23.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.321+0000 7f4916000640 1 --2- 172.21.15.131:0/230546481 >> v2:172.21.15.195:3300/0 conn(0x7f491806d5d0 0x7f491806d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:23.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.321+0000 7f4916000640 1 -- 172.21.15.131:0/230546481 >> v1:172.21.15.195:6789/0 conn(0x7f491815cff0 legacy=0x7f49180b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:23.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.321+0000 7f4916000640 1 -- 172.21.15.131:0/230546481 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49180ce990 con 0x7f49180b0a10 2024-04-25T19:23:23.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.321+0000 7f4916000640 1 -- 172.21.15.131:0/230546481 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f4908001840 con 0x7f49180b0a10 2024-04-25T19:23:23.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.321+0000 7f4916000640 1 -- 172.21.15.131:0/230546481 >> v1:172.21.15.131:6789/0 conn(0x7f49180b0a10 legacy=0x7f49181615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:23.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.321+0000 7f4916000640 1 --2- 172.21.15.131:0/230546481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48f80039b0 0x7f48f8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:23.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.321+0000 7f4916000640 1 --2- 172.21.15.131:0/230546481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48f8004800 0x7f48f8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:23.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.321+0000 7f4916000640 1 --2- 172.21.15.131:0/230546481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48f8005300 0x7f48f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:23.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.321+0000 7f4916000640 1 -- 172.21.15.131:0/230546481 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f48f800c270 con 0x7f48f80039b0 2024-04-25T19:23:23.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.321+0000 7f4916000640 1 -- 172.21.15.131:0/230546481 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f48f800c420 con 0x7f48f8004800 2024-04-25T19:23:23.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.321+0000 7f4916000640 1 -- 172.21.15.131:0/230546481 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f48f800c620 con 0x7f48f8005300 2024-04-25T19:23:23.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.322+0000 7f4916a00640 1 --2- 172.21.15.131:0/230546481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48f80039b0 0x7f48f8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:23.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.322+0000 7f4917400640 1 --2- 172.21.15.131:0/230546481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48f8005300 0x7f48f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:23.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.322+0000 7f490fe00640 1 --2- 172.21.15.131:0/230546481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48f8004800 0x7f48f8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:23.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.322+0000 7f4916a00640 1 -- 172.21.15.131:0/230546481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48f8005300 msgr2=0x7f48f800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:23.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.322+0000 7f4916a00640 1 --2- 172.21.15.131:0/230546481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48f8005300 0x7f48f800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:23.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.322+0000 7f4916a00640 1 -- 172.21.15.131:0/230546481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48f8004800 msgr2=0x7f48f8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:23.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.322+0000 7f4916a00640 1 --2- 172.21.15.131:0/230546481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48f8004800 0x7f48f8004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:23.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.322+0000 7f4916a00640 1 -- 172.21.15.131:0/230546481 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f8003520 con 0x7f48f80039b0 2024-04-25T19:23:23.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.322+0000 7f4917400640 1 -- 172.21.15.131:0/230546481 reap_dead start 2024-04-25T19:23:23.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.323+0000 7f4916a00640 1 --2- 172.21.15.131:0/230546481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48f80039b0 0x7f48f8003e20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f490800c4c0 tx=0x7f48f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abacf7ca22cebbad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:23.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.324+0000 7f4916000640 1 -- 172.21.15.131:0/230546481 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490800c0e0 con 0x7f48f80039b0 2024-04-25T19:23:23.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.324+0000 7f4916000640 1 -- 172.21.15.131:0/230546481 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4908034070 con 0x7f48f80039b0 2024-04-25T19:23:23.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.324+0000 7f4916000640 1 -- 172.21.15.131:0/230546481 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4908005d10 con 0x7f48f80039b0 2024-04-25T19:23:23.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.324+0000 7f491d800640 1 -- 172.21.15.131:0/230546481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48f80039b0 msgr2=0x7f48f8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:23.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.324+0000 7f491d800640 1 --2- 172.21.15.131:0/230546481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48f80039b0 0x7f48f8003e20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f490800c4c0 tx=0x7f48f8005830 comp rx=0 tx=0).stop 2024-04-25T19:23:23.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.325+0000 7f491d800640 1 -- 172.21.15.131:0/230546481 shutdown_connections 2024-04-25T19:23:23.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.325+0000 7f491d800640 1 --2- 172.21.15.131:0/230546481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48f80039b0 0x7f48f8003e20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:23.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.325+0000 7f491d800640 1 -- 172.21.15.131:0/230546481 >> 172.21.15.131:0/230546481 conn(0x7f49180730b0 msgr2=0x7f49180734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:23.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.325+0000 7f491d800640 1 -- 172.21.15.131:0/230546481 shutdown_connections 2024-04-25T19:23:23.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.325+0000 7f491d800640 1 -- 172.21.15.131:0/230546481 wait complete. 2024-04-25T19:23:23.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.328+0000 7f491d800640 1 Processor -- start 2024-04-25T19:23:23.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.328+0000 7f491d800640 1 -- start start 2024-04-25T19:23:23.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.330+0000 7f491d800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48f80039b0 0x7f491815bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:23.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.330+0000 7f491d800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f491815c280 0x7f49180ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:23.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.330+0000 7f491d800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f491814a290 0x7f49180aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:23.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.330+0000 7f491d800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f491815d400 con 0x7f491815c280 2024-04-25T19:23:23.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.330+0000 7f491d800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f49180d0740 con 0x7f491814a290 2024-04-25T19:23:23.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.330+0000 7f491d800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f49180cef50 con 0x7f48f80039b0 2024-04-25T19:23:23.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.331+0000 7f490fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f491815c280 0x7f49180ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:23.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.331+0000 7f490fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f491815c280 0x7f49180ae640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56494/0 (socket says 172.21.15.131:56494) 2024-04-25T19:23:23.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.331+0000 7f490fe00640 1 -- 172.21.15.131:0/3271270816 learned_addr learned my addr 172.21.15.131:0/3271270816 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:23.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.331+0000 7f4916a00640 1 --2- 172.21.15.131:0/3271270816 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48f80039b0 0x7f491815bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:23.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.331+0000 7f4917400640 1 --2- 172.21.15.131:0/3271270816 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f491814a290 0x7f49180aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:23.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.331+0000 7f490fe00640 1 -- 172.21.15.131:0/3271270816 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48f80039b0 msgr2=0x7f491815bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:23.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.331+0000 7f490fe00640 1 --2- 172.21.15.131:0/3271270816 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48f80039b0 0x7f491815bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:23.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.331+0000 7f490fe00640 1 -- 172.21.15.131:0/3271270816 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f491814a290 msgr2=0x7f49180aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:23.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.331+0000 7f490fe00640 1 --2- 172.21.15.131:0/3271270816 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f491814a290 0x7f49180aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:23.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.331+0000 7f490fe00640 1 -- 172.21.15.131:0/3271270816 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f491815f610 con 0x7f491815c280 2024-04-25T19:23:23.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.332+0000 7f490fe00640 1 --2- 172.21.15.131:0/3271270816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f491815c280 0x7f49180ae640 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4900007fd0 tx=0x7f490000e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:23.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.332+0000 7f490ea00640 1 -- 172.21.15.131:0/3271270816 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4900019070 con 0x7f491815c280 2024-04-25T19:23:23.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.332+0000 7f490ea00640 1 -- 172.21.15.131:0/3271270816 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49000052e0 con 0x7f491815c280 2024-04-25T19:23:23.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.332+0000 7f490ea00640 1 -- 172.21.15.131:0/3271270816 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4900003810 con 0x7f491815c280 2024-04-25T19:23:23.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.332+0000 7f491d800640 1 -- 172.21.15.131:0/3271270816 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49180cdbd0 con 0x7f491815c280 2024-04-25T19:23:23.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.332+0000 7f491d800640 1 -- 172.21.15.131:0/3271270816 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f491815dd90 con 0x7f491815c280 2024-04-25T19:23:23.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.334+0000 7f491d800640 1 -- 172.21.15.131:0/3271270816 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4918050740 con 0x7f491815c280 2024-04-25T19:23:23.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.335+0000 7f490ea00640 1 -- 172.21.15.131:0/3271270816 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f490001c070 con 0x7f491815c280 2024-04-25T19:23:23.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.336+0000 7f490ea00640 1 --2- 172.21.15.131:0/3271270816 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f48f40744b0 0x7f48f40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:23.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.336+0000 7f490ea00640 1 -- 172.21.15.131:0/3271270816 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5911+0+0 (secure 0 0 0) 0x7f4900094790 con 0x7f491815c280 2024-04-25T19:23:23.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.336+0000 7f4916a00640 1 --2- 172.21.15.131:0/3271270816 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f48f40744b0 0x7f48f40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:23.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.338+0000 7f4916a00640 1 --2- 172.21.15.131:0/3271270816 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f48f40744b0 0x7f48f40769c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4908033000 tx=0x7f490802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:23.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.341+0000 7f490ea00640 1 -- 172.21.15.131:0/3271270816 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f490005e890 con 0x7f491815c280 2024-04-25T19:23:23.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:23.545+0000 7f491d800640 1 -- 172.21.15.131:0/3271270816 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f491806d390 con 0x7f491815c280 2024-04-25T19:23:24.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.532+0000 7f490ea00640 1 -- 172.21.15.131:0/3271270816 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) ==== 181+0+0 (secure 0 0 0) 0x7f4900062b90 con 0x7f491815c280 2024-04-25T19:23:24.534 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'cephfs_metadata' removed 2024-04-25T19:23:24.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.536+0000 7f491d800640 1 -- 172.21.15.131:0/3271270816 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f48f40744b0 msgr2=0x7f48f40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:24.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.536+0000 7f491d800640 1 --2- 172.21.15.131:0/3271270816 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f48f40744b0 0x7f48f40769c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4908033000 tx=0x7f490802e000 comp rx=0 tx=0).stop 2024-04-25T19:23:24.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.536+0000 7f491d800640 1 -- 172.21.15.131:0/3271270816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f491815c280 msgr2=0x7f49180ae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:24.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.536+0000 7f491d800640 1 --2- 172.21.15.131:0/3271270816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f491815c280 0x7f49180ae640 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4900007fd0 tx=0x7f490000e8a0 comp rx=0 tx=0).stop 2024-04-25T19:23:24.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.537+0000 7f491d800640 1 -- 172.21.15.131:0/3271270816 shutdown_connections 2024-04-25T19:23:24.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.537+0000 7f491d800640 1 --2- 172.21.15.131:0/3271270816 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f48f40744b0 0x7f48f40769c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:24.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.537+0000 7f491d800640 1 --2- 172.21.15.131:0/3271270816 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f491814a290 0x7f49180aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:24.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.537+0000 7f491d800640 1 --2- 172.21.15.131:0/3271270816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f491815c280 0x7f49180ae640 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:24.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.537+0000 7f491d800640 1 --2- 172.21.15.131:0/3271270816 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48f80039b0 0x7f491815bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:24.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.537+0000 7f491d800640 1 -- 172.21.15.131:0/3271270816 >> 172.21.15.131:0/3271270816 conn(0x7f49180730b0 msgr2=0x7f491806cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:24.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.537+0000 7f491d800640 1 -- 172.21.15.131:0/3271270816 shutdown_connections 2024-04-25T19:23:24.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.538+0000 7f491d800640 1 -- 172.21.15.131:0/3271270816 wait complete. 2024-04-25T19:23:24.571 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T19:23:24.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.848+0000 7f1149e00640 1 Processor -- start 2024-04-25T19:23:24.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.848+0000 7f1149e00640 1 -- start start 2024-04-25T19:23:24.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.850+0000 7f1149e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11440ce250 0x7f114415cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:24.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.850+0000 7f1149e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f11441458c0 0x7f1144073bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:24.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.850+0000 7f1149e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1144145cd0 con 0x7f11440b47b0 2024-04-25T19:23:24.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.850+0000 7f1149e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f114415d5c0 con 0x7f11441458c0 2024-04-25T19:23:24.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.850+0000 7f1149e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f114415d8a0 con 0x7f11440ce250 2024-04-25T19:23:24.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.851+0000 7f1142a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11440ce250 0x7f114415cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:24.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.851+0000 7f1142a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11440ce250 0x7f114415cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.131:47642/0 (socket says 172.21.15.131:47642) 2024-04-25T19:23:24.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.851+0000 7f1142a00640 1 -- 172.21.15.131:0/4088291994 learned_addr learned my addr 172.21.15.131:0/4088291994 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:24.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.851+0000 7f1142000640 1 --2- 172.21.15.131:0/4088291994 >> v2:172.21.15.195:3300/0 conn(0x7f11441458c0 0x7f1144073bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:24.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.852+0000 7f1142000640 1 -- 172.21.15.131:0/4088291994 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11440ce250 msgr2=0x7f114415cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:24.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.852+0000 7f1142000640 1 --2- 172.21.15.131:0/4088291994 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11440ce250 0x7f114415cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:24.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.852+0000 7f1142000640 1 -- 172.21.15.131:0/4088291994 >> v1:172.21.15.195:6789/0 conn(0x7f11440b47b0 legacy=0x7f114406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:24.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.852+0000 7f1142000640 1 -- 172.21.15.131:0/4088291994 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f114415db80 con 0x7f11441458c0 2024-04-25T19:23:24.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.852+0000 7f1142a00640 1 --2- 172.21.15.131:0/4088291994 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11440ce250 0x7f114415cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T19:23:24.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.853+0000 7f1142000640 1 --2- 172.21.15.131:0/4088291994 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11441458c0 0x7f1144073bb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f112c0097a0 tx=0x7f112c02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dfa672c6d2f516b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:24.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.854+0000 7f1141600640 1 -- 172.21.15.131:0/4088291994 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c037070 con 0x7f11441458c0 2024-04-25T19:23:24.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.854+0000 7f1141600640 1 -- 172.21.15.131:0/4088291994 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f112c02ae50 con 0x7f11441458c0 2024-04-25T19:23:24.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.854+0000 7f1141600640 1 -- 172.21.15.131:0/4088291994 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c032660 con 0x7f11441458c0 2024-04-25T19:23:24.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.854+0000 7f1149e00640 1 -- 172.21.15.131:0/4088291994 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11441458c0 msgr2=0x7f1144073bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:24.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.854+0000 7f1149e00640 1 --2- 172.21.15.131:0/4088291994 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11441458c0 0x7f1144073bb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f112c0097a0 tx=0x7f112c02a100 comp rx=0 tx=0).stop 2024-04-25T19:23:24.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.854+0000 7f1149e00640 1 -- 172.21.15.131:0/4088291994 shutdown_connections 2024-04-25T19:23:24.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.854+0000 7f1149e00640 1 --2- 172.21.15.131:0/4088291994 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11441458c0 0x7f1144073bb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:24.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.854+0000 7f1149e00640 1 --2- 172.21.15.131:0/4088291994 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11440ce250 0x7f114415cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:24.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.854+0000 7f1149e00640 1 -- 172.21.15.131:0/4088291994 >> 172.21.15.131:0/4088291994 conn(0x7f1144073090 msgr2=0x7f11440734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:24.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.855+0000 7f1149e00640 1 -- 172.21.15.131:0/4088291994 shutdown_connections 2024-04-25T19:23:24.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.855+0000 7f1149e00640 1 -- 172.21.15.131:0/4088291994 wait complete. 2024-04-25T19:23:24.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.857+0000 7f1149e00640 1 Processor -- start 2024-04-25T19:23:24.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.857+0000 7f1149e00640 1 -- start start 2024-04-25T19:23:24.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.859+0000 7f1149e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11440b47b0 0x7f114413dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:24.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.859+0000 7f1149e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11440ce250 0x7f11441f86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:24.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.859+0000 7f1149e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11441458c0 0x7f114415b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:24.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.859+0000 7f1149e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1144071310 con 0x7f11440b47b0 2024-04-25T19:23:24.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.859+0000 7f1149e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f114415de60 con 0x7f11441458c0 2024-04-25T19:23:24.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.859+0000 7f1149e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f11440740f0 con 0x7f11440ce250 2024-04-25T19:23:24.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.859+0000 7f1142a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11440b47b0 0x7f114413dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:24.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.859+0000 7f1142a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11440b47b0 0x7f114413dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56502/0 (socket says 172.21.15.131:56502) 2024-04-25T19:23:24.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.859+0000 7f1142a00640 1 -- 172.21.15.131:0/2237863315 learned_addr learned my addr 172.21.15.131:0/2237863315 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:24.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.859+0000 7f1142000640 1 --2- 172.21.15.131:0/2237863315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11440ce250 0x7f11441f86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:24.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.859+0000 7f1143400640 1 --2- 172.21.15.131:0/2237863315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11441458c0 0x7f114415b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:24.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.860+0000 7f1142a00640 1 -- 172.21.15.131:0/2237863315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11440ce250 msgr2=0x7f11441f86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:24.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.860+0000 7f1142a00640 1 --2- 172.21.15.131:0/2237863315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11440ce250 0x7f11441f86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:24.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.860+0000 7f1142a00640 1 -- 172.21.15.131:0/2237863315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11441458c0 msgr2=0x7f114415b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:24.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.860+0000 7f1142a00640 1 --2- 172.21.15.131:0/2237863315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11441458c0 0x7f114415b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:24.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.860+0000 7f1142a00640 1 -- 172.21.15.131:0/2237863315 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11440aa230 con 0x7f11440b47b0 2024-04-25T19:23:24.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.860+0000 7f1142a00640 1 --2- 172.21.15.131:0/2237863315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11440b47b0 0x7f114413dc30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f113400e900 tx=0x7f113400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:24.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.860+0000 7f113b400640 1 -- 172.21.15.131:0/2237863315 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1134017070 con 0x7f11440b47b0 2024-04-25T19:23:24.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.860+0000 7f113b400640 1 -- 172.21.15.131:0/2237863315 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f113400ca00 con 0x7f11440b47b0 2024-04-25T19:23:24.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.860+0000 7f113b400640 1 -- 172.21.15.131:0/2237863315 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113400cdf0 con 0x7f11440b47b0 2024-04-25T19:23:24.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.860+0000 7f1149e00640 1 -- 172.21.15.131:0/2237863315 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11440aa510 con 0x7f11440b47b0 2024-04-25T19:23:24.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.860+0000 7f1149e00640 1 -- 172.21.15.131:0/2237863315 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f114413e270 con 0x7f11440b47b0 2024-04-25T19:23:24.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.862+0000 7f1149e00640 1 -- 172.21.15.131:0/2237863315 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11441f4630 con 0x7f11440b47b0 2024-04-25T19:23:24.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.863+0000 7f113b400640 1 -- 172.21.15.131:0/2237863315 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f113401a070 con 0x7f11440b47b0 2024-04-25T19:23:24.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.864+0000 7f113b400640 1 --2- 172.21.15.131:0/2237863315 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f11200744e0 0x7f11200769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:24.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.865+0000 7f113b400640 1 -- 172.21.15.131:0/2237863315 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5473+0+0 (secure 0 0 0) 0x7f1134095400 con 0x7f11440b47b0 2024-04-25T19:23:24.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.865+0000 7f1142000640 1 --2- 172.21.15.131:0/2237863315 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f11200744e0 0x7f11200769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:24.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.866+0000 7f1142000640 1 --2- 172.21.15.131:0/2237863315 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f11200744e0 0x7f11200769f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f112c034000 tx=0x7f112c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:24.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:24.869+0000 7f113b400640 1 -- 172.21.15.131:0/2237863315 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f113405fbd0 con 0x7f11440b47b0 2024-04-25T19:23:25.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.074+0000 7f1149e00640 1 -- 172.21.15.131:0/2237863315 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f114413e4d0 con 0x7f11440b47b0 2024-04-25T19:23:25.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.536+0000 7f113b400640 1 -- 172.21.15.131:0/2237863315 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) ==== 169+0+0 (secure 0 0 0) 0x7f113405f4d0 con 0x7f11440b47b0 2024-04-25T19:23:25.538 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'cephfs_data' removed 2024-04-25T19:23:25.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.539+0000 7f1149e00640 1 -- 172.21.15.131:0/2237863315 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f11200744e0 msgr2=0x7f11200769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:25.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.539+0000 7f1149e00640 1 --2- 172.21.15.131:0/2237863315 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f11200744e0 0x7f11200769f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f112c034000 tx=0x7f112c02e000 comp rx=0 tx=0).stop 2024-04-25T19:23:25.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.539+0000 7f1149e00640 1 -- 172.21.15.131:0/2237863315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11440b47b0 msgr2=0x7f114413dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:25.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.539+0000 7f1149e00640 1 --2- 172.21.15.131:0/2237863315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11440b47b0 0x7f114413dc30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f113400e900 tx=0x7f113400edc0 comp rx=0 tx=0).stop 2024-04-25T19:23:25.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.540+0000 7f1149e00640 1 -- 172.21.15.131:0/2237863315 shutdown_connections 2024-04-25T19:23:25.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.540+0000 7f1149e00640 1 --2- 172.21.15.131:0/2237863315 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f11200744e0 0x7f11200769f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:25.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.540+0000 7f1149e00640 1 --2- 172.21.15.131:0/2237863315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11440ce250 0x7f11441f86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:25.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.540+0000 7f1149e00640 1 --2- 172.21.15.131:0/2237863315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11441458c0 0x7f114415b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:25.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.540+0000 7f1149e00640 1 --2- 172.21.15.131:0/2237863315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11440b47b0 0x7f114413dc30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:25.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.540+0000 7f1149e00640 1 -- 172.21.15.131:0/2237863315 >> 172.21.15.131:0/2237863315 conn(0x7f1144073090 msgr2=0x7f1144141700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:25.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.540+0000 7f1149e00640 1 -- 172.21.15.131:0/2237863315 shutdown_connections 2024-04-25T19:23:25.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.540+0000 7f1149e00640 1 -- 172.21.15.131:0/2237863315 wait complete. 2024-04-25T19:23:25.588 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T19:23:25.588 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T19:23:25.588 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T19:23:25.588 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T19:23:25.588 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T19:23:25.588 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T19:23:25.589 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T19:23:25.589 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T19:23:25.589 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T19:23:25.589 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T19:23:25.590 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T19:23:25.590 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T19:23:25.590 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T19:23:25.590 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T19:23:25.590 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T19:23:25.591 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T19:23:25.614 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T19:23:25.615 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T19:23:25.616 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T19:23:25.616 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T19:23:25.620 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T19:23:25.620 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T19:23:25.625 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T19:23:25.625 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T19:23:25.662 INFO:tasks.ceph.mds.b:Started 2024-04-25T19:23:25.663 DEBUG:teuthology.parallel:result is None 2024-04-25T19:23:25.669 INFO:tasks.ceph.mds.d:Started 2024-04-25T19:23:25.669 DEBUG:teuthology.parallel:result is None 2024-04-25T19:23:25.670 INFO:tasks.ceph.mds.c:Started 2024-04-25T19:23:25.670 DEBUG:teuthology.parallel:result is None 2024-04-25T19:23:25.674 INFO:tasks.ceph.mds.a:Started 2024-04-25T19:23:25.674 DEBUG:teuthology.parallel:result is None 2024-04-25T19:23:25.674 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T19:23:25.887 INFO:tasks.ceph.mds.b.smithi195.stdout:starting mds.b at 2024-04-25T19:23:25.889 INFO:tasks.ceph.mds.a.smithi131.stdout:starting mds.a at 2024-04-25T19:23:25.889 INFO:tasks.ceph.mds.c.smithi131.stdout:starting mds.c at 2024-04-25T19:23:25.891 INFO:tasks.ceph.mds.d.smithi195.stdout:starting mds.d at 2024-04-25T19:23:25.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.924+0000 7f94f7c00640 1 Processor -- start 2024-04-25T19:23:25.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.924+0000 7f94f7c00640 1 -- start start 2024-04-25T19:23:25.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.926+0000 7f94f7c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94f0070680 0x7f94f01647f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:25.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.926+0000 7f94f7c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f94f0160360 0x7f94f00af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:25.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.926+0000 7f94f7c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94f006c7d0 con 0x7f94f00af9e0 2024-04-25T19:23:25.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.926+0000 7f94f7c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f94f006d100 con 0x7f94f0160360 2024-04-25T19:23:25.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.926+0000 7f94f7c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f94f006cab0 con 0x7f94f0070680 2024-04-25T19:23:25.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.927+0000 7f94e7e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f94f0160360 0x7f94f00af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:25.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.927+0000 7f94e7e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f94f0160360 0x7f94f00af4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.131:51626/0 (socket says 172.21.15.131:51626) 2024-04-25T19:23:25.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.927+0000 7f94e7e00640 1 -- 172.21.15.131:0/430941381 learned_addr learned my addr 172.21.15.131:0/430941381 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:25.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.927+0000 7f94f5200640 1 --2- 172.21.15.131:0/430941381 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94f0070680 0x7f94f01647f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:25.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.927+0000 7f94e7e00640 1 -- 172.21.15.131:0/430941381 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94f0070680 msgr2=0x7f94f01647f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:25.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.927+0000 7f94e7e00640 1 --2- 172.21.15.131:0/430941381 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94f0070680 0x7f94f01647f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:25.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.927+0000 7f94e7e00640 1 -- 172.21.15.131:0/430941381 >> v1:172.21.15.195:6789/0 conn(0x7f94f00af9e0 legacy=0x7f94f00b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:25.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.927+0000 7f94e7e00640 1 -- 172.21.15.131:0/430941381 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f006cd90 con 0x7f94f0160360 2024-04-25T19:23:25.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.927+0000 7f94efe00640 1 -- 172.21.15.131:0/430941381 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2284773034 0 0) 0x7f94f006c7d0 con 0x7f94f00af9e0 2024-04-25T19:23:25.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.928+0000 7f94e7e00640 1 --2- 172.21.15.131:0/430941381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94f0160360 0x7f94f00af4a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009870 tx=0x7f94d802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70f4929dcdbaf7c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:25.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.929+0000 7f94efe00640 1 -- 172.21.15.131:0/430941381 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d8037070 con 0x7f94f0160360 2024-04-25T19:23:25.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.929+0000 7f94efe00640 1 -- 172.21.15.131:0/430941381 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d8032440 con 0x7f94f0160360 2024-04-25T19:23:25.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.929+0000 7f94efe00640 1 -- 172.21.15.131:0/430941381 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d8032810 con 0x7f94f0160360 2024-04-25T19:23:25.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.929+0000 7f94f7c00640 1 -- 172.21.15.131:0/430941381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94f0160360 msgr2=0x7f94f00af4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:25.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.929+0000 7f94f7c00640 1 --2- 172.21.15.131:0/430941381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94f0160360 0x7f94f00af4a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009870 tx=0x7f94d802a130 comp rx=0 tx=0).stop 2024-04-25T19:23:25.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.930+0000 7f94f7c00640 1 -- 172.21.15.131:0/430941381 shutdown_connections 2024-04-25T19:23:25.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.930+0000 7f94f7c00640 1 --2- 172.21.15.131:0/430941381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94f0160360 0x7f94f00af4a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:25.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.930+0000 7f94f7c00640 1 --2- 172.21.15.131:0/430941381 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94f0070680 0x7f94f01647f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:25.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.930+0000 7f94f7c00640 1 -- 172.21.15.131:0/430941381 >> 172.21.15.131:0/430941381 conn(0x7f94f00d1ae0 msgr2=0x7f94f00d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:25.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.930+0000 7f94f7c00640 1 -- 172.21.15.131:0/430941381 shutdown_connections 2024-04-25T19:23:25.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.930+0000 7f94f7c00640 1 -- 172.21.15.131:0/430941381 wait complete. 2024-04-25T19:23:25.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.932+0000 7f94f7c00640 1 Processor -- start 2024-04-25T19:23:25.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.932+0000 7f94f7c00640 1 -- start start 2024-04-25T19:23:25.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.934+0000 7f94f7c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94f0070680 0x7f94f0162020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:25.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.934+0000 7f94f7c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94f00af9e0 0x7f94f00afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:25.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.934+0000 7f94f7c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94f0160360 0x7f94f00b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:25.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.934+0000 7f94f7c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f94f00b6520 con 0x7f94f0070680 2024-04-25T19:23:25.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.934+0000 7f94f7c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f94f00b63a0 con 0x7f94f0160360 2024-04-25T19:23:25.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.934+0000 7f94f7c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f94f006d590 con 0x7f94f00af9e0 2024-04-25T19:23:25.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.934+0000 7f94f5200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94f0070680 0x7f94f0162020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:25.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.934+0000 7f94f5200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94f0070680 0x7f94f0162020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56538/0 (socket says 172.21.15.131:56538) 2024-04-25T19:23:25.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.934+0000 7f94f5200640 1 -- 172.21.15.131:0/1034280415 learned_addr learned my addr 172.21.15.131:0/1034280415 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:25.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.934+0000 7f94f5c00640 1 --2- 172.21.15.131:0/1034280415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94f0160360 0x7f94f00b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:25.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.934+0000 7f94e7e00640 1 --2- 172.21.15.131:0/1034280415 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94f00af9e0 0x7f94f00afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:25.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.934+0000 7f94f5200640 1 -- 172.21.15.131:0/1034280415 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94f00af9e0 msgr2=0x7f94f00afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:25.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.934+0000 7f94f5200640 1 --2- 172.21.15.131:0/1034280415 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94f00af9e0 0x7f94f00afdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:25.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.934+0000 7f94f5200640 1 -- 172.21.15.131:0/1034280415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94f0160360 msgr2=0x7f94f00b0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:25.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.934+0000 7f94f5200640 1 --2- 172.21.15.131:0/1034280415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94f0160360 0x7f94f00b0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:25.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.934+0000 7f94f5200640 1 -- 172.21.15.131:0/1034280415 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f00c8130 con 0x7f94f0070680 2024-04-25T19:23:25.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.935+0000 7f94f5200640 1 --2- 172.21.15.131:0/1034280415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94f0070680 0x7f94f0162020 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f94e000e870 tx=0x7f94e000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:25.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.935+0000 7f94ed600640 1 -- 172.21.15.131:0/1034280415 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e0017070 con 0x7f94f0070680 2024-04-25T19:23:25.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.935+0000 7f94ed600640 1 -- 172.21.15.131:0/1034280415 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e000c940 con 0x7f94f0070680 2024-04-25T19:23:25.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.935+0000 7f94ed600640 1 -- 172.21.15.131:0/1034280415 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e000cd10 con 0x7f94f0070680 2024-04-25T19:23:25.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.935+0000 7f94f7c00640 1 -- 172.21.15.131:0/1034280415 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94f00c8410 con 0x7f94f0070680 2024-04-25T19:23:25.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.935+0000 7f94f7c00640 1 -- 172.21.15.131:0/1034280415 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94f00c89d0 con 0x7f94f0070680 2024-04-25T19:23:25.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.937+0000 7f94f7c00640 1 -- 172.21.15.131:0/1034280415 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94f0050740 con 0x7f94f0070680 2024-04-25T19:23:25.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.938+0000 7f94ed600640 1 -- 172.21.15.131:0/1034280415 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f94e001a070 con 0x7f94f0070680 2024-04-25T19:23:25.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.939+0000 7f94ed600640 1 --2- 172.21.15.131:0/1034280415 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f94cc0744b0 0x7f94cc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:25.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.939+0000 7f94ed600640 1 -- 172.21.15.131:0/1034280415 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4943+0+0 (secure 0 0 0) 0x7f94e00950c0 con 0x7f94f0070680 2024-04-25T19:23:25.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.940+0000 7f94e7e00640 1 --2- 172.21.15.131:0/1034280415 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f94cc0744b0 0x7f94cc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:25.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.941+0000 7f94e7e00640 1 --2- 172.21.15.131:0/1034280415 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f94cc0744b0 0x7f94cc0769c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f94d8034000 tx=0x7f94d802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:25.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:25.944+0000 7f94ed600640 1 -- 172.21.15.131:0/1034280415 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f94e005f4f0 con 0x7f94f0070680 2024-04-25T19:23:26.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.159+0000 7f94f7c00640 1 -- 172.21.15.131:0/1034280415 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f94f006f620 con 0x7f94f0070680 2024-04-25T19:23:26.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.582+0000 7f94ed600640 1 -- 172.21.15.131:0/1034280415 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) ==== 97+0+0 (secure 0 0 0) 0x7f94e00637f0 con 0x7f94f0070680 2024-04-25T19:23:26.584 INFO:teuthology.orchestra.run.smithi131.stderr: removed all blocklist entries 2024-04-25T19:23:26.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.586+0000 7f94f7c00640 1 -- 172.21.15.131:0/1034280415 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f94cc0744b0 msgr2=0x7f94cc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:26.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.586+0000 7f94f7c00640 1 --2- 172.21.15.131:0/1034280415 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f94cc0744b0 0x7f94cc0769c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f94d8034000 tx=0x7f94d802e000 comp rx=0 tx=0).stop 2024-04-25T19:23:26.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.586+0000 7f94f7c00640 1 -- 172.21.15.131:0/1034280415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94f0070680 msgr2=0x7f94f0162020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:26.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.586+0000 7f94f7c00640 1 --2- 172.21.15.131:0/1034280415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94f0070680 0x7f94f0162020 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f94e000e870 tx=0x7f94e000ed30 comp rx=0 tx=0).stop 2024-04-25T19:23:26.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.586+0000 7f94f7c00640 1 -- 172.21.15.131:0/1034280415 shutdown_connections 2024-04-25T19:23:26.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.586+0000 7f94f7c00640 1 --2- 172.21.15.131:0/1034280415 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f94cc0744b0 0x7f94cc0769c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:26.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.586+0000 7f94f7c00640 1 --2- 172.21.15.131:0/1034280415 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94f00af9e0 0x7f94f00afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:26.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.586+0000 7f94f7c00640 1 --2- 172.21.15.131:0/1034280415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94f0160360 0x7f94f00b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:26.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.586+0000 7f94f7c00640 1 --2- 172.21.15.131:0/1034280415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94f0070680 0x7f94f0162020 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:26.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.586+0000 7f94f7c00640 1 -- 172.21.15.131:0/1034280415 >> 172.21.15.131:0/1034280415 conn(0x7f94f00d1ae0 msgr2=0x7f94f00b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:26.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.586+0000 7f94f7c00640 1 -- 172.21.15.131:0/1034280415 shutdown_connections 2024-04-25T19:23:26.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.586+0000 7f94f7c00640 1 -- 172.21.15.131:0/1034280415 wait complete. 2024-04-25T19:23:26.623 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T19:23:26.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.877+0000 7f2f13200640 1 Processor -- start 2024-04-25T19:23:26.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.877+0000 7f2f13200640 1 -- start start 2024-04-25T19:23:26.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.880+0000 7f2f13200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2f140d1040 0x7f2f14142e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:26.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.880+0000 7f2f13200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f1415d5e0 con 0x7f2f1406dce0 2024-04-25T19:23:26.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.880+0000 7f2f13200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f1415d8c0 con 0x7f2f1413fe10 2024-04-25T19:23:26.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.880+0000 7f2f13200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f2f1415dba0 con 0x7f2f140d1040 2024-04-25T19:23:26.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.880+0000 7f2f0be00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f2f1406dce0 0x7f2f14142730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:47880/0 (socket says 172.21.15.131:47880) 2024-04-25T19:23:26.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.880+0000 7f2f0be00640 1 -- 172.21.15.131:0/927437128 learned_addr learned my addr 172.21.15.131:0/927437128 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:26.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.880+0000 7f2f12800640 1 --2- 172.21.15.131:0/927437128 >> v2:172.21.15.195:3300/0 conn(0x7f2f140d1040 0x7f2f14142e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:26.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.880+0000 7f2f11400640 1 -- 172.21.15.131:0/927437128 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4158149543 0 0) 0x7f2f1415d5e0 con 0x7f2f1406dce0 2024-04-25T19:23:26.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.881+0000 7f2f11400640 1 -- 172.21.15.131:0/927437128 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ef8003520 con 0x7f2f1406dce0 2024-04-25T19:23:26.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.881+0000 7f2f11400640 1 -- 172.21.15.131:0/927437128 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1921665889 0 0) 0x7f2ef8003520 con 0x7f2f1406dce0 2024-04-25T19:23:26.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.881+0000 7f2f11400640 1 -- 172.21.15.131:0/927437128 >> v2:172.21.15.195:3300/0 conn(0x7f2f140d1040 msgr2=0x7f2f14142e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:26.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.881+0000 7f2f11400640 1 --2- 172.21.15.131:0/927437128 >> v2:172.21.15.195:3300/0 conn(0x7f2f140d1040 0x7f2f14142e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:26.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.881+0000 7f2f11400640 1 -- 172.21.15.131:0/927437128 >> v1:172.21.15.195:6789/0 conn(0x7f2f1413fe10 legacy=0x7f2f1406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:26.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.881+0000 7f2f11400640 1 -- 172.21.15.131:0/927437128 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1415de80 con 0x7f2f1406dce0 2024-04-25T19:23:26.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.881+0000 7f2f11400640 1 -- 172.21.15.131:0/927437128 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f2efc001670 con 0x7f2f1406dce0 2024-04-25T19:23:26.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.881+0000 7f2f11400640 1 -- 172.21.15.131:0/927437128 >> v1:172.21.15.131:6789/0 conn(0x7f2f1406dce0 legacy=0x7f2f14142730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:26.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.881+0000 7f2f11400640 1 --2- 172.21.15.131:0/927437128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ef8003a00 0x7f2ef8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:26.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.881+0000 7f2f11400640 1 --2- 172.21.15.131:0/927437128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ef8004800 0x7f2ef8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:26.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.881+0000 7f2f11400640 1 --2- 172.21.15.131:0/927437128 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2ef80052a0 0x7f2ef800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:26.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.881+0000 7f2f11400640 1 -- 172.21.15.131:0/927437128 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1415dba0 con 0x7f2ef8003a00 2024-04-25T19:23:26.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.881+0000 7f2f11400640 1 -- 172.21.15.131:0/927437128 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef800c230 con 0x7f2ef8004800 2024-04-25T19:23:26.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.881+0000 7f2f11400640 1 -- 172.21.15.131:0/927437128 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2ef800c430 con 0x7f2ef80052a0 2024-04-25T19:23:26.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.881+0000 7f2f11e00640 1 --2- 172.21.15.131:0/927437128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ef8003a00 0x7f2ef8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:26.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.882+0000 7f2f11e00640 1 -- 172.21.15.131:0/927437128 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2ef80052a0 msgr2=0x7f2ef800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:26.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.882+0000 7f2f11e00640 1 --2- 172.21.15.131:0/927437128 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2ef80052a0 0x7f2ef800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:26.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.882+0000 7f2f0be00640 1 --2- 172.21.15.131:0/927437128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ef8004800 0x7f2ef8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:26.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.882+0000 7f2f11e00640 1 -- 172.21.15.131:0/927437128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ef8004800 msgr2=0x7f2ef8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:26.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.882+0000 7f2f11e00640 1 --2- 172.21.15.131:0/927437128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ef8004800 0x7f2ef8004c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:26.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.882+0000 7f2f11e00640 1 -- 172.21.15.131:0/927437128 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef8003520 con 0x7f2ef8003a00 2024-04-25T19:23:26.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.882+0000 7f2f12800640 1 -- 172.21.15.131:0/927437128 reap_dead start 2024-04-25T19:23:26.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.883+0000 7f2f11e00640 1 --2- 172.21.15.131:0/927437128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ef8003a00 0x7f2ef8003e70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2f04001720 tx=0x7f2ef8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560118f46c17b2fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:26.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.883+0000 7f2f11400640 1 -- 172.21.15.131:0/927437128 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f04001370 con 0x7f2ef8003a00 2024-04-25T19:23:26.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.883+0000 7f2f11400640 1 -- 172.21.15.131:0/927437128 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f040052d0 con 0x7f2ef8003a00 2024-04-25T19:23:26.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.883+0000 7f2f11400640 1 -- 172.21.15.131:0/927437128 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0402abc0 con 0x7f2ef8003a00 2024-04-25T19:23:26.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.884+0000 7f2f13200640 1 -- 172.21.15.131:0/927437128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ef8003a00 msgr2=0x7f2ef8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:26.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.884+0000 7f2f13200640 1 --2- 172.21.15.131:0/927437128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ef8003a00 0x7f2ef8003e70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2f04001720 tx=0x7f2ef8005830 comp rx=0 tx=0).stop 2024-04-25T19:23:26.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.884+0000 7f2f13200640 1 -- 172.21.15.131:0/927437128 shutdown_connections 2024-04-25T19:23:26.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.884+0000 7f2f13200640 1 --2- 172.21.15.131:0/927437128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ef8003a00 0x7f2ef8003e70 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:26.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.884+0000 7f2f13200640 1 -- 172.21.15.131:0/927437128 >> 172.21.15.131:0/927437128 conn(0x7f2f14072ee0 msgr2=0x7f2f140732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:26.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.884+0000 7f2f13200640 1 -- 172.21.15.131:0/927437128 shutdown_connections 2024-04-25T19:23:26.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.884+0000 7f2f13200640 1 -- 172.21.15.131:0/927437128 wait complete. 2024-04-25T19:23:26.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.887+0000 7f2f13200640 1 Processor -- start 2024-04-25T19:23:26.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.887+0000 7f2f13200640 1 -- start start 2024-04-25T19:23:26.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.888+0000 7f2f13200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2ef8003a00 0x7f2f141f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.888+0000 7f2f13200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f14135c90 0x7f2f141423a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.888+0000 7f2f13200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f141428e0 0x7f2f14154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.888+0000 7f2f13200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1406d750 con 0x7f2f14135c90 2024-04-25T19:23:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.888+0000 7f2f13200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1406d5d0 con 0x7f2f141428e0 2024-04-25T19:23:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.888+0000 7f2f13200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2f1406d8d0 con 0x7f2ef8003a00 2024-04-25T19:23:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.889+0000 7f2f0be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f14135c90 0x7f2f141423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.889+0000 7f2f0be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f14135c90 0x7f2f141423a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56558/0 (socket says 172.21.15.131:56558) 2024-04-25T19:23:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.889+0000 7f2f0be00640 1 -- 172.21.15.131:0/1302272163 learned_addr learned my addr 172.21.15.131:0/1302272163 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.889+0000 7f2f0be00640 1 -- 172.21.15.131:0/1302272163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2ef8003a00 msgr2=0x7f2f141f3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.889+0000 7f2f0be00640 1 --2- 172.21.15.131:0/1302272163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2ef8003a00 0x7f2f141f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.889+0000 7f2f0be00640 1 -- 172.21.15.131:0/1302272163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f141428e0 msgr2=0x7f2f14154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.889+0000 7f2f0be00640 1 --2- 172.21.15.131:0/1302272163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f141428e0 0x7f2f14154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:26.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.889+0000 7f2f0be00640 1 -- 172.21.15.131:0/1302272163 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f14142cf0 con 0x7f2f14135c90 2024-04-25T19:23:26.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.889+0000 7f2f0be00640 1 --2- 172.21.15.131:0/1302272163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f14135c90 0x7f2f141423a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00d7d0 tx=0x7f2efc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:26.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.890+0000 7f2f0a000640 1 -- 172.21.15.131:0/1302272163 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2efc019070 con 0x7f2f14135c90 2024-04-25T19:23:26.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.890+0000 7f2f0a000640 1 -- 172.21.15.131:0/1302272163 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2efc0074e0 con 0x7f2f14135c90 2024-04-25T19:23:26.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.890+0000 7f2f0a000640 1 -- 172.21.15.131:0/1302272163 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0049e0 con 0x7f2f14135c90 2024-04-25T19:23:26.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.890+0000 7f2f13200640 1 -- 172.21.15.131:0/1302272163 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f141f3fc0 con 0x7f2f14135c90 2024-04-25T19:23:26.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.890+0000 7f2f13200640 1 -- 172.21.15.131:0/1302272163 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f1413a310 con 0x7f2f14135c90 2024-04-25T19:23:26.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.891+0000 7f2f13200640 1 -- 172.21.15.131:0/1302272163 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f14050740 con 0x7f2f14135c90 2024-04-25T19:23:26.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.892+0000 7f2f0a000640 1 -- 172.21.15.131:0/1302272163 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2efc004b80 con 0x7f2f14135c90 2024-04-25T19:23:26.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.893+0000 7f2f0a000640 1 --2- 172.21.15.131:0/1302272163 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2ef00744e0 0x7f2ef00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:26.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.893+0000 7f2f0a000640 1 -- 172.21.15.131:0/1302272163 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f2efc0947c0 con 0x7f2f14135c90 2024-04-25T19:23:26.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.894+0000 7f2f11e00640 1 --2- 172.21.15.131:0/1302272163 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2ef00744e0 0x7f2ef00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:26.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.895+0000 7f2f11e00640 1 --2- 172.21.15.131:0/1302272163 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2ef00744e0 0x7f2ef00769f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2f04032000 tx=0x7f2f0402c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:26.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:26.898+0000 7f2f0a000640 1 -- 172.21.15.131:0/1302272163 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2f14142cf0 con 0x7f2f14135c90 2024-04-25T19:23:27.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.170+0000 7f2f13200640 1 -- 172.21.15.131:0/1302272163 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f2f140b5350 con 0x7f2f14135c90 2024-04-25T19:23:27.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.172+0000 7f2f0a000640 1 -- 172.21.15.131:0/1302272163 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7f2efc05f290 con 0x7f2f14135c90 2024-04-25T19:23:27.173 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:27.173 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-25T19:23:27.174 INFO:teuthology.orchestra.run.smithi131.stdout: "auth_dump": [ 2024-04-25T19:23:27.174 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:27.174 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "mds.a", 2024-04-25T19:23:27.174 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAlrSpmqg5cNxAAWJ0TNKbWYEtA7s5RxJ6Fhg==", 2024-04-25T19:23:27.174 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:23:27.174 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow", 2024-04-25T19:23:27.174 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow *", 2024-04-25T19:23:27.174 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow *", 2024-04-25T19:23:27.174 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:23:27.174 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.174 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:23:27.174 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:27.174 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "mds.b", 2024-04-25T19:23:27.175 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAmrSpmPcS8IxAA0/2QnmpsJxkbZGtvgPzigA==", 2024-04-25T19:23:27.175 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:23:27.175 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow", 2024-04-25T19:23:27.175 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow *", 2024-04-25T19:23:27.175 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow *", 2024-04-25T19:23:27.175 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:23:27.175 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.175 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:23:27.175 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:27.175 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "mds.c", 2024-04-25T19:23:27.175 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAmrSpmYTSdDxAAe05MkvENoxxx/9CEAqVulw==", 2024-04-25T19:23:27.175 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:23:27.175 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow", 2024-04-25T19:23:27.175 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow *", 2024-04-25T19:23:27.176 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow *", 2024-04-25T19:23:27.176 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:23:27.176 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.176 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:23:27.176 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:27.176 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "mds.d", 2024-04-25T19:23:27.176 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAmrSpmlTDINRAANW7Yrhyzj9B9tueRk+OALw==", 2024-04-25T19:23:27.176 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:23:27.176 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow", 2024-04-25T19:23:27.176 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow *", 2024-04-25T19:23:27.176 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow *", 2024-04-25T19:23:27.176 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:23:27.176 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.176 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:23:27.177 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:27.177 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "osd.0", 2024-04-25T19:23:27.177 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQArrSpmDyNSExAAq7QOaxXYhk0uJro2xsAnIQ==", 2024-04-25T19:23:27.177 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:23:27.177 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow profile osd", 2024-04-25T19:23:27.177 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile osd", 2024-04-25T19:23:27.177 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:23:27.177 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.177 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:23:27.177 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:27.177 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "osd.1", 2024-04-25T19:23:27.177 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAurSpm5oMiNRAARATy+zVosunvnnyrj20Vag==", 2024-04-25T19:23:27.177 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:23:27.178 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow profile osd", 2024-04-25T19:23:27.178 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile osd", 2024-04-25T19:23:27.178 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:23:27.178 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.178 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:23:27.178 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:27.178 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "osd.2", 2024-04-25T19:23:27.178 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAyrSpmaiGyGRAA7/TDEA2+LxFGdAssJD67yA==", 2024-04-25T19:23:27.178 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:23:27.178 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow profile osd", 2024-04-25T19:23:27.178 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile osd", 2024-04-25T19:23:27.178 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:23:27.178 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.179 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:23:27.179 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:27.179 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "osd.3", 2024-04-25T19:23:27.179 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQA1rSpmc3idKRAA46Dj8IuduRvkuZzZZcz+Pw==", 2024-04-25T19:23:27.179 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:23:27.179 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow profile osd", 2024-04-25T19:23:27.179 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile osd", 2024-04-25T19:23:27.179 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:23:27.179 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.179 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:23:27.179 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:27.179 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "osd.4", 2024-04-25T19:23:27.179 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQA6rSpmBf1IKxAA0WHniS5uxIAFRlmPXdovZQ==", 2024-04-25T19:23:27.179 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:23:27.180 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow profile osd", 2024-04-25T19:23:27.180 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile osd", 2024-04-25T19:23:27.180 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:23:27.180 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.180 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:23:27.180 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:27.180 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "osd.5", 2024-04-25T19:23:27.180 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQA+rSpmaa1EDRAA4sjV6lnWG2Wks2UMi+mDsg==", 2024-04-25T19:23:27.180 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:23:27.180 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow profile osd", 2024-04-25T19:23:27.180 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile osd", 2024-04-25T19:23:27.180 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:23:27.180 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.180 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:23:27.180 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:27.181 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "osd.6", 2024-04-25T19:23:27.181 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQBBrSpmRAtbHBAAoX0qYn2X8UQvVhD9/8ESpQ==", 2024-04-25T19:23:27.181 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:23:27.181 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow profile osd", 2024-04-25T19:23:27.181 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile osd", 2024-04-25T19:23:27.181 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:23:27.181 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.181 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:23:27.181 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:27.181 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "osd.7", 2024-04-25T19:23:27.181 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQBErSpm/ySRLBAAslPaxYOGkHT9/nOX04fVSA==", 2024-04-25T19:23:27.182 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:23:27.182 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow profile osd", 2024-04-25T19:23:27.182 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile osd", 2024-04-25T19:23:27.182 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:23:27.182 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.182 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:23:27.182 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:27.182 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.0", 2024-04-25T19:23:27.183 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAnrSpmvjE7CxAABw7VdVfflQSjatWfjdHUXQ==", 2024-04-25T19:23:27.183 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:23:27.183 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow", 2024-04-25T19:23:27.183 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow r", 2024-04-25T19:23:27.183 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow rw", 2024-04-25T19:23:27.183 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow rwx" 2024-04-25T19:23:27.183 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.183 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:23:27.183 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:27.183 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.1", 2024-04-25T19:23:27.184 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAnrSpmSP3NJxAAJZ3U1F/vuUzN2tAHqtIreA==", 2024-04-25T19:23:27.184 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:23:27.184 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow", 2024-04-25T19:23:27.184 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow r", 2024-04-25T19:23:27.184 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow rw", 2024-04-25T19:23:27.184 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow rwx" 2024-04-25T19:23:27.184 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.184 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:23:27.184 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:27.184 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.2", 2024-04-25T19:23:27.184 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAnrSpm5+TmGBAA3du3m8geJUah6/gf6KfBww==", 2024-04-25T19:23:27.184 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:23:27.184 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow", 2024-04-25T19:23:27.184 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow r", 2024-04-25T19:23:27.185 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow rw", 2024-04-25T19:23:27.185 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow rwx" 2024-04-25T19:23:27.185 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.185 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:23:27.185 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:27.185 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.3", 2024-04-25T19:23:27.185 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAnrSpm0pcbNRAAnUUEf+YKSh6BjpnN1NpC9w==", 2024-04-25T19:23:27.185 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:23:27.185 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow", 2024-04-25T19:23:27.185 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow r", 2024-04-25T19:23:27.185 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow rw", 2024-04-25T19:23:27.185 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow rwx" 2024-04-25T19:23:27.185 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.186 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:23:27.186 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:27.186 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.admin", 2024-04-25T19:23:27.186 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAkrSpm92F7JhAADCf4e6pojPAzP2pr+RjT/g==", 2024-04-25T19:23:27.186 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:23:27.186 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow *", 2024-04-25T19:23:27.186 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow *", 2024-04-25T19:23:27.186 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow *", 2024-04-25T19:23:27.186 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:23:27.186 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.186 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:23:27.186 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:27.186 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.bootstrap-mds", 2024-04-25T19:23:27.186 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQBOrSpmXNNHORAABrJtNN8oS0qOo8MADl/s7g==", 2024-04-25T19:23:27.187 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:23:27.187 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile bootstrap-mds" 2024-04-25T19:23:27.187 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.187 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:23:27.187 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:27.187 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.bootstrap-mgr", 2024-04-25T19:23:27.187 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQBOrSpmeeNHORAA0ZjUmRRhMYvo/X/wIWq/2w==", 2024-04-25T19:23:27.187 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:23:27.187 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-25T19:23:27.187 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.187 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:23:27.187 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:27.187 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.bootstrap-osd", 2024-04-25T19:23:27.187 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQBOrSpm9u9HORAA8YWYfZuJBJIgvheeDHI3eg==", 2024-04-25T19:23:27.187 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:23:27.188 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile bootstrap-osd" 2024-04-25T19:23:27.188 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.188 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:23:27.188 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:27.188 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.bootstrap-rbd", 2024-04-25T19:23:27.188 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQBOrSpmVfxHORAAOOzF8oA8pEX58cI8YC638Q==", 2024-04-25T19:23:27.188 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:23:27.188 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-25T19:23:27.188 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.188 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:23:27.188 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:27.188 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-25T19:23:27.188 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQBOrSpm+AhIORAAEtcKZTPdak42FMeZ+tOoWQ==", 2024-04-25T19:23:27.188 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:23:27.189 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-25T19:23:27.189 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.189 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:23:27.189 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:27.189 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.bootstrap-rgw", 2024-04-25T19:23:27.189 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQBOrSpmFhpIORAA4eVFKovTdzsyxsTvIdD+ug==", 2024-04-25T19:23:27.189 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:23:27.189 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-25T19:23:27.190 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.190 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:23:27.190 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:27.190 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "mgr.x", 2024-04-25T19:23:27.190 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAlrSpmc81JKBAA83A0rfzYE5nUkz0rH1KrSw==", 2024-04-25T19:23:27.190 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:23:27.190 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow *", 2024-04-25T19:23:27.190 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile mgr", 2024-04-25T19:23:27.190 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:23:27.190 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.190 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:23:27.190 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:27.190 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "mgr.y", 2024-04-25T19:23:27.191 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAlrSpm8cFSGhAAzZX5s8YMuNvdbiCd34TG5Q==", 2024-04-25T19:23:27.191 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:23:27.191 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow *", 2024-04-25T19:23:27.191 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile mgr", 2024-04-25T19:23:27.191 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:23:27.191 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.191 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:27.191 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-25T19:23:27.191 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-25T19:23:27.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.174+0000 7f2f13200640 1 -- 172.21.15.131:0/1302272163 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2ef00744e0 msgr2=0x7f2ef00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:27.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.175+0000 7f2f13200640 1 --2- 172.21.15.131:0/1302272163 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2ef00744e0 0x7f2ef00769f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2f04032000 tx=0x7f2f0402c000 comp rx=0 tx=0).stop 2024-04-25T19:23:27.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.175+0000 7f2f13200640 1 -- 172.21.15.131:0/1302272163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f14135c90 msgr2=0x7f2f141423a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:27.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.175+0000 7f2f13200640 1 --2- 172.21.15.131:0/1302272163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f14135c90 0x7f2f141423a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00d7d0 tx=0x7f2efc00dc90 comp rx=0 tx=0).stop 2024-04-25T19:23:27.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.175+0000 7f2f13200640 1 -- 172.21.15.131:0/1302272163 shutdown_connections 2024-04-25T19:23:27.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.175+0000 7f2f13200640 1 --2- 172.21.15.131:0/1302272163 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2ef00744e0 0x7f2ef00769f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:27.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.175+0000 7f2f13200640 1 --2- 172.21.15.131:0/1302272163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f141428e0 0x7f2f14154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:27.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.175+0000 7f2f13200640 1 --2- 172.21.15.131:0/1302272163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f14135c90 0x7f2f141423a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:27.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.175+0000 7f2f13200640 1 --2- 172.21.15.131:0/1302272163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2ef8003a00 0x7f2f141f3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:27.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.175+0000 7f2f13200640 1 -- 172.21.15.131:0/1302272163 >> 172.21.15.131:0/1302272163 conn(0x7f2f14072ee0 msgr2=0x7f2f140b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:27.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.175+0000 7f2f13200640 1 -- 172.21.15.131:0/1302272163 shutdown_connections 2024-04-25T19:23:27.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.175+0000 7f2f13200640 1 -- 172.21.15.131:0/1302272163 wait complete. 2024-04-25T19:23:27.205 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-25T19:23:27.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.472+0000 7f297a000640 1 Processor -- start 2024-04-25T19:23:27.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.472+0000 7f297a000640 1 -- start start 2024-04-25T19:23:27.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.474+0000 7f297a000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29740d08c0 0x7f297415c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:27.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.474+0000 7f297a000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f29740b51e0 0x7f29740b6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:27.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.474+0000 7f297a000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29740cfb00 con 0x7f29740b4800 2024-04-25T19:23:27.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.474+0000 7f297a000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f297415c9f0 con 0x7f29740b51e0 2024-04-25T19:23:27.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.474+0000 7f297a000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f29740cfde0 con 0x7f29740d08c0 2024-04-25T19:23:27.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.474+0000 7f2979600640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f29740b4800 0x7f29741600f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:47896/0 (socket says 172.21.15.131:47896) 2024-04-25T19:23:27.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.474+0000 7f2979600640 1 -- 172.21.15.131:0/3999940681 learned_addr learned my addr 172.21.15.131:0/3999940681 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:27.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.474+0000 7f2978c00640 1 --2- 172.21.15.131:0/3999940681 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29740d08c0 0x7f297415c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:27.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.474+0000 7f296be00640 1 --2- 172.21.15.131:0/3999940681 >> v2:172.21.15.195:3300/0 conn(0x7f29740b51e0 0x7f29740b6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:27.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.475+0000 7f2973e00640 1 -- 172.21.15.131:0/3999940681 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3337715780 0 0) 0x7f29740cfb00 con 0x7f29740b4800 2024-04-25T19:23:27.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.475+0000 7f2973e00640 1 -- 172.21.15.131:0/3999940681 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2958003520 con 0x7f29740b4800 2024-04-25T19:23:27.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.475+0000 7f2973e00640 1 -- 172.21.15.131:0/3999940681 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 930760629 0 0) 0x7f2958003520 con 0x7f29740b4800 2024-04-25T19:23:27.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.475+0000 7f2973e00640 1 -- 172.21.15.131:0/3999940681 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29740d08c0 msgr2=0x7f297415c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:27.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.475+0000 7f2973e00640 1 --2- 172.21.15.131:0/3999940681 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29740d08c0 0x7f297415c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:27.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.475+0000 7f2973e00640 1 -- 172.21.15.131:0/3999940681 >> v2:172.21.15.195:3300/0 conn(0x7f29740b51e0 msgr2=0x7f29740b6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:27.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.475+0000 7f2973e00640 1 --2- 172.21.15.131:0/3999940681 >> v2:172.21.15.195:3300/0 conn(0x7f29740b51e0 0x7f29740b6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:27.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.475+0000 7f2973e00640 1 -- 172.21.15.131:0/3999940681 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29740d00c0 con 0x7f29740b4800 2024-04-25T19:23:27.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.475+0000 7f2973e00640 1 -- 172.21.15.131:0/3999940681 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f296c0019f0 con 0x7f29740b4800 2024-04-25T19:23:27.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.475+0000 7f2973e00640 1 -- 172.21.15.131:0/3999940681 >> v1:172.21.15.131:6789/0 conn(0x7f29740b4800 legacy=0x7f29741600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:27.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.475+0000 7f2973e00640 1 --2- 172.21.15.131:0/3999940681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29580039b0 0x7f2958003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:27.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.475+0000 7f2973e00640 1 --2- 172.21.15.131:0/3999940681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2958004800 0x7f2958004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:27.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.475+0000 7f2973e00640 1 --2- 172.21.15.131:0/3999940681 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29740d08c0 0x7f2958005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:27.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.475+0000 7f2973e00640 1 -- 172.21.15.131:0/3999940681 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f297415c9f0 con 0x7f29580039b0 2024-04-25T19:23:27.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.475+0000 7f2973e00640 1 -- 172.21.15.131:0/3999940681 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f29740cfde0 con 0x7f2958004800 2024-04-25T19:23:27.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.475+0000 7f2973e00640 1 -- 172.21.15.131:0/3999940681 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f295800dbd0 con 0x7f29740d08c0 2024-04-25T19:23:27.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.475+0000 7f2978c00640 1 --2- 172.21.15.131:0/3999940681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29580039b0 0x7f2958003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:27.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.476+0000 7f296be00640 1 --2- 172.21.15.131:0/3999940681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2958004800 0x7f2958004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:27.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.476+0000 7f2978c00640 1 -- 172.21.15.131:0/3999940681 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29740d08c0 msgr2=0x7f2958005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:27.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.476+0000 7f2978c00640 1 --2- 172.21.15.131:0/3999940681 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29740d08c0 0x7f2958005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:27.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.476+0000 7f2978c00640 1 -- 172.21.15.131:0/3999940681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2958004800 msgr2=0x7f2958004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:27.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.476+0000 7f2978c00640 1 --2- 172.21.15.131:0/3999940681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2958004800 0x7f2958004c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:27.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.476+0000 7f2978c00640 1 -- 172.21.15.131:0/3999940681 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2958003520 con 0x7f29580039b0 2024-04-25T19:23:27.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.477+0000 7f2978c00640 1 --2- 172.21.15.131:0/3999940681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29580039b0 0x7f2958003e20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2964009ac0 tx=0x7f2958005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed83cbbd995ea30b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:27.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.477+0000 7f2973e00640 1 -- 172.21.15.131:0/3999940681 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2964036070 con 0x7f29580039b0 2024-04-25T19:23:27.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.477+0000 7f2973e00640 1 -- 172.21.15.131:0/3999940681 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2964031400 con 0x7f29580039b0 2024-04-25T19:23:27.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.477+0000 7f2973e00640 1 -- 172.21.15.131:0/3999940681 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2964009690 con 0x7f29580039b0 2024-04-25T19:23:27.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.478+0000 7f297a000640 1 -- 172.21.15.131:0/3999940681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29580039b0 msgr2=0x7f2958003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:27.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.478+0000 7f297a000640 1 --2- 172.21.15.131:0/3999940681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29580039b0 0x7f2958003e20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2964009ac0 tx=0x7f2958005830 comp rx=0 tx=0).stop 2024-04-25T19:23:27.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.478+0000 7f2979600640 1 -- 172.21.15.131:0/3999940681 reap_dead start 2024-04-25T19:23:27.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.478+0000 7f297a000640 1 -- 172.21.15.131:0/3999940681 shutdown_connections 2024-04-25T19:23:27.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.478+0000 7f297a000640 1 -- 172.21.15.131:0/3999940681 >> 172.21.15.131:0/3999940681 conn(0x7f2974072ee0 msgr2=0x7f29740732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:27.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.478+0000 7f297a000640 1 -- 172.21.15.131:0/3999940681 shutdown_connections 2024-04-25T19:23:27.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.478+0000 7f297a000640 1 -- 172.21.15.131:0/3999940681 wait complete. 2024-04-25T19:23:27.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.481+0000 7f297a000640 1 Processor -- start 2024-04-25T19:23:27.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.481+0000 7f297a000640 1 -- start start 2024-04-25T19:23:27.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.482+0000 7f297a000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29580039b0 0x7f2974151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:27.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.482+0000 7f297a000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2974145340 0x7f297415e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:27.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.482+0000 7f297a000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f297415ef00 0x7f2974150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:27.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.482+0000 7f297a000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f29740cf8a0 con 0x7f29580039b0 2024-04-25T19:23:27.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.482+0000 7f297a000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f29740cf720 con 0x7f2974145340 2024-04-25T19:23:27.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.482+0000 7f297a000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f29740d1090 con 0x7f297415ef00 2024-04-25T19:23:27.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.483+0000 7f2978c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29580039b0 0x7f2974151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:27.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.483+0000 7f2978c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29580039b0 0x7f2974151ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56576/0 (socket says 172.21.15.131:56576) 2024-04-25T19:23:27.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.483+0000 7f2978c00640 1 -- 172.21.15.131:0/498897838 learned_addr learned my addr 172.21.15.131:0/498897838 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:27.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.483+0000 7f2979600640 1 --2- 172.21.15.131:0/498897838 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f297415ef00 0x7f2974150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:27.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.483+0000 7f296be00640 1 --2- 172.21.15.131:0/498897838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2974145340 0x7f297415e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:27.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.483+0000 7f2978c00640 1 -- 172.21.15.131:0/498897838 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f297415ef00 msgr2=0x7f2974150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:27.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.483+0000 7f2978c00640 1 --2- 172.21.15.131:0/498897838 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f297415ef00 0x7f2974150a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:27.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.483+0000 7f2978c00640 1 -- 172.21.15.131:0/498897838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2974145340 msgr2=0x7f297415e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:27.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.483+0000 7f2978c00640 1 --2- 172.21.15.131:0/498897838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2974145340 0x7f297415e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:27.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.483+0000 7f2978c00640 1 -- 172.21.15.131:0/498897838 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f297415f310 con 0x7f29580039b0 2024-04-25T19:23:27.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.483+0000 7f296be00640 1 --2- 172.21.15.131:0/498897838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2974145340 0x7f297415e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:27.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.483+0000 7f2978c00640 1 --2- 172.21.15.131:0/498897838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29580039b0 0x7f2974151ec0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2964034040 tx=0x7f2964004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:27.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.484+0000 7f2971600640 1 -- 172.21.15.131:0/498897838 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2964040020 con 0x7f29580039b0 2024-04-25T19:23:27.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.484+0000 7f2971600640 1 -- 172.21.15.131:0/498897838 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29640038d0 con 0x7f29580039b0 2024-04-25T19:23:27.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.484+0000 7f2971600640 1 -- 172.21.15.131:0/498897838 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2964036040 con 0x7f29580039b0 2024-04-25T19:23:27.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.484+0000 7f297a000640 1 -- 172.21.15.131:0/498897838 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2974154550 con 0x7f29580039b0 2024-04-25T19:23:27.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.484+0000 7f297a000640 1 -- 172.21.15.131:0/498897838 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2974154b10 con 0x7f29580039b0 2024-04-25T19:23:27.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.485+0000 7f297a000640 1 -- 172.21.15.131:0/498897838 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2974050740 con 0x7f29580039b0 2024-04-25T19:23:27.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.486+0000 7f2971600640 1 -- 172.21.15.131:0/498897838 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2964043020 con 0x7f29580039b0 2024-04-25T19:23:27.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.487+0000 7f2971600640 1 --2- 172.21.15.131:0/498897838 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f29500744e0 0x7f29500769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:27.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.488+0000 7f2971600640 1 -- 172.21.15.131:0/498897838 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f29640b5040 con 0x7f29580039b0 2024-04-25T19:23:27.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.488+0000 7f296be00640 1 --2- 172.21.15.131:0/498897838 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f29500744e0 0x7f29500769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:27.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.490+0000 7f296be00640 1 --2- 172.21.15.131:0/498897838 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f29500744e0 0x7f29500769f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f29740ce110 tx=0x7f295c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:27.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.493+0000 7f2971600640 1 -- 172.21.15.131:0/498897838 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f296404a070 con 0x7f29580039b0 2024-04-25T19:23:27.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.773+0000 7f297a000640 1 -- 172.21.15.131:0/498897838 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f29740b4f90 con 0x7f29580039b0 2024-04-25T19:23:27.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.780+0000 7f2971600640 1 -- 172.21.15.131:0/498897838 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f297415f310 con 0x7f29580039b0 2024-04-25T19:23:27.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.783+0000 7f297a000640 1 -- 172.21.15.131:0/498897838 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f29500744e0 msgr2=0x7f29500769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:27.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.783+0000 7f297a000640 1 --2- 172.21.15.131:0/498897838 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f29500744e0 0x7f29500769f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f29740ce110 tx=0x7f295c008040 comp rx=0 tx=0).stop 2024-04-25T19:23:27.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.783+0000 7f297a000640 1 -- 172.21.15.131:0/498897838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29580039b0 msgr2=0x7f2974151ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:27.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.783+0000 7f297a000640 1 --2- 172.21.15.131:0/498897838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29580039b0 0x7f2974151ec0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2964034040 tx=0x7f2964004730 comp rx=0 tx=0).stop 2024-04-25T19:23:27.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.783+0000 7f297a000640 1 -- 172.21.15.131:0/498897838 shutdown_connections 2024-04-25T19:23:27.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.783+0000 7f297a000640 1 --2- 172.21.15.131:0/498897838 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f29500744e0 0x7f29500769f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:27.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.783+0000 7f297a000640 1 --2- 172.21.15.131:0/498897838 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f297415ef00 0x7f2974150a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:27.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.783+0000 7f297a000640 1 --2- 172.21.15.131:0/498897838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2974145340 0x7f297415e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:27.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.783+0000 7f297a000640 1 --2- 172.21.15.131:0/498897838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29580039b0 0x7f2974151ec0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:27.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.783+0000 7f297a000640 1 -- 172.21.15.131:0/498897838 >> 172.21.15.131:0/498897838 conn(0x7f2974072ee0 msgr2=0x7f29740732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:27.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.783+0000 7f297a000640 1 -- 172.21.15.131:0/498897838 shutdown_connections 2024-04-25T19:23:27.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:27.783+0000 7f297a000640 1 -- 172.21.15.131:0/498897838 wait complete. 2024-04-25T19:23:27.809 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-25T19:23:28.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.059+0000 7fa8efe00640 1 Processor -- start 2024-04-25T19:23:28.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.059+0000 7fa8efe00640 1 -- start start 2024-04-25T19:23:28.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.061+0000 7fa8efe00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa8f006ea40 0x7fa8f00cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:28.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.061+0000 7fa8efe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa8f008cd60 0x7fa8f008d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:28.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.061+0000 7fa8efe00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8f006e280 con 0x7fa8f00cdfc0 2024-04-25T19:23:28.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.061+0000 7fa8efe00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fa8f008ddc0 con 0x7fa8f006ea40 2024-04-25T19:23:28.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.061+0000 7fa8efe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa8f008dae0 con 0x7fa8f008cd60 2024-04-25T19:23:28.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.061+0000 7fa8ef400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fa8f00cdfc0 0x7fa8f00ce3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:44904/0 (socket says 172.21.15.131:44904) 2024-04-25T19:23:28.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.061+0000 7fa8ef400640 1 -- 172.21.15.131:0/1103434158 learned_addr learned my addr 172.21.15.131:0/1103434158 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:28.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.062+0000 7fa8e6000640 1 --2- 172.21.15.131:0/1103434158 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa8f008cd60 0x7fa8f008d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:28.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.062+0000 7fa8ee000640 1 -- 172.21.15.131:0/1103434158 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4008095730 0 0) 0x7fa8f006e280 con 0x7fa8f00cdfc0 2024-04-25T19:23:28.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.062+0000 7fa8ee000640 1 -- 172.21.15.131:0/1103434158 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8d4003520 con 0x7fa8f00cdfc0 2024-04-25T19:23:28.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.062+0000 7fa8eea00640 1 --2- 172.21.15.131:0/1103434158 >> v2:172.21.15.195:3300/0 conn(0x7fa8f006ea40 0x7fa8f00cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:28.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.062+0000 7fa8ee000640 1 -- 172.21.15.131:0/1103434158 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2180750184 0 0) 0x7fa8d4003520 con 0x7fa8f00cdfc0 2024-04-25T19:23:28.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.062+0000 7fa8ee000640 1 -- 172.21.15.131:0/1103434158 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa8f008cd60 msgr2=0x7fa8f008d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:28.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.062+0000 7fa8ee000640 1 --2- 172.21.15.131:0/1103434158 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa8f008cd60 0x7fa8f008d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:28.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.062+0000 7fa8ee000640 1 -- 172.21.15.131:0/1103434158 >> v2:172.21.15.195:3300/0 conn(0x7fa8f006ea40 msgr2=0x7fa8f00cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:28.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.062+0000 7fa8ee000640 1 --2- 172.21.15.131:0/1103434158 >> v2:172.21.15.195:3300/0 conn(0x7fa8f006ea40 0x7fa8f00cfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:28.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.062+0000 7fa8ee000640 1 -- 172.21.15.131:0/1103434158 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f008d6b0 con 0x7fa8f00cdfc0 2024-04-25T19:23:28.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.062+0000 7fa8ee000640 1 -- 172.21.15.131:0/1103434158 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7fa8e8001690 con 0x7fa8f00cdfc0 2024-04-25T19:23:28.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.062+0000 7fa8ee000640 1 -- 172.21.15.131:0/1103434158 >> v1:172.21.15.131:6789/0 conn(0x7fa8f00cdfc0 legacy=0x7fa8f00ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:28.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.062+0000 7fa8ee000640 1 --2- 172.21.15.131:0/1103434158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8d40039b0 0x7fa8d4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:28.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.062+0000 7fa8ee000640 1 --2- 172.21.15.131:0/1103434158 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8d4004800 0x7fa8d4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:28.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.062+0000 7fa8ee000640 1 --2- 172.21.15.131:0/1103434158 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa8f008cd60 0x7fa8d4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:28.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.062+0000 7fa8ee000640 1 -- 172.21.15.131:0/1103434158 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f008ddc0 con 0x7fa8d40039b0 2024-04-25T19:23:28.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.062+0000 7fa8ee000640 1 -- 172.21.15.131:0/1103434158 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f008dae0 con 0x7fa8d4004800 2024-04-25T19:23:28.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.062+0000 7fa8ee000640 1 -- 172.21.15.131:0/1103434158 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa8d400bb70 con 0x7fa8f008cd60 2024-04-25T19:23:28.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.063+0000 7fa8eea00640 1 --2- 172.21.15.131:0/1103434158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8d40039b0 0x7fa8d4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:28.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.063+0000 7fa8eea00640 1 -- 172.21.15.131:0/1103434158 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa8f008cd60 msgr2=0x7fa8d4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:28.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.063+0000 7fa8eea00640 1 --2- 172.21.15.131:0/1103434158 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa8f008cd60 0x7fa8d4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:28.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.063+0000 7fa8eea00640 1 -- 172.21.15.131:0/1103434158 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8d4004800 msgr2=0x7fa8d4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:28.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.063+0000 7fa8eea00640 1 --2- 172.21.15.131:0/1103434158 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8d4004800 0x7fa8d4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:28.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.063+0000 7fa8eea00640 1 -- 172.21.15.131:0/1103434158 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d4003520 con 0x7fa8d40039b0 2024-04-25T19:23:28.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.064+0000 7fa8eea00640 1 --2- 172.21.15.131:0/1103434158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8d40039b0 0x7fa8d4003e20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa8e00073b0 tx=0x7fa8d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a956b6f852d766d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:28.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.064+0000 7fa8ee000640 1 -- 172.21.15.131:0/1103434158 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0009c30 con 0x7fa8d40039b0 2024-04-25T19:23:28.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.064+0000 7fa8ee000640 1 -- 172.21.15.131:0/1103434158 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e002e640 con 0x7fa8d40039b0 2024-04-25T19:23:28.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.064+0000 7fa8ee000640 1 -- 172.21.15.131:0/1103434158 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e002ea30 con 0x7fa8d40039b0 2024-04-25T19:23:28.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.065+0000 7fa8efe00640 1 -- 172.21.15.131:0/1103434158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8d40039b0 msgr2=0x7fa8d4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:28.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.065+0000 7fa8efe00640 1 --2- 172.21.15.131:0/1103434158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8d40039b0 0x7fa8d4003e20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa8e00073b0 tx=0x7fa8d4005830 comp rx=0 tx=0).stop 2024-04-25T19:23:28.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.065+0000 7fa8ef400640 1 -- 172.21.15.131:0/1103434158 reap_dead start 2024-04-25T19:23:28.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.065+0000 7fa8efe00640 1 -- 172.21.15.131:0/1103434158 shutdown_connections 2024-04-25T19:23:28.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.065+0000 7fa8efe00640 1 -- 172.21.15.131:0/1103434158 >> 172.21.15.131:0/1103434158 conn(0x7fa8f00b5460 msgr2=0x7fa8f00b5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:28.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.065+0000 7fa8efe00640 1 -- 172.21.15.131:0/1103434158 shutdown_connections 2024-04-25T19:23:28.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.065+0000 7fa8efe00640 1 -- 172.21.15.131:0/1103434158 wait complete. 2024-04-25T19:23:28.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.068+0000 7fa8efe00640 1 Processor -- start 2024-04-25T19:23:28.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.068+0000 7fa8efe00640 1 -- start start 2024-04-25T19:23:28.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.069+0000 7fa8efe00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8d40039b0 0x7fa8f01e9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:28.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.069+0000 7fa8efe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8f0152bb0 0x7fa8f00c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:28.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.069+0000 7fa8efe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa8f0152fc0 0x7fa8f00c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:28.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.069+0000 7fa8efe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f008d880 con 0x7fa8f0152bb0 2024-04-25T19:23:28.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.069+0000 7fa8efe00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f00b8fb0 con 0x7fa8d40039b0 2024-04-25T19:23:28.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.069+0000 7fa8efe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa8f00b6190 con 0x7fa8f0152fc0 2024-04-25T19:23:28.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.069+0000 7fa8e6000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8f0152bb0 0x7fa8f00c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:28.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.069+0000 7fa8e6000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8f0152bb0 0x7fa8f00c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33730/0 (socket says 172.21.15.131:33730) 2024-04-25T19:23:28.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.069+0000 7fa8e6000640 1 -- 172.21.15.131:0/2024998203 learned_addr learned my addr 172.21.15.131:0/2024998203 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:28.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.070+0000 7fa8eea00640 1 --2- 172.21.15.131:0/2024998203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8d40039b0 0x7fa8f01e9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:28.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.070+0000 7fa8e6000640 1 -- 172.21.15.131:0/2024998203 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa8f0152fc0 msgr2=0x7fa8f00c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:28.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.070+0000 7fa8e6000640 1 --2- 172.21.15.131:0/2024998203 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa8f0152fc0 0x7fa8f00c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:28.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.070+0000 7fa8e6000640 1 -- 172.21.15.131:0/2024998203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8d40039b0 msgr2=0x7fa8f01e9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:28.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.070+0000 7fa8e6000640 1 --2- 172.21.15.131:0/2024998203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8d40039b0 0x7fa8f01e9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:28.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.070+0000 7fa8e6000640 1 -- 172.21.15.131:0/2024998203 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f00d2a60 con 0x7fa8f0152bb0 2024-04-25T19:23:28.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.070+0000 7fa8e6000640 1 --2- 172.21.15.131:0/2024998203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8f0152bb0 0x7fa8f00c81d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800d830 tx=0x7fa8d800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:28.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.070+0000 7fa8e7400640 1 -- 172.21.15.131:0/2024998203 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8018020 con 0x7fa8f0152bb0 2024-04-25T19:23:28.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.070+0000 7fa8e7400640 1 -- 172.21.15.131:0/2024998203 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8d800b6c0 con 0x7fa8f0152bb0 2024-04-25T19:23:28.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.070+0000 7fa8efe00640 1 -- 172.21.15.131:0/2024998203 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f00d2d40 con 0x7fa8f0152bb0 2024-04-25T19:23:28.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.070+0000 7fa8e7400640 1 -- 172.21.15.131:0/2024998203 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d800ba90 con 0x7fa8f0152bb0 2024-04-25T19:23:28.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.071+0000 7fa8efe00640 1 -- 172.21.15.131:0/2024998203 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8f01e9780 con 0x7fa8f0152bb0 2024-04-25T19:23:28.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.072+0000 7fa8efe00640 1 -- 172.21.15.131:0/2024998203 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8f0050740 con 0x7fa8f0152bb0 2024-04-25T19:23:28.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.073+0000 7fa8e7400640 1 -- 172.21.15.131:0/2024998203 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa8d801b020 con 0x7fa8f0152bb0 2024-04-25T19:23:28.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.074+0000 7fa8e7400640 1 --2- 172.21.15.131:0/2024998203 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa8cc0744e0 0x7fa8cc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:28.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.074+0000 7fa8e7400640 1 -- 172.21.15.131:0/2024998203 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fa8d80953b0 con 0x7fa8f0152bb0 2024-04-25T19:23:28.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.075+0000 7fa8eea00640 1 --2- 172.21.15.131:0/2024998203 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa8cc0744e0 0x7fa8cc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:28.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.076+0000 7fa8eea00640 1 --2- 172.21.15.131:0/2024998203 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa8cc0744e0 0x7fa8cc0769f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0035000 tx=0x7fa8e0038040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:28.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.079+0000 7fa8e7400640 1 -- 172.21.15.131:0/2024998203 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa8d8022030 con 0x7fa8f0152bb0 2024-04-25T19:23:28.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.329+0000 7fa8efe00640 1 -- 172.21.15.131:0/2024998203 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fa8f0068c30 con 0x7fa8f0152bb0 2024-04-25T19:23:28.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.334+0000 7fa8e7400640 1 -- 172.21.15.131:0/2024998203 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fa8d8066e20 con 0x7fa8f0152bb0 2024-04-25T19:23:28.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.337+0000 7fa8efe00640 1 -- 172.21.15.131:0/2024998203 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa8cc0744e0 msgr2=0x7fa8cc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:28.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.337+0000 7fa8efe00640 1 --2- 172.21.15.131:0/2024998203 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa8cc0744e0 0x7fa8cc0769f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0035000 tx=0x7fa8e0038040 comp rx=0 tx=0).stop 2024-04-25T19:23:28.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.337+0000 7fa8efe00640 1 -- 172.21.15.131:0/2024998203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8f0152bb0 msgr2=0x7fa8f00c81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:28.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.337+0000 7fa8efe00640 1 --2- 172.21.15.131:0/2024998203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8f0152bb0 0x7fa8f00c81d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800d830 tx=0x7fa8d800dcf0 comp rx=0 tx=0).stop 2024-04-25T19:23:28.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.337+0000 7fa8efe00640 1 -- 172.21.15.131:0/2024998203 shutdown_connections 2024-04-25T19:23:28.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.337+0000 7fa8efe00640 1 --2- 172.21.15.131:0/2024998203 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa8cc0744e0 0x7fa8cc0769f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:28.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.337+0000 7fa8efe00640 1 --2- 172.21.15.131:0/2024998203 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa8f0152fc0 0x7fa8f00c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:28.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.337+0000 7fa8efe00640 1 --2- 172.21.15.131:0/2024998203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8f0152bb0 0x7fa8f00c81d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:28.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.337+0000 7fa8efe00640 1 --2- 172.21.15.131:0/2024998203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8d40039b0 0x7fa8f01e9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:28.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.337+0000 7fa8efe00640 1 -- 172.21.15.131:0/2024998203 >> 172.21.15.131:0/2024998203 conn(0x7fa8f00b5460 msgr2=0x7fa8f00711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:28.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.337+0000 7fa8efe00640 1 -- 172.21.15.131:0/2024998203 shutdown_connections 2024-04-25T19:23:28.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.337+0000 7fa8efe00640 1 -- 172.21.15.131:0/2024998203 wait complete. 2024-04-25T19:23:28.362 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-25T19:23:28.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.621+0000 7f3d9de00640 1 Processor -- start 2024-04-25T19:23:28.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.621+0000 7f3d9de00640 1 -- start start 2024-04-25T19:23:28.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.623+0000 7f3d9de00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3d980d3580 0x7f3d980d3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:28.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.623+0000 7f3d9de00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3d9806dc80 0x7f3d9806e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:28.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.623+0000 7f3d9de00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d9806e5d0 con 0x7f3d980d5370 2024-04-25T19:23:28.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.623+0000 7f3d9de00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f3d981616f0 con 0x7f3d9806dc80 2024-04-25T19:23:28.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.623+0000 7f3d9de00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3d98145860 con 0x7f3d980d3580 2024-04-25T19:23:28.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.623+0000 7f3d9d400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3d9806dc80 0x7f3d9806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:28.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.623+0000 7f3d9d400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3d9806dc80 0x7f3d9806e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33740/0 (socket says 172.21.15.131:33740) 2024-04-25T19:23:28.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.623+0000 7f3d9d400640 1 -- 172.21.15.131:0/2180813058 learned_addr learned my addr 172.21.15.131:0/2180813058 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:28.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.623+0000 7f3d97e00640 1 --2- 172.21.15.131:0/2180813058 >> v2:172.21.15.195:3300/0 conn(0x7f3d980d3580 0x7f3d980d3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:28.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.623+0000 7f3d9d400640 1 -- 172.21.15.131:0/2180813058 >> v2:172.21.15.195:3300/0 conn(0x7f3d980d3580 msgr2=0x7f3d980d3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:28.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.623+0000 7f3d9d400640 1 --2- 172.21.15.131:0/2180813058 >> v2:172.21.15.195:3300/0 conn(0x7f3d980d3580 0x7f3d980d3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:28.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.623+0000 7f3d9d400640 1 -- 172.21.15.131:0/2180813058 >> v1:172.21.15.195:6789/0 conn(0x7f3d980d5370 legacy=0x7f3d98142e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:28.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.623+0000 7f3d9d400640 1 -- 172.21.15.131:0/2180813058 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d98145b40 con 0x7f3d9806dc80 2024-04-25T19:23:28.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.625+0000 7f3d9d400640 1 --2- 172.21.15.131:0/2180813058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d9806dc80 0x7f3d9806e090 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3d980b9df0 tx=0x7f3d8802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13692faa7007578 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:28.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.625+0000 7f3d97400640 1 -- 172.21.15.131:0/2180813058 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d88037070 con 0x7f3d9806dc80 2024-04-25T19:23:28.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.625+0000 7f3d97400640 1 -- 172.21.15.131:0/2180813058 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d88032440 con 0x7f3d9806dc80 2024-04-25T19:23:28.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.625+0000 7f3d97400640 1 -- 172.21.15.131:0/2180813058 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d88032810 con 0x7f3d9806dc80 2024-04-25T19:23:28.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.625+0000 7f3d9de00640 1 -- 172.21.15.131:0/2180813058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d9806dc80 msgr2=0x7f3d9806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:28.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.625+0000 7f3d9de00640 1 --2- 172.21.15.131:0/2180813058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d9806dc80 0x7f3d9806e090 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3d980b9df0 tx=0x7f3d8802a1a0 comp rx=0 tx=0).stop 2024-04-25T19:23:28.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.626+0000 7f3d9de00640 1 -- 172.21.15.131:0/2180813058 shutdown_connections 2024-04-25T19:23:28.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.626+0000 7f3d9de00640 1 --2- 172.21.15.131:0/2180813058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d9806dc80 0x7f3d9806e090 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:28.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.626+0000 7f3d9de00640 1 --2- 172.21.15.131:0/2180813058 >> v2:172.21.15.195:3300/0 conn(0x7f3d980d3580 0x7f3d980d3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:28.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.626+0000 7f3d9de00640 1 -- 172.21.15.131:0/2180813058 >> 172.21.15.131:0/2180813058 conn(0x7f3d9806c5c0 msgr2=0x7f3d9806c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:28.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.626+0000 7f3d9de00640 1 -- 172.21.15.131:0/2180813058 shutdown_connections 2024-04-25T19:23:28.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.626+0000 7f3d9de00640 1 -- 172.21.15.131:0/2180813058 wait complete. 2024-04-25T19:23:28.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.628+0000 7f3d9de00640 1 Processor -- start 2024-04-25T19:23:28.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.628+0000 7f3d9de00640 1 -- start start 2024-04-25T19:23:28.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.630+0000 7f3d9de00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d9806dc80 0x7f3d98156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:28.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.630+0000 7f3d9de00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d980d3580 0x7f3d981f9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:28.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.630+0000 7f3d9de00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d980d5370 0x7f3d981fa220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:28.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.630+0000 7f3d9de00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3d98164ae0 con 0x7f3d980d3580 2024-04-25T19:23:28.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.630+0000 7f3d9de00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3d98146100 con 0x7f3d9806dc80 2024-04-25T19:23:28.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.630+0000 7f3d9de00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3d98164c60 con 0x7f3d980d5370 2024-04-25T19:23:28.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.630+0000 7f3d97e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d980d3580 0x7f3d981f9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:28.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.630+0000 7f3d97e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d980d3580 0x7f3d981f9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33742/0 (socket says 172.21.15.131:33742) 2024-04-25T19:23:28.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.630+0000 7f3d97e00640 1 -- 172.21.15.131:0/3873188090 learned_addr learned my addr 172.21.15.131:0/3873188090 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:28.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.630+0000 7f3d97e00640 1 -- 172.21.15.131:0/3873188090 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d980d5370 msgr2=0x7f3d981fa220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:28.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.630+0000 7f3d97e00640 1 --2- 172.21.15.131:0/3873188090 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d980d5370 0x7f3d981fa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:28.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.630+0000 7f3d97e00640 1 -- 172.21.15.131:0/3873188090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d9806dc80 msgr2=0x7f3d98156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:28.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.630+0000 7f3d97e00640 1 --2- 172.21.15.131:0/3873188090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d9806dc80 0x7f3d98156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:28.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.630+0000 7f3d97e00640 1 -- 172.21.15.131:0/3873188090 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d9815b9b0 con 0x7f3d980d3580 2024-04-25T19:23:28.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.631+0000 7f3d97e00640 1 --2- 172.21.15.131:0/3873188090 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d980d3580 0x7f3d981f9ce0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3d8000ccd0 tx=0x7f3d8000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:28.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.631+0000 7f3d94c00640 1 -- 172.21.15.131:0/3873188090 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d80003990 con 0x7f3d980d3580 2024-04-25T19:23:28.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.631+0000 7f3d94c00640 1 -- 172.21.15.131:0/3873188090 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d80003b30 con 0x7f3d980d3580 2024-04-25T19:23:28.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.631+0000 7f3d94c00640 1 -- 172.21.15.131:0/3873188090 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d80004020 con 0x7f3d980d3580 2024-04-25T19:23:28.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.631+0000 7f3d9de00640 1 -- 172.21.15.131:0/3873188090 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d9815bc90 con 0x7f3d980d3580 2024-04-25T19:23:28.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.631+0000 7f3d9de00640 1 -- 172.21.15.131:0/3873188090 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d981faa80 con 0x7f3d980d3580 2024-04-25T19:23:28.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.632+0000 7f3d9de00640 1 -- 172.21.15.131:0/3873188090 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d98050740 con 0x7f3d980d3580 2024-04-25T19:23:28.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.633+0000 7f3d94c00640 1 -- 172.21.15.131:0/3873188090 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3d800041c0 con 0x7f3d980d3580 2024-04-25T19:23:28.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.635+0000 7f3d94c00640 1 --2- 172.21.15.131:0/3873188090 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3d740744b0 0x7f3d740769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:28.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.635+0000 7f3d94c00640 1 -- 172.21.15.131:0/3873188090 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f3d800953a0 con 0x7f3d980d3580 2024-04-25T19:23:28.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.636+0000 7f3d9ca00640 1 --2- 172.21.15.131:0/3873188090 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3d740744b0 0x7f3d740769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:28.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.637+0000 7f3d9ca00640 1 --2- 172.21.15.131:0/3873188090 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3d740744b0 0x7f3d740769c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3d90006fd0 tx=0x7f3d90006bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:28.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.640+0000 7f3d94c00640 1 -- 172.21.15.131:0/3873188090 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3d80014030 con 0x7f3d980d3580 2024-04-25T19:23:28.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.905+0000 7f3d9de00640 1 -- 172.21.15.131:0/3873188090 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f3d981fa7a0 con 0x7f3d980d3580 2024-04-25T19:23:28.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.911+0000 7f3d94c00640 1 -- 172.21.15.131:0/3873188090 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f3d8005fe80 con 0x7f3d980d3580 2024-04-25T19:23:28.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.914+0000 7f3d9de00640 1 -- 172.21.15.131:0/3873188090 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3d740744b0 msgr2=0x7f3d740769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:28.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.914+0000 7f3d9de00640 1 --2- 172.21.15.131:0/3873188090 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3d740744b0 0x7f3d740769c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3d90006fd0 tx=0x7f3d90006bc0 comp rx=0 tx=0).stop 2024-04-25T19:23:28.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.914+0000 7f3d9de00640 1 -- 172.21.15.131:0/3873188090 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d980d3580 msgr2=0x7f3d981f9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:28.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.914+0000 7f3d9de00640 1 --2- 172.21.15.131:0/3873188090 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d980d3580 0x7f3d981f9ce0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3d8000ccd0 tx=0x7f3d8000a5c0 comp rx=0 tx=0).stop 2024-04-25T19:23:28.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.914+0000 7f3d9de00640 1 -- 172.21.15.131:0/3873188090 shutdown_connections 2024-04-25T19:23:28.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.914+0000 7f3d9de00640 1 --2- 172.21.15.131:0/3873188090 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3d740744b0 0x7f3d740769c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:28.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.914+0000 7f3d9de00640 1 --2- 172.21.15.131:0/3873188090 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d980d5370 0x7f3d981fa220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:28.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.914+0000 7f3d9de00640 1 --2- 172.21.15.131:0/3873188090 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d980d3580 0x7f3d981f9ce0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:28.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.914+0000 7f3d9de00640 1 --2- 172.21.15.131:0/3873188090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d9806dc80 0x7f3d98156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:28.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.914+0000 7f3d9de00640 1 -- 172.21.15.131:0/3873188090 >> 172.21.15.131:0/3873188090 conn(0x7f3d9806c5c0 msgr2=0x7f3d980d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:28.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.914+0000 7f3d9de00640 1 -- 172.21.15.131:0/3873188090 shutdown_connections 2024-04-25T19:23:28.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:28.914+0000 7f3d9de00640 1 -- 172.21.15.131:0/3873188090 wait complete. 2024-04-25T19:23:28.941 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-25T19:23:29.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.198+0000 7f604b200640 1 Processor -- start 2024-04-25T19:23:29.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.198+0000 7f604b200640 1 -- start start 2024-04-25T19:23:29.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.200+0000 7f604b200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f604c0b51e0 0x7f604c15c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:29.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.200+0000 7f604b200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f604c0cfb00 con 0x7f604c0b7680 2024-04-25T19:23:29.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.200+0000 7f604b200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f604c0cfde0 con 0x7f604c0d08c0 2024-04-25T19:23:29.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.200+0000 7f604b200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f604c15c9f0 con 0x7f604c0b51e0 2024-04-25T19:23:29.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.200+0000 7f6041400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f604c0b7680 0x7f604c06f130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:44912/0 (socket says 172.21.15.131:44912) 2024-04-25T19:23:29.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.200+0000 7f6041400640 1 -- 172.21.15.131:0/3565838264 learned_addr learned my addr 172.21.15.131:0/3565838264 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:29.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.201+0000 7f6049400640 1 -- 172.21.15.131:0/3565838264 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3397794384 0 0) 0x7f604c0cfb00 con 0x7f604c0b7680 2024-04-25T19:23:29.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.201+0000 7f6049400640 1 -- 172.21.15.131:0/3565838264 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6030003520 con 0x7f604c0b7680 2024-04-25T19:23:29.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.201+0000 7f604a800640 1 --2- 172.21.15.131:0/3565838264 >> v2:172.21.15.195:3300/0 conn(0x7f604c0b51e0 0x7f604c15c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:29.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.201+0000 7f6049400640 1 -- 172.21.15.131:0/3565838264 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 700441704 0 0) 0x7f6030003520 con 0x7f604c0b7680 2024-04-25T19:23:29.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.201+0000 7f6049400640 1 -- 172.21.15.131:0/3565838264 >> v2:172.21.15.195:3300/0 conn(0x7f604c0b51e0 msgr2=0x7f604c15c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:29.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.201+0000 7f6049400640 1 --2- 172.21.15.131:0/3565838264 >> v2:172.21.15.195:3300/0 conn(0x7f604c0b51e0 0x7f604c15c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:29.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.201+0000 7f6049400640 1 -- 172.21.15.131:0/3565838264 >> v1:172.21.15.195:6789/0 conn(0x7f604c0d08c0 legacy=0x7f604c0b6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:29.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.201+0000 7f6049400640 1 -- 172.21.15.131:0/3565838264 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f604c0d00c0 con 0x7f604c0b7680 2024-04-25T19:23:29.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.201+0000 7f6049400640 1 -- 172.21.15.131:0/3565838264 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f6034001670 con 0x7f604c0b7680 2024-04-25T19:23:29.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.201+0000 7f6049400640 1 -- 172.21.15.131:0/3565838264 >> v1:172.21.15.131:6789/0 conn(0x7f604c0b7680 legacy=0x7f604c06f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:29.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.201+0000 7f6049400640 1 --2- 172.21.15.131:0/3565838264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6030003a00 0x7f6030003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:29.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.201+0000 7f6049400640 1 --2- 172.21.15.131:0/3565838264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6030004800 0x7f6030004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:29.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.201+0000 7f6049400640 1 --2- 172.21.15.131:0/3565838264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6030005330 0x7f603000b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:29.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.201+0000 7f6049400640 1 -- 172.21.15.131:0/3565838264 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f604c15c9f0 con 0x7f6030003a00 2024-04-25T19:23:29.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.201+0000 7f6049400640 1 -- 172.21.15.131:0/3565838264 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f603000c2c0 con 0x7f6030005330 2024-04-25T19:23:29.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.201+0000 7f6049400640 1 -- 172.21.15.131:0/3565838264 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f603000c4c0 con 0x7f6030004800 2024-04-25T19:23:29.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.201+0000 7f6049e00640 1 --2- 172.21.15.131:0/3565838264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6030003a00 0x7f6030003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:29.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.202+0000 7f6041400640 1 --2- 172.21.15.131:0/3565838264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6030004800 0x7f6030004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:29.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.202+0000 7f6049e00640 1 -- 172.21.15.131:0/3565838264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6030004800 msgr2=0x7f6030004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:29.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.202+0000 7f6049e00640 1 --2- 172.21.15.131:0/3565838264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6030004800 0x7f6030004c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:29.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.202+0000 7f6049e00640 1 -- 172.21.15.131:0/3565838264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6030005330 msgr2=0x7f603000b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:29.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.202+0000 7f6049e00640 1 --2- 172.21.15.131:0/3565838264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6030005330 0x7f603000b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:29.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.202+0000 7f6049e00640 1 -- 172.21.15.131:0/3565838264 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6030003520 con 0x7f6030003a00 2024-04-25T19:23:29.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.202+0000 7f604a800640 1 -- 172.21.15.131:0/3565838264 reap_dead start 2024-04-25T19:23:29.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.203+0000 7f6049e00640 1 --2- 172.21.15.131:0/3565838264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6030003a00 0x7f6030003e50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f603c003db0 tx=0x7f6030005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee976720f18d7969 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:29.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.203+0000 7f6049400640 1 -- 172.21.15.131:0/3565838264 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603c037070 con 0x7f6030003a00 2024-04-25T19:23:29.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.203+0000 7f6049400640 1 -- 172.21.15.131:0/3565838264 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f603c02aa00 con 0x7f6030003a00 2024-04-25T19:23:29.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.203+0000 7f6049400640 1 -- 172.21.15.131:0/3565838264 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603c003980 con 0x7f6030003a00 2024-04-25T19:23:29.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.204+0000 7f604b200640 1 -- 172.21.15.131:0/3565838264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6030003a00 msgr2=0x7f6030003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:29.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.204+0000 7f604b200640 1 --2- 172.21.15.131:0/3565838264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6030003a00 0x7f6030003e50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f603c003db0 tx=0x7f6030005830 comp rx=0 tx=0).stop 2024-04-25T19:23:29.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.204+0000 7f604b200640 1 -- 172.21.15.131:0/3565838264 shutdown_connections 2024-04-25T19:23:29.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.204+0000 7f604b200640 1 --2- 172.21.15.131:0/3565838264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6030003a00 0x7f6030003e50 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:29.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.204+0000 7f604b200640 1 -- 172.21.15.131:0/3565838264 >> 172.21.15.131:0/3565838264 conn(0x7f604c072ee0 msgr2=0x7f604c0732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:29.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.204+0000 7f604b200640 1 -- 172.21.15.131:0/3565838264 shutdown_connections 2024-04-25T19:23:29.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.204+0000 7f604b200640 1 -- 172.21.15.131:0/3565838264 wait complete. 2024-04-25T19:23:29.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.206+0000 7f604b200640 1 Processor -- start 2024-04-25T19:23:29.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.206+0000 7f604b200640 1 -- start start 2024-04-25T19:23:29.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.208+0000 7f604b200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6030003a00 0x7f604c14d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:29.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.208+0000 7f604b200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f604c0cc970 0x7f604c0ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:29.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.208+0000 7f604b200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f604c15ae70 0x7f604c15b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:29.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.208+0000 7f604b200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f604c0d1090 con 0x7f604c0cc970 2024-04-25T19:23:29.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.208+0000 7f604b200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f604c0d0400 con 0x7f604c15ae70 2024-04-25T19:23:29.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.208+0000 7f604b200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f604c0d1210 con 0x7f6030003a00 2024-04-25T19:23:29.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.208+0000 7f6041400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f604c0cc970 0x7f604c0ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:29.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.208+0000 7f6041400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f604c0cc970 0x7f604c0ccd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33756/0 (socket says 172.21.15.131:33756) 2024-04-25T19:23:29.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.208+0000 7f6041400640 1 -- 172.21.15.131:0/2738928140 learned_addr learned my addr 172.21.15.131:0/2738928140 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:29.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.209+0000 7f6049e00640 1 --2- 172.21.15.131:0/2738928140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6030003a00 0x7f604c14d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:29.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.209+0000 7f6041400640 1 -- 172.21.15.131:0/2738928140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6030003a00 msgr2=0x7f604c14d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:29.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.209+0000 7f6041400640 1 --2- 172.21.15.131:0/2738928140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6030003a00 0x7f604c14d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:29.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.209+0000 7f6041400640 1 -- 172.21.15.131:0/2738928140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f604c15ae70 msgr2=0x7f604c15b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:29.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.209+0000 7f6041400640 1 --2- 172.21.15.131:0/2738928140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f604c15ae70 0x7f604c15b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:29.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.209+0000 7f6041400640 1 -- 172.21.15.131:0/2738928140 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f604c15eb30 con 0x7f604c0cc970 2024-04-25T19:23:29.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.209+0000 7f6049e00640 1 --2- 172.21.15.131:0/2738928140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6030003a00 0x7f604c14d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:29.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.209+0000 7f6041400640 1 --2- 172.21.15.131:0/2738928140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f604c0cc970 0x7f604c0ccd80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f603400d910 tx=0x7f603400ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:29.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.209+0000 7f6042a00640 1 -- 172.21.15.131:0/2738928140 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6034019070 con 0x7f604c0cc970 2024-04-25T19:23:29.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.209+0000 7f6042a00640 1 -- 172.21.15.131:0/2738928140 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60340074e0 con 0x7f604c0cc970 2024-04-25T19:23:29.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.209+0000 7f6042a00640 1 -- 172.21.15.131:0/2738928140 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6034004a00 con 0x7f604c0cc970 2024-04-25T19:23:29.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.209+0000 7f604b200640 1 -- 172.21.15.131:0/2738928140 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f604c15b7c0 con 0x7f604c0cc970 2024-04-25T19:23:29.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.209+0000 7f604b200640 1 -- 172.21.15.131:0/2738928140 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f604c15cd10 con 0x7f604c0cc970 2024-04-25T19:23:29.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.211+0000 7f604b200640 1 -- 172.21.15.131:0/2738928140 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f604c0cd450 con 0x7f604c0cc970 2024-04-25T19:23:29.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.212+0000 7f6042a00640 1 -- 172.21.15.131:0/2738928140 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f603401c070 con 0x7f604c0cc970 2024-04-25T19:23:29.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.213+0000 7f6042a00640 1 --2- 172.21.15.131:0/2738928140 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6028074500 0x7f6028076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:29.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.213+0000 7f6042a00640 1 -- 172.21.15.131:0/2738928140 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f6034094980 con 0x7f604c0cc970 2024-04-25T19:23:29.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.213+0000 7f6049e00640 1 --2- 172.21.15.131:0/2738928140 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6028074500 0x7f6028076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:29.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.215+0000 7f6049e00640 1 --2- 172.21.15.131:0/2738928140 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6028074500 0x7f6028076a10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f603c034000 tx=0x7f603c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:29.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.217+0000 7f6042a00640 1 -- 172.21.15.131:0/2738928140 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f604c15b7c0 con 0x7f604c0cc970 2024-04-25T19:23:29.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.490+0000 7f604b200640 1 -- 172.21.15.131:0/2738928140 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f604c0b4f90 con 0x7f604c0cc970 2024-04-25T19:23:29.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.496+0000 7f6042a00640 1 -- 172.21.15.131:0/2738928140 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f603405edf0 con 0x7f604c0cc970 2024-04-25T19:23:29.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.499+0000 7f604b200640 1 -- 172.21.15.131:0/2738928140 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6028074500 msgr2=0x7f6028076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:29.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.499+0000 7f604b200640 1 --2- 172.21.15.131:0/2738928140 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6028074500 0x7f6028076a10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f603c034000 tx=0x7f603c02e000 comp rx=0 tx=0).stop 2024-04-25T19:23:29.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.499+0000 7f604b200640 1 -- 172.21.15.131:0/2738928140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f604c0cc970 msgr2=0x7f604c0ccd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:29.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.499+0000 7f604b200640 1 --2- 172.21.15.131:0/2738928140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f604c0cc970 0x7f604c0ccd80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f603400d910 tx=0x7f603400ddd0 comp rx=0 tx=0).stop 2024-04-25T19:23:29.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.499+0000 7f604b200640 1 -- 172.21.15.131:0/2738928140 shutdown_connections 2024-04-25T19:23:29.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.499+0000 7f604b200640 1 --2- 172.21.15.131:0/2738928140 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6028074500 0x7f6028076a10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:29.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.499+0000 7f604b200640 1 --2- 172.21.15.131:0/2738928140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f604c15ae70 0x7f604c15b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:29.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.499+0000 7f604b200640 1 --2- 172.21.15.131:0/2738928140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f604c0cc970 0x7f604c0ccd80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:29.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.499+0000 7f604b200640 1 --2- 172.21.15.131:0/2738928140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6030003a00 0x7f604c14d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:29.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.499+0000 7f604b200640 1 -- 172.21.15.131:0/2738928140 >> 172.21.15.131:0/2738928140 conn(0x7f604c072ee0 msgr2=0x7f604c1543e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:29.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.500+0000 7f604b200640 1 -- 172.21.15.131:0/2738928140 shutdown_connections 2024-04-25T19:23:29.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.500+0000 7f604b200640 1 -- 172.21.15.131:0/2738928140 wait complete. 2024-04-25T19:23:29.526 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-25T19:23:29.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.785+0000 7f3dd3e00640 1 Processor -- start 2024-04-25T19:23:29.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.785+0000 7f3dd3e00640 1 -- start start 2024-04-25T19:23:29.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.787+0000 7f3dd3e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3dd406ea40 0x7f3dd40cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:29.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.787+0000 7f3dd3e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3dd40d1e90 0x7f3dd40d22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:29.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.787+0000 7f3dd3e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dd406e280 con 0x7f3dd408cd60 2024-04-25T19:23:29.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.787+0000 7f3dd3e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f3dd408ddc0 con 0x7f3dd406ea40 2024-04-25T19:23:29.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.787+0000 7f3dd3e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3dd408d880 con 0x7f3dd40d1e90 2024-04-25T19:23:29.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.788+0000 7f3dd2a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3dd406ea40 0x7f3dd40cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:29.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.788+0000 7f3dd2a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3dd406ea40 0x7f3dd40cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33770/0 (socket says 172.21.15.131:33770) 2024-04-25T19:23:29.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.788+0000 7f3dd2a00640 1 -- 172.21.15.131:0/1502784970 learned_addr learned my addr 172.21.15.131:0/1502784970 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:29.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.788+0000 7f3dd3400640 1 --2- 172.21.15.131:0/1502784970 >> v2:172.21.15.195:3300/0 conn(0x7f3dd40d1e90 0x7f3dd40d22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:29.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.788+0000 7f3dd2a00640 1 -- 172.21.15.131:0/1502784970 >> v2:172.21.15.195:3300/0 conn(0x7f3dd40d1e90 msgr2=0x7f3dd40d22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:29.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.788+0000 7f3dd2a00640 1 --2- 172.21.15.131:0/1502784970 >> v2:172.21.15.195:3300/0 conn(0x7f3dd40d1e90 0x7f3dd40d22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:29.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.788+0000 7f3dd2a00640 1 -- 172.21.15.131:0/1502784970 >> v1:172.21.15.195:6789/0 conn(0x7f3dd408cd60 legacy=0x7f3dd408d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:29.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.788+0000 7f3dd2a00640 1 -- 172.21.15.131:0/1502784970 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd408dae0 con 0x7f3dd406ea40 2024-04-25T19:23:29.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.790+0000 7f3dd2a00640 1 --2- 172.21.15.131:0/1502784970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3dd406ea40 0x7f3dd40cfa40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40740e0 tx=0x7f3dc402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f939c4781a400477 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:29.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.793+0000 7f3dd1600640 1 -- 172.21.15.131:0/1502784970 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4037070 con 0x7f3dd406ea40 2024-04-25T19:23:29.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.793+0000 7f3dd1600640 1 -- 172.21.15.131:0/1502784970 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc4032440 con 0x7f3dd406ea40 2024-04-25T19:23:29.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.793+0000 7f3dd1600640 1 -- 172.21.15.131:0/1502784970 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4032810 con 0x7f3dd406ea40 2024-04-25T19:23:29.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.794+0000 7f3dd3e00640 1 -- 172.21.15.131:0/1502784970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3dd406ea40 msgr2=0x7f3dd40cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:29.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.794+0000 7f3dd3e00640 1 --2- 172.21.15.131:0/1502784970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3dd406ea40 0x7f3dd40cfa40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40740e0 tx=0x7f3dc402a230 comp rx=0 tx=0).stop 2024-04-25T19:23:29.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.794+0000 7f3dd3e00640 1 -- 172.21.15.131:0/1502784970 shutdown_connections 2024-04-25T19:23:29.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.794+0000 7f3dd3e00640 1 --2- 172.21.15.131:0/1502784970 >> v2:172.21.15.195:3300/0 conn(0x7f3dd40d1e90 0x7f3dd40d22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:29.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.794+0000 7f3dd3e00640 1 --2- 172.21.15.131:0/1502784970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3dd406ea40 0x7f3dd40cfa40 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:29.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.794+0000 7f3dd3e00640 1 -- 172.21.15.131:0/1502784970 >> 172.21.15.131:0/1502784970 conn(0x7f3dd40b5460 msgr2=0x7f3dd40b5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:29.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.794+0000 7f3dd3e00640 1 -- 172.21.15.131:0/1502784970 shutdown_connections 2024-04-25T19:23:29.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.794+0000 7f3dd3e00640 1 -- 172.21.15.131:0/1502784970 wait complete. 2024-04-25T19:23:29.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.797+0000 7f3dd3e00640 1 Processor -- start 2024-04-25T19:23:29.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.797+0000 7f3dd3e00640 1 -- start start 2024-04-25T19:23:29.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.798+0000 7f3dd3e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3dd408cd60 0x7f3dd40c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:29.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.798+0000 7f3dd3e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3dd40d1e90 0x7f3dd4150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:29.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.798+0000 7f3dd3e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3dd40cc0a0 0x7f3dd40cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:29.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.798+0000 7f3dd3e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd40b6190 con 0x7f3dd408cd60 2024-04-25T19:23:29.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.798+0000 7f3dd3e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd40b8fb0 con 0x7f3dd40cc0a0 2024-04-25T19:23:29.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.798+0000 7f3dd3e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3dd40b6310 con 0x7f3dd40d1e90 2024-04-25T19:23:29.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.799+0000 7f3dd2a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3dd408cd60 0x7f3dd40c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:29.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.799+0000 7f3dd2a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3dd408cd60 0x7f3dd40c7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33772/0 (socket says 172.21.15.131:33772) 2024-04-25T19:23:29.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.799+0000 7f3dd2a00640 1 -- 172.21.15.131:0/1210659432 learned_addr learned my addr 172.21.15.131:0/1210659432 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:29.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.799+0000 7f3dd2a00640 1 -- 172.21.15.131:0/1210659432 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3dd40d1e90 msgr2=0x7f3dd4150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:29.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.799+0000 7f3dd2a00640 1 --2- 172.21.15.131:0/1210659432 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3dd40d1e90 0x7f3dd4150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:29.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.799+0000 7f3dd2a00640 1 -- 172.21.15.131:0/1210659432 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3dd40cc0a0 msgr2=0x7f3dd40cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:29.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.799+0000 7f3dd2a00640 1 --2- 172.21.15.131:0/1210659432 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3dd40cc0a0 0x7f3dd40cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:29.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.799+0000 7f3dd2a00640 1 -- 172.21.15.131:0/1210659432 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd40cc9f0 con 0x7f3dd408cd60 2024-04-25T19:23:29.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.799+0000 7f3dd2a00640 1 --2- 172.21.15.131:0/1210659432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3dd408cd60 0x7f3dd40c7e60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4000c00 tx=0x7f3dc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:29.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.800+0000 7f3dcaa00640 1 -- 172.21.15.131:0/1210659432 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4037040 con 0x7f3dd408cd60 2024-04-25T19:23:29.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.800+0000 7f3dcaa00640 1 -- 172.21.15.131:0/1210659432 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc4004230 con 0x7f3dd408cd60 2024-04-25T19:23:29.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.800+0000 7f3dd3e00640 1 -- 172.21.15.131:0/1210659432 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd415a5b0 con 0x7f3dd408cd60 2024-04-25T19:23:29.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.800+0000 7f3dcaa00640 1 -- 172.21.15.131:0/1210659432 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4003610 con 0x7f3dd408cd60 2024-04-25T19:23:29.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.800+0000 7f3dd3e00640 1 -- 172.21.15.131:0/1210659432 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd40c8bd0 con 0x7f3dd408cd60 2024-04-25T19:23:29.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.801+0000 7f3dd3e00640 1 -- 172.21.15.131:0/1210659432 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd4050740 con 0x7f3dd408cd60 2024-04-25T19:23:29.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.802+0000 7f3dcaa00640 1 -- 172.21.15.131:0/1210659432 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3dc40037b0 con 0x7f3dd408cd60 2024-04-25T19:23:29.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.803+0000 7f3dcaa00640 1 --2- 172.21.15.131:0/1210659432 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3db40744e0 0x7f3db40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:29.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.803+0000 7f3dcaa00640 1 -- 172.21.15.131:0/1210659432 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f3dc40b5be0 con 0x7f3dd408cd60 2024-04-25T19:23:29.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.804+0000 7f3dd2000640 1 --2- 172.21.15.131:0/1210659432 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3db40744e0 0x7f3db40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:29.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.805+0000 7f3dd2000640 1 --2- 172.21.15.131:0/1210659432 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3db40744e0 0x7f3db40769f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40b4a50 tx=0x7f3dc0006ba0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:29.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:29.808+0000 7f3dcaa00640 1 -- 172.21.15.131:0/1210659432 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3dd40cc9f0 con 0x7f3dd408cd60 2024-04-25T19:23:30.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.062+0000 7f3dd3e00640 1 -- 172.21.15.131:0/1210659432 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f3dd41e60b0 con 0x7f3dd408cd60 2024-04-25T19:23:30.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.069+0000 7f3dcaa00640 1 -- 172.21.15.131:0/1210659432 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7f3dc4080750 con 0x7f3dd408cd60 2024-04-25T19:23:30.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.072+0000 7f3dd3e00640 1 -- 172.21.15.131:0/1210659432 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3db40744e0 msgr2=0x7f3db40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:30.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.072+0000 7f3dd3e00640 1 --2- 172.21.15.131:0/1210659432 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3db40744e0 0x7f3db40769f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40b4a50 tx=0x7f3dc0006ba0 comp rx=0 tx=0).stop 2024-04-25T19:23:30.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.072+0000 7f3dd3e00640 1 -- 172.21.15.131:0/1210659432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3dd408cd60 msgr2=0x7f3dd40c7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:30.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.072+0000 7f3dd3e00640 1 --2- 172.21.15.131:0/1210659432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3dd408cd60 0x7f3dd40c7e60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4000c00 tx=0x7f3dc40046c0 comp rx=0 tx=0).stop 2024-04-25T19:23:30.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.073+0000 7f3dd3e00640 1 -- 172.21.15.131:0/1210659432 shutdown_connections 2024-04-25T19:23:30.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.073+0000 7f3dd3e00640 1 --2- 172.21.15.131:0/1210659432 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3db40744e0 0x7f3db40769f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:30.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.073+0000 7f3dd3e00640 1 --2- 172.21.15.131:0/1210659432 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3dd40d1e90 0x7f3dd4150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:30.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.073+0000 7f3dd3e00640 1 --2- 172.21.15.131:0/1210659432 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3dd40cc0a0 0x7f3dd40cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:30.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.073+0000 7f3dd3e00640 1 --2- 172.21.15.131:0/1210659432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3dd408cd60 0x7f3dd40c7e60 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:30.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.073+0000 7f3dd3e00640 1 -- 172.21.15.131:0/1210659432 >> 172.21.15.131:0/1210659432 conn(0x7f3dd40b5460 msgr2=0x7f3dd406db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:30.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.073+0000 7f3dd3e00640 1 -- 172.21.15.131:0/1210659432 shutdown_connections 2024-04-25T19:23:30.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.073+0000 7f3dd3e00640 1 -- 172.21.15.131:0/1210659432 wait complete. 2024-04-25T19:23:30.099 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-25T19:23:30.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.359+0000 7fc637200640 1 Processor -- start 2024-04-25T19:23:30.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.360+0000 7fc637200640 1 -- start start 2024-04-25T19:23:30.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.362+0000 7fc637200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6301443c0 0x7fc63006fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:30.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.362+0000 7fc637200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc630070370 0x7fc6300cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:30.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.362+0000 7fc637200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6300cff30 con 0x7fc6300cfb20 2024-04-25T19:23:30.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.362+0000 7fc637200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fc6300708d0 con 0x7fc630070370 2024-04-25T19:23:30.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.362+0000 7fc637200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc63015f160 con 0x7fc6301443c0 2024-04-25T19:23:30.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.362+0000 7fc635200640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fc6300cfb20 0x7fc6300ce330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:44916/0 (socket says 172.21.15.131:44916) 2024-04-25T19:23:30.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.362+0000 7fc635200640 1 -- 172.21.15.131:0/1002432647 learned_addr learned my addr 172.21.15.131:0/1002432647 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:30.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.362+0000 7fc62f400640 1 --2- 172.21.15.131:0/1002432647 >> v2:172.21.15.131:3300/0 conn(0x7fc630070370 0x7fc6300cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:30.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.363+0000 7fc62fe00640 1 --2- 172.21.15.131:0/1002432647 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6301443c0 0x7fc63006fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:30.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.363+0000 7fc62f400640 1 -- 172.21.15.131:0/1002432647 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6301443c0 msgr2=0x7fc63006fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:30.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.363+0000 7fc62f400640 1 --2- 172.21.15.131:0/1002432647 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6301443c0 0x7fc63006fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:30.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.363+0000 7fc62f400640 1 -- 172.21.15.131:0/1002432647 >> v1:172.21.15.131:6789/0 conn(0x7fc6300cfb20 legacy=0x7fc6300ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:30.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.363+0000 7fc62f400640 1 -- 172.21.15.131:0/1002432647 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc63015f5f0 con 0x7fc630070370 2024-04-25T19:23:30.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.363+0000 7fc62ea00640 1 -- 172.21.15.131:0/1002432647 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 904521171 0 0) 0x7fc628001110 con 0x7fc6300cfb20 2024-04-25T19:23:30.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.364+0000 7fc62f400640 1 --2- 172.21.15.131:0/1002432647 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc630070370 0x7fc6300cf5e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc620009d90 tx=0x7fc62002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7116595b2059646 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:30.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.364+0000 7fc62ea00640 1 -- 172.21.15.131:0/1002432647 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620007740 con 0x7fc630070370 2024-04-25T19:23:30.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.364+0000 7fc62ea00640 1 -- 172.21.15.131:0/1002432647 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6200078e0 con 0x7fc630070370 2024-04-25T19:23:30.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.364+0000 7fc62ea00640 1 -- 172.21.15.131:0/1002432647 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620007cb0 con 0x7fc630070370 2024-04-25T19:23:30.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.365+0000 7fc637200640 1 -- 172.21.15.131:0/1002432647 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc630070370 msgr2=0x7fc6300cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:30.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.365+0000 7fc637200640 1 --2- 172.21.15.131:0/1002432647 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc630070370 0x7fc6300cf5e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc620009d90 tx=0x7fc62002a660 comp rx=0 tx=0).stop 2024-04-25T19:23:30.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.365+0000 7fc637200640 1 -- 172.21.15.131:0/1002432647 shutdown_connections 2024-04-25T19:23:30.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.365+0000 7fc637200640 1 --2- 172.21.15.131:0/1002432647 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc630070370 0x7fc6300cf5e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:30.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.365+0000 7fc637200640 1 --2- 172.21.15.131:0/1002432647 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6301443c0 0x7fc63006fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:30.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.365+0000 7fc637200640 1 -- 172.21.15.131:0/1002432647 >> 172.21.15.131:0/1002432647 conn(0x7fc6300d1ae0 msgr2=0x7fc6300d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:30.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.365+0000 7fc637200640 1 -- 172.21.15.131:0/1002432647 shutdown_connections 2024-04-25T19:23:30.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.365+0000 7fc637200640 1 -- 172.21.15.131:0/1002432647 wait complete. 2024-04-25T19:23:30.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.368+0000 7fc637200640 1 Processor -- start 2024-04-25T19:23:30.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.368+0000 7fc637200640 1 -- start start 2024-04-25T19:23:30.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.369+0000 7fc637200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc630070370 0x7fc63015b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:30.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.369+0000 7fc637200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6300cfb20 0x7fc6300af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:30.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.369+0000 7fc637200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6301443c0 0x7fc6300af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:30.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.369+0000 7fc637200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc63015edf0 con 0x7fc6301443c0 2024-04-25T19:23:30.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.369+0000 7fc637200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc63015eb10 con 0x7fc630070370 2024-04-25T19:23:30.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.369+0000 7fc637200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc63006d5d0 con 0x7fc6300cfb20 2024-04-25T19:23:30.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.370+0000 7fc635200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6301443c0 0x7fc6300af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:30.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.370+0000 7fc635200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6301443c0 0x7fc6300af580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33786/0 (socket says 172.21.15.131:33786) 2024-04-25T19:23:30.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.370+0000 7fc635200640 1 -- 172.21.15.131:0/1367475720 learned_addr learned my addr 172.21.15.131:0/1367475720 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:30.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.370+0000 7fc62fe00640 1 --2- 172.21.15.131:0/1367475720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc630070370 0x7fc63015b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:30.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.370+0000 7fc62f400640 1 --2- 172.21.15.131:0/1367475720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6300cfb20 0x7fc6300af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:30.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.370+0000 7fc635200640 1 -- 172.21.15.131:0/1367475720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6300cfb20 msgr2=0x7fc6300af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:30.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.370+0000 7fc635200640 1 --2- 172.21.15.131:0/1367475720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6300cfb20 0x7fc6300af040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:30.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.370+0000 7fc635200640 1 -- 172.21.15.131:0/1367475720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc630070370 msgr2=0x7fc63015b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:30.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.370+0000 7fc635200640 1 --2- 172.21.15.131:0/1367475720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc630070370 0x7fc63015b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:30.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.370+0000 7fc635200640 1 -- 172.21.15.131:0/1367475720 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6300b6370 con 0x7fc6301443c0 2024-04-25T19:23:30.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.370+0000 7fc635200640 1 --2- 172.21.15.131:0/1367475720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6301443c0 0x7fc6300af580 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc62800c410 tx=0x7fc62800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:30.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.371+0000 7fc627e00640 1 -- 172.21.15.131:0/1367475720 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6280074e0 con 0x7fc6301443c0 2024-04-25T19:23:30.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.371+0000 7fc627e00640 1 -- 172.21.15.131:0/1367475720 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6280047e0 con 0x7fc6301443c0 2024-04-25T19:23:30.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.371+0000 7fc627e00640 1 -- 172.21.15.131:0/1367475720 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc628004bd0 con 0x7fc6301443c0 2024-04-25T19:23:30.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.371+0000 7fc637200640 1 -- 172.21.15.131:0/1367475720 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc630139b50 con 0x7fc6301443c0 2024-04-25T19:23:30.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.371+0000 7fc637200640 1 -- 172.21.15.131:0/1367475720 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6300b5890 con 0x7fc6301443c0 2024-04-25T19:23:30.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.372+0000 7fc637200640 1 -- 172.21.15.131:0/1367475720 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6301398c0 con 0x7fc6301443c0 2024-04-25T19:23:30.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.373+0000 7fc627e00640 1 -- 172.21.15.131:0/1367475720 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc628011070 con 0x7fc6301443c0 2024-04-25T19:23:30.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.374+0000 7fc627e00640 1 --2- 172.21.15.131:0/1367475720 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc60c0744b0 0x7fc60c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:30.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.374+0000 7fc627e00640 1 -- 172.21.15.131:0/1367475720 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fc628094b40 con 0x7fc6301443c0 2024-04-25T19:23:30.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.375+0000 7fc62fe00640 1 --2- 172.21.15.131:0/1367475720 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc60c0744b0 0x7fc60c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:30.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.376+0000 7fc62fe00640 1 --2- 172.21.15.131:0/1367475720 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc60c0744b0 0x7fc60c0769c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc618006fd0 tx=0x7fc618008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:30.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.379+0000 7fc627e00640 1 -- 172.21.15.131:0/1367475720 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc6300cff30 con 0x7fc6301443c0 2024-04-25T19:23:30.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.642+0000 7fc637200640 1 -- 172.21.15.131:0/1367475720 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fc63006f950 con 0x7fc6301443c0 2024-04-25T19:23:30.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.647+0000 7fc627e00640 1 -- 172.21.15.131:0/1367475720 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7fc62805f580 con 0x7fc6301443c0 2024-04-25T19:23:30.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.650+0000 7fc637200640 1 -- 172.21.15.131:0/1367475720 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc60c0744b0 msgr2=0x7fc60c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:30.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.650+0000 7fc637200640 1 --2- 172.21.15.131:0/1367475720 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc60c0744b0 0x7fc60c0769c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc618006fd0 tx=0x7fc618008040 comp rx=0 tx=0).stop 2024-04-25T19:23:30.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.650+0000 7fc637200640 1 -- 172.21.15.131:0/1367475720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6301443c0 msgr2=0x7fc6300af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:30.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.650+0000 7fc637200640 1 --2- 172.21.15.131:0/1367475720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6301443c0 0x7fc6300af580 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc62800c410 tx=0x7fc62800c8d0 comp rx=0 tx=0).stop 2024-04-25T19:23:30.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.650+0000 7fc637200640 1 -- 172.21.15.131:0/1367475720 shutdown_connections 2024-04-25T19:23:30.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.650+0000 7fc637200640 1 --2- 172.21.15.131:0/1367475720 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc60c0744b0 0x7fc60c0769c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:30.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.650+0000 7fc637200640 1 --2- 172.21.15.131:0/1367475720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6300cfb20 0x7fc6300af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:30.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.650+0000 7fc637200640 1 --2- 172.21.15.131:0/1367475720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6301443c0 0x7fc6300af580 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:30.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.650+0000 7fc637200640 1 --2- 172.21.15.131:0/1367475720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc630070370 0x7fc63015b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:30.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.650+0000 7fc637200640 1 -- 172.21.15.131:0/1367475720 >> 172.21.15.131:0/1367475720 conn(0x7fc6300d1ae0 msgr2=0x7fc6300b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:30.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.650+0000 7fc637200640 1 -- 172.21.15.131:0/1367475720 shutdown_connections 2024-04-25T19:23:30.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.651+0000 7fc637200640 1 -- 172.21.15.131:0/1367475720 wait complete. 2024-04-25T19:23:30.677 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:23:30.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.928+0000 7faf47e00640 1 Processor -- start 2024-04-25T19:23:30.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.929+0000 7faf47e00640 1 -- start start 2024-04-25T19:23:30.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.931+0000 7faf47e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7faf4806c5c0 0x7faf480cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:30.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.931+0000 7faf47e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf480d1230 con 0x7faf48144370 2024-04-25T19:23:30.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.931+0000 7faf47e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf480d06b0 con 0x7faf480b4ea0 2024-04-25T19:23:30.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.931+0000 7faf47e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7faf480d0990 con 0x7faf4806c5c0 2024-04-25T19:23:30.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.931+0000 7faf46000640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7faf48144370 0x7faf480b4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:44932/0 (socket says 172.21.15.131:44932) 2024-04-25T19:23:30.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.931+0000 7faf46000640 1 -- 172.21.15.131:0/676129649 learned_addr learned my addr 172.21.15.131:0/676129649 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:30.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.932+0000 7faf46a00640 1 --2- 172.21.15.131:0/676129649 >> v2:172.21.15.195:3300/0 conn(0x7faf4806c5c0 0x7faf480cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:30.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.932+0000 7faf45600640 1 -- 172.21.15.131:0/676129649 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2195642142 0 0) 0x7faf480d1230 con 0x7faf48144370 2024-04-25T19:23:30.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.932+0000 7faf45600640 1 -- 172.21.15.131:0/676129649 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf2c003520 con 0x7faf48144370 2024-04-25T19:23:30.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.932+0000 7faf45600640 1 -- 172.21.15.131:0/676129649 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2165871485 0 0) 0x7faf2c003520 con 0x7faf48144370 2024-04-25T19:23:30.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.932+0000 7faf45600640 1 -- 172.21.15.131:0/676129649 >> v2:172.21.15.195:3300/0 conn(0x7faf4806c5c0 msgr2=0x7faf480cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:30.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.932+0000 7faf45600640 1 --2- 172.21.15.131:0/676129649 >> v2:172.21.15.195:3300/0 conn(0x7faf4806c5c0 0x7faf480cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:30.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.932+0000 7faf45600640 1 -- 172.21.15.131:0/676129649 >> v1:172.21.15.195:6789/0 conn(0x7faf480b4ea0 legacy=0x7faf4815e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:30.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.932+0000 7faf45600640 1 -- 172.21.15.131:0/676129649 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf480d0c70 con 0x7faf48144370 2024-04-25T19:23:30.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.932+0000 7faf45600640 1 -- 172.21.15.131:0/676129649 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7faf34001670 con 0x7faf48144370 2024-04-25T19:23:30.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.932+0000 7faf45600640 1 -- 172.21.15.131:0/676129649 >> v1:172.21.15.131:6789/0 conn(0x7faf48144370 legacy=0x7faf480b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:30.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.932+0000 7faf45600640 1 --2- 172.21.15.131:0/676129649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf2c0039b0 0x7faf2c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:30.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.932+0000 7faf45600640 1 --2- 172.21.15.131:0/676129649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf2c004800 0x7faf2c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:30.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.932+0000 7faf45600640 1 --2- 172.21.15.131:0/676129649 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf2c005270 0x7faf2c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:30.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.933+0000 7faf45600640 1 -- 172.21.15.131:0/676129649 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7faf480d0990 con 0x7faf2c004800 2024-04-25T19:23:30.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.933+0000 7faf45600640 1 -- 172.21.15.131:0/676129649 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c00c200 con 0x7faf2c0039b0 2024-04-25T19:23:30.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.933+0000 7faf45600640 1 -- 172.21.15.131:0/676129649 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faf2c00c400 con 0x7faf2c005270 2024-04-25T19:23:30.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.933+0000 7faf46000640 1 --2- 172.21.15.131:0/676129649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf2c004800 0x7faf2c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:30.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.933+0000 7faf46a00640 1 --2- 172.21.15.131:0/676129649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf2c0039b0 0x7faf2c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:30.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.933+0000 7faf46000640 1 -- 172.21.15.131:0/676129649 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf2c005270 msgr2=0x7faf2c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:30.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.933+0000 7faf46000640 1 --2- 172.21.15.131:0/676129649 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf2c005270 0x7faf2c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:30.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.933+0000 7faf46000640 1 -- 172.21.15.131:0/676129649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf2c0039b0 msgr2=0x7faf2c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:30.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.933+0000 7faf46000640 1 --2- 172.21.15.131:0/676129649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf2c0039b0 0x7faf2c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:30.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.933+0000 7faf46000640 1 -- 172.21.15.131:0/676129649 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf2c003520 con 0x7faf2c004800 2024-04-25T19:23:30.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.933+0000 7faf47400640 1 -- 172.21.15.131:0/676129649 reap_dead start 2024-04-25T19:23:30.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.934+0000 7faf46000640 1 --2- 172.21.15.131:0/676129649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf2c004800 0x7faf2c004c10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7faf3400c240 tx=0x7faf2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8239e6434593297d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:30.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.935+0000 7faf45600640 1 -- 172.21.15.131:0/676129649 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf34007d10 con 0x7faf2c004800 2024-04-25T19:23:30.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.935+0000 7faf45600640 1 -- 172.21.15.131:0/676129649 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf34005ad0 con 0x7faf2c004800 2024-04-25T19:23:30.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.935+0000 7faf45600640 1 -- 172.21.15.131:0/676129649 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf34007070 con 0x7faf2c004800 2024-04-25T19:23:30.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.935+0000 7faf47e00640 1 -- 172.21.15.131:0/676129649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf2c004800 msgr2=0x7faf2c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:30.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.935+0000 7faf47e00640 1 --2- 172.21.15.131:0/676129649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf2c004800 0x7faf2c004c10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7faf3400c240 tx=0x7faf2c005830 comp rx=0 tx=0).stop 2024-04-25T19:23:30.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.935+0000 7faf47e00640 1 -- 172.21.15.131:0/676129649 shutdown_connections 2024-04-25T19:23:30.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.935+0000 7faf47e00640 1 --2- 172.21.15.131:0/676129649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf2c004800 0x7faf2c004c10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:30.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.935+0000 7faf47e00640 1 -- 172.21.15.131:0/676129649 >> 172.21.15.131:0/676129649 conn(0x7faf480d1720 msgr2=0x7faf480d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:30.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.936+0000 7faf47e00640 1 -- 172.21.15.131:0/676129649 shutdown_connections 2024-04-25T19:23:30.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.936+0000 7faf47e00640 1 -- 172.21.15.131:0/676129649 wait complete. 2024-04-25T19:23:30.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.938+0000 7faf47e00640 1 Processor -- start 2024-04-25T19:23:30.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.938+0000 7faf47e00640 1 -- start start 2024-04-25T19:23:30.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.940+0000 7faf47e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf2c004800 0x7faf4813afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:30.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.940+0000 7faf47e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf48161370 0x7faf48161780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:30.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.940+0000 7faf47e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf480cb390 0x7faf480cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:30.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.940+0000 7faf47e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7faf480d0450 con 0x7faf480cb390 2024-04-25T19:23:30.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.940+0000 7faf47e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7faf480d02d0 con 0x7faf2c004800 2024-04-25T19:23:30.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.940+0000 7faf47e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faf48147760 con 0x7faf48161370 2024-04-25T19:23:30.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.940+0000 7faf47400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf480cb390 0x7faf480cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:30.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.940+0000 7faf47400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf480cb390 0x7faf480cb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33794/0 (socket says 172.21.15.131:33794) 2024-04-25T19:23:30.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.940+0000 7faf47400640 1 -- 172.21.15.131:0/3269875442 learned_addr learned my addr 172.21.15.131:0/3269875442 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:30.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.940+0000 7faf46000640 1 --2- 172.21.15.131:0/3269875442 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf48161370 0x7faf48161780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:30.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.940+0000 7faf46a00640 1 --2- 172.21.15.131:0/3269875442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf2c004800 0x7faf4813afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:30.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.940+0000 7faf47400640 1 -- 172.21.15.131:0/3269875442 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf48161370 msgr2=0x7faf48161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:30.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.940+0000 7faf47400640 1 --2- 172.21.15.131:0/3269875442 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf48161370 0x7faf48161780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:30.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.941+0000 7faf47400640 1 -- 172.21.15.131:0/3269875442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf2c004800 msgr2=0x7faf4813afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:30.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.941+0000 7faf47400640 1 --2- 172.21.15.131:0/3269875442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf2c004800 0x7faf4813afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:30.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.941+0000 7faf47400640 1 -- 172.21.15.131:0/3269875442 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf480cbce0 con 0x7faf480cb390 2024-04-25T19:23:30.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.941+0000 7faf46a00640 1 --2- 172.21.15.131:0/3269875442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf2c004800 0x7faf4813afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:30.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.941+0000 7faf47400640 1 --2- 172.21.15.131:0/3269875442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf480cb390 0x7faf480cb7a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7faf480b6bf0 tx=0x7faf4000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:30.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.941+0000 7faf3ea00640 1 -- 172.21.15.131:0/3269875442 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf40017070 con 0x7faf480cb390 2024-04-25T19:23:30.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.941+0000 7faf3ea00640 1 -- 172.21.15.131:0/3269875442 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf40005d60 con 0x7faf480cb390 2024-04-25T19:23:30.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.941+0000 7faf3ea00640 1 -- 172.21.15.131:0/3269875442 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4000a850 con 0x7faf480cb390 2024-04-25T19:23:30.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.941+0000 7faf47e00640 1 -- 172.21.15.131:0/3269875442 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf48162080 con 0x7faf480cb390 2024-04-25T19:23:30.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.941+0000 7faf47e00640 1 -- 172.21.15.131:0/3269875442 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf4806faa0 con 0x7faf480cb390 2024-04-25T19:23:30.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.943+0000 7faf47e00640 1 -- 172.21.15.131:0/3269875442 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf48050740 con 0x7faf480cb390 2024-04-25T19:23:30.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.944+0000 7faf3ea00640 1 -- 172.21.15.131:0/3269875442 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7faf4001a070 con 0x7faf480cb390 2024-04-25T19:23:30.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.945+0000 7faf3ea00640 1 --2- 172.21.15.131:0/3269875442 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7faf280744e0 0x7faf280769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:30.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.945+0000 7faf3ea00640 1 -- 172.21.15.131:0/3269875442 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7faf40093f20 con 0x7faf480cb390 2024-04-25T19:23:30.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.945+0000 7faf46a00640 1 --2- 172.21.15.131:0/3269875442 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7faf280744e0 0x7faf280769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:30.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.947+0000 7faf46a00640 1 --2- 172.21.15.131:0/3269875442 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7faf280744e0 0x7faf280769f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faf38006fd0 tx=0x7faf38008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:30.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:30.950+0000 7faf3ea00640 1 -- 172.21.15.131:0/3269875442 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faf480cbce0 con 0x7faf480cb390 2024-04-25T19:23:31.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.155+0000 7faf47e00640 1 -- 172.21.15.131:0/3269875442 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf48068a10 con 0x7faf480cb390 2024-04-25T19:23:31.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.157+0000 7faf3ea00640 1 -- 172.21.15.131:0/3269875442 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+12915 (secure 0 0 0) 0x7faf4005e960 con 0x7faf480cb390 2024-04-25T19:23:31.159 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:31.159 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":29,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:23:26.601095+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:23:31.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.160+0000 7faf47e00640 1 -- 172.21.15.131:0/3269875442 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7faf280744e0 msgr2=0x7faf280769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:31.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.160+0000 7faf47e00640 1 --2- 172.21.15.131:0/3269875442 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7faf280744e0 0x7faf280769f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faf38006fd0 tx=0x7faf38008040 comp rx=0 tx=0).stop 2024-04-25T19:23:31.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.160+0000 7faf47e00640 1 -- 172.21.15.131:0/3269875442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf480cb390 msgr2=0x7faf480cb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:31.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.160+0000 7faf47e00640 1 --2- 172.21.15.131:0/3269875442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf480cb390 0x7faf480cb7a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7faf480b6bf0 tx=0x7faf4000cb90 comp rx=0 tx=0).stop 2024-04-25T19:23:31.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.160+0000 7faf47e00640 1 -- 172.21.15.131:0/3269875442 shutdown_connections 2024-04-25T19:23:31.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.160+0000 7faf47e00640 1 --2- 172.21.15.131:0/3269875442 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7faf280744e0 0x7faf280769f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:31.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.160+0000 7faf47e00640 1 --2- 172.21.15.131:0/3269875442 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf48161370 0x7faf48161780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:31.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.160+0000 7faf47e00640 1 --2- 172.21.15.131:0/3269875442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf480cb390 0x7faf480cb7a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:31.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.160+0000 7faf47e00640 1 --2- 172.21.15.131:0/3269875442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf2c004800 0x7faf4813afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:31.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.160+0000 7faf47e00640 1 -- 172.21.15.131:0/3269875442 >> 172.21.15.131:0/3269875442 conn(0x7faf480d1720 msgr2=0x7faf4815ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:31.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.160+0000 7faf47e00640 1 -- 172.21.15.131:0/3269875442 shutdown_connections 2024-04-25T19:23:31.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.160+0000 7faf47e00640 1 -- 172.21.15.131:0/3269875442 wait complete. 2024-04-25T19:23:31.185 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T19:22:04.178847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T19:23:31.186 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T19:23:31.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.455+0000 7f8dfd000640 1 Processor -- start 2024-04-25T19:23:31.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.456+0000 7f8dfd000640 1 -- start start 2024-04-25T19:23:31.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.458+0000 7f8dfd000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8df8070820 0x7f8df815f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:31.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.458+0000 7f8dfd000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8df8070c30 con 0x7f8df8158850 2024-04-25T19:23:31.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.458+0000 7f8dfd000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8df815ef90 con 0x7f8df815fe40 2024-04-25T19:23:31.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.458+0000 7f8dfd000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8df8158c60 con 0x7f8df8070820 2024-04-25T19:23:31.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.458+0000 7f8df5e00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f8df8158850 0x7f8df815e780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:44946/0 (socket says 172.21.15.131:44946) 2024-04-25T19:23:31.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.458+0000 7f8df5e00640 1 -- 172.21.15.131:0/3747156930 learned_addr learned my addr 172.21.15.131:0/3747156930 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:31.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.459+0000 7f8defe00640 1 --2- 172.21.15.131:0/3747156930 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8df8070820 0x7f8df815f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:31.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.459+0000 7f8df5400640 1 -- 172.21.15.131:0/3747156930 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3522111834 0 0) 0x7f8df8070c30 con 0x7f8df8158850 2024-04-25T19:23:31.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.459+0000 7f8df5400640 1 -- 172.21.15.131:0/3747156930 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ddc003520 con 0x7f8df8158850 2024-04-25T19:23:31.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.459+0000 7f8df5400640 1 -- 172.21.15.131:0/3747156930 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1456346958 0 0) 0x7f8ddc003520 con 0x7f8df8158850 2024-04-25T19:23:31.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.459+0000 7f8df5400640 1 -- 172.21.15.131:0/3747156930 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8df8070820 msgr2=0x7f8df815f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:31.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.459+0000 7f8df5400640 1 --2- 172.21.15.131:0/3747156930 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8df8070820 0x7f8df815f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:31.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.459+0000 7f8df5400640 1 -- 172.21.15.131:0/3747156930 >> v1:172.21.15.195:6789/0 conn(0x7f8df815fe40 legacy=0x7f8df806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:31.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.459+0000 7f8df5400640 1 -- 172.21.15.131:0/3747156930 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df815f270 con 0x7f8df8158850 2024-04-25T19:23:31.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.459+0000 7f8df5400640 1 -- 172.21.15.131:0/3747156930 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f8de8001670 con 0x7f8df8158850 2024-04-25T19:23:31.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.459+0000 7f8df5400640 1 -- 172.21.15.131:0/3747156930 >> v1:172.21.15.131:6789/0 conn(0x7f8df8158850 legacy=0x7f8df815e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:31.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.459+0000 7f8df5400640 1 --2- 172.21.15.131:0/3747156930 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8df8070820 0x7f8ddc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:31.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.460+0000 7f8df5400640 1 --2- 172.21.15.131:0/3747156930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ddc003fb0 0x7f8ddc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:31.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.460+0000 7f8df5400640 1 --2- 172.21.15.131:0/3747156930 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ddc004d40 0x7f8ddc0051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:31.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.460+0000 7f8df5400640 1 -- 172.21.15.131:0/3747156930 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8df8158c60 con 0x7f8ddc003fb0 2024-04-25T19:23:31.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.460+0000 7f8df5400640 1 -- 172.21.15.131:0/3747156930 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc00bbb0 con 0x7f8ddc004d40 2024-04-25T19:23:31.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.460+0000 7f8df5400640 1 -- 172.21.15.131:0/3747156930 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8ddc00bdb0 con 0x7f8df8070820 2024-04-25T19:23:31.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.460+0000 7f8defe00640 1 --2- 172.21.15.131:0/3747156930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ddc003fb0 0x7f8ddc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:31.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.460+0000 7f8defe00640 1 -- 172.21.15.131:0/3747156930 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8df8070820 msgr2=0x7f8ddc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:31.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.460+0000 7f8df5e00640 1 --2- 172.21.15.131:0/3747156930 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8df8070820 0x7f8ddc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:31.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.460+0000 7f8defe00640 1 --2- 172.21.15.131:0/3747156930 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8df8070820 0x7f8ddc0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:31.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.460+0000 7f8defe00640 1 -- 172.21.15.131:0/3747156930 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ddc004d40 msgr2=0x7f8ddc0051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:31.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.460+0000 7f8defe00640 1 --2- 172.21.15.131:0/3747156930 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ddc004d40 0x7f8ddc0051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:31.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.460+0000 7f8defe00640 1 -- 172.21.15.131:0/3747156930 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ddc003520 con 0x7f8ddc003fb0 2024-04-25T19:23:31.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.460+0000 7f8df5e00640 1 --2- 172.21.15.131:0/3747156930 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8df8070820 0x7f8ddc0039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:31.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.461+0000 7f8defe00640 1 --2- 172.21.15.131:0/3747156930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ddc003fb0 0x7f8ddc004800 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8de0009a90 tx=0x7f8ddc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=650384e30006427a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:31.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.462+0000 7f8df5400640 1 -- 172.21.15.131:0/3747156930 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de0036070 con 0x7f8ddc003fb0 2024-04-25T19:23:31.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.462+0000 7f8df5400640 1 -- 172.21.15.131:0/3747156930 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8de0031400 con 0x7f8ddc003fb0 2024-04-25T19:23:31.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.462+0000 7f8df5400640 1 -- 172.21.15.131:0/3747156930 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de0009690 con 0x7f8ddc003fb0 2024-04-25T19:23:31.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.462+0000 7f8dfd000640 1 -- 172.21.15.131:0/3747156930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ddc003fb0 msgr2=0x7f8ddc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:31.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.462+0000 7f8dfd000640 1 --2- 172.21.15.131:0/3747156930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ddc003fb0 0x7f8ddc004800 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8de0009a90 tx=0x7f8ddc005830 comp rx=0 tx=0).stop 2024-04-25T19:23:31.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.462+0000 7f8df6800640 1 -- 172.21.15.131:0/3747156930 reap_dead start 2024-04-25T19:23:31.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.463+0000 7f8dfd000640 1 -- 172.21.15.131:0/3747156930 shutdown_connections 2024-04-25T19:23:31.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.463+0000 7f8dfd000640 1 -- 172.21.15.131:0/3747156930 >> 172.21.15.131:0/3747156930 conn(0x7f8df80730b0 msgr2=0x7f8df80734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:31.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.463+0000 7f8dfd000640 1 -- 172.21.15.131:0/3747156930 shutdown_connections 2024-04-25T19:23:31.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.463+0000 7f8dfd000640 1 -- 172.21.15.131:0/3747156930 wait complete. 2024-04-25T19:23:31.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.465+0000 7f8dfd000640 1 Processor -- start 2024-04-25T19:23:31.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.465+0000 7f8dfd000640 1 -- start start 2024-04-25T19:23:31.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.467+0000 7f8dfd000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ddc003fb0 0x7f8df8157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:31.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.467+0000 7f8dfd000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8df815ab30 0x7f8df815af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:31.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.467+0000 7f8dfd000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8df80b26b0 0x7f8df80b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:31.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.467+0000 7f8dfd000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8df806dce0 con 0x7f8df80b26b0 2024-04-25T19:23:31.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.467+0000 7f8dfd000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8df806f040 con 0x7f8df815ab30 2024-04-25T19:23:31.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.467+0000 7f8dfd000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8df806de60 con 0x7f8ddc003fb0 2024-04-25T19:23:31.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.467+0000 7f8df6800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8df80b26b0 0x7f8df80b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:31.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.467+0000 7f8df6800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8df80b26b0 0x7f8df80b2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33810/0 (socket says 172.21.15.131:33810) 2024-04-25T19:23:31.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.467+0000 7f8df6800640 1 -- 172.21.15.131:0/3767666874 learned_addr learned my addr 172.21.15.131:0/3767666874 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:31.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.468+0000 7f8df5e00640 1 --2- 172.21.15.131:0/3767666874 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ddc003fb0 0x7f8df8157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:31.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.468+0000 7f8defe00640 1 --2- 172.21.15.131:0/3767666874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8df815ab30 0x7f8df815af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:31.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.468+0000 7f8df6800640 1 -- 172.21.15.131:0/3767666874 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ddc003fb0 msgr2=0x7f8df8157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:31.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.468+0000 7f8df6800640 1 --2- 172.21.15.131:0/3767666874 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ddc003fb0 0x7f8df8157730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:31.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.468+0000 7f8df6800640 1 -- 172.21.15.131:0/3767666874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8df815ab30 msgr2=0x7f8df815af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:31.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.468+0000 7f8df6800640 1 --2- 172.21.15.131:0/3767666874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8df815ab30 0x7f8df815af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:31.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.468+0000 7f8df6800640 1 -- 172.21.15.131:0/3767666874 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df80b3000 con 0x7f8df80b26b0 2024-04-25T19:23:31.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.468+0000 7f8df6800640 1 --2- 172.21.15.131:0/3767666874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8df80b26b0 0x7f8df80b2ac0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc004780 tx=0x7f8df000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:31.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.468+0000 7f8dee000640 1 -- 172.21.15.131:0/3767666874 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df0017070 con 0x7f8df80b26b0 2024-04-25T19:23:31.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.468+0000 7f8dee000640 1 -- 172.21.15.131:0/3767666874 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8df0007070 con 0x7f8df80b26b0 2024-04-25T19:23:31.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.468+0000 7f8dfd000640 1 -- 172.21.15.131:0/3767666874 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8df815b780 con 0x7f8df80b26b0 2024-04-25T19:23:31.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.468+0000 7f8dee000640 1 -- 172.21.15.131:0/3767666874 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df0007460 con 0x7f8df80b26b0 2024-04-25T19:23:31.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.468+0000 7f8dfd000640 1 -- 172.21.15.131:0/3767666874 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8df80b48d0 con 0x7f8df80b26b0 2024-04-25T19:23:31.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.470+0000 7f8dfd000640 1 -- 172.21.15.131:0/3767666874 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8df80761c0 con 0x7f8df80b26b0 2024-04-25T19:23:31.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.471+0000 7f8dee000640 1 -- 172.21.15.131:0/3767666874 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8df001a070 con 0x7f8df80b26b0 2024-04-25T19:23:31.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.472+0000 7f8dee000640 1 --2- 172.21.15.131:0/3767666874 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8dd40744b0 0x7f8dd40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:31.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.472+0000 7f8dee000640 1 -- 172.21.15.131:0/3767666874 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f8df0093ef0 con 0x7f8df80b26b0 2024-04-25T19:23:31.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.473+0000 7f8df5e00640 1 --2- 172.21.15.131:0/3767666874 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8dd40744b0 0x7f8dd40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:31.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.474+0000 7f8df5e00640 1 --2- 172.21.15.131:0/3767666874 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8dd40744b0 0x7f8dd40769c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8de8000ff0 tx=0x7f8de8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:31.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.477+0000 7f8dee000640 1 -- 172.21.15.131:0/3767666874 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8df80b3000 con 0x7f8df80b26b0 2024-04-25T19:23:31.680 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.678+0000 7f8dfd000640 1 -- 172.21.15.131:0/3767666874 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8df80b1870 con 0x7f8df80b26b0 2024-04-25T19:23:31.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.680+0000 7f8dee000640 1 -- 172.21.15.131:0/3767666874 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f8df005e4a0 con 0x7f8df80b26b0 2024-04-25T19:23:31.681 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-25T19:23:31.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.682+0000 7f8dfd000640 1 -- 172.21.15.131:0/3767666874 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8dd40744b0 msgr2=0x7f8dd40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:31.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.682+0000 7f8dfd000640 1 --2- 172.21.15.131:0/3767666874 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8dd40744b0 0x7f8dd40769c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8de8000ff0 tx=0x7f8de8009040 comp rx=0 tx=0).stop 2024-04-25T19:23:31.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.682+0000 7f8dfd000640 1 -- 172.21.15.131:0/3767666874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8df80b26b0 msgr2=0x7f8df80b2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:31.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.682+0000 7f8dfd000640 1 --2- 172.21.15.131:0/3767666874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8df80b26b0 0x7f8df80b2ac0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc004780 tx=0x7f8df000c960 comp rx=0 tx=0).stop 2024-04-25T19:23:31.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.683+0000 7f8dfd000640 1 -- 172.21.15.131:0/3767666874 shutdown_connections 2024-04-25T19:23:31.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.683+0000 7f8dfd000640 1 --2- 172.21.15.131:0/3767666874 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8dd40744b0 0x7f8dd40769c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:31.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.683+0000 7f8dfd000640 1 --2- 172.21.15.131:0/3767666874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8df80b26b0 0x7f8df80b2ac0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:31.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.683+0000 7f8dfd000640 1 --2- 172.21.15.131:0/3767666874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8df815ab30 0x7f8df815af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:31.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.683+0000 7f8dfd000640 1 --2- 172.21.15.131:0/3767666874 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ddc003fb0 0x7f8df8157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:31.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.683+0000 7f8dfd000640 1 -- 172.21.15.131:0/3767666874 >> 172.21.15.131:0/3767666874 conn(0x7f8df80730b0 msgr2=0x7f8df806f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:31.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.683+0000 7f8dfd000640 1 -- 172.21.15.131:0/3767666874 shutdown_connections 2024-04-25T19:23:31.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.683+0000 7f8dfd000640 1 -- 172.21.15.131:0/3767666874 wait complete. 2024-04-25T19:23:31.711 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T19:23:31.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.968+0000 7febaa800640 1 Processor -- start 2024-04-25T19:23:31.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.968+0000 7febaa800640 1 -- start start 2024-04-25T19:23:31.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.971+0000 7febaa800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7feba4163cd0 0x7feba406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:31.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.971+0000 7febaa800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feba4164640 con 0x7feba41640e0 2024-04-25T19:23:31.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.971+0000 7febaa800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feba4164920 con 0x7feba41610f0 2024-04-25T19:23:31.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.971+0000 7febaa800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7feba4160c60 con 0x7feba4163cd0 2024-04-25T19:23:31.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.971+0000 7feba8a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7feba4163cd0 0x7feba406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:31.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.971+0000 7feba8a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7feba4163cd0 0x7feba406d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33826/0 (socket says 172.21.15.131:33826) 2024-04-25T19:23:31.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.971+0000 7feba8a00640 1 -- 172.21.15.131:0/383823422 learned_addr learned my addr 172.21.15.131:0/383823422 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:31.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.971+0000 7feba8a00640 1 -- 172.21.15.131:0/383823422 >> v1:172.21.15.195:6789/0 conn(0x7feba41610f0 legacy=0x7feba40b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:31.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.971+0000 7feba8a00640 1 -- 172.21.15.131:0/383823422 >> v1:172.21.15.131:6789/0 conn(0x7feba41640e0 legacy=0x7feba41569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:31.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.971+0000 7feba8a00640 1 -- 172.21.15.131:0/383823422 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba41608f0 con 0x7feba4163cd0 2024-04-25T19:23:31.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.972+0000 7feba8a00640 1 --2- 172.21.15.131:0/383823422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feba4163cd0 0x7feba406d5d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7feb90009870 tx=0x7feb9002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85cd0eb99bd182e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:31.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.973+0000 7feba3e00640 1 -- 172.21.15.131:0/383823422 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90037070 con 0x7feba4163cd0 2024-04-25T19:23:31.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.973+0000 7feba3e00640 1 -- 172.21.15.131:0/383823422 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb90032440 con 0x7feba4163cd0 2024-04-25T19:23:31.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.973+0000 7feba3e00640 1 -- 172.21.15.131:0/383823422 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90032810 con 0x7feba4163cd0 2024-04-25T19:23:31.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.974+0000 7febaa800640 1 -- 172.21.15.131:0/383823422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feba4163cd0 msgr2=0x7feba406d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:31.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.974+0000 7febaa800640 1 --2- 172.21.15.131:0/383823422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feba4163cd0 0x7feba406d5d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7feb90009870 tx=0x7feb9002a2a0 comp rx=0 tx=0).stop 2024-04-25T19:23:31.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.974+0000 7febaa800640 1 -- 172.21.15.131:0/383823422 shutdown_connections 2024-04-25T19:23:31.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.974+0000 7febaa800640 1 --2- 172.21.15.131:0/383823422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feba4163cd0 0x7feba406d5d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:31.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.974+0000 7febaa800640 1 -- 172.21.15.131:0/383823422 >> 172.21.15.131:0/383823422 conn(0x7feba4072ee0 msgr2=0x7feba40732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:31.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.974+0000 7febaa800640 1 -- 172.21.15.131:0/383823422 shutdown_connections 2024-04-25T19:23:31.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.974+0000 7febaa800640 1 -- 172.21.15.131:0/383823422 wait complete. 2024-04-25T19:23:31.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.976+0000 7febaa800640 1 Processor -- start 2024-04-25T19:23:31.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.976+0000 7febaa800640 1 -- start start 2024-04-25T19:23:31.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.978+0000 7febaa800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feba41610f0 0x7feba415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:31.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.978+0000 7febaa800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feba4163cd0 0x7feba4145120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:31.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.978+0000 7febaa800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feba41640e0 0x7feba41f98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:31.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.978+0000 7febaa800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7feba40b7490 con 0x7feba4163cd0 2024-04-25T19:23:31.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.978+0000 7febaa800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7feba4160690 con 0x7feba41610f0 2024-04-25T19:23:31.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.978+0000 7febaa800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7feba40b7610 con 0x7feba41640e0 2024-04-25T19:23:31.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.978+0000 7feba8a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feba4163cd0 0x7feba4145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:31.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.978+0000 7feba8a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feba4163cd0 0x7feba4145120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33838/0 (socket says 172.21.15.131:33838) 2024-04-25T19:23:31.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.978+0000 7feba8a00640 1 -- 172.21.15.131:0/385460943 learned_addr learned my addr 172.21.15.131:0/385460943 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:31.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.978+0000 7feba8a00640 1 -- 172.21.15.131:0/385460943 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feba41640e0 msgr2=0x7feba41f98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:31.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.978+0000 7feba8a00640 1 --2- 172.21.15.131:0/385460943 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feba41640e0 0x7feba41f98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:31.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.978+0000 7feba8a00640 1 -- 172.21.15.131:0/385460943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feba41610f0 msgr2=0x7feba415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:31.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.978+0000 7feba8a00640 1 --2- 172.21.15.131:0/385460943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feba41610f0 0x7feba415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:31.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.978+0000 7feba8a00640 1 -- 172.21.15.131:0/385460943 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba415b210 con 0x7feba4163cd0 2024-04-25T19:23:31.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.979+0000 7feba8a00640 1 --2- 172.21.15.131:0/385460943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feba4163cd0 0x7feba4145120 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7feb90000c00 tx=0x7feb900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:31.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.979+0000 7feba1600640 1 -- 172.21.15.131:0/385460943 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90041070 con 0x7feba4163cd0 2024-04-25T19:23:31.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.979+0000 7feba1600640 1 -- 172.21.15.131:0/385460943 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb9003c870 con 0x7feba4163cd0 2024-04-25T19:23:31.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.979+0000 7febaa800640 1 -- 172.21.15.131:0/385460943 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba41537c0 con 0x7feba4163cd0 2024-04-25T19:23:31.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.979+0000 7feba1600640 1 -- 172.21.15.131:0/385460943 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90037040 con 0x7feba4163cd0 2024-04-25T19:23:31.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.979+0000 7febaa800640 1 -- 172.21.15.131:0/385460943 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba4153d80 con 0x7feba4163cd0 2024-04-25T19:23:31.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.980+0000 7febaa800640 1 -- 172.21.15.131:0/385460943 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba4050740 con 0x7feba4163cd0 2024-04-25T19:23:31.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.981+0000 7feba1600640 1 -- 172.21.15.131:0/385460943 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7feb90044070 con 0x7feba4163cd0 2024-04-25T19:23:31.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.982+0000 7feba1600640 1 --2- 172.21.15.131:0/385460943 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7feb840744b0 0x7feb840769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:31.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.982+0000 7feba1600640 1 -- 172.21.15.131:0/385460943 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7feb900b5b00 con 0x7feba4163cd0 2024-04-25T19:23:31.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.983+0000 7feba9400640 1 --2- 172.21.15.131:0/385460943 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7feb840744b0 0x7feb840769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:31.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.984+0000 7feba9400640 1 --2- 172.21.15.131:0/385460943 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7feb840744b0 0x7feb840769c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7feb98006fd0 tx=0x7feb98006bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:31.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:31.986+0000 7feba1600640 1 -- 172.21.15.131:0/385460943 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feb900805e0 con 0x7feba4163cd0 2024-04-25T19:23:32.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.187+0000 7febaa800640 1 -- 172.21.15.131:0/385460943 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7feba415b4d0 con 0x7feba4163cd0 2024-04-25T19:23:32.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.188+0000 7feba1600640 1 -- 172.21.15.131:0/385460943 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) ==== 84+0+65 (secure 0 0 0) 0x7feb9007fee0 con 0x7feba4163cd0 2024-04-25T19:23:32.190 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:32.191 INFO:teuthology.orchestra.run.smithi131.stdout:[ 2024-04-25T19:23:32.191 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:23:32.191 INFO:teuthology.orchestra.run.smithi131.stdout: "poolnum": 1, 2024-04-25T19:23:32.191 INFO:teuthology.orchestra.run.smithi131.stdout: "poolname": ".mgr" 2024-04-25T19:23:32.191 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:23:32.191 INFO:teuthology.orchestra.run.smithi131.stdout:] 2024-04-25T19:23:32.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.191+0000 7febaa800640 1 -- 172.21.15.131:0/385460943 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7feb840744b0 msgr2=0x7feb840769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:32.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.191+0000 7febaa800640 1 --2- 172.21.15.131:0/385460943 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7feb840744b0 0x7feb840769c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7feb98006fd0 tx=0x7feb98006bc0 comp rx=0 tx=0).stop 2024-04-25T19:23:32.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.191+0000 7febaa800640 1 -- 172.21.15.131:0/385460943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feba4163cd0 msgr2=0x7feba4145120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:32.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.191+0000 7febaa800640 1 --2- 172.21.15.131:0/385460943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feba4163cd0 0x7feba4145120 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7feb90000c00 tx=0x7feb900046c0 comp rx=0 tx=0).stop 2024-04-25T19:23:32.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.191+0000 7febaa800640 1 -- 172.21.15.131:0/385460943 shutdown_connections 2024-04-25T19:23:32.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.191+0000 7febaa800640 1 --2- 172.21.15.131:0/385460943 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7feb840744b0 0x7feb840769c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:32.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.191+0000 7febaa800640 1 --2- 172.21.15.131:0/385460943 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feba41640e0 0x7feba41f98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:32.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.191+0000 7febaa800640 1 --2- 172.21.15.131:0/385460943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feba4163cd0 0x7feba4145120 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:32.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.191+0000 7febaa800640 1 --2- 172.21.15.131:0/385460943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feba41610f0 0x7feba415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:32.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.191+0000 7febaa800640 1 -- 172.21.15.131:0/385460943 >> 172.21.15.131:0/385460943 conn(0x7feba4072ee0 msgr2=0x7feba4158e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:32.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.191+0000 7febaa800640 1 -- 172.21.15.131:0/385460943 shutdown_connections 2024-04-25T19:23:32.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.191+0000 7febaa800640 1 -- 172.21.15.131:0/385460943 wait complete. 2024-04-25T19:23:32.216 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T19:23:32.217 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T19:23:32.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.483+0000 7f6947200640 1 Processor -- start 2024-04-25T19:23:32.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.483+0000 7f6947200640 1 -- start start 2024-04-25T19:23:32.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.485+0000 7f6947200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f694813fcb0 0x7f69480701d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:32.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.486+0000 7f6947200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6948070b20 con 0x7f6948070710 2024-04-25T19:23:32.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.486+0000 7f6947200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69480cda60 con 0x7f6948143000 2024-04-25T19:23:32.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.486+0000 7f6947200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f69480ce630 con 0x7f694813fcb0 2024-04-25T19:23:32.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.486+0000 7f693fe00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f6948070710 0x7f69481428f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:44962/0 (socket says 172.21.15.131:44962) 2024-04-25T19:23:32.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.486+0000 7f693fe00640 1 -- 172.21.15.131:0/3871103861 learned_addr learned my addr 172.21.15.131:0/3871103861 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:32.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.486+0000 7f6945400640 1 -- 172.21.15.131:0/3871103861 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3970411467 0 0) 0x7f6930001110 con 0x7f6948070710 2024-04-25T19:23:32.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.486+0000 7f6945e00640 1 --2- 172.21.15.131:0/3871103861 >> v2:172.21.15.195:3300/0 conn(0x7f694813fcb0 0x7f69480701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:32.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.486+0000 7f6945400640 1 -- 172.21.15.131:0/3871103861 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f692c003520 con 0x7f6948070710 2024-04-25T19:23:32.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.486+0000 7f6945400640 1 -- 172.21.15.131:0/3871103861 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1667433557 0 0) 0x7f692c003520 con 0x7f6948070710 2024-04-25T19:23:32.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.487+0000 7f6945400640 1 -- 172.21.15.131:0/3871103861 >> v2:172.21.15.195:3300/0 conn(0x7f694813fcb0 msgr2=0x7f69480701d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:32.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.487+0000 7f6945400640 1 --2- 172.21.15.131:0/3871103861 >> v2:172.21.15.195:3300/0 conn(0x7f694813fcb0 0x7f69480701d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:32.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.487+0000 7f6945400640 1 -- 172.21.15.131:0/3871103861 >> v1:172.21.15.195:6789/0 conn(0x7f6948143000 legacy=0x7f69480d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:32.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.487+0000 7f6945400640 1 -- 172.21.15.131:0/3871103861 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69480cdd00 con 0x7f6948070710 2024-04-25T19:23:32.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.487+0000 7f6945400640 1 -- 172.21.15.131:0/3871103861 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f6930001840 con 0x7f6948070710 2024-04-25T19:23:32.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.487+0000 7f6945400640 1 -- 172.21.15.131:0/3871103861 >> v1:172.21.15.131:6789/0 conn(0x7f6948070710 legacy=0x7f69481428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:32.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.487+0000 7f6945400640 1 --2- 172.21.15.131:0/3871103861 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f692c003a00 0x7f692c003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:32.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.487+0000 7f6945400640 1 --2- 172.21.15.131:0/3871103861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f692c004800 0x7f692c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:32.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.487+0000 7f6945400640 1 --2- 172.21.15.131:0/3871103861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f692c005220 0x7f692c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:32.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.487+0000 7f6945400640 1 -- 172.21.15.131:0/3871103861 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f69480ce630 con 0x7f692c004800 2024-04-25T19:23:32.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.487+0000 7f6945400640 1 -- 172.21.15.131:0/3871103861 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f692c00c1b0 con 0x7f692c005220 2024-04-25T19:23:32.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.487+0000 7f6945400640 1 -- 172.21.15.131:0/3871103861 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f692c00c3b0 con 0x7f692c003a00 2024-04-25T19:23:32.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.487+0000 7f693fe00640 1 --2- 172.21.15.131:0/3871103861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f692c004800 0x7f692c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:32.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.487+0000 7f6945e00640 1 --2- 172.21.15.131:0/3871103861 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f692c003a00 0x7f692c003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:32.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.488+0000 7f6946800640 1 --2- 172.21.15.131:0/3871103861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f692c005220 0x7f692c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:32.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.488+0000 7f693fe00640 1 -- 172.21.15.131:0/3871103861 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f692c003a00 msgr2=0x7f692c003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:32.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.488+0000 7f693fe00640 1 --2- 172.21.15.131:0/3871103861 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f692c003a00 0x7f692c003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:32.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.488+0000 7f693fe00640 1 -- 172.21.15.131:0/3871103861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f692c005220 msgr2=0x7f692c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:32.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.488+0000 7f693fe00640 1 --2- 172.21.15.131:0/3871103861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f692c005220 0x7f692c00b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:32.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.488+0000 7f6946800640 1 -- 172.21.15.131:0/3871103861 reap_dead start 2024-04-25T19:23:32.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.488+0000 7f693fe00640 1 -- 172.21.15.131:0/3871103861 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f692c003520 con 0x7f692c004800 2024-04-25T19:23:32.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.489+0000 7f693fe00640 1 --2- 172.21.15.131:0/3871103861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f692c004800 0x7f692c004c10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f693000c320 tx=0x7f692c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8be2ae216fe35c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:32.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.489+0000 7f6945400640 1 -- 172.21.15.131:0/3871103861 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6930007e10 con 0x7f692c004800 2024-04-25T19:23:32.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.489+0000 7f6945400640 1 -- 172.21.15.131:0/3871103861 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6930005ad0 con 0x7f692c004800 2024-04-25T19:23:32.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.489+0000 7f6945400640 1 -- 172.21.15.131:0/3871103861 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6930007070 con 0x7f692c004800 2024-04-25T19:23:32.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.489+0000 7f6947200640 1 -- 172.21.15.131:0/3871103861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f692c004800 msgr2=0x7f692c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:32.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.489+0000 7f6947200640 1 --2- 172.21.15.131:0/3871103861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f692c004800 0x7f692c004c10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f693000c320 tx=0x7f692c005830 comp rx=0 tx=0).stop 2024-04-25T19:23:32.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.490+0000 7f6947200640 1 -- 172.21.15.131:0/3871103861 shutdown_connections 2024-04-25T19:23:32.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.490+0000 7f6947200640 1 --2- 172.21.15.131:0/3871103861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f692c004800 0x7f692c004c10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:32.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.490+0000 7f6947200640 1 -- 172.21.15.131:0/3871103861 >> 172.21.15.131:0/3871103861 conn(0x7f6948072f40 msgr2=0x7f6948073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:32.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.490+0000 7f6947200640 1 -- 172.21.15.131:0/3871103861 shutdown_connections 2024-04-25T19:23:32.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.490+0000 7f6947200640 1 -- 172.21.15.131:0/3871103861 wait complete. 2024-04-25T19:23:32.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.492+0000 7f6947200640 1 Processor -- start 2024-04-25T19:23:32.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.492+0000 7f6947200640 1 -- start start 2024-04-25T19:23:32.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.494+0000 7f6947200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f692c004800 0x7f69480aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:32.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.494+0000 7f6947200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69480c9840 0x7f69480b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:32.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.494+0000 7f6947200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69480af080 0x7f69480af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:32.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.494+0000 7f6947200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f69480ce2c0 con 0x7f69480af080 2024-04-25T19:23:32.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.494+0000 7f6947200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6948143410 con 0x7f69480c9840 2024-04-25T19:23:32.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.494+0000 7f6947200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f69480ceac0 con 0x7f692c004800 2024-04-25T19:23:32.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.494+0000 7f6946800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69480af080 0x7f69480af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:32.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.494+0000 7f6946800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69480af080 0x7f69480af490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33850/0 (socket says 172.21.15.131:33850) 2024-04-25T19:23:32.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.494+0000 7f6946800640 1 -- 172.21.15.131:0/1256898349 learned_addr learned my addr 172.21.15.131:0/1256898349 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:32.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.494+0000 7f6945e00640 1 --2- 172.21.15.131:0/1256898349 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f692c004800 0x7f69480aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:32.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.494+0000 7f693fe00640 1 --2- 172.21.15.131:0/1256898349 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69480c9840 0x7f69480b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:32.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.494+0000 7f6946800640 1 -- 172.21.15.131:0/1256898349 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f692c004800 msgr2=0x7f69480aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:32.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.494+0000 7f6946800640 1 --2- 172.21.15.131:0/1256898349 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f692c004800 0x7f69480aeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:32.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.494+0000 7f6946800640 1 -- 172.21.15.131:0/1256898349 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69480c9840 msgr2=0x7f69480b0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:32.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.494+0000 7f6946800640 1 --2- 172.21.15.131:0/1256898349 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69480c9840 0x7f69480b0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:32.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.494+0000 7f6946800640 1 -- 172.21.15.131:0/1256898349 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69480cc180 con 0x7f69480af080 2024-04-25T19:23:32.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.495+0000 7f6946800640 1 --2- 172.21.15.131:0/1256898349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69480af080 0x7f69480af490 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f69480cf990 tx=0x7f694000d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:32.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.495+0000 7f693e000640 1 -- 172.21.15.131:0/1256898349 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940018070 con 0x7f69480af080 2024-04-25T19:23:32.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.495+0000 7f693e000640 1 -- 172.21.15.131:0/1256898349 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6940003d80 con 0x7f69480af080 2024-04-25T19:23:32.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.495+0000 7f6947200640 1 -- 172.21.15.131:0/1256898349 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69480cc460 con 0x7f69480af080 2024-04-25T19:23:32.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.495+0000 7f693e000640 1 -- 172.21.15.131:0/1256898349 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940005290 con 0x7f69480af080 2024-04-25T19:23:32.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.495+0000 7f6947200640 1 -- 172.21.15.131:0/1256898349 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69480cca20 con 0x7f69480af080 2024-04-25T19:23:32.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.496+0000 7f6947200640 1 -- 172.21.15.131:0/1256898349 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6948076c60 con 0x7f69480af080 2024-04-25T19:23:32.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.497+0000 7f693e000640 1 -- 172.21.15.131:0/1256898349 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f694001b070 con 0x7f69480af080 2024-04-25T19:23:32.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.498+0000 7f693e000640 1 --2- 172.21.15.131:0/1256898349 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f69240744b0 0x7f69240769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:32.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.498+0000 7f693e000640 1 -- 172.21.15.131:0/1256898349 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f69400945b0 con 0x7f69480af080 2024-04-25T19:23:32.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.499+0000 7f6945e00640 1 --2- 172.21.15.131:0/1256898349 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f69240744b0 0x7f69240769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:32.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.500+0000 7f6945e00640 1 --2- 172.21.15.131:0/1256898349 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f69240744b0 0x7f69240769c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f69380099d0 tx=0x7f6938008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:32.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.503+0000 7f693e000640 1 -- 172.21.15.131:0/1256898349 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f694005f080 con 0x7f69480af080 2024-04-25T19:23:32.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.702+0000 7f6947200640 1 -- 172.21.15.131:0/1256898349 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f694806d9c0 con 0x7f69480af080 2024-04-25T19:23:32.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.807+0000 7f693e000640 1 -- 172.21.15.131:0/1256898349 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) ==== 138+0+0 (secure 0 0 0) 0x7f6940094030 con 0x7f69480af080 2024-04-25T19:23:32.810 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'cephfs_metadata' created 2024-04-25T19:23:32.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.811+0000 7f6947200640 1 -- 172.21.15.131:0/1256898349 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f69240744b0 msgr2=0x7f69240769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:32.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.811+0000 7f6947200640 1 --2- 172.21.15.131:0/1256898349 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f69240744b0 0x7f69240769c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f69380099d0 tx=0x7f6938008040 comp rx=0 tx=0).stop 2024-04-25T19:23:32.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.811+0000 7f6947200640 1 -- 172.21.15.131:0/1256898349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69480af080 msgr2=0x7f69480af490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:32.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.811+0000 7f6947200640 1 --2- 172.21.15.131:0/1256898349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69480af080 0x7f69480af490 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f69480cf990 tx=0x7f694000d9d0 comp rx=0 tx=0).stop 2024-04-25T19:23:32.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.811+0000 7f6947200640 1 -- 172.21.15.131:0/1256898349 shutdown_connections 2024-04-25T19:23:32.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.811+0000 7f6947200640 1 --2- 172.21.15.131:0/1256898349 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f69240744b0 0x7f69240769c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:32.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.811+0000 7f6947200640 1 --2- 172.21.15.131:0/1256898349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69480af080 0x7f69480af490 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:32.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.811+0000 7f6947200640 1 --2- 172.21.15.131:0/1256898349 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69480c9840 0x7f69480b0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:32.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.811+0000 7f6947200640 1 --2- 172.21.15.131:0/1256898349 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f692c004800 0x7f69480aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:32.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.811+0000 7f6947200640 1 -- 172.21.15.131:0/1256898349 >> 172.21.15.131:0/1256898349 conn(0x7f6948072f40 msgr2=0x7f694813f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:32.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.811+0000 7f6947200640 1 -- 172.21.15.131:0/1256898349 shutdown_connections 2024-04-25T19:23:32.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:32.811+0000 7f6947200640 1 -- 172.21.15.131:0/1256898349 wait complete. 2024-04-25T19:23:32.845 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T19:23:33.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.101+0000 7ff437e00640 1 Processor -- start 2024-04-25T19:23:33.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.101+0000 7ff437e00640 1 -- start start 2024-04-25T19:23:33.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.103+0000 7ff437e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff4380cd420 0x7ff4380cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:33.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.103+0000 7ff437e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff438070b90 0x7ff438160910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:33.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.103+0000 7ff437e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff43815d1b0 con 0x7ff43806c5c0 2024-04-25T19:23:33.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.103+0000 7ff437e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ff4380cbf80 con 0x7ff4380cd420 2024-04-25T19:23:33.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.103+0000 7ff437e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7ff4380ce190 con 0x7ff438070b90 2024-04-25T19:23:33.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.103+0000 7ff42fe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff4380cd420 0x7ff4380cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:33.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.103+0000 7ff42fe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff4380cd420 0x7ff4380cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33852/0 (socket says 172.21.15.131:33852) 2024-04-25T19:23:33.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.103+0000 7ff436a00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7ff43806c5c0 0x7ff438070480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:44966/0 (socket says 172.21.15.131:44966) 2024-04-25T19:23:33.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.103+0000 7ff42fe00640 1 -- 172.21.15.131:0/3013648603 learned_addr learned my addr 172.21.15.131:0/3013648603 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:33.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.104+0000 7ff437400640 1 --2- 172.21.15.131:0/3013648603 >> v2:172.21.15.195:3300/0 conn(0x7ff438070b90 0x7ff438160910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:33.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.104+0000 7ff42fe00640 1 -- 172.21.15.131:0/3013648603 >> v2:172.21.15.195:3300/0 conn(0x7ff438070b90 msgr2=0x7ff438160910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:33.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.104+0000 7ff42fe00640 1 --2- 172.21.15.131:0/3013648603 >> v2:172.21.15.195:3300/0 conn(0x7ff438070b90 0x7ff438160910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:33.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.104+0000 7ff42fe00640 1 -- 172.21.15.131:0/3013648603 >> v1:172.21.15.131:6789/0 conn(0x7ff43806c5c0 legacy=0x7ff438070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:33.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.104+0000 7ff42fe00640 1 -- 172.21.15.131:0/3013648603 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4380d05b0 con 0x7ff4380cd420 2024-04-25T19:23:33.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.104+0000 7ff436000640 1 -- 172.21.15.131:0/3013648603 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1020105108 0 0) 0x7ff428001110 con 0x7ff43806c5c0 2024-04-25T19:23:33.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.105+0000 7ff42fe00640 1 --2- 172.21.15.131:0/3013648603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4380cd420 0x7ff4380cfec0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff4380d1130 tx=0x7ff42002c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38179aa44b2822b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:33.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.105+0000 7ff436000640 1 -- 172.21.15.131:0/3013648603 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff420036020 con 0x7ff4380cd420 2024-04-25T19:23:33.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.105+0000 7ff436000640 1 -- 172.21.15.131:0/3013648603 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff420032640 con 0x7ff4380cd420 2024-04-25T19:23:33.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.105+0000 7ff436000640 1 -- 172.21.15.131:0/3013648603 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff420032a10 con 0x7ff4380cd420 2024-04-25T19:23:33.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.106+0000 7ff437e00640 1 -- 172.21.15.131:0/3013648603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4380cd420 msgr2=0x7ff4380cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:33.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.106+0000 7ff437e00640 1 --2- 172.21.15.131:0/3013648603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4380cd420 0x7ff4380cfec0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff4380d1130 tx=0x7ff42002c940 comp rx=0 tx=0).stop 2024-04-25T19:23:33.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.106+0000 7ff437e00640 1 -- 172.21.15.131:0/3013648603 shutdown_connections 2024-04-25T19:23:33.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.106+0000 7ff437e00640 1 --2- 172.21.15.131:0/3013648603 >> v2:172.21.15.195:3300/0 conn(0x7ff438070b90 0x7ff438160910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:33.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.106+0000 7ff437e00640 1 --2- 172.21.15.131:0/3013648603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4380cd420 0x7ff4380cfec0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:33.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.106+0000 7ff437e00640 1 -- 172.21.15.131:0/3013648603 >> 172.21.15.131:0/3013648603 conn(0x7ff4380ce3b0 msgr2=0x7ff4380ce7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:33.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.106+0000 7ff437e00640 1 -- 172.21.15.131:0/3013648603 shutdown_connections 2024-04-25T19:23:33.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.106+0000 7ff437e00640 1 -- 172.21.15.131:0/3013648603 wait complete. 2024-04-25T19:23:33.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.109+0000 7ff437e00640 1 Processor -- start 2024-04-25T19:23:33.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.109+0000 7ff437e00640 1 -- start start 2024-04-25T19:23:33.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.110+0000 7ff437e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff43806c5c0 0x7ff4381ef480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:33.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.110+0000 7ff437e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff438070b90 0x7ff4381e61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:33.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.110+0000 7ff437e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4380cd420 0x7ff4381e6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:33.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.110+0000 7ff437e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff4380d0e50 con 0x7ff43806c5c0 2024-04-25T19:23:33.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.110+0000 7ff437e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff4380d0b70 con 0x7ff4380cd420 2024-04-25T19:23:33.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.110+0000 7ff437e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff438070fa0 con 0x7ff438070b90 2024-04-25T19:23:33.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.110+0000 7ff436a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff43806c5c0 0x7ff4381ef480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:33.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.111+0000 7ff436a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff43806c5c0 0x7ff4381ef480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33858/0 (socket says 172.21.15.131:33858) 2024-04-25T19:23:33.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.111+0000 7ff436a00640 1 -- 172.21.15.131:0/1304777139 learned_addr learned my addr 172.21.15.131:0/1304777139 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:33.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.111+0000 7ff42fe00640 1 --2- 172.21.15.131:0/1304777139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff438070b90 0x7ff4381e61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:33.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.111+0000 7ff436a00640 1 -- 172.21.15.131:0/1304777139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff438070b90 msgr2=0x7ff4381e61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:33.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.111+0000 7ff436a00640 1 --2- 172.21.15.131:0/1304777139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff438070b90 0x7ff4381e61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:33.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.111+0000 7ff436a00640 1 -- 172.21.15.131:0/1304777139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4380cd420 msgr2=0x7ff4381e6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:33.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.111+0000 7ff436a00640 1 --2- 172.21.15.131:0/1304777139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4380cd420 0x7ff4381e6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:33.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.111+0000 7ff436a00640 1 -- 172.21.15.131:0/1304777139 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4381e6f90 con 0x7ff43806c5c0 2024-04-25T19:23:33.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.111+0000 7ff436a00640 1 --2- 172.21.15.131:0/1304777139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff43806c5c0 0x7ff4381ef480 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff42800c460 tx=0x7ff42800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:33.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.112+0000 7ff42ea00640 1 -- 172.21.15.131:0/1304777139 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4280074e0 con 0x7ff43806c5c0 2024-04-25T19:23:33.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.112+0000 7ff42ea00640 1 -- 172.21.15.131:0/1304777139 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4280047e0 con 0x7ff43806c5c0 2024-04-25T19:23:33.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.112+0000 7ff42ea00640 1 -- 172.21.15.131:0/1304777139 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff428004bd0 con 0x7ff43806c5c0 2024-04-25T19:23:33.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.112+0000 7ff437e00640 1 -- 172.21.15.131:0/1304777139 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4381f3140 con 0x7ff43806c5c0 2024-04-25T19:23:33.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.112+0000 7ff437e00640 1 -- 172.21.15.131:0/1304777139 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4381f4ca0 con 0x7ff43806c5c0 2024-04-25T19:23:33.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.113+0000 7ff437e00640 1 -- 172.21.15.131:0/1304777139 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff438076c60 con 0x7ff43806c5c0 2024-04-25T19:23:33.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.115+0000 7ff42ea00640 1 -- 172.21.15.131:0/1304777139 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff428011070 con 0x7ff43806c5c0 2024-04-25T19:23:33.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.117+0000 7ff42ea00640 1 --2- 172.21.15.131:0/1304777139 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff4140744e0 0x7ff4140769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:33.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.117+0000 7ff42ea00640 1 -- 172.21.15.131:0/1304777139 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5227+0+0 (secure 0 0 0) 0x7ff428095270 con 0x7ff43806c5c0 2024-04-25T19:23:33.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.117+0000 7ff42fe00640 1 --2- 172.21.15.131:0/1304777139 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff4140744e0 0x7ff4140769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:33.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.119+0000 7ff42fe00640 1 --2- 172.21.15.131:0/1304777139 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff4140744e0 0x7ff4140769f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff420037000 tx=0x7ff420032000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:33.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.121+0000 7ff42ea00640 1 -- 172.21.15.131:0/1304777139 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff43815d1b0 con 0x7ff43806c5c0 2024-04-25T19:23:33.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.326+0000 7ff437e00640 1 -- 172.21.15.131:0/1304777139 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff43806e100 con 0x7ff43806c5c0 2024-04-25T19:23:33.829 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.827+0000 7ff42ea00640 1 -- 172.21.15.131:0/1304777139 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) ==== 170+0+0 (secure 0 0 0) 0x7ff42805fc50 con 0x7ff43806c5c0 2024-04-25T19:23:33.829 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'cephfs_data' created 2024-04-25T19:23:33.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.830+0000 7ff437e00640 1 -- 172.21.15.131:0/1304777139 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff4140744e0 msgr2=0x7ff4140769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:33.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.830+0000 7ff437e00640 1 --2- 172.21.15.131:0/1304777139 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff4140744e0 0x7ff4140769f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff420037000 tx=0x7ff420032000 comp rx=0 tx=0).stop 2024-04-25T19:23:33.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.830+0000 7ff437e00640 1 -- 172.21.15.131:0/1304777139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff43806c5c0 msgr2=0x7ff4381ef480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:33.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.830+0000 7ff437e00640 1 --2- 172.21.15.131:0/1304777139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff43806c5c0 0x7ff4381ef480 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff42800c460 tx=0x7ff42800c920 comp rx=0 tx=0).stop 2024-04-25T19:23:33.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.831+0000 7ff437e00640 1 -- 172.21.15.131:0/1304777139 shutdown_connections 2024-04-25T19:23:33.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.831+0000 7ff437e00640 1 --2- 172.21.15.131:0/1304777139 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff4140744e0 0x7ff4140769f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:33.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.831+0000 7ff437e00640 1 --2- 172.21.15.131:0/1304777139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff438070b90 0x7ff4381e61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:33.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.831+0000 7ff437e00640 1 --2- 172.21.15.131:0/1304777139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4380cd420 0x7ff4381e6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:33.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.831+0000 7ff437e00640 1 --2- 172.21.15.131:0/1304777139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff43806c5c0 0x7ff4381ef480 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:33.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.831+0000 7ff437e00640 1 -- 172.21.15.131:0/1304777139 >> 172.21.15.131:0/1304777139 conn(0x7ff4380ce3b0 msgr2=0x7ff43815d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:33.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.831+0000 7ff437e00640 1 -- 172.21.15.131:0/1304777139 shutdown_connections 2024-04-25T19:23:33.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:33.831+0000 7ff437e00640 1 -- 172.21.15.131:0/1304777139 wait complete. 2024-04-25T19:23:33.874 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T19:23:34.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.117+0000 7fb24ce00640 1 Processor -- start 2024-04-25T19:23:34.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.117+0000 7fb24ce00640 1 -- start start 2024-04-25T19:23:34.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.119+0000 7fb24ce00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb2480cd9a0 0x7fb24815f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:34.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.119+0000 7fb24ce00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb24806dce0 0x7fb24815faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:34.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.119+0000 7fb24ce00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2480cdea0 con 0x7fb2480b0af0 2024-04-25T19:23:34.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.120+0000 7fb24ce00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb2480ceab0 con 0x7fb2480cd9a0 2024-04-25T19:23:34.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.120+0000 7fb24ce00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb2480ce180 con 0x7fb24806dce0 2024-04-25T19:23:34.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.120+0000 7fb245400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fb2480b0af0 0x7fb24806d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:44972/0 (socket says 172.21.15.131:44972) 2024-04-25T19:23:34.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.120+0000 7fb245400640 1 -- 172.21.15.131:0/750075781 learned_addr learned my addr 172.21.15.131:0/750075781 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:34.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.120+0000 7fb245e00640 1 --2- 172.21.15.131:0/750075781 >> v2:172.21.15.195:3300/0 conn(0x7fb2480cd9a0 0x7fb24815f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:34.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.120+0000 7fb246800640 1 --2- 172.21.15.131:0/750075781 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb24806dce0 0x7fb24815faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:34.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.121+0000 7fb244a00640 1 -- 172.21.15.131:0/750075781 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1317920339 0 0) 0x7fb2480cdea0 con 0x7fb2480b0af0 2024-04-25T19:23:34.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.121+0000 7fb244a00640 1 -- 172.21.15.131:0/750075781 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb22c003520 con 0x7fb2480b0af0 2024-04-25T19:23:34.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.121+0000 7fb244a00640 1 -- 172.21.15.131:0/750075781 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2821594645 0 0) 0x7fb22c003520 con 0x7fb2480b0af0 2024-04-25T19:23:34.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.121+0000 7fb244a00640 1 -- 172.21.15.131:0/750075781 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb24806dce0 msgr2=0x7fb24815faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:34.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.121+0000 7fb244a00640 1 --2- 172.21.15.131:0/750075781 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb24806dce0 0x7fb24815faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:34.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.121+0000 7fb244a00640 1 -- 172.21.15.131:0/750075781 >> v2:172.21.15.195:3300/0 conn(0x7fb2480cd9a0 msgr2=0x7fb24815f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:34.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.121+0000 7fb244a00640 1 --2- 172.21.15.131:0/750075781 >> v2:172.21.15.195:3300/0 conn(0x7fb2480cd9a0 0x7fb24815f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:34.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.121+0000 7fb244a00640 1 -- 172.21.15.131:0/750075781 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2480ce460 con 0x7fb2480b0af0 2024-04-25T19:23:34.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.121+0000 7fb244a00640 1 -- 172.21.15.131:0/750075781 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7fb234001670 con 0x7fb2480b0af0 2024-04-25T19:23:34.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.121+0000 7fb244a00640 1 -- 172.21.15.131:0/750075781 >> v1:172.21.15.131:6789/0 conn(0x7fb2480b0af0 legacy=0x7fb24806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:34.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.121+0000 7fb244a00640 1 --2- 172.21.15.131:0/750075781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb22c0039b0 0x7fb22c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:34.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.121+0000 7fb244a00640 1 --2- 172.21.15.131:0/750075781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb22c004800 0x7fb22c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:34.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.121+0000 7fb244a00640 1 --2- 172.21.15.131:0/750075781 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb22c005150 0x7fb22c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:34.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.121+0000 7fb244a00640 1 -- 172.21.15.131:0/750075781 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb2480ceab0 con 0x7fb22c0039b0 2024-04-25T19:23:34.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.121+0000 7fb244a00640 1 -- 172.21.15.131:0/750075781 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb2480ce180 con 0x7fb22c004800 2024-04-25T19:23:34.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.121+0000 7fb244a00640 1 -- 172.21.15.131:0/750075781 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb22c00bf00 con 0x7fb22c005150 2024-04-25T19:23:34.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.122+0000 7fb245e00640 1 --2- 172.21.15.131:0/750075781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb22c0039b0 0x7fb22c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:34.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.122+0000 7fb245400640 1 --2- 172.21.15.131:0/750075781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb22c004800 0x7fb22c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:34.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.122+0000 7fb246800640 1 --2- 172.21.15.131:0/750075781 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb22c005150 0x7fb22c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:34.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.122+0000 7fb245e00640 1 -- 172.21.15.131:0/750075781 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb22c005150 msgr2=0x7fb22c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:34.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.122+0000 7fb245e00640 1 --2- 172.21.15.131:0/750075781 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb22c005150 0x7fb22c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:34.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.122+0000 7fb245e00640 1 -- 172.21.15.131:0/750075781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb22c004800 msgr2=0x7fb22c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:34.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.122+0000 7fb245e00640 1 --2- 172.21.15.131:0/750075781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb22c004800 0x7fb22c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:34.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.122+0000 7fb245e00640 1 -- 172.21.15.131:0/750075781 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22c003520 con 0x7fb22c0039b0 2024-04-25T19:23:34.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.123+0000 7fb245e00640 1 --2- 172.21.15.131:0/750075781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb22c0039b0 0x7fb22c003e20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb238009ac0 tx=0x7fb22c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379a222672084ef6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:34.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.124+0000 7fb244a00640 1 -- 172.21.15.131:0/750075781 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238036070 con 0x7fb22c0039b0 2024-04-25T19:23:34.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.124+0000 7fb244a00640 1 -- 172.21.15.131:0/750075781 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb238031400 con 0x7fb22c0039b0 2024-04-25T19:23:34.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.124+0000 7fb244a00640 1 -- 172.21.15.131:0/750075781 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238009690 con 0x7fb22c0039b0 2024-04-25T19:23:34.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.124+0000 7fb24ce00640 1 -- 172.21.15.131:0/750075781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb22c0039b0 msgr2=0x7fb22c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:34.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.124+0000 7fb24ce00640 1 --2- 172.21.15.131:0/750075781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb22c0039b0 0x7fb22c003e20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb238009ac0 tx=0x7fb22c005830 comp rx=0 tx=0).stop 2024-04-25T19:23:34.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.124+0000 7fb246800640 1 -- 172.21.15.131:0/750075781 reap_dead start 2024-04-25T19:23:34.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.125+0000 7fb24ce00640 1 -- 172.21.15.131:0/750075781 shutdown_connections 2024-04-25T19:23:34.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.125+0000 7fb24ce00640 1 -- 172.21.15.131:0/750075781 >> 172.21.15.131:0/750075781 conn(0x7fb248073090 msgr2=0x7fb2480734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:34.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.125+0000 7fb24ce00640 1 -- 172.21.15.131:0/750075781 shutdown_connections 2024-04-25T19:23:34.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.125+0000 7fb24ce00640 1 -- 172.21.15.131:0/750075781 wait complete. 2024-04-25T19:23:34.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.127+0000 7fb24ce00640 1 Processor -- start 2024-04-25T19:23:34.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.127+0000 7fb24ce00640 1 -- start start 2024-04-25T19:23:34.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.129+0000 7fb24ce00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb248143670 0x7fb248146360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:34.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.129+0000 7fb24ce00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2481468a0 0x7fb248146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:34.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.129+0000 7fb24ce00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb248143a80 0x7fb248147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:34.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.129+0000 7fb24ce00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb2480cef40 con 0x7fb2481468a0 2024-04-25T19:23:34.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.129+0000 7fb24ce00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb2480b0f00 con 0x7fb248143670 2024-04-25T19:23:34.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.129+0000 7fb24ce00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb2480cf0c0 con 0x7fb248143a80 2024-04-25T19:23:34.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.129+0000 7fb245400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2481468a0 0x7fb248146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:34.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.129+0000 7fb245400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2481468a0 0x7fb248146f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33884/0 (socket says 172.21.15.131:33884) 2024-04-25T19:23:34.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.129+0000 7fb245400640 1 -- 172.21.15.131:0/1946436702 learned_addr learned my addr 172.21.15.131:0/1946436702 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:34.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.129+0000 7fb245e00640 1 --2- 172.21.15.131:0/1946436702 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb248143670 0x7fb248146360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:34.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.129+0000 7fb246800640 1 --2- 172.21.15.131:0/1946436702 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb248143a80 0x7fb248147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:34.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.130+0000 7fb245400640 1 -- 172.21.15.131:0/1946436702 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb248143a80 msgr2=0x7fb248147480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:34.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.130+0000 7fb245400640 1 --2- 172.21.15.131:0/1946436702 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb248143a80 0x7fb248147480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:34.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.130+0000 7fb245400640 1 -- 172.21.15.131:0/1946436702 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb248143670 msgr2=0x7fb248146360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:34.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.130+0000 7fb245400640 1 --2- 172.21.15.131:0/1946436702 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb248143670 0x7fb248146360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:34.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.130+0000 7fb245400640 1 -- 172.21.15.131:0/1946436702 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb24815c3f0 con 0x7fb2481468a0 2024-04-25T19:23:34.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.130+0000 7fb245400640 1 --2- 172.21.15.131:0/1946436702 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2481468a0 0x7fb248146f40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb23400eaf0 tx=0x7fb234001760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:34.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.130+0000 7fb23e000640 1 -- 172.21.15.131:0/1946436702 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23400c8d0 con 0x7fb2481468a0 2024-04-25T19:23:34.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.130+0000 7fb23e000640 1 -- 172.21.15.131:0/1946436702 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb234018070 con 0x7fb2481468a0 2024-04-25T19:23:34.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.130+0000 7fb24ce00640 1 -- 172.21.15.131:0/1946436702 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb24815c6d0 con 0x7fb2481468a0 2024-04-25T19:23:34.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.130+0000 7fb23e000640 1 -- 172.21.15.131:0/1946436702 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23400ccb0 con 0x7fb2481468a0 2024-04-25T19:23:34.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.131+0000 7fb24ce00640 1 -- 172.21.15.131:0/1946436702 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb24815cc90 con 0x7fb2481468a0 2024-04-25T19:23:34.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.132+0000 7fb24ce00640 1 -- 172.21.15.131:0/1946436702 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb248050740 con 0x7fb2481468a0 2024-04-25T19:23:34.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.133+0000 7fb23e000640 1 -- 172.21.15.131:0/1946436702 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb23401d460 con 0x7fb2481468a0 2024-04-25T19:23:34.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.134+0000 7fb23e000640 1 --2- 172.21.15.131:0/1946436702 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb2280744b0 0x7fb2280769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:34.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.134+0000 7fb23e000640 1 -- 172.21.15.131:0/1946436702 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5609+0+0 (secure 0 0 0) 0x7fb234095bc0 con 0x7fb2481468a0 2024-04-25T19:23:34.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.135+0000 7fb245e00640 1 --2- 172.21.15.131:0/1946436702 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb2280744b0 0x7fb2280769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:34.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.136+0000 7fb245e00640 1 --2- 172.21.15.131:0/1946436702 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb2280744b0 0x7fb2280769c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb238033000 tx=0x7fb238008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:34.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.138+0000 7fb23e000640 1 -- 172.21.15.131:0/1946436702 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb234060520 con 0x7fb2481468a0 2024-04-25T19:23:34.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.377+0000 7fb24ce00640 1 -- 172.21.15.131:0/1946436702 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb24815d090 con 0x7fb2481468a0 2024-04-25T19:23:34.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.857+0000 7fb23e000640 1 -- 172.21.15.131:0/1946436702 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7fb23405fe20 con 0x7fb2481468a0 2024-04-25T19:23:34.863 INFO:teuthology.orchestra.run.smithi131.stderr:new fs with metadata pool 4 and data pool 5 2024-04-25T19:23:34.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.864+0000 7fb24ce00640 1 -- 172.21.15.131:0/1946436702 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb2280744b0 msgr2=0x7fb2280769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:34.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.864+0000 7fb24ce00640 1 --2- 172.21.15.131:0/1946436702 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb2280744b0 0x7fb2280769c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb238033000 tx=0x7fb238008030 comp rx=0 tx=0).stop 2024-04-25T19:23:34.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.864+0000 7fb24ce00640 1 -- 172.21.15.131:0/1946436702 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2481468a0 msgr2=0x7fb248146f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:34.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.864+0000 7fb24ce00640 1 --2- 172.21.15.131:0/1946436702 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2481468a0 0x7fb248146f40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb23400eaf0 tx=0x7fb234001760 comp rx=0 tx=0).stop 2024-04-25T19:23:34.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.865+0000 7fb24ce00640 1 -- 172.21.15.131:0/1946436702 shutdown_connections 2024-04-25T19:23:34.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.865+0000 7fb24ce00640 1 --2- 172.21.15.131:0/1946436702 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb2280744b0 0x7fb2280769c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:34.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.865+0000 7fb24ce00640 1 --2- 172.21.15.131:0/1946436702 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb248143a80 0x7fb248147480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:34.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.865+0000 7fb24ce00640 1 --2- 172.21.15.131:0/1946436702 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2481468a0 0x7fb248146f40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:34.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.865+0000 7fb24ce00640 1 --2- 172.21.15.131:0/1946436702 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb248143670 0x7fb248146360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:34.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.865+0000 7fb24ce00640 1 -- 172.21.15.131:0/1946436702 >> 172.21.15.131:0/1946436702 conn(0x7fb248073090 msgr2=0x7fb2480b2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:34.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.865+0000 7fb24ce00640 1 -- 172.21.15.131:0/1946436702 shutdown_connections 2024-04-25T19:23:34.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:34.866+0000 7fb24ce00640 1 -- 172.21.15.131:0/1946436702 wait complete. 2024-04-25T19:23:34.911 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:23:35.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.148+0000 7fc41d400640 1 Processor -- start 2024-04-25T19:23:35.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.148+0000 7fc41d400640 1 -- start start 2024-04-25T19:23:35.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.151+0000 7fc41d400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc41806f7f0 0x7fc41816b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:35.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.151+0000 7fc41d400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc418160840 con 0x7fc4180b5420 2024-04-25T19:23:35.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.151+0000 7fc41d400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc418160ab0 con 0x7fc4180b4790 2024-04-25T19:23:35.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.151+0000 7fc41d400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fc418160d90 con 0x7fc41806f7f0 2024-04-25T19:23:35.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.151+0000 7fc417e00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fc4180b5420 0x7fc4180700e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:44980/0 (socket says 172.21.15.131:44980) 2024-04-25T19:23:35.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.151+0000 7fc417e00640 1 -- 172.21.15.131:0/2245705113 learned_addr learned my addr 172.21.15.131:0/2245705113 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:35.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.151+0000 7fc41ca00640 1 --2- 172.21.15.131:0/2245705113 >> v2:172.21.15.195:3300/0 conn(0x7fc41806f7f0 0x7fc41816b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:35.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.152+0000 7fc417400640 1 -- 172.21.15.131:0/2245705113 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1738226135 0 0) 0x7fc418160840 con 0x7fc4180b5420 2024-04-25T19:23:35.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.152+0000 7fc417400640 1 -- 172.21.15.131:0/2245705113 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3fc003520 con 0x7fc4180b5420 2024-04-25T19:23:35.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.152+0000 7fc417400640 1 -- 172.21.15.131:0/2245705113 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2538099048 0 0) 0x7fc3fc003520 con 0x7fc4180b5420 2024-04-25T19:23:35.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.152+0000 7fc417400640 1 -- 172.21.15.131:0/2245705113 >> v2:172.21.15.195:3300/0 conn(0x7fc41806f7f0 msgr2=0x7fc41816b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:35.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.152+0000 7fc417400640 1 --2- 172.21.15.131:0/2245705113 >> v2:172.21.15.195:3300/0 conn(0x7fc41806f7f0 0x7fc41816b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:35.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.152+0000 7fc417400640 1 -- 172.21.15.131:0/2245705113 >> v1:172.21.15.195:6789/0 conn(0x7fc4180b4790 legacy=0x7fc41806f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:35.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.152+0000 7fc417400640 1 -- 172.21.15.131:0/2245705113 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc418161070 con 0x7fc4180b5420 2024-04-25T19:23:35.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.152+0000 7fc417400640 1 -- 172.21.15.131:0/2245705113 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7fc408001670 con 0x7fc4180b5420 2024-04-25T19:23:35.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.152+0000 7fc417400640 1 -- 172.21.15.131:0/2245705113 >> v1:172.21.15.131:6789/0 conn(0x7fc4180b5420 legacy=0x7fc4180700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:35.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.152+0000 7fc417400640 1 --2- 172.21.15.131:0/2245705113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3fc0039b0 0x7fc3fc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:35.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.152+0000 7fc417400640 1 --2- 172.21.15.131:0/2245705113 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3fc004800 0x7fc3fc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:35.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.152+0000 7fc417400640 1 --2- 172.21.15.131:0/2245705113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3fc005250 0x7fc3fc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:35.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.152+0000 7fc417400640 1 -- 172.21.15.131:0/2245705113 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc418160d90 con 0x7fc3fc005250 2024-04-25T19:23:35.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.152+0000 7fc417400640 1 -- 172.21.15.131:0/2245705113 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc00c1e0 con 0x7fc3fc0039b0 2024-04-25T19:23:35.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.152+0000 7fc417400640 1 -- 172.21.15.131:0/2245705113 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc3fc00c3e0 con 0x7fc3fc004800 2024-04-25T19:23:35.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.152+0000 7fc41ca00640 1 --2- 172.21.15.131:0/2245705113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3fc005250 0x7fc3fc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:35.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.153+0000 7fc417e00640 1 --2- 172.21.15.131:0/2245705113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3fc0039b0 0x7fc3fc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:35.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.153+0000 7fc41ca00640 1 -- 172.21.15.131:0/2245705113 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3fc004800 msgr2=0x7fc3fc004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:35.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.153+0000 7fc41ca00640 1 --2- 172.21.15.131:0/2245705113 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3fc004800 0x7fc3fc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:35.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.153+0000 7fc41ca00640 1 -- 172.21.15.131:0/2245705113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3fc0039b0 msgr2=0x7fc3fc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:35.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.153+0000 7fc41ca00640 1 --2- 172.21.15.131:0/2245705113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3fc0039b0 0x7fc3fc003e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:35.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.153+0000 7fc41ca00640 1 -- 172.21.15.131:0/2245705113 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3fc003520 con 0x7fc3fc005250 2024-04-25T19:23:35.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.154+0000 7fc41ca00640 1 -- 172.21.15.131:0/2245705113 reap_dead start 2024-04-25T19:23:35.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.154+0000 7fc41ca00640 1 --2- 172.21.15.131:0/2245705113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3fc005250 0x7fc3fc00b9c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc410009fc0 tx=0x7fc3fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b330b9a7bb2ce4e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:35.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.154+0000 7fc417400640 1 -- 172.21.15.131:0/2245705113 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc410035020 con 0x7fc3fc005250 2024-04-25T19:23:35.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.154+0000 7fc417400640 1 -- 172.21.15.131:0/2245705113 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc410003bd0 con 0x7fc3fc005250 2024-04-25T19:23:35.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.154+0000 7fc417400640 1 -- 172.21.15.131:0/2245705113 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc410009c10 con 0x7fc3fc005250 2024-04-25T19:23:35.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.155+0000 7fc41d400640 1 -- 172.21.15.131:0/2245705113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3fc005250 msgr2=0x7fc3fc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:35.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.155+0000 7fc41d400640 1 --2- 172.21.15.131:0/2245705113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3fc005250 0x7fc3fc00b9c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc410009fc0 tx=0x7fc3fc005830 comp rx=0 tx=0).stop 2024-04-25T19:23:35.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.155+0000 7fc41d400640 1 -- 172.21.15.131:0/2245705113 shutdown_connections 2024-04-25T19:23:35.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.155+0000 7fc41d400640 1 --2- 172.21.15.131:0/2245705113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3fc005250 0x7fc3fc00b9c0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:35.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.155+0000 7fc41d400640 1 -- 172.21.15.131:0/2245705113 >> 172.21.15.131:0/2245705113 conn(0x7fc4180d1720 msgr2=0x7fc4180d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:35.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.155+0000 7fc41d400640 1 -- 172.21.15.131:0/2245705113 shutdown_connections 2024-04-25T19:23:35.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.155+0000 7fc41d400640 1 -- 172.21.15.131:0/2245705113 wait complete. 2024-04-25T19:23:35.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.157+0000 7fc41d400640 1 Processor -- start 2024-04-25T19:23:35.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.157+0000 7fc41d400640 1 -- start start 2024-04-25T19:23:35.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.159+0000 7fc41d400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3fc005250 0x7fc418148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:35.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.159+0000 7fc41d400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc41815d840 0x7fc418162cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:35.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.159+0000 7fc41d400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc41815dc50 0x7fc418163230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:35.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.159+0000 7fc41d400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc4180b0f60 con 0x7fc3fc005250 2024-04-25T19:23:35.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.159+0000 7fc41d400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc4180b0de0 con 0x7fc41815d840 2024-04-25T19:23:35.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.159+0000 7fc41d400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc4180700e0 con 0x7fc41815dc50 2024-04-25T19:23:35.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.159+0000 7fc417e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3fc005250 0x7fc418148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:35.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.159+0000 7fc417e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3fc005250 0x7fc418148170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33898/0 (socket says 172.21.15.131:33898) 2024-04-25T19:23:35.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.159+0000 7fc417e00640 1 -- 172.21.15.131:0/2425193383 learned_addr learned my addr 172.21.15.131:0/2425193383 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:35.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.160+0000 7fc417e00640 1 -- 172.21.15.131:0/2425193383 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc41815dc50 msgr2=0x7fc418163230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:35.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.160+0000 7fc417e00640 1 --2- 172.21.15.131:0/2425193383 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc41815dc50 0x7fc418163230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:35.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.160+0000 7fc417e00640 1 -- 172.21.15.131:0/2425193383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc41815d840 msgr2=0x7fc418162cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:35.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.160+0000 7fc40f400640 1 --2- 172.21.15.131:0/2425193383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc41815d840 0x7fc418162cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:35.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.160+0000 7fc417e00640 1 --2- 172.21.15.131:0/2425193383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc41815d840 0x7fc418162cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:35.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.160+0000 7fc417e00640 1 -- 172.21.15.131:0/2425193383 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4180d1530 con 0x7fc3fc005250 2024-04-25T19:23:35.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.160+0000 7fc417e00640 1 --2- 172.21.15.131:0/2425193383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3fc005250 0x7fc418148170 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc40800d7a0 tx=0x7fc40800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:35.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.160+0000 7fc414c00640 1 -- 172.21.15.131:0/2425193383 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc408019070 con 0x7fc3fc005250 2024-04-25T19:23:35.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.160+0000 7fc414c00640 1 -- 172.21.15.131:0/2425193383 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc40800de50 con 0x7fc3fc005250 2024-04-25T19:23:35.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.160+0000 7fc41d400640 1 -- 172.21.15.131:0/2425193383 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4181486b0 con 0x7fc3fc005250 2024-04-25T19:23:35.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.160+0000 7fc414c00640 1 -- 172.21.15.131:0/2425193383 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4080047e0 con 0x7fc3fc005250 2024-04-25T19:23:35.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.160+0000 7fc41d400640 1 -- 172.21.15.131:0/2425193383 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4180ce260 con 0x7fc3fc005250 2024-04-25T19:23:35.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.162+0000 7fc41d400640 1 -- 172.21.15.131:0/2425193383 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc418050740 con 0x7fc3fc005250 2024-04-25T19:23:35.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.163+0000 7fc414c00640 1 -- 172.21.15.131:0/2425193383 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc40801c070 con 0x7fc3fc005250 2024-04-25T19:23:35.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.164+0000 7fc414c00640 1 --2- 172.21.15.131:0/2425193383 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc3f40744b0 0x7fc3f40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:35.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.164+0000 7fc414c00640 1 -- 172.21.15.131:0/2425193383 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fc408094be0 con 0x7fc3fc005250 2024-04-25T19:23:35.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.165+0000 7fc40f400640 1 --2- 172.21.15.131:0/2425193383 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc3f40744b0 0x7fc3f40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:35.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.166+0000 7fc40f400640 1 --2- 172.21.15.131:0/2425193383 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc3f40744b0 0x7fc3f40769c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc4180d1ca0 tx=0x7fc400009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:35.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.169+0000 7fc414c00640 1 -- 172.21.15.131:0/2425193383 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc40805f370 con 0x7fc3fc005250 2024-04-25T19:23:35.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.356+0000 7fc41d400640 1 -- 172.21.15.131:0/2425193383 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc41806fb70 con 0x7fc3fc005250 2024-04-25T19:23:35.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.358+0000 7fc414c00640 1 -- 172.21.15.131:0/2425193383 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16706 (secure 0 0 0) 0x7fc40805ec70 con 0x7fc3fc005250 2024-04-25T19:23:35.361 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:35.361 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":32,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:23:34.379335+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:23:32.719018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T19:23:33.342898+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:23:35.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.361+0000 7fc41d400640 1 -- 172.21.15.131:0/2425193383 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc3f40744b0 msgr2=0x7fc3f40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:35.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.361+0000 7fc41d400640 1 --2- 172.21.15.131:0/2425193383 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc3f40744b0 0x7fc3f40769c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc4180d1ca0 tx=0x7fc400009040 comp rx=0 tx=0).stop 2024-04-25T19:23:35.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.361+0000 7fc41d400640 1 -- 172.21.15.131:0/2425193383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3fc005250 msgr2=0x7fc418148170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:35.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.361+0000 7fc41d400640 1 --2- 172.21.15.131:0/2425193383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3fc005250 0x7fc418148170 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc40800d7a0 tx=0x7fc40800dc60 comp rx=0 tx=0).stop 2024-04-25T19:23:35.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.361+0000 7fc41d400640 1 -- 172.21.15.131:0/2425193383 shutdown_connections 2024-04-25T19:23:35.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.361+0000 7fc41d400640 1 --2- 172.21.15.131:0/2425193383 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc3f40744b0 0x7fc3f40769c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:35.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.361+0000 7fc41d400640 1 --2- 172.21.15.131:0/2425193383 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc41815dc50 0x7fc418163230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:35.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.361+0000 7fc41d400640 1 --2- 172.21.15.131:0/2425193383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc41815d840 0x7fc418162cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:35.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.361+0000 7fc41d400640 1 --2- 172.21.15.131:0/2425193383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3fc005250 0x7fc418148170 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:35.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.361+0000 7fc41d400640 1 -- 172.21.15.131:0/2425193383 >> 172.21.15.131:0/2425193383 conn(0x7fc4180d1720 msgr2=0x7fc41806c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:35.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.361+0000 7fc41d400640 1 -- 172.21.15.131:0/2425193383 shutdown_connections 2024-04-25T19:23:35.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.361+0000 7fc41d400640 1 -- 172.21.15.131:0/2425193383 wait complete. 2024-04-25T19:23:35.389 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:23:35.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.630+0000 7f730fe00640 1 Processor -- start 2024-04-25T19:23:35.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.630+0000 7f730fe00640 1 -- start start 2024-04-25T19:23:35.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.632+0000 7f730fe00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f73100cf2f0 0x7f73100b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:35.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.632+0000 7f730fe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f73101608d0 0x7f7310160ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:35.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.632+0000 7f730fe00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7310161220 con 0x7f731015a810 2024-04-25T19:23:35.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.632+0000 7f730fe00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f731006f870 con 0x7f73101608d0 2024-04-25T19:23:35.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.632+0000 7f730fe00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f73100b74d0 con 0x7f73100cf2f0 2024-04-25T19:23:35.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.633+0000 7f730f400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f73101608d0 0x7f7310160ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:35.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.633+0000 7f730f400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f73101608d0 0x7f7310160ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33912/0 (socket says 172.21.15.131:33912) 2024-04-25T19:23:35.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.633+0000 7f730f400640 1 -- 172.21.15.131:0/1807013726 learned_addr learned my addr 172.21.15.131:0/1807013726 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:35.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.633+0000 7f730ea00640 1 --2- 172.21.15.131:0/1807013726 >> v2:172.21.15.195:3300/0 conn(0x7f73100cf2f0 0x7f73100b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:35.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.633+0000 7f730f400640 1 -- 172.21.15.131:0/1807013726 >> v2:172.21.15.195:3300/0 conn(0x7f73100cf2f0 msgr2=0x7f73100b6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:35.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.633+0000 7f730f400640 1 --2- 172.21.15.131:0/1807013726 >> v2:172.21.15.195:3300/0 conn(0x7f73100cf2f0 0x7f73100b6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:35.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.633+0000 7f730f400640 1 -- 172.21.15.131:0/1807013726 >> v1:172.21.15.195:6789/0 conn(0x7f731015a810 legacy=0x7f73100b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:35.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.633+0000 7f730f400640 1 -- 172.21.15.131:0/1807013726 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73100b77b0 con 0x7f73101608d0 2024-04-25T19:23:35.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.634+0000 7f730f400640 1 --2- 172.21.15.131:0/1807013726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73101608d0 0x7f7310160ce0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f73100d26d0 tx=0x7f730802c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e1c1f4c383dff3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:35.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.635+0000 7f730e000640 1 -- 172.21.15.131:0/1807013726 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7308036020 con 0x7f73101608d0 2024-04-25T19:23:35.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.635+0000 7f730e000640 1 -- 172.21.15.131:0/1807013726 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7308032640 con 0x7f73101608d0 2024-04-25T19:23:35.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.635+0000 7f730e000640 1 -- 172.21.15.131:0/1807013726 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7308032a10 con 0x7f73101608d0 2024-04-25T19:23:35.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.635+0000 7f730fe00640 1 -- 172.21.15.131:0/1807013726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73101608d0 msgr2=0x7f7310160ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:35.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.635+0000 7f730fe00640 1 --2- 172.21.15.131:0/1807013726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73101608d0 0x7f7310160ce0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f73100d26d0 tx=0x7f730802c940 comp rx=0 tx=0).stop 2024-04-25T19:23:35.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.635+0000 7f730fe00640 1 -- 172.21.15.131:0/1807013726 shutdown_connections 2024-04-25T19:23:35.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.635+0000 7f730fe00640 1 --2- 172.21.15.131:0/1807013726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73101608d0 0x7f7310160ce0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:35.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.635+0000 7f730fe00640 1 --2- 172.21.15.131:0/1807013726 >> v2:172.21.15.195:3300/0 conn(0x7f73100cf2f0 0x7f73100b6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:35.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.636+0000 7f730fe00640 1 -- 172.21.15.131:0/1807013726 >> 172.21.15.131:0/1807013726 conn(0x7f73100d1720 msgr2=0x7f73100d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:35.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.636+0000 7f730fe00640 1 -- 172.21.15.131:0/1807013726 shutdown_connections 2024-04-25T19:23:35.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.636+0000 7f730fe00640 1 -- 172.21.15.131:0/1807013726 wait complete. 2024-04-25T19:23:35.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.638+0000 7f730fe00640 1 Processor -- start 2024-04-25T19:23:35.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.638+0000 7f730fe00640 1 -- start start 2024-04-25T19:23:35.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.639+0000 7f730fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73100cf2f0 0x7f7310157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:35.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.640+0000 7f730fe00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f731015a810 0x7f7310152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:35.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.640+0000 7f730fe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f73101608d0 0x7f73100684e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:35.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.640+0000 7f730fe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f731015ac20 con 0x7f73100cf2f0 2024-04-25T19:23:35.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.640+0000 7f730fe00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f731006f500 con 0x7f731015a810 2024-04-25T19:23:35.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.640+0000 7f730fe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f731006fd00 con 0x7f73101608d0 2024-04-25T19:23:35.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.640+0000 7f730ea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73100cf2f0 0x7f7310157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:35.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.640+0000 7f730ea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73100cf2f0 0x7f7310157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33924/0 (socket says 172.21.15.131:33924) 2024-04-25T19:23:35.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.640+0000 7f730ea00640 1 -- 172.21.15.131:0/287476865 learned_addr learned my addr 172.21.15.131:0/287476865 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:35.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.640+0000 7f730ea00640 1 -- 172.21.15.131:0/287476865 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f73101608d0 msgr2=0x7f73100684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:35.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.640+0000 7f730ea00640 1 --2- 172.21.15.131:0/287476865 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f73101608d0 0x7f73100684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:35.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.640+0000 7f730ea00640 1 -- 172.21.15.131:0/287476865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f731015a810 msgr2=0x7f7310152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:35.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.640+0000 7f730ea00640 1 --2- 172.21.15.131:0/287476865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f731015a810 0x7f7310152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:35.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.640+0000 7f730ea00640 1 -- 172.21.15.131:0/287476865 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f731015f2b0 con 0x7f73100cf2f0 2024-04-25T19:23:35.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.641+0000 7f730ea00640 1 --2- 172.21.15.131:0/287476865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73100cf2f0 0x7f7310157210 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f730000e8a0 tx=0x7f730000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:35.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.641+0000 7f7307400640 1 -- 172.21.15.131:0/287476865 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7300017070 con 0x7f73100cf2f0 2024-04-25T19:23:35.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.641+0000 7f7307400640 1 -- 172.21.15.131:0/287476865 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f730000c940 con 0x7f73100cf2f0 2024-04-25T19:23:35.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.641+0000 7f7307400640 1 -- 172.21.15.131:0/287476865 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730000cd30 con 0x7f73100cf2f0 2024-04-25T19:23:35.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.641+0000 7f730fe00640 1 -- 172.21.15.131:0/287476865 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f731015f590 con 0x7f73100cf2f0 2024-04-25T19:23:35.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.641+0000 7f730fe00640 1 -- 172.21.15.131:0/287476865 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f731015fb50 con 0x7f73100cf2f0 2024-04-25T19:23:35.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.642+0000 7f730fe00640 1 -- 172.21.15.131:0/287476865 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7310050740 con 0x7f73100cf2f0 2024-04-25T19:23:35.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.643+0000 7f7307400640 1 -- 172.21.15.131:0/287476865 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f730001a070 con 0x7f73100cf2f0 2024-04-25T19:23:35.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.644+0000 7f7307400640 1 --2- 172.21.15.131:0/287476865 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f72ec0744b0 0x7f72ec0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:35.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.644+0000 7f7307400640 1 -- 172.21.15.131:0/287476865 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f73000954c0 con 0x7f73100cf2f0 2024-04-25T19:23:35.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.645+0000 7f7306000640 1 --2- 172.21.15.131:0/287476865 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f72ec0744b0 0x7f72ec0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:35.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.646+0000 7f7306000640 1 --2- 172.21.15.131:0/287476865 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f72ec0744b0 0x7f72ec0769c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72f80012e0 tx=0x7f72f8007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:35.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.649+0000 7f7307400640 1 -- 172.21.15.131:0/287476865 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f730005fc50 con 0x7f73100cf2f0 2024-04-25T19:23:35.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.848+0000 7f730fe00640 1 -- 172.21.15.131:0/287476865 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f731006c770 con 0x7f73100cf2f0 2024-04-25T19:23:35.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.852+0000 7f7307400640 1 -- 172.21.15.131:0/287476865 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16706 (secure 0 0 0) 0x7f730005f550 con 0x7f73100cf2f0 2024-04-25T19:23:35.854 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:35.855 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":32,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:23:34.379335+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:23:32.719018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T19:23:33.342898+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:23:35.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.854+0000 7f730fe00640 1 -- 172.21.15.131:0/287476865 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f72ec0744b0 msgr2=0x7f72ec0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:35.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.854+0000 7f730fe00640 1 --2- 172.21.15.131:0/287476865 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f72ec0744b0 0x7f72ec0769c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72f80012e0 tx=0x7f72f8007d50 comp rx=0 tx=0).stop 2024-04-25T19:23:35.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.854+0000 7f730fe00640 1 -- 172.21.15.131:0/287476865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73100cf2f0 msgr2=0x7f7310157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:35.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.854+0000 7f730fe00640 1 --2- 172.21.15.131:0/287476865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73100cf2f0 0x7f7310157210 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f730000e8a0 tx=0x7f730000ed60 comp rx=0 tx=0).stop 2024-04-25T19:23:35.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.854+0000 7f730fe00640 1 -- 172.21.15.131:0/287476865 shutdown_connections 2024-04-25T19:23:35.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.854+0000 7f730fe00640 1 --2- 172.21.15.131:0/287476865 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f72ec0744b0 0x7f72ec0769c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:35.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.854+0000 7f730fe00640 1 --2- 172.21.15.131:0/287476865 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f73101608d0 0x7f73100684e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:35.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.854+0000 7f730fe00640 1 --2- 172.21.15.131:0/287476865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f731015a810 0x7f7310152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:35.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.854+0000 7f730fe00640 1 --2- 172.21.15.131:0/287476865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73100cf2f0 0x7f7310157210 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:35.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.854+0000 7f730fe00640 1 -- 172.21.15.131:0/287476865 >> 172.21.15.131:0/287476865 conn(0x7f73100d1720 msgr2=0x7f73100d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:35.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.855+0000 7f730fe00640 1 -- 172.21.15.131:0/287476865 shutdown_connections 2024-04-25T19:23:35.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:35.855+0000 7f730fe00640 1 -- 172.21.15.131:0/287476865 wait complete. 2024-04-25T19:23:35.887 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T19:23:36.048 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:23:36.057 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:23:36.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.152+0000 7fada3e00640 1 Processor -- start 2024-04-25T19:23:36.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.153+0000 7fada3e00640 1 -- start start 2024-04-25T19:23:36.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.155+0000 7fada3e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fada4144340 0x7fada406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:36.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.155+0000 7fada3e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fada415ee60 0x7fada415f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:36.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.155+0000 7fada3e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fada406df20 con 0x7fada406db10 2024-04-25T19:23:36.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.155+0000 7fada3e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fada415f270 con 0x7fada415ee60 2024-04-25T19:23:36.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.155+0000 7fada3e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fada4144750 con 0x7fada4144340 2024-04-25T19:23:36.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.156+0000 7fad9a000640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fada406db10 0x7fada415e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:44992/0 (socket says 172.21.15.131:44992) 2024-04-25T19:23:36.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.156+0000 7fad9a000640 1 -- 172.21.15.131:0/2273520220 learned_addr learned my addr 172.21.15.131:0/2273520220 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:36.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.156+0000 7fada3400640 1 --2- 172.21.15.131:0/2273520220 >> v2:172.21.15.131:3300/0 conn(0x7fada415ee60 0x7fada415f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:36.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.156+0000 7fada2a00640 1 --2- 172.21.15.131:0/2273520220 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fada4144340 0x7fada406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:36.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.156+0000 7fada2000640 1 -- 172.21.15.131:0/2273520220 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3901167178 0 0) 0x7fad8c001110 con 0x7fada406db10 2024-04-25T19:23:36.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.156+0000 7fada2000640 1 -- 172.21.15.131:0/2273520220 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad88003520 con 0x7fada406db10 2024-04-25T19:23:36.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.156+0000 7fada3400640 1 -- 172.21.15.131:0/2273520220 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fada4144340 msgr2=0x7fada406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:36.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.156+0000 7fada3400640 1 --2- 172.21.15.131:0/2273520220 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fada4144340 0x7fada406d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:36.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.156+0000 7fada3400640 1 -- 172.21.15.131:0/2273520220 >> v1:172.21.15.131:6789/0 conn(0x7fada406db10 legacy=0x7fada415e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:36.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.156+0000 7fada3400640 1 -- 172.21.15.131:0/2273520220 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada4070000 con 0x7fada415ee60 2024-04-25T19:23:36.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.157+0000 7fada3400640 1 --2- 172.21.15.131:0/2273520220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fada415ee60 0x7fada415f4a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009d90 tx=0x7fad9c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882178b8fa75e7a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:36.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.158+0000 7fada2000640 1 -- 172.21.15.131:0/2273520220 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9c007740 con 0x7fada415ee60 2024-04-25T19:23:36.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.158+0000 7fada2000640 1 -- 172.21.15.131:0/2273520220 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad9c0078e0 con 0x7fada415ee60 2024-04-25T19:23:36.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.158+0000 7fada2000640 1 -- 172.21.15.131:0/2273520220 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9c007c90 con 0x7fada415ee60 2024-04-25T19:23:36.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.158+0000 7fada3e00640 1 -- 172.21.15.131:0/2273520220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fada415ee60 msgr2=0x7fada415f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:36.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.158+0000 7fada3e00640 1 --2- 172.21.15.131:0/2273520220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fada415ee60 0x7fada415f4a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009d90 tx=0x7fad9c02a660 comp rx=0 tx=0).stop 2024-04-25T19:23:36.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.159+0000 7fada3e00640 1 -- 172.21.15.131:0/2273520220 shutdown_connections 2024-04-25T19:23:36.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.159+0000 7fada3e00640 1 --2- 172.21.15.131:0/2273520220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fada415ee60 0x7fada415f4a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:36.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.159+0000 7fada3e00640 1 --2- 172.21.15.131:0/2273520220 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fada4144340 0x7fada406d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:36.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.159+0000 7fada3e00640 1 -- 172.21.15.131:0/2273520220 >> 172.21.15.131:0/2273520220 conn(0x7fada4072f40 msgr2=0x7fada4073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:36.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.159+0000 7fada3e00640 1 -- 172.21.15.131:0/2273520220 shutdown_connections 2024-04-25T19:23:36.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.159+0000 7fada3e00640 1 -- 172.21.15.131:0/2273520220 wait complete. 2024-04-25T19:23:36.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.161+0000 7fada3e00640 1 Processor -- start 2024-04-25T19:23:36.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.161+0000 7fada3e00640 1 -- start start 2024-04-25T19:23:36.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.162+0000 7fada3e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fada406db10 0x7fada40b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:36.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.162+0000 7fada3e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fada4144340 0x7fada415ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.162+0000 7fada3e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fada415ee60 0x7fada415b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.162+0000 7fada3e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fada406f800 con 0x7fada415ee60 2024-04-25T19:23:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.162+0000 7fada3e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fada406f520 con 0x7fada4144340 2024-04-25T19:23:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.162+0000 7fada3e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fada406fae0 con 0x7fada406db10 2024-04-25T19:23:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.163+0000 7fada3400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fada415ee60 0x7fada415b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.163+0000 7fada3400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fada415ee60 0x7fada415b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33938/0 (socket says 172.21.15.131:33938) 2024-04-25T19:23:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.163+0000 7fada3400640 1 -- 172.21.15.131:0/3804371039 learned_addr learned my addr 172.21.15.131:0/3804371039 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.163+0000 7fada3400640 1 -- 172.21.15.131:0/3804371039 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fada406db10 msgr2=0x7fada40b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.163+0000 7fada3400640 1 --2- 172.21.15.131:0/3804371039 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fada406db10 0x7fada40b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.163+0000 7fada3400640 1 -- 172.21.15.131:0/3804371039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fada4144340 msgr2=0x7fada415ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.163+0000 7fada3400640 1 --2- 172.21.15.131:0/3804371039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fada4144340 0x7fada415ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.163+0000 7fada3400640 1 -- 172.21.15.131:0/3804371039 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada415b7d0 con 0x7fada415ee60 2024-04-25T19:23:36.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.163+0000 7fada3400640 1 --2- 172.21.15.131:0/3804371039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fada415ee60 0x7fada415b290 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fad9c02ac50 tx=0x7fad9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:36.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.164+0000 7fad9b400640 1 -- 172.21.15.131:0/3804371039 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9c03f070 con 0x7fada415ee60 2024-04-25T19:23:36.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.164+0000 7fad9b400640 1 -- 172.21.15.131:0/3804371039 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad9c031c60 con 0x7fada415ee60 2024-04-25T19:23:36.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.164+0000 7fad9b400640 1 -- 172.21.15.131:0/3804371039 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9c009450 con 0x7fada415ee60 2024-04-25T19:23:36.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.164+0000 7fada3e00640 1 -- 172.21.15.131:0/3804371039 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fada4159cf0 con 0x7fada415ee60 2024-04-25T19:23:36.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.164+0000 7fada3e00640 1 -- 172.21.15.131:0/3804371039 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fada415a270 con 0x7fada415ee60 2024-04-25T19:23:36.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.165+0000 7fada3e00640 1 -- 172.21.15.131:0/3804371039 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fada4162980 con 0x7fada415ee60 2024-04-25T19:23:36.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.166+0000 7fad9b400640 1 -- 172.21.15.131:0/3804371039 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fad9c03b410 con 0x7fada415ee60 2024-04-25T19:23:36.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.167+0000 7fad9b400640 1 --2- 172.21.15.131:0/3804371039 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fad800744e0 0x7fad800769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:36.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.167+0000 7fad9b400640 1 -- 172.21.15.131:0/3804371039 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fad9c0b5c90 con 0x7fada415ee60 2024-04-25T19:23:36.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.168+0000 7fada2a00640 1 --2- 172.21.15.131:0/3804371039 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fad800744e0 0x7fad800769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:36.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.169+0000 7fada2a00640 1 --2- 172.21.15.131:0/3804371039 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fad800744e0 0x7fad800769f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fad94006fd0 tx=0x7fad94008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:36.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.173+0000 7fad9b400640 1 -- 172.21.15.131:0/3804371039 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fada4162980 con 0x7fada415ee60 2024-04-25T19:23:36.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.410+0000 7fada3e00640 1 -- 172.21.15.131:0/3804371039 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fada4076c60 con 0x7fada415ee60 2024-04-25T19:23:36.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.885+0000 7fad9b400640 1 -- 172.21.15.131:0/3804371039 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7fad9c04a020 con 0x7fada415ee60 2024-04-25T19:23:36.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.888+0000 7fada3e00640 1 -- 172.21.15.131:0/3804371039 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fad800744e0 msgr2=0x7fad800769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:36.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.888+0000 7fada3e00640 1 --2- 172.21.15.131:0/3804371039 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fad800744e0 0x7fad800769f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fad94006fd0 tx=0x7fad94008040 comp rx=0 tx=0).stop 2024-04-25T19:23:36.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.888+0000 7fada3e00640 1 -- 172.21.15.131:0/3804371039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fada415ee60 msgr2=0x7fada415b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:36.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.888+0000 7fada3e00640 1 --2- 172.21.15.131:0/3804371039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fada415ee60 0x7fada415b290 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fad9c02ac50 tx=0x7fad9c004a40 comp rx=0 tx=0).stop 2024-04-25T19:23:36.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.888+0000 7fada3e00640 1 -- 172.21.15.131:0/3804371039 shutdown_connections 2024-04-25T19:23:36.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.888+0000 7fada3e00640 1 --2- 172.21.15.131:0/3804371039 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fad800744e0 0x7fad800769f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:36.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.888+0000 7fada3e00640 1 --2- 172.21.15.131:0/3804371039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fada415ee60 0x7fada415b290 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:36.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.888+0000 7fada3e00640 1 --2- 172.21.15.131:0/3804371039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fada4144340 0x7fada415ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:36.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.888+0000 7fada3e00640 1 --2- 172.21.15.131:0/3804371039 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fada406db10 0x7fada40b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:36.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.888+0000 7fada3e00640 1 -- 172.21.15.131:0/3804371039 >> 172.21.15.131:0/3804371039 conn(0x7fada4072f40 msgr2=0x7fada4161a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:36.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.889+0000 7fada3e00640 1 -- 172.21.15.131:0/3804371039 shutdown_connections 2024-04-25T19:23:36.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:36.889+0000 7fada3e00640 1 -- 172.21.15.131:0/3804371039 wait complete. 2024-04-25T19:23:36.920 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T19:23:36.920 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T19:23:37.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.232+0000 7f6161a00640 1 Processor -- start 2024-04-25T19:23:37.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.233+0000 7f6161a00640 1 -- start start 2024-04-25T19:23:37.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.235+0000 7f6161a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f615c06dce0 0x7f615c16b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:37.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.235+0000 7f6161a00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f615c06f440 con 0x7f615c160390 2024-04-25T19:23:37.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.235+0000 7f6161a00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f615c06f720 con 0x7f615c0af710 2024-04-25T19:23:37.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.235+0000 7f6161a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f615c0afb20 con 0x7f615c06dce0 2024-04-25T19:23:37.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.235+0000 7f615a000640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f615c160390 0x7f615c06d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:45008/0 (socket says 172.21.15.131:45008) 2024-04-25T19:23:37.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.235+0000 7f615a000640 1 -- 172.21.15.131:0/2787266920 learned_addr learned my addr 172.21.15.131:0/2787266920 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:37.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.236+0000 7f615b400640 1 --2- 172.21.15.131:0/2787266920 >> v2:172.21.15.195:3300/0 conn(0x7f615c06dce0 0x7f615c16b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:37.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.236+0000 7f6159600640 1 -- 172.21.15.131:0/2787266920 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1808224200 0 0) 0x7f615c06f440 con 0x7f615c160390 2024-04-25T19:23:37.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.236+0000 7f6159600640 1 -- 172.21.15.131:0/2787266920 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f613c003520 con 0x7f615c160390 2024-04-25T19:23:37.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.236+0000 7f6159600640 1 -- 172.21.15.131:0/2787266920 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3185385504 0 0) 0x7f613c003520 con 0x7f615c160390 2024-04-25T19:23:37.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.236+0000 7f6159600640 1 -- 172.21.15.131:0/2787266920 >> v2:172.21.15.195:3300/0 conn(0x7f615c06dce0 msgr2=0x7f615c16b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:37.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.236+0000 7f6159600640 1 --2- 172.21.15.131:0/2787266920 >> v2:172.21.15.195:3300/0 conn(0x7f615c06dce0 0x7f615c16b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:37.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.236+0000 7f6159600640 1 -- 172.21.15.131:0/2787266920 >> v1:172.21.15.195:6789/0 conn(0x7f615c0af710 legacy=0x7f615c164a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:37.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.236+0000 7f6159600640 1 -- 172.21.15.131:0/2787266920 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f615c06fa00 con 0x7f615c160390 2024-04-25T19:23:37.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.236+0000 7f6159600640 1 -- 172.21.15.131:0/2787266920 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f61440019f0 con 0x7f615c160390 2024-04-25T19:23:37.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.236+0000 7f6159600640 1 -- 172.21.15.131:0/2787266920 >> v1:172.21.15.131:6789/0 conn(0x7f615c160390 legacy=0x7f615c06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:37.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.236+0000 7f6159600640 1 --2- 172.21.15.131:0/2787266920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f613c003a00 0x7f613c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:37.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.236+0000 7f6159600640 1 --2- 172.21.15.131:0/2787266920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f613c004800 0x7f613c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:37.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.237+0000 7f6159600640 1 --2- 172.21.15.131:0/2787266920 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f613c0052a0 0x7f613c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:37.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.237+0000 7f6159600640 1 -- 172.21.15.131:0/2787266920 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f615c0afb20 con 0x7f613c003a00 2024-04-25T19:23:37.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.237+0000 7f6159600640 1 -- 172.21.15.131:0/2787266920 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f613c00c230 con 0x7f613c004800 2024-04-25T19:23:37.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.237+0000 7f6159600640 1 -- 172.21.15.131:0/2787266920 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f613c00c430 con 0x7f613c0052a0 2024-04-25T19:23:37.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.237+0000 7f615aa00640 1 --2- 172.21.15.131:0/2787266920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f613c003a00 0x7f613c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:37.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.237+0000 7f615aa00640 1 -- 172.21.15.131:0/2787266920 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f613c0052a0 msgr2=0x7f613c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:37.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.237+0000 7f615aa00640 1 --2- 172.21.15.131:0/2787266920 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f613c0052a0 0x7f613c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:37.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.237+0000 7f615aa00640 1 -- 172.21.15.131:0/2787266920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f613c004800 msgr2=0x7f613c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:37.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.237+0000 7f615aa00640 1 --2- 172.21.15.131:0/2787266920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f613c004800 0x7f613c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:37.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.237+0000 7f615aa00640 1 -- 172.21.15.131:0/2787266920 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613c003520 con 0x7f613c003a00 2024-04-25T19:23:37.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.237+0000 7f615b400640 1 -- 172.21.15.131:0/2787266920 reap_dead start 2024-04-25T19:23:37.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.238+0000 7f615aa00640 1 --2- 172.21.15.131:0/2787266920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f613c003a00 0x7f613c003e70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f614c001750 tx=0x7f613c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e0580f89ea0e28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:37.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.238+0000 7f6159600640 1 -- 172.21.15.131:0/2787266920 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614c001370 con 0x7f613c003a00 2024-04-25T19:23:37.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.238+0000 7f6159600640 1 -- 172.21.15.131:0/2787266920 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f614c0052d0 con 0x7f613c003a00 2024-04-25T19:23:37.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.238+0000 7f6159600640 1 -- 172.21.15.131:0/2787266920 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614c02abc0 con 0x7f613c003a00 2024-04-25T19:23:37.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.239+0000 7f6161a00640 1 -- 172.21.15.131:0/2787266920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f613c003a00 msgr2=0x7f613c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:37.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.239+0000 7f6161a00640 1 --2- 172.21.15.131:0/2787266920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f613c003a00 0x7f613c003e70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f614c001750 tx=0x7f613c005830 comp rx=0 tx=0).stop 2024-04-25T19:23:37.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.239+0000 7f6161a00640 1 -- 172.21.15.131:0/2787266920 shutdown_connections 2024-04-25T19:23:37.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.239+0000 7f6161a00640 1 --2- 172.21.15.131:0/2787266920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f613c003a00 0x7f613c003e70 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:37.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.239+0000 7f6161a00640 1 -- 172.21.15.131:0/2787266920 >> 172.21.15.131:0/2787266920 conn(0x7f615c073090 msgr2=0x7f615c0734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:37.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.240+0000 7f6161a00640 1 -- 172.21.15.131:0/2787266920 shutdown_connections 2024-04-25T19:23:37.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.240+0000 7f6161a00640 1 -- 172.21.15.131:0/2787266920 wait complete. 2024-04-25T19:23:37.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.242+0000 7f6161a00640 1 Processor -- start 2024-04-25T19:23:37.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.242+0000 7f6161a00640 1 -- start start 2024-04-25T19:23:37.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.243+0000 7f6161a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f613c003a00 0x7f615c14ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:37.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.243+0000 7f6161a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f615c1576f0 0x7f615c1593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:37.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.243+0000 7f6161a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f615c1598e0 0x7f615c0cf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:37.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.244+0000 7f6161a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f615c06f0d0 con 0x7f615c1576f0 2024-04-25T19:23:37.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.244+0000 7f6161a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f615c06fda0 con 0x7f613c003a00 2024-04-25T19:23:37.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.244+0000 7f6161a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f615c0b1110 con 0x7f615c1598e0 2024-04-25T19:23:37.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.244+0000 7f615a000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f615c1576f0 0x7f615c1593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:37.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.244+0000 7f615a000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f615c1576f0 0x7f615c1593a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33946/0 (socket says 172.21.15.131:33946) 2024-04-25T19:23:37.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.244+0000 7f615a000640 1 -- 172.21.15.131:0/2378846273 learned_addr learned my addr 172.21.15.131:0/2378846273 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:37.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.244+0000 7f615a000640 1 -- 172.21.15.131:0/2378846273 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f615c1598e0 msgr2=0x7f615c0cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:37.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.244+0000 7f615a000640 1 --2- 172.21.15.131:0/2378846273 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f615c1598e0 0x7f615c0cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:37.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.244+0000 7f615a000640 1 -- 172.21.15.131:0/2378846273 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f613c003a00 msgr2=0x7f615c14ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:37.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.244+0000 7f615a000640 1 --2- 172.21.15.131:0/2378846273 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f613c003a00 0x7f615c14ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:37.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.244+0000 7f615a000640 1 -- 172.21.15.131:0/2378846273 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f615c158300 con 0x7f615c1576f0 2024-04-25T19:23:37.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.245+0000 7f615a000640 1 --2- 172.21.15.131:0/2378846273 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f615c1576f0 0x7f615c1593a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f614400caa0 tx=0x7f614400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:37.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.245+0000 7f6152a00640 1 -- 172.21.15.131:0/2378846273 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6144018070 con 0x7f615c1576f0 2024-04-25T19:23:37.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.245+0000 7f6152a00640 1 -- 172.21.15.131:0/2378846273 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f614400a650 con 0x7f615c1576f0 2024-04-25T19:23:37.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.245+0000 7f6152a00640 1 -- 172.21.15.131:0/2378846273 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614400aa40 con 0x7f615c1576f0 2024-04-25T19:23:37.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.245+0000 7f6161a00640 1 -- 172.21.15.131:0/2378846273 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f615c1585e0 con 0x7f615c1576f0 2024-04-25T19:23:37.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.245+0000 7f6161a00640 1 -- 172.21.15.131:0/2378846273 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f615c158ba0 con 0x7f615c1576f0 2024-04-25T19:23:37.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.246+0000 7f6161a00640 1 -- 172.21.15.131:0/2378846273 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f615c050740 con 0x7f615c1576f0 2024-04-25T19:23:37.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.247+0000 7f6152a00640 1 -- 172.21.15.131:0/2378846273 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f614400abe0 con 0x7f615c1576f0 2024-04-25T19:23:37.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.248+0000 7f6152a00640 1 --2- 172.21.15.131:0/2378846273 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f61380744b0 0x7f61380769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:37.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.248+0000 7f6152a00640 1 -- 172.21.15.131:0/2378846273 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f6144094a00 con 0x7f615c1576f0 2024-04-25T19:23:37.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.249+0000 7f615aa00640 1 --2- 172.21.15.131:0/2378846273 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f61380744b0 0x7f61380769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:37.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.250+0000 7f615aa00640 1 --2- 172.21.15.131:0/2378846273 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f61380744b0 0x7f61380769c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f614c032000 tx=0x7f614c02c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:37.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.254+0000 7f6152a00640 1 -- 172.21.15.131:0/2378846273 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f614405f0f0 con 0x7f615c1576f0 2024-04-25T19:23:37.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.483+0000 7f6161a00640 1 -- 172.21.15.131:0/2378846273 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f615c158050 con 0x7f615c1576f0 2024-04-25T19:23:37.610 INFO:tasks.ceph.mds.d.smithi195.stderr:2024-04-25T19:23:37.609+0000 7fd3a1c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T19:23:37.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.902+0000 7f6152a00640 1 -- 172.21.15.131:0/2378846273 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f614405e9f0 con 0x7f615c1576f0 2024-04-25T19:23:37.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.907+0000 7f6161a00640 1 -- 172.21.15.131:0/2378846273 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f61380744b0 msgr2=0x7f61380769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:37.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.907+0000 7f6161a00640 1 --2- 172.21.15.131:0/2378846273 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f61380744b0 0x7f61380769c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f614c032000 tx=0x7f614c02c000 comp rx=0 tx=0).stop 2024-04-25T19:23:37.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.907+0000 7f6161a00640 1 -- 172.21.15.131:0/2378846273 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f615c1576f0 msgr2=0x7f615c1593a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:37.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.907+0000 7f6161a00640 1 --2- 172.21.15.131:0/2378846273 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f615c1576f0 0x7f615c1593a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f614400caa0 tx=0x7f614400cf60 comp rx=0 tx=0).stop 2024-04-25T19:23:37.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.908+0000 7f6161a00640 1 -- 172.21.15.131:0/2378846273 shutdown_connections 2024-04-25T19:23:37.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.908+0000 7f6161a00640 1 --2- 172.21.15.131:0/2378846273 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f61380744b0 0x7f61380769c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:37.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.908+0000 7f6161a00640 1 --2- 172.21.15.131:0/2378846273 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f615c1598e0 0x7f615c0cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:37.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.908+0000 7f6161a00640 1 --2- 172.21.15.131:0/2378846273 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f615c1576f0 0x7f615c1593a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:37.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.908+0000 7f6161a00640 1 --2- 172.21.15.131:0/2378846273 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f613c003a00 0x7f615c14ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:37.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.908+0000 7f6161a00640 1 -- 172.21.15.131:0/2378846273 >> 172.21.15.131:0/2378846273 conn(0x7f615c073090 msgr2=0x7f615c06c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:37.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.908+0000 7f6161a00640 1 -- 172.21.15.131:0/2378846273 shutdown_connections 2024-04-25T19:23:37.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:37.908+0000 7f6161a00640 1 -- 172.21.15.131:0/2378846273 wait complete. 2024-04-25T19:23:37.941 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T19:23:37.941 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:23:38.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.202+0000 7f714ca00640 1 Processor -- start 2024-04-25T19:23:38.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.202+0000 7f714ca00640 1 -- start start 2024-04-25T19:23:38.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.204+0000 7f714ca00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7148164860 0x7f71480b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:38.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.204+0000 7f714ca00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71480b7540 0x7f71480b7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:38.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.204+0000 7f714ca00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f71480d44a0 0x7f71480d48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:38.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.204+0000 7f714ca00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f71481643d0 con 0x7f71480d44a0 2024-04-25T19:23:38.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.204+0000 7f714ca00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f71480b5270 con 0x7f7148164860 2024-04-25T19:23:38.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.204+0000 7f714ca00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7148161650 con 0x7f71480b7540 2024-04-25T19:23:38.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.204+0000 7f7147e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f71480d44a0 0x7f71480d48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:38.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.205+0000 7f7147e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f71480d44a0 0x7f71480d48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51684/0 (socket says 172.21.15.131:51684) 2024-04-25T19:23:38.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.205+0000 7f7147e00640 1 -- 172.21.15.131:0/917430472 learned_addr learned my addr 172.21.15.131:0/917430472 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:38.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.205+0000 7f7147400640 1 --2- 172.21.15.131:0/917430472 >> v2:172.21.15.195:3300/0 conn(0x7f7148164860 0x7f71480b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:38.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.205+0000 7f713fe00640 1 --2- 172.21.15.131:0/917430472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71480b7540 0x7f71480b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:38.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.205+0000 7f7147e00640 1 -- 172.21.15.131:0/917430472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71480b7540 msgr2=0x7f71480b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:38.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.205+0000 7f7147e00640 1 --2- 172.21.15.131:0/917430472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71480b7540 0x7f71480b7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:38.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.205+0000 7f7147e00640 1 -- 172.21.15.131:0/917430472 >> v2:172.21.15.195:3300/0 conn(0x7f7148164860 msgr2=0x7f71480b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:38.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.205+0000 7f7147e00640 1 --2- 172.21.15.131:0/917430472 >> v2:172.21.15.195:3300/0 conn(0x7f7148164860 0x7f71480b4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:38.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.205+0000 7f7147e00640 1 -- 172.21.15.131:0/917430472 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71480b7e90 con 0x7f71480d44a0 2024-04-25T19:23:38.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.206+0000 7f7147e00640 1 --2- 172.21.15.131:0/917430472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71480d44a0 0x7f71480d48b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f71480d3820 tx=0x7f714002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df386c61e5c8efc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:38.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.206+0000 7f7146a00640 1 -- 172.21.15.131:0/917430472 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7140036070 con 0x7f71480d44a0 2024-04-25T19:23:38.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.206+0000 7f7146a00640 1 -- 172.21.15.131:0/917430472 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7140031600 con 0x7f71480d44a0 2024-04-25T19:23:38.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.206+0000 7f7146a00640 1 -- 172.21.15.131:0/917430472 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71400319d0 con 0x7f71480d44a0 2024-04-25T19:23:38.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.207+0000 7f714ca00640 1 -- 172.21.15.131:0/917430472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71480d44a0 msgr2=0x7f71480d48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:38.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.207+0000 7f714ca00640 1 --2- 172.21.15.131:0/917430472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71480d44a0 0x7f71480d48b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f71480d3820 tx=0x7f714002a6a0 comp rx=0 tx=0).stop 2024-04-25T19:23:38.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.207+0000 7f714ca00640 1 -- 172.21.15.131:0/917430472 shutdown_connections 2024-04-25T19:23:38.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.207+0000 7f714ca00640 1 --2- 172.21.15.131:0/917430472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71480d44a0 0x7f71480d48b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:38.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.207+0000 7f714ca00640 1 --2- 172.21.15.131:0/917430472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71480b7540 0x7f71480b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:38.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.207+0000 7f714ca00640 1 --2- 172.21.15.131:0/917430472 >> v2:172.21.15.195:3300/0 conn(0x7f7148164860 0x7f71480b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:38.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.207+0000 7f714ca00640 1 -- 172.21.15.131:0/917430472 >> 172.21.15.131:0/917430472 conn(0x7f71480d2720 msgr2=0x7f71480d2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:38.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.207+0000 7f714ca00640 1 -- 172.21.15.131:0/917430472 shutdown_connections 2024-04-25T19:23:38.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.207+0000 7f714ca00640 1 -- 172.21.15.131:0/917430472 wait complete. 2024-04-25T19:23:38.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.210+0000 7f714ca00640 1 Processor -- start 2024-04-25T19:23:38.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.210+0000 7f714ca00640 1 -- start start 2024-04-25T19:23:38.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.211+0000 7f714ca00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71480b7540 0x7f71480c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:38.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.211+0000 7f714ca00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71480d44a0 0x7f714814e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:38.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.211+0000 7f714ca00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7148164860 0x7f714814e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:38.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.211+0000 7f714ca00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7148164060 con 0x7f7148164860 2024-04-25T19:23:38.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.211+0000 7f714ca00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7148163d80 con 0x7f71480d44a0 2024-04-25T19:23:38.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.211+0000 7f714ca00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f71480d4df0 con 0x7f71480b7540 2024-04-25T19:23:38.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.212+0000 7f7147e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7148164860 0x7f714814e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:38.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.212+0000 7f7147e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7148164860 0x7f714814e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51686/0 (socket says 172.21.15.131:51686) 2024-04-25T19:23:38.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.212+0000 7f7147e00640 1 -- 172.21.15.131:0/3407312480 learned_addr learned my addr 172.21.15.131:0/3407312480 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:38.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.212+0000 7f713fe00640 1 --2- 172.21.15.131:0/3407312480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71480d44a0 0x7f714814e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:38.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.212+0000 7f7147400640 1 --2- 172.21.15.131:0/3407312480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71480b7540 0x7f71480c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:38.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.212+0000 7f7147e00640 1 -- 172.21.15.131:0/3407312480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71480b7540 msgr2=0x7f71480c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:38.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.212+0000 7f7147e00640 1 --2- 172.21.15.131:0/3407312480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71480b7540 0x7f71480c9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:38.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.212+0000 7f7147e00640 1 -- 172.21.15.131:0/3407312480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71480d44a0 msgr2=0x7f714814e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:38.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.212+0000 7f7147e00640 1 --2- 172.21.15.131:0/3407312480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71480d44a0 0x7f714814e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:38.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.212+0000 7f7147e00640 1 -- 172.21.15.131:0/3407312480 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71480cfd20 con 0x7f7148164860 2024-04-25T19:23:38.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.212+0000 7f7147e00640 1 --2- 172.21.15.131:0/3407312480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7148164860 0x7f714814e6e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7140034040 tx=0x7f7140004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:38.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.213+0000 7f713f400640 1 -- 172.21.15.131:0/3407312480 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7140036050 con 0x7f7148164860 2024-04-25T19:23:38.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.213+0000 7f713f400640 1 -- 172.21.15.131:0/3407312480 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7140042070 con 0x7f7148164860 2024-04-25T19:23:38.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.213+0000 7f714ca00640 1 -- 172.21.15.131:0/3407312480 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71480ca100 con 0x7f7148164860 2024-04-25T19:23:38.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.213+0000 7f713f400640 1 -- 172.21.15.131:0/3407312480 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7140009510 con 0x7f7148164860 2024-04-25T19:23:38.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.213+0000 7f714ca00640 1 -- 172.21.15.131:0/3407312480 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71481eab00 con 0x7f7148164860 2024-04-25T19:23:38.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.214+0000 7f714ca00640 1 -- 172.21.15.131:0/3407312480 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71480cf790 con 0x7f7148164860 2024-04-25T19:23:38.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.215+0000 7f713f400640 1 -- 172.21.15.131:0/3407312480 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7140007bd0 con 0x7f7148164860 2024-04-25T19:23:38.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.216+0000 7f713f400640 1 --2- 172.21.15.131:0/3407312480 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f71240744b0 0x7f71240769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:38.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.216+0000 7f713f400640 1 -- 172.21.15.131:0/3407312480 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f71400b6210 con 0x7f7148164860 2024-04-25T19:23:38.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.217+0000 7f7147400640 1 --2- 172.21.15.131:0/3407312480 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f71240744b0 0x7f71240769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:38.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.218+0000 7f7147400640 1 --2- 172.21.15.131:0/3407312480 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f71240744b0 0x7f71240769c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f71480d3740 tx=0x7f7138008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:38.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.220+0000 7f713f400640 1 -- 172.21.15.131:0/3407312480 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f71480b7e90 con 0x7f7148164860 2024-04-25T19:23:38.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.441+0000 7f714ca00640 1 -- 172.21.15.131:0/3407312480 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7148050740 con 0x7f7148164860 2024-04-25T19:23:38.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.442+0000 7f713f400640 1 -- 172.21.15.131:0/3407312480 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5193 (secure 0 0 0) 0x7f7140080990 con 0x7f7148164860 2024-04-25T19:23:38.444 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:38.444 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3675320819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3675320819},{"type":"v1","addr":"172.21.15.131:6834","nonce":3675320819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/2332391948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":2332391948},{"type":"v1","addr":"172.21.15.195:6835","nonce":2332391948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4726,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2008890338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2008890338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2008890338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T19:23:34.379246+0000","modified":"2024-04-25T19:23:37.485292+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4729":{"gid":4729,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6837/2364484867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2364484867},{"type":"v1","addr":"172.21.15.195:6837","nonce":2364484867}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4729,"qdb_cluster":[4729]},"id":2}]} 2024-04-25T19:23:38.444 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 16 2024-04-25T19:23:38.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.446+0000 7f714ca00640 1 -- 172.21.15.131:0/3407312480 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f71240744b0 msgr2=0x7f71240769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:38.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.446+0000 7f714ca00640 1 --2- 172.21.15.131:0/3407312480 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f71240744b0 0x7f71240769c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f71480d3740 tx=0x7f7138008040 comp rx=0 tx=0).stop 2024-04-25T19:23:38.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.446+0000 7f714ca00640 1 -- 172.21.15.131:0/3407312480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7148164860 msgr2=0x7f714814e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:38.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.446+0000 7f714ca00640 1 --2- 172.21.15.131:0/3407312480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7148164860 0x7f714814e6e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7140034040 tx=0x7f7140004a40 comp rx=0 tx=0).stop 2024-04-25T19:23:38.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.446+0000 7f714ca00640 1 -- 172.21.15.131:0/3407312480 shutdown_connections 2024-04-25T19:23:38.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.446+0000 7f714ca00640 1 --2- 172.21.15.131:0/3407312480 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f71240744b0 0x7f71240769c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:38.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.446+0000 7f714ca00640 1 --2- 172.21.15.131:0/3407312480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7148164860 0x7f714814e6e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:38.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.446+0000 7f714ca00640 1 --2- 172.21.15.131:0/3407312480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71480d44a0 0x7f714814e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:38.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.446+0000 7f714ca00640 1 --2- 172.21.15.131:0/3407312480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71480b7540 0x7f71480c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:38.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.446+0000 7f714ca00640 1 -- 172.21.15.131:0/3407312480 >> 172.21.15.131:0/3407312480 conn(0x7f71480d2720 msgr2=0x7f71480b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:38.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.446+0000 7f714ca00640 1 -- 172.21.15.131:0/3407312480 shutdown_connections 2024-04-25T19:23:38.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.446+0000 7f714ca00640 1 -- 172.21.15.131:0/3407312480 wait complete. 2024-04-25T19:23:38.473 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:23:38.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.735+0000 7fce30e00640 1 Processor -- start 2024-04-25T19:23:38.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.735+0000 7fce30e00640 1 -- start start 2024-04-25T19:23:38.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.737+0000 7fce30e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fce2c06c5c0 0x7fce2c0cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:38.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.737+0000 7fce30e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fce2c144370 0x7fce2c0b4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:38.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.737+0000 7fce30e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce2c0b4cd0 0x7fce2c161a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:38.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.737+0000 7fce30e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fce2c0b50e0 con 0x7fce2c06c5c0 2024-04-25T19:23:38.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.737+0000 7fce30e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fce2c0d1230 con 0x7fce2c144370 2024-04-25T19:23:38.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.737+0000 7fce30e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fce2c0d06b0 con 0x7fce2c0b4cd0 2024-04-25T19:23:38.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.738+0000 7fce2b400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fce2c06c5c0 0x7fce2c0cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:38.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.738+0000 7fce2b400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fce2c06c5c0 0x7fce2c0cfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51690/0 (socket says 172.21.15.131:51690) 2024-04-25T19:23:38.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.738+0000 7fce2b400640 1 -- 172.21.15.131:0/2547788607 learned_addr learned my addr 172.21.15.131:0/2547788607 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:38.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.738+0000 7fce2aa00640 1 --2- 172.21.15.131:0/2547788607 >> v2:172.21.15.195:3300/0 conn(0x7fce2c144370 0x7fce2c0b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:38.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.738+0000 7fce2be00640 1 --2- 172.21.15.131:0/2547788607 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce2c0b4cd0 0x7fce2c161a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:38.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.738+0000 7fce2b400640 1 -- 172.21.15.131:0/2547788607 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce2c0b4cd0 msgr2=0x7fce2c161a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:38.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.738+0000 7fce2b400640 1 --2- 172.21.15.131:0/2547788607 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce2c0b4cd0 0x7fce2c161a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:38.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.738+0000 7fce2b400640 1 -- 172.21.15.131:0/2547788607 >> v2:172.21.15.195:3300/0 conn(0x7fce2c144370 msgr2=0x7fce2c0b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:38.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.738+0000 7fce2b400640 1 --2- 172.21.15.131:0/2547788607 >> v2:172.21.15.195:3300/0 conn(0x7fce2c144370 0x7fce2c0b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:38.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.738+0000 7fce2b400640 1 -- 172.21.15.131:0/2547788607 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce2c0d0990 con 0x7fce2c06c5c0 2024-04-25T19:23:38.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.738+0000 7fce2aa00640 1 --2- 172.21.15.131:0/2547788607 >> v2:172.21.15.195:3300/0 conn(0x7fce2c144370 0x7fce2c0b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:38.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.739+0000 7fce2b400640 1 --2- 172.21.15.131:0/2547788607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce2c06c5c0 0x7fce2c0cfa70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fce2c0b5550 tx=0x7fce1c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46875bffa735a54c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:38.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.740+0000 7fce2a000640 1 -- 172.21.15.131:0/2547788607 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c036070 con 0x7fce2c06c5c0 2024-04-25T19:23:38.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.740+0000 7fce2a000640 1 -- 172.21.15.131:0/2547788607 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce1c031600 con 0x7fce2c06c5c0 2024-04-25T19:23:38.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.740+0000 7fce2a000640 1 -- 172.21.15.131:0/2547788607 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c0319d0 con 0x7fce2c06c5c0 2024-04-25T19:23:38.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.740+0000 7fce30e00640 1 -- 172.21.15.131:0/2547788607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce2c06c5c0 msgr2=0x7fce2c0cfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:38.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.740+0000 7fce30e00640 1 --2- 172.21.15.131:0/2547788607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce2c06c5c0 0x7fce2c0cfa70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fce2c0b5550 tx=0x7fce1c02a6a0 comp rx=0 tx=0).stop 2024-04-25T19:23:38.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.740+0000 7fce30e00640 1 -- 172.21.15.131:0/2547788607 shutdown_connections 2024-04-25T19:23:38.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.740+0000 7fce30e00640 1 --2- 172.21.15.131:0/2547788607 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce2c0b4cd0 0x7fce2c161a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:38.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.740+0000 7fce30e00640 1 --2- 172.21.15.131:0/2547788607 >> v2:172.21.15.195:3300/0 conn(0x7fce2c144370 0x7fce2c0b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:38.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.740+0000 7fce30e00640 1 --2- 172.21.15.131:0/2547788607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce2c06c5c0 0x7fce2c0cfa70 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:38.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.741+0000 7fce30e00640 1 -- 172.21.15.131:0/2547788607 >> 172.21.15.131:0/2547788607 conn(0x7fce2c0d1720 msgr2=0x7fce2c0d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:38.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.741+0000 7fce30e00640 1 -- 172.21.15.131:0/2547788607 shutdown_connections 2024-04-25T19:23:38.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.741+0000 7fce30e00640 1 -- 172.21.15.131:0/2547788607 wait complete. 2024-04-25T19:23:38.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.743+0000 7fce30e00640 1 Processor -- start 2024-04-25T19:23:38.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.743+0000 7fce30e00640 1 -- start start 2024-04-25T19:23:38.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.745+0000 7fce30e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce2c06c5c0 0x7fce2c15d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:38.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.745+0000 7fce30e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce2c0b4cd0 0x7fce2c1419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:38.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.745+0000 7fce30e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce2c144370 0x7fce2c0af690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:38.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.745+0000 7fce30e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c0d02d0 con 0x7fce2c06c5c0 2024-04-25T19:23:38.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.745+0000 7fce30e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c0d0f50 con 0x7fce2c0b4cd0 2024-04-25T19:23:38.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.745+0000 7fce30e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fce2c0d0450 con 0x7fce2c144370 2024-04-25T19:23:38.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.745+0000 7fce2b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce2c06c5c0 0x7fce2c15d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:38.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.745+0000 7fce2b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce2c06c5c0 0x7fce2c15d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51692/0 (socket says 172.21.15.131:51692) 2024-04-25T19:23:38.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.745+0000 7fce2b400640 1 -- 172.21.15.131:0/2283391862 learned_addr learned my addr 172.21.15.131:0/2283391862 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:38.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.745+0000 7fce2aa00640 1 --2- 172.21.15.131:0/2283391862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce2c0b4cd0 0x7fce2c1419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:38.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.746+0000 7fce2be00640 1 --2- 172.21.15.131:0/2283391862 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce2c144370 0x7fce2c0af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:38.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.746+0000 7fce2b400640 1 -- 172.21.15.131:0/2283391862 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce2c144370 msgr2=0x7fce2c0af690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:38.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.746+0000 7fce2b400640 1 --2- 172.21.15.131:0/2283391862 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce2c144370 0x7fce2c0af690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:38.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.746+0000 7fce2b400640 1 -- 172.21.15.131:0/2283391862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce2c0b4cd0 msgr2=0x7fce2c1419f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:38.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.746+0000 7fce2b400640 1 --2- 172.21.15.131:0/2283391862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce2c0b4cd0 0x7fce2c1419f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:38.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.746+0000 7fce2b400640 1 -- 172.21.15.131:0/2283391862 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce2c15d700 con 0x7fce2c06c5c0 2024-04-25T19:23:38.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.746+0000 7fce2aa00640 1 --2- 172.21.15.131:0/2283391862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce2c0b4cd0 0x7fce2c1419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:38.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.746+0000 7fce2be00640 1 --2- 172.21.15.131:0/2283391862 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce2c144370 0x7fce2c0af690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:38.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.746+0000 7fce2b400640 1 --2- 172.21.15.131:0/2283391862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce2c06c5c0 0x7fce2c15d1c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fce1c000f80 tx=0x7fce1c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:38.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.746+0000 7fce23400640 1 -- 172.21.15.131:0/2283391862 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c036050 con 0x7fce2c06c5c0 2024-04-25T19:23:38.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.746+0000 7fce23400640 1 -- 172.21.15.131:0/2283391862 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce1c042070 con 0x7fce2c06c5c0 2024-04-25T19:23:38.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.746+0000 7fce23400640 1 -- 172.21.15.131:0/2283391862 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c009510 con 0x7fce2c06c5c0 2024-04-25T19:23:38.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.746+0000 7fce30e00640 1 -- 172.21.15.131:0/2283391862 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce2c142420 con 0x7fce2c06c5c0 2024-04-25T19:23:38.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.746+0000 7fce30e00640 1 -- 172.21.15.131:0/2283391862 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce2c15fa40 con 0x7fce2c06c5c0 2024-04-25T19:23:38.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.748+0000 7fce30e00640 1 -- 172.21.15.131:0/2283391862 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce2c050740 con 0x7fce2c06c5c0 2024-04-25T19:23:38.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.749+0000 7fce23400640 1 -- 172.21.15.131:0/2283391862 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fce1c007c70 con 0x7fce2c06c5c0 2024-04-25T19:23:38.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.750+0000 7fce23400640 1 --2- 172.21.15.131:0/2283391862 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fce080744e0 0x7fce080769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:38.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.751+0000 7fce23400640 1 -- 172.21.15.131:0/2283391862 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fce1c0b61f0 con 0x7fce2c06c5c0 2024-04-25T19:23:38.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.751+0000 7fce2aa00640 1 --2- 172.21.15.131:0/2283391862 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fce080744e0 0x7fce080769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:38.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.752+0000 7fce2aa00640 1 --2- 172.21.15.131:0/2283391862 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fce080744e0 0x7fce080769f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fce14006fd0 tx=0x7fce14008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:38.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.755+0000 7fce23400640 1 -- 172.21.15.131:0/2283391862 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fce2c15d700 con 0x7fce2c06c5c0 2024-04-25T19:23:38.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.957+0000 7fce30e00640 1 -- 172.21.15.131:0/2283391862 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce2c0d1f20 con 0x7fce2c06c5c0 2024-04-25T19:23:38.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.959+0000 7fce23400640 1 -- 172.21.15.131:0/2283391862 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16693 (secure 0 0 0) 0x7fce1c080970 con 0x7fce2c06c5c0 2024-04-25T19:23:38.961 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:38.961 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":33,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:23:35.859003+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:23:32.719018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T19:23:33.342898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:23:38.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.962+0000 7fce30e00640 1 -- 172.21.15.131:0/2283391862 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fce080744e0 msgr2=0x7fce080769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:38.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.962+0000 7fce30e00640 1 --2- 172.21.15.131:0/2283391862 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fce080744e0 0x7fce080769f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fce14006fd0 tx=0x7fce14008040 comp rx=0 tx=0).stop 2024-04-25T19:23:38.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.962+0000 7fce30e00640 1 -- 172.21.15.131:0/2283391862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce2c06c5c0 msgr2=0x7fce2c15d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:38.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.962+0000 7fce30e00640 1 --2- 172.21.15.131:0/2283391862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce2c06c5c0 0x7fce2c15d1c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fce1c000f80 tx=0x7fce1c004a40 comp rx=0 tx=0).stop 2024-04-25T19:23:38.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.962+0000 7fce30e00640 1 -- 172.21.15.131:0/2283391862 shutdown_connections 2024-04-25T19:23:38.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.962+0000 7fce30e00640 1 --2- 172.21.15.131:0/2283391862 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fce080744e0 0x7fce080769f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:38.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.962+0000 7fce30e00640 1 --2- 172.21.15.131:0/2283391862 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce2c144370 0x7fce2c0af690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:38.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.962+0000 7fce30e00640 1 --2- 172.21.15.131:0/2283391862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce2c0b4cd0 0x7fce2c1419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:38.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.962+0000 7fce30e00640 1 --2- 172.21.15.131:0/2283391862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce2c06c5c0 0x7fce2c15d1c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:38.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.962+0000 7fce30e00640 1 -- 172.21.15.131:0/2283391862 >> 172.21.15.131:0/2283391862 conn(0x7fce2c0d1720 msgr2=0x7fce2c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:38.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.962+0000 7fce30e00640 1 -- 172.21.15.131:0/2283391862 shutdown_connections 2024-04-25T19:23:38.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:38.962+0000 7fce30e00640 1 -- 172.21.15.131:0/2283391862 wait complete. 2024-04-25T19:23:38.989 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T19:23:38.989 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T19:23:39.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.263+0000 7f88f2400640 1 Processor -- start 2024-04-25T19:23:39.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.263+0000 7f88f2400640 1 -- start start 2024-04-25T19:23:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.265+0000 7f88f2400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f88ec164860 0x7f88ec0b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.265+0000 7f88f2400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88ec0b7540 0x7f88ec0b7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.265+0000 7f88f2400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f88ec0d44a0 0x7f88ec0d48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.265+0000 7f88f2400640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f88ec1643d0 con 0x7f88ec0d44a0 2024-04-25T19:23:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.265+0000 7f88f2400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f88ec0b5270 con 0x7f88ec164860 2024-04-25T19:23:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.265+0000 7f88f2400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f88ec161650 con 0x7f88ec0b7540 2024-04-25T19:23:39.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.266+0000 7f88f1a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f88ec0d44a0 0x7f88ec0d48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:39.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.266+0000 7f88f1a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f88ec0d44a0 0x7f88ec0d48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51704/0 (socket says 172.21.15.131:51704) 2024-04-25T19:23:39.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.266+0000 7f88f1a00640 1 -- 172.21.15.131:0/3666577715 learned_addr learned my addr 172.21.15.131:0/3666577715 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:39.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.266+0000 7f88ebe00640 1 --2- 172.21.15.131:0/3666577715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88ec0b7540 0x7f88ec0b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:39.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.266+0000 7f88f1000640 1 --2- 172.21.15.131:0/3666577715 >> v2:172.21.15.195:3300/0 conn(0x7f88ec164860 0x7f88ec0b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:39.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.266+0000 7f88f1a00640 1 -- 172.21.15.131:0/3666577715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88ec0b7540 msgr2=0x7f88ec0b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:39.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.266+0000 7f88f1a00640 1 --2- 172.21.15.131:0/3666577715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88ec0b7540 0x7f88ec0b7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:39.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.266+0000 7f88f1a00640 1 -- 172.21.15.131:0/3666577715 >> v2:172.21.15.195:3300/0 conn(0x7f88ec164860 msgr2=0x7f88ec0b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:39.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.266+0000 7f88f1a00640 1 --2- 172.21.15.131:0/3666577715 >> v2:172.21.15.195:3300/0 conn(0x7f88ec164860 0x7f88ec0b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:39.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.266+0000 7f88f1a00640 1 -- 172.21.15.131:0/3666577715 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ec0b7e90 con 0x7f88ec0d44a0 2024-04-25T19:23:39.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.267+0000 7f88f1a00640 1 --2- 172.21.15.131:0/3666577715 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88ec0d44a0 0x7f88ec0d48b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0d3820 tx=0x7f88e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2a168e6db9457c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:39.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.268+0000 7f88eb400640 1 -- 172.21.15.131:0/3666577715 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e4037070 con 0x7f88ec0d44a0 2024-04-25T19:23:39.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.268+0000 7f88eb400640 1 -- 172.21.15.131:0/3666577715 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88e4032440 con 0x7f88ec0d44a0 2024-04-25T19:23:39.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.268+0000 7f88eb400640 1 -- 172.21.15.131:0/3666577715 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e4032810 con 0x7f88ec0d44a0 2024-04-25T19:23:39.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.268+0000 7f88f2400640 1 -- 172.21.15.131:0/3666577715 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88ec0d44a0 msgr2=0x7f88ec0d48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:39.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.268+0000 7f88f2400640 1 --2- 172.21.15.131:0/3666577715 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88ec0d44a0 0x7f88ec0d48b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0d3820 tx=0x7f88e402a1e0 comp rx=0 tx=0).stop 2024-04-25T19:23:39.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.269+0000 7f88f2400640 1 -- 172.21.15.131:0/3666577715 shutdown_connections 2024-04-25T19:23:39.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.269+0000 7f88f2400640 1 --2- 172.21.15.131:0/3666577715 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88ec0d44a0 0x7f88ec0d48b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:39.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.269+0000 7f88f2400640 1 --2- 172.21.15.131:0/3666577715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88ec0b7540 0x7f88ec0b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:39.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.269+0000 7f88f2400640 1 --2- 172.21.15.131:0/3666577715 >> v2:172.21.15.195:3300/0 conn(0x7f88ec164860 0x7f88ec0b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:39.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.269+0000 7f88f2400640 1 -- 172.21.15.131:0/3666577715 >> 172.21.15.131:0/3666577715 conn(0x7f88ec0d2720 msgr2=0x7f88ec0d2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:39.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.269+0000 7f88f2400640 1 -- 172.21.15.131:0/3666577715 shutdown_connections 2024-04-25T19:23:39.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.269+0000 7f88f2400640 1 -- 172.21.15.131:0/3666577715 wait complete. 2024-04-25T19:23:39.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.271+0000 7f88f2400640 1 Processor -- start 2024-04-25T19:23:39.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.271+0000 7f88f2400640 1 -- start start 2024-04-25T19:23:39.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.273+0000 7f88f2400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88ec0b7540 0x7f88ec14edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:39.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.273+0000 7f88f2400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88ec0d44a0 0x7f88ec14b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:39.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.273+0000 7f88f2400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88ec164860 0x7f88ec06c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:39.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.273+0000 7f88f2400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec164060 con 0x7f88ec0d44a0 2024-04-25T19:23:39.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.273+0000 7f88f2400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec163d80 con 0x7f88ec164860 2024-04-25T19:23:39.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.273+0000 7f88f2400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f88ec0d4df0 con 0x7f88ec0b7540 2024-04-25T19:23:39.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.273+0000 7f88ebe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88ec0d44a0 0x7f88ec14b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:39.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.273+0000 7f88ebe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88ec0d44a0 0x7f88ec14b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51706/0 (socket says 172.21.15.131:51706) 2024-04-25T19:23:39.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.273+0000 7f88ebe00640 1 -- 172.21.15.131:0/3593346653 learned_addr learned my addr 172.21.15.131:0/3593346653 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:39.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.273+0000 7f88f1000640 1 --2- 172.21.15.131:0/3593346653 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88ec0b7540 0x7f88ec14edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:39.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.273+0000 7f88f1a00640 1 --2- 172.21.15.131:0/3593346653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88ec164860 0x7f88ec06c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:39.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.273+0000 7f88ebe00640 1 -- 172.21.15.131:0/3593346653 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88ec0b7540 msgr2=0x7f88ec14edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:39.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.273+0000 7f88ebe00640 1 --2- 172.21.15.131:0/3593346653 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88ec0b7540 0x7f88ec14edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:39.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.273+0000 7f88ebe00640 1 -- 172.21.15.131:0/3593346653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88ec164860 msgr2=0x7f88ec06c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:39.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.273+0000 7f88ebe00640 1 --2- 172.21.15.131:0/3593346653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88ec164860 0x7f88ec06c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:39.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.273+0000 7f88ebe00640 1 -- 172.21.15.131:0/3593346653 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ec14f300 con 0x7f88ec0d44a0 2024-04-25T19:23:39.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.273+0000 7f88f1a00640 1 --2- 172.21.15.131:0/3593346653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88ec164860 0x7f88ec06c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:39.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.274+0000 7f88ebe00640 1 --2- 172.21.15.131:0/3593346653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88ec0d44a0 0x7f88ec14b9e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f88d4007e90 tx=0x7f88d400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:39.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.274+0000 7f88e8c00640 1 -- 172.21.15.131:0/3593346653 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d4014420 con 0x7f88ec0d44a0 2024-04-25T19:23:39.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.274+0000 7f88e8c00640 1 -- 172.21.15.131:0/3593346653 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88d4019070 con 0x7f88ec0d44a0 2024-04-25T19:23:39.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.274+0000 7f88f2400640 1 -- 172.21.15.131:0/3593346653 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88ec0ce9f0 con 0x7f88ec0d44a0 2024-04-25T19:23:39.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.274+0000 7f88e8c00640 1 -- 172.21.15.131:0/3593346653 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d40147e0 con 0x7f88ec0d44a0 2024-04-25T19:23:39.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.274+0000 7f88f2400640 1 -- 172.21.15.131:0/3593346653 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88ec0cefb0 con 0x7f88ec0d44a0 2024-04-25T19:23:39.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.275+0000 7f88f2400640 1 -- 172.21.15.131:0/3593346653 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88ec050740 con 0x7f88ec0d44a0 2024-04-25T19:23:39.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.276+0000 7f88e8c00640 1 -- 172.21.15.131:0/3593346653 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f88d4014980 con 0x7f88ec0d44a0 2024-04-25T19:23:39.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.277+0000 7f88e8c00640 1 --2- 172.21.15.131:0/3593346653 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f88c80744e0 0x7f88c80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:39.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.278+0000 7f88e8c00640 1 -- 172.21.15.131:0/3593346653 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f88d4095a10 con 0x7f88ec0d44a0 2024-04-25T19:23:39.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.278+0000 7f88f1000640 1 --2- 172.21.15.131:0/3593346653 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f88c80744e0 0x7f88c80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:39.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.279+0000 7f88f1000640 1 --2- 172.21.15.131:0/3593346653 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f88c80744e0 0x7f88c80769f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0d3740 tx=0x7f88dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:39.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.282+0000 7f88e8c00640 1 -- 172.21.15.131:0/3593346653 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f88d405fb50 con 0x7f88ec0d44a0 2024-04-25T19:23:39.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.477+0000 7f88f2400640 1 -- 172.21.15.131:0/3593346653 --> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f88ec0d3f30 con 0x7f88c80744e0 2024-04-25T19:23:39.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.498+0000 7f88e8c00640 1 -- 172.21.15.131:0/3593346653 <== mgr.4105 v2:172.21.15.195:6832/2541913764 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246620 (secure 0 0 0) 0x7f88ec0d3f30 con 0x7f88c80744e0 2024-04-25T19:23:39.503 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:39.504 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-04-25T19:23:39.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.503+0000 7f88f2400640 1 -- 172.21.15.131:0/3593346653 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f88c80744e0 msgr2=0x7f88c80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:39.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.503+0000 7f88f2400640 1 --2- 172.21.15.131:0/3593346653 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f88c80744e0 0x7f88c80769f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0d3740 tx=0x7f88dc008040 comp rx=0 tx=0).stop 2024-04-25T19:23:39.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.503+0000 7f88f2400640 1 -- 172.21.15.131:0/3593346653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88ec0d44a0 msgr2=0x7f88ec14b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:39.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.503+0000 7f88f2400640 1 --2- 172.21.15.131:0/3593346653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88ec0d44a0 0x7f88ec14b9e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f88d4007e90 tx=0x7f88d400e4b0 comp rx=0 tx=0).stop 2024-04-25T19:23:39.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.503+0000 7f88f2400640 1 -- 172.21.15.131:0/3593346653 shutdown_connections 2024-04-25T19:23:39.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.503+0000 7f88f2400640 1 --2- 172.21.15.131:0/3593346653 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f88c80744e0 0x7f88c80769f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:39.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.503+0000 7f88f2400640 1 --2- 172.21.15.131:0/3593346653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88ec164860 0x7f88ec06c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:39.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.503+0000 7f88f2400640 1 --2- 172.21.15.131:0/3593346653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88ec0d44a0 0x7f88ec14b9e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:39.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.503+0000 7f88f2400640 1 --2- 172.21.15.131:0/3593346653 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88ec0b7540 0x7f88ec14edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:39.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.503+0000 7f88f2400640 1 -- 172.21.15.131:0/3593346653 >> 172.21.15.131:0/3593346653 conn(0x7f88ec0d2720 msgr2=0x7f88ec0b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:39.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.503+0000 7f88f2400640 1 -- 172.21.15.131:0/3593346653 shutdown_connections 2024-04-25T19:23:39.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.503+0000 7f88f2400640 1 -- 172.21.15.131:0/3593346653 wait complete. 2024-04-25T19:23:39.533 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-04-25T19:23:38.168366+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236632,"kb_used_data":3820,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738088,"statfs":{"total":773094113280,"available":772851802112,"internally_reserved":0,"allocated":3911680,"data_stored":2217665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.356739"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.852456+0000","last_change":"2024-04-25T19:23:33.852456+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.852456+0000","last_undegraded":"2024-04-25T19:23:33.852456+0000","last_fullsized":"2024-04-25T19:23:33.852456+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.843476+0000","last_change":"2024-04-25T19:23:33.843476+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.843476+0000","last_undegraded":"2024-04-25T19:23:33.843476+0000","last_fullsized":"2024-04-25T19:23:33.843476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.843011+0000","last_change":"2024-04-25T19:23:33.843011+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.843011+0000","last_undegraded":"2024-04-25T19:23:33.843011+0000","last_fullsized":"2024-04-25T19:23:33.843011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.846795+0000","last_change":"2024-04-25T19:23:33.846795+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.846795+0000","last_undegraded":"2024-04-25T19:23:33.846795+0000","last_fullsized":"2024-04-25T19:23:33.846795+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.846078+0000","last_change":"2024-04-25T19:23:33.846078+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.846078+0000","last_undegraded":"2024-04-25T19:23:33.846078+0000","last_fullsized":"2024-04-25T19:23:33.846078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.839576+0000","last_change":"2024-04-25T19:23:33.839576+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.839576+0000","last_undegraded":"2024-04-25T19:23:33.839576+0000","last_fullsized":"2024-04-25T19:23:33.839576+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.854199+0000","last_change":"2024-04-25T19:23:33.854199+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.854199+0000","last_undegraded":"2024-04-25T19:23:33.854199+0000","last_fullsized":"2024-04-25T19:23:33.854199+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.858259+0000","last_change":"2024-04-25T19:23:33.858259+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.858259+0000","last_undegraded":"2024-04-25T19:23:33.858259+0000","last_fullsized":"2024-04-25T19:23:33.858259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.847955+0000","last_change":"2024-04-25T19:23:33.847955+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.847955+0000","last_undegraded":"2024-04-25T19:23:33.847955+0000","last_fullsized":"2024-04-25T19:23:33.847955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.855311+0000","last_change":"2024-04-25T19:23:33.855311+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.855311+0000","last_undegraded":"2024-04-25T19:23:33.855311+0000","last_fullsized":"2024-04-25T19:23:33.855311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.864320+0000","last_change":"2024-04-25T19:23:33.864320+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.864320+0000","last_undegraded":"2024-04-25T19:23:33.864320+0000","last_fullsized":"2024-04-25T19:23:33.864320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.845030+0000","last_change":"2024-04-25T19:23:33.845030+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.845030+0000","last_undegraded":"2024-04-25T19:23:33.845030+0000","last_fullsized":"2024-04-25T19:23:33.845030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.845367+0000","last_change":"2024-04-25T19:23:33.845367+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.845367+0000","last_undegraded":"2024-04-25T19:23:33.845367+0000","last_fullsized":"2024-04-25T19:23:33.845367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.839071+0000","last_change":"2024-04-25T19:23:33.839071+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.839071+0000","last_undegraded":"2024-04-25T19:23:33.839071+0000","last_fullsized":"2024-04-25T19:23:33.839071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.839013+0000","last_change":"2024-04-25T19:23:33.839013+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.839013+0000","last_undegraded":"2024-04-25T19:23:33.839013+0000","last_fullsized":"2024-04-25T19:23:33.839013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.851459+0000","last_change":"2024-04-25T19:23:33.851459+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.851459+0000","last_undegraded":"2024-04-25T19:23:33.851459+0000","last_fullsized":"2024-04-25T19:23:33.851459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.858677+0000","last_change":"2024-04-25T19:23:33.858677+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.858677+0000","last_undegraded":"2024-04-25T19:23:33.858677+0000","last_fullsized":"2024-04-25T19:23:33.858677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.843011+0000","last_change":"2024-04-25T19:23:33.843011+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.843011+0000","last_undegraded":"2024-04-25T19:23:33.843011+0000","last_fullsized":"2024-04-25T19:23:33.843011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.841312+0000","last_change":"2024-04-25T19:23:33.841312+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.841312+0000","last_undegraded":"2024-04-25T19:23:33.841312+0000","last_fullsized":"2024-04-25T19:23:33.841312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.841229+0000","last_change":"2024-04-25T19:23:33.841229+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.841229+0000","last_undegraded":"2024-04-25T19:23:33.841229+0000","last_fullsized":"2024-04-25T19:23:33.841229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.846480+0000","last_change":"2024-04-25T19:23:33.846480+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.846480+0000","last_undegraded":"2024-04-25T19:23:33.846480+0000","last_fullsized":"2024-04-25T19:23:33.846480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.842673+0000","last_change":"2024-04-25T19:23:33.842673+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.842673+0000","last_undegraded":"2024-04-25T19:23:33.842673+0000","last_fullsized":"2024-04-25T19:23:33.842673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.838143+0000","last_change":"2024-04-25T19:23:33.838143+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.838143+0000","last_undegraded":"2024-04-25T19:23:33.838143+0000","last_fullsized":"2024-04-25T19:23:33.838143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.846185+0000","last_change":"2024-04-25T19:23:33.846185+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.846185+0000","last_undegraded":"2024-04-25T19:23:33.846185+0000","last_fullsized":"2024-04-25T19:23:33.846185+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.851461+0000","last_change":"2024-04-25T19:23:33.851461+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.851461+0000","last_undegraded":"2024-04-25T19:23:33.851461+0000","last_fullsized":"2024-04-25T19:23:33.851461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.842442+0000","last_change":"2024-04-25T19:23:33.842442+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.842442+0000","last_undegraded":"2024-04-25T19:23:33.842442+0000","last_fullsized":"2024-04-25T19:23:33.842442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.851546+0000","last_change":"2024-04-25T19:23:33.851546+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.851546+0000","last_undegraded":"2024-04-25T19:23:33.851546+0000","last_fullsized":"2024-04-25T19:23:33.851546+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.838999+0000","last_change":"2024-04-25T19:23:33.838999+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.838999+0000","last_undegraded":"2024-04-25T19:23:33.838999+0000","last_fullsized":"2024-04-25T19:23:33.838999+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.845408+0000","last_change":"2024-04-25T19:23:33.845408+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.845408+0000","last_undegraded":"2024-04-25T19:23:33.845408+0000","last_fullsized":"2024-04-25T19:23:33.845408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.862047+0000","last_change":"2024-04-25T19:23:33.862047+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.862047+0000","last_undegraded":"2024-04-25T19:23:33.862047+0000","last_fullsized":"2024-04-25T19:23:33.862047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.849621+0000","last_change":"2024-04-25T19:23:33.849621+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.849621+0000","last_undegraded":"2024-04-25T19:23:33.849621+0000","last_fullsized":"2024-04-25T19:23:33.849621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.857745+0000","last_change":"2024-04-25T19:23:33.857745+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.857745+0000","last_undegraded":"2024-04-25T19:23:33.857745+0000","last_fullsized":"2024-04-25T19:23:33.857745+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.838883+0000","last_change":"2024-04-25T19:23:33.838883+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.838883+0000","last_undegraded":"2024-04-25T19:23:33.838883+0000","last_fullsized":"2024-04-25T19:23:33.838883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.871051+0000","last_change":"2024-04-25T19:23:33.869661+0000","last_active":"2024-04-25T19:23:33.871051+0000","last_peered":"2024-04-25T19:23:33.871051+0000","last_clean":"2024-04-25T19:23:33.871051+0000","last_became_active":"2024-04-25T19:23:33.869333+0000","last_became_peered":"2024-04-25T19:23:33.869333+0000","last_unstale":"2024-04-25T19:23:33.871051+0000","last_undegraded":"2024-04-25T19:23:33.871051+0000","last_fullsized":"2024-04-25T19:23:33.871051+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:08.115832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.850256+0000","last_change":"2024-04-25T19:23:33.850256+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.850256+0000","last_undegraded":"2024-04-25T19:23:33.850256+0000","last_fullsized":"2024-04-25T19:23:33.850256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.868093+0000","last_change":"2024-04-25T19:23:33.862637+0000","last_active":"2024-04-25T19:23:33.868093+0000","last_peered":"2024-04-25T19:23:33.868093+0000","last_clean":"2024-04-25T19:23:33.868093+0000","last_became_active":"2024-04-25T19:23:33.862409+0000","last_became_peered":"2024-04-25T19:23:33.862409+0000","last_unstale":"2024-04-25T19:23:33.868093+0000","last_undegraded":"2024-04-25T19:23:33.868093+0000","last_fullsized":"2024-04-25T19:23:33.868093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:08.115832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.848944+0000","last_change":"2024-04-25T19:23:33.848944+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.848944+0000","last_undegraded":"2024-04-25T19:23:33.848944+0000","last_fullsized":"2024-04-25T19:23:33.848944+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.868677+0000","last_change":"2024-04-25T19:23:33.861801+0000","last_active":"2024-04-25T19:23:33.868677+0000","last_peered":"2024-04-25T19:23:33.868677+0000","last_clean":"2024-04-25T19:23:33.868677+0000","last_became_active":"2024-04-25T19:23:33.861477+0000","last_became_peered":"2024-04-25T19:23:33.861477+0000","last_unstale":"2024-04-25T19:23:33.868677+0000","last_undegraded":"2024-04-25T19:23:33.868677+0000","last_fullsized":"2024-04-25T19:23:33.868677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:29.370419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.850965+0000","last_change":"2024-04-25T19:23:33.850965+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.850965+0000","last_undegraded":"2024-04-25T19:23:33.850965+0000","last_fullsized":"2024-04-25T19:23:33.850965+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.867447+0000","last_change":"2024-04-25T19:23:33.861932+0000","last_active":"2024-04-25T19:23:33.867447+0000","last_peered":"2024-04-25T19:23:33.867447+0000","last_clean":"2024-04-25T19:23:33.867447+0000","last_became_active":"2024-04-25T19:23:33.860394+0000","last_became_peered":"2024-04-25T19:23:33.860394+0000","last_unstale":"2024-04-25T19:23:33.867447+0000","last_undegraded":"2024-04-25T19:23:33.867447+0000","last_fullsized":"2024-04-25T19:23:33.867447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:25.649340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.851805+0000","last_change":"2024-04-25T19:23:33.851805+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.851805+0000","last_undegraded":"2024-04-25T19:23:33.851805+0000","last_fullsized":"2024-04-25T19:23:33.851805+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.865809+0000","last_change":"2024-04-25T19:23:33.861192+0000","last_active":"2024-04-25T19:23:33.865809+0000","last_peered":"2024-04-25T19:23:33.865809+0000","last_clean":"2024-04-25T19:23:33.865809+0000","last_became_active":"2024-04-25T19:23:33.860848+0000","last_became_peered":"2024-04-25T19:23:33.860848+0000","last_unstale":"2024-04-25T19:23:33.865809+0000","last_undegraded":"2024-04-25T19:23:33.865809+0000","last_fullsized":"2024-04-25T19:23:33.865809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:30:21.396542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.841507+0000","last_change":"2024-04-25T19:23:33.841507+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.841507+0000","last_undegraded":"2024-04-25T19:23:33.841507+0000","last_fullsized":"2024-04-25T19:23:33.841507+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.865378+0000","last_change":"2024-04-25T19:23:33.859288+0000","last_active":"2024-04-25T19:23:33.865378+0000","last_peered":"2024-04-25T19:23:33.865378+0000","last_clean":"2024-04-25T19:23:33.865378+0000","last_became_active":"2024-04-25T19:23:33.858841+0000","last_became_peered":"2024-04-25T19:23:33.858841+0000","last_unstale":"2024-04-25T19:23:33.865378+0000","last_undegraded":"2024-04-25T19:23:33.865378+0000","last_fullsized":"2024-04-25T19:23:33.865378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:07:55.891874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.847021+0000","last_change":"2024-04-25T19:23:33.847021+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.847021+0000","last_undegraded":"2024-04-25T19:23:33.847021+0000","last_fullsized":"2024-04-25T19:23:33.847021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.859647+0000","last_change":"2024-04-25T19:23:33.853794+0000","last_active":"2024-04-25T19:23:33.859647+0000","last_peered":"2024-04-25T19:23:33.859647+0000","last_clean":"2024-04-25T19:23:33.859647+0000","last_became_active":"2024-04-25T19:23:33.853451+0000","last_became_peered":"2024-04-25T19:23:33.853451+0000","last_unstale":"2024-04-25T19:23:33.859647+0000","last_undegraded":"2024-04-25T19:23:33.859647+0000","last_fullsized":"2024-04-25T19:23:33.859647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:31:03.100180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.842949+0000","last_change":"2024-04-25T19:23:33.842949+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.842949+0000","last_undegraded":"2024-04-25T19:23:33.842949+0000","last_fullsized":"2024-04-25T19:23:33.842949+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.865843+0000","last_change":"2024-04-25T19:23:33.861563+0000","last_active":"2024-04-25T19:23:33.865843+0000","last_peered":"2024-04-25T19:23:33.865843+0000","last_clean":"2024-04-25T19:23:33.865843+0000","last_became_active":"2024-04-25T19:23:33.859069+0000","last_became_peered":"2024-04-25T19:23:33.859069+0000","last_unstale":"2024-04-25T19:23:33.865843+0000","last_undegraded":"2024-04-25T19:23:33.865843+0000","last_fullsized":"2024-04-25T19:23:33.865843+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:38.558221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.839477+0000","last_change":"2024-04-25T19:23:33.839477+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.839477+0000","last_undegraded":"2024-04-25T19:23:33.839477+0000","last_fullsized":"2024-04-25T19:23:33.839477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.869873+0000","last_change":"2024-04-25T19:23:33.867663+0000","last_active":"2024-04-25T19:23:33.869873+0000","last_peered":"2024-04-25T19:23:33.869873+0000","last_clean":"2024-04-25T19:23:33.869873+0000","last_became_active":"2024-04-25T19:23:33.867106+0000","last_became_peered":"2024-04-25T19:23:33.867106+0000","last_unstale":"2024-04-25T19:23:33.869873+0000","last_undegraded":"2024-04-25T19:23:33.869873+0000","last_fullsized":"2024-04-25T19:23:33.869873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:51.486951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.842841+0000","last_change":"2024-04-25T19:23:33.842841+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.842841+0000","last_undegraded":"2024-04-25T19:23:33.842841+0000","last_fullsized":"2024-04-25T19:23:33.842841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.857348+0000","last_change":"2024-04-25T19:23:33.853876+0000","last_active":"2024-04-25T19:23:33.857348+0000","last_peered":"2024-04-25T19:23:33.857348+0000","last_clean":"2024-04-25T19:23:33.857348+0000","last_became_active":"2024-04-25T19:23:33.853522+0000","last_became_peered":"2024-04-25T19:23:33.853522+0000","last_unstale":"2024-04-25T19:23:33.857348+0000","last_undegraded":"2024-04-25T19:23:33.857348+0000","last_fullsized":"2024-04-25T19:23:33.857348+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:26.949430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.840803+0000","last_change":"2024-04-25T19:23:33.840803+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.840803+0000","last_undegraded":"2024-04-25T19:23:33.840803+0000","last_fullsized":"2024-04-25T19:23:33.840803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.873134+0000","last_change":"2024-04-25T19:23:33.871669+0000","last_active":"2024-04-25T19:23:33.873134+0000","last_peered":"2024-04-25T19:23:33.873134+0000","last_clean":"2024-04-25T19:23:33.873134+0000","last_became_active":"2024-04-25T19:23:33.870470+0000","last_became_peered":"2024-04-25T19:23:33.870470+0000","last_unstale":"2024-04-25T19:23:33.873134+0000","last_undegraded":"2024-04-25T19:23:33.873134+0000","last_fullsized":"2024-04-25T19:23:33.873134+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:00.480595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.844292+0000","last_change":"2024-04-25T19:23:33.844292+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.844292+0000","last_undegraded":"2024-04-25T19:23:33.844292+0000","last_fullsized":"2024-04-25T19:23:33.844292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.863488+0000","last_change":"2024-04-25T19:23:33.859210+0000","last_active":"2024-04-25T19:23:33.863488+0000","last_peered":"2024-04-25T19:23:33.863488+0000","last_clean":"2024-04-25T19:23:33.863488+0000","last_became_active":"2024-04-25T19:23:33.858457+0000","last_became_peered":"2024-04-25T19:23:33.858457+0000","last_unstale":"2024-04-25T19:23:33.863488+0000","last_undegraded":"2024-04-25T19:23:33.863488+0000","last_fullsized":"2024-04-25T19:23:33.863488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:42.202405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.844212+0000","last_change":"2024-04-25T19:23:33.844212+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.844212+0000","last_undegraded":"2024-04-25T19:23:33.844212+0000","last_fullsized":"2024-04-25T19:23:33.844212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.865836+0000","last_change":"2024-04-25T19:23:33.859947+0000","last_active":"2024-04-25T19:23:33.865836+0000","last_peered":"2024-04-25T19:23:33.865836+0000","last_clean":"2024-04-25T19:23:33.865836+0000","last_became_active":"2024-04-25T19:23:33.859569+0000","last_became_peered":"2024-04-25T19:23:33.859569+0000","last_unstale":"2024-04-25T19:23:33.865836+0000","last_undegraded":"2024-04-25T19:23:33.865836+0000","last_fullsized":"2024-04-25T19:23:33.865836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:01.440217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.841834+0000","last_change":"2024-04-25T19:23:33.841834+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.841834+0000","last_undegraded":"2024-04-25T19:23:33.841834+0000","last_fullsized":"2024-04-25T19:23:33.841834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.867689+0000","last_change":"2024-04-25T19:23:33.865049+0000","last_active":"2024-04-25T19:23:33.867689+0000","last_peered":"2024-04-25T19:23:33.867689+0000","last_clean":"2024-04-25T19:23:33.867689+0000","last_became_active":"2024-04-25T19:23:33.864681+0000","last_became_peered":"2024-04-25T19:23:33.864681+0000","last_unstale":"2024-04-25T19:23:33.867689+0000","last_undegraded":"2024-04-25T19:23:33.867689+0000","last_fullsized":"2024-04-25T19:23:33.867689+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:12:04.487364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.857136+0000","last_change":"2024-04-25T19:23:33.857136+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.857136+0000","last_undegraded":"2024-04-25T19:23:33.857136+0000","last_fullsized":"2024-04-25T19:23:33.857136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.869856+0000","last_change":"2024-04-25T19:23:33.867671+0000","last_active":"2024-04-25T19:23:33.869856+0000","last_peered":"2024-04-25T19:23:33.869856+0000","last_clean":"2024-04-25T19:23:33.869856+0000","last_became_active":"2024-04-25T19:23:33.866592+0000","last_became_peered":"2024-04-25T19:23:33.866592+0000","last_unstale":"2024-04-25T19:23:33.869856+0000","last_undegraded":"2024-04-25T19:23:33.869856+0000","last_fullsized":"2024-04-25T19:23:33.869856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:03:16.565706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.848339+0000","last_change":"2024-04-25T19:23:33.848339+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.848339+0000","last_undegraded":"2024-04-25T19:23:33.848339+0000","last_fullsized":"2024-04-25T19:23:33.848339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.862172+0000","last_change":"2024-04-25T19:23:33.857697+0000","last_active":"2024-04-25T19:23:33.862172+0000","last_peered":"2024-04-25T19:23:33.862172+0000","last_clean":"2024-04-25T19:23:33.862172+0000","last_became_active":"2024-04-25T19:23:33.857359+0000","last_became_peered":"2024-04-25T19:23:33.857359+0000","last_unstale":"2024-04-25T19:23:33.862172+0000","last_undegraded":"2024-04-25T19:23:33.862172+0000","last_fullsized":"2024-04-25T19:23:33.862172+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:08.115832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.847662+0000","last_change":"2024-04-25T19:23:33.847662+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.847662+0000","last_undegraded":"2024-04-25T19:23:33.847662+0000","last_fullsized":"2024-04-25T19:23:33.847662+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.867826+0000","last_change":"2024-04-25T19:23:33.866277+0000","last_active":"2024-04-25T19:23:33.867826+0000","last_peered":"2024-04-25T19:23:33.867826+0000","last_clean":"2024-04-25T19:23:33.867826+0000","last_became_active":"2024-04-25T19:23:33.865920+0000","last_became_peered":"2024-04-25T19:23:33.865920+0000","last_unstale":"2024-04-25T19:23:33.867826+0000","last_undegraded":"2024-04-25T19:23:33.867826+0000","last_fullsized":"2024-04-25T19:23:33.867826+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:31:03.100180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.842680+0000","last_change":"2024-04-25T19:23:33.842680+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.842680+0000","last_undegraded":"2024-04-25T19:23:33.842680+0000","last_fullsized":"2024-04-25T19:23:33.842680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.867948+0000","last_change":"2024-04-25T19:23:33.863747+0000","last_active":"2024-04-25T19:23:33.867948+0000","last_peered":"2024-04-25T19:23:33.867948+0000","last_clean":"2024-04-25T19:23:33.867948+0000","last_became_active":"2024-04-25T19:23:33.863073+0000","last_became_peered":"2024-04-25T19:23:33.863073+0000","last_unstale":"2024-04-25T19:23:33.867948+0000","last_undegraded":"2024-04-25T19:23:33.867948+0000","last_fullsized":"2024-04-25T19:23:33.867948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:04:54.536294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.846322+0000","last_change":"2024-04-25T19:23:33.846322+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.846322+0000","last_undegraded":"2024-04-25T19:23:33.846322+0000","last_fullsized":"2024-04-25T19:23:33.846322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.868097+0000","last_change":"2024-04-25T19:23:33.863501+0000","last_active":"2024-04-25T19:23:33.868097+0000","last_peered":"2024-04-25T19:23:33.868097+0000","last_clean":"2024-04-25T19:23:33.868097+0000","last_became_active":"2024-04-25T19:23:33.863105+0000","last_became_peered":"2024-04-25T19:23:33.863105+0000","last_unstale":"2024-04-25T19:23:33.868097+0000","last_undegraded":"2024-04-25T19:23:33.868097+0000","last_fullsized":"2024-04-25T19:23:33.868097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:58.887186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.842874+0000","last_change":"2024-04-25T19:23:33.842874+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.842874+0000","last_undegraded":"2024-04-25T19:23:33.842874+0000","last_fullsized":"2024-04-25T19:23:33.842874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.865883+0000","last_change":"2024-04-25T19:23:33.861614+0000","last_active":"2024-04-25T19:23:33.865883+0000","last_peered":"2024-04-25T19:23:33.865883+0000","last_clean":"2024-04-25T19:23:33.865883+0000","last_became_active":"2024-04-25T19:23:33.861269+0000","last_became_peered":"2024-04-25T19:23:33.861269+0000","last_unstale":"2024-04-25T19:23:33.865883+0000","last_undegraded":"2024-04-25T19:23:33.865883+0000","last_fullsized":"2024-04-25T19:23:33.865883+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:15:56.625735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.840716+0000","last_change":"2024-04-25T19:23:33.840716+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.840716+0000","last_undegraded":"2024-04-25T19:23:33.840716+0000","last_fullsized":"2024-04-25T19:23:33.840716+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.859307+0000","last_change":"2024-04-25T19:23:33.856541+0000","last_active":"2024-04-25T19:23:33.859307+0000","last_peered":"2024-04-25T19:23:33.859307+0000","last_clean":"2024-04-25T19:23:33.859307+0000","last_became_active":"2024-04-25T19:23:33.856217+0000","last_became_peered":"2024-04-25T19:23:33.856217+0000","last_unstale":"2024-04-25T19:23:33.859307+0000","last_undegraded":"2024-04-25T19:23:33.859307+0000","last_fullsized":"2024-04-25T19:23:33.859307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:12:04.487364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.840305+0000","last_change":"2024-04-25T19:23:33.840305+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.840305+0000","last_undegraded":"2024-04-25T19:23:33.840305+0000","last_fullsized":"2024-04-25T19:23:33.840305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.868821+0000","last_change":"2024-04-25T19:23:33.865209+0000","last_active":"2024-04-25T19:23:33.868821+0000","last_peered":"2024-04-25T19:23:33.868821+0000","last_clean":"2024-04-25T19:23:33.868821+0000","last_became_active":"2024-04-25T19:23:33.864805+0000","last_became_peered":"2024-04-25T19:23:33.864805+0000","last_unstale":"2024-04-25T19:23:33.868821+0000","last_undegraded":"2024-04-25T19:23:33.868821+0000","last_fullsized":"2024-04-25T19:23:33.868821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:31:03.100180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.840703+0000","last_change":"2024-04-25T19:23:33.840703+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.840703+0000","last_undegraded":"2024-04-25T19:23:33.840703+0000","last_fullsized":"2024-04-25T19:23:33.840703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.865594+0000","last_change":"2024-04-25T19:23:33.860629+0000","last_active":"2024-04-25T19:23:33.865594+0000","last_peered":"2024-04-25T19:23:33.865594+0000","last_clean":"2024-04-25T19:23:33.865594+0000","last_became_active":"2024-04-25T19:23:33.860264+0000","last_became_peered":"2024-04-25T19:23:33.860264+0000","last_unstale":"2024-04-25T19:23:33.865594+0000","last_undegraded":"2024-04-25T19:23:33.865594+0000","last_fullsized":"2024-04-25T19:23:33.865594+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:25.649340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.858404+0000","last_change":"2024-04-25T19:23:33.858404+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.858404+0000","last_undegraded":"2024-04-25T19:23:33.858404+0000","last_fullsized":"2024-04-25T19:23:33.858404+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.871646+0000","last_change":"2024-04-25T19:23:33.869661+0000","last_active":"2024-04-25T19:23:33.871646+0000","last_peered":"2024-04-25T19:23:33.871646+0000","last_clean":"2024-04-25T19:23:33.871646+0000","last_became_active":"2024-04-25T19:23:33.869274+0000","last_became_peered":"2024-04-25T19:23:33.869274+0000","last_unstale":"2024-04-25T19:23:33.871646+0000","last_undegraded":"2024-04-25T19:23:33.871646+0000","last_fullsized":"2024-04-25T19:23:33.871646+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:50.633103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.843801+0000","last_change":"2024-04-25T19:23:33.843801+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.843801+0000","last_undegraded":"2024-04-25T19:23:33.843801+0000","last_fullsized":"2024-04-25T19:23:33.843801+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.870549+0000","last_change":"2024-04-25T19:23:33.869537+0000","last_active":"2024-04-25T19:23:33.870549+0000","last_peered":"2024-04-25T19:23:33.870549+0000","last_clean":"2024-04-25T19:23:33.870549+0000","last_became_active":"2024-04-25T19:23:33.869181+0000","last_became_peered":"2024-04-25T19:23:33.869181+0000","last_unstale":"2024-04-25T19:23:33.870549+0000","last_undegraded":"2024-04-25T19:23:33.870549+0000","last_fullsized":"2024-04-25T19:23:33.870549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:08.115832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.841192+0000","last_change":"2024-04-25T19:23:33.841192+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.841192+0000","last_undegraded":"2024-04-25T19:23:33.841192+0000","last_fullsized":"2024-04-25T19:23:33.841192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.864815+0000","last_change":"2024-04-25T19:23:33.860892+0000","last_active":"2024-04-25T19:23:33.864815+0000","last_peered":"2024-04-25T19:23:33.864815+0000","last_clean":"2024-04-25T19:23:33.864815+0000","last_became_active":"2024-04-25T19:23:33.860529+0000","last_became_peered":"2024-04-25T19:23:33.860529+0000","last_unstale":"2024-04-25T19:23:33.864815+0000","last_undegraded":"2024-04-25T19:23:33.864815+0000","last_fullsized":"2024-04-25T19:23:33.864815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:31:03.100180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.838586+0000","last_change":"2024-04-25T19:23:33.838586+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.838586+0000","last_undegraded":"2024-04-25T19:23:33.838586+0000","last_fullsized":"2024-04-25T19:23:33.838586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.863455+0000","last_change":"2024-04-25T19:23:33.859331+0000","last_active":"2024-04-25T19:23:33.863455+0000","last_peered":"2024-04-25T19:23:33.863455+0000","last_clean":"2024-04-25T19:23:33.863455+0000","last_became_active":"2024-04-25T19:23:33.858500+0000","last_became_peered":"2024-04-25T19:23:33.858500+0000","last_unstale":"2024-04-25T19:23:33.863455+0000","last_undegraded":"2024-04-25T19:23:33.863455+0000","last_fullsized":"2024-04-25T19:23:33.863455+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:56:59.616393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.851297+0000","last_change":"2024-04-25T19:23:33.851297+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.851297+0000","last_undegraded":"2024-04-25T19:23:33.851297+0000","last_fullsized":"2024-04-25T19:23:33.851297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.859280+0000","last_change":"2024-04-25T19:23:33.855462+0000","last_active":"2024-04-25T19:23:33.859280+0000","last_peered":"2024-04-25T19:23:33.859280+0000","last_clean":"2024-04-25T19:23:33.859280+0000","last_became_active":"2024-04-25T19:23:33.855113+0000","last_became_peered":"2024-04-25T19:23:33.855113+0000","last_unstale":"2024-04-25T19:23:33.859280+0000","last_undegraded":"2024-04-25T19:23:33.859280+0000","last_fullsized":"2024-04-25T19:23:33.859280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:56:59.616393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.838151+0000","last_change":"2024-04-25T19:23:33.838151+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.838151+0000","last_undegraded":"2024-04-25T19:23:33.838151+0000","last_fullsized":"2024-04-25T19:23:33.838151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.870591+0000","last_change":"2024-04-25T19:23:33.869538+0000","last_active":"2024-04-25T19:23:33.870591+0000","last_peered":"2024-04-25T19:23:33.870591+0000","last_clean":"2024-04-25T19:23:33.870591+0000","last_became_active":"2024-04-25T19:23:33.869167+0000","last_became_peered":"2024-04-25T19:23:33.869167+0000","last_unstale":"2024-04-25T19:23:33.870591+0000","last_undegraded":"2024-04-25T19:23:33.870591+0000","last_fullsized":"2024-04-25T19:23:33.870591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:42.202405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.839704+0000","last_change":"2024-04-25T19:23:33.839704+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.839704+0000","last_undegraded":"2024-04-25T19:23:33.839704+0000","last_fullsized":"2024-04-25T19:23:33.839704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.865567+0000","last_change":"2024-04-25T19:23:33.860231+0000","last_active":"2024-04-25T19:23:33.865567+0000","last_peered":"2024-04-25T19:23:33.865567+0000","last_clean":"2024-04-25T19:23:33.865567+0000","last_became_active":"2024-04-25T19:23:33.859759+0000","last_became_peered":"2024-04-25T19:23:33.859759+0000","last_unstale":"2024-04-25T19:23:33.865567+0000","last_undegraded":"2024-04-25T19:23:33.865567+0000","last_fullsized":"2024-04-25T19:23:33.865567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:56:35.512857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.841340+0000","last_change":"2024-04-25T19:23:33.841340+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.841340+0000","last_undegraded":"2024-04-25T19:23:33.841340+0000","last_fullsized":"2024-04-25T19:23:33.841340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.870123+0000","last_change":"2024-04-25T19:23:33.868354+0000","last_active":"2024-04-25T19:23:33.870123+0000","last_peered":"2024-04-25T19:23:33.870123+0000","last_clean":"2024-04-25T19:23:33.870123+0000","last_became_active":"2024-04-25T19:23:33.867050+0000","last_became_peered":"2024-04-25T19:23:33.867050+0000","last_unstale":"2024-04-25T19:23:33.870123+0000","last_undegraded":"2024-04-25T19:23:33.870123+0000","last_fullsized":"2024-04-25T19:23:33.870123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:50.633103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.851993+0000","last_change":"2024-04-25T19:23:33.851993+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.851993+0000","last_undegraded":"2024-04-25T19:23:33.851993+0000","last_fullsized":"2024-04-25T19:23:33.851993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.872978+0000","last_change":"2024-04-25T19:23:33.871947+0000","last_active":"2024-04-25T19:23:33.872978+0000","last_peered":"2024-04-25T19:23:33.872978+0000","last_clean":"2024-04-25T19:23:33.872978+0000","last_became_active":"2024-04-25T19:23:33.870719+0000","last_became_peered":"2024-04-25T19:23:33.870719+0000","last_unstale":"2024-04-25T19:23:33.872978+0000","last_undegraded":"2024-04-25T19:23:33.872978+0000","last_fullsized":"2024-04-25T19:23:33.872978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:42.202405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":129,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.866122+0000","last_change":"2024-04-25T19:22:06.081655+0000","last_active":"2024-04-25T19:23:33.866122+0000","last_peered":"2024-04-25T19:23:33.866122+0000","last_clean":"2024-04-25T19:23:33.866122+0000","last_became_active":"2024-04-25T19:22:06.078999+0000","last_became_peered":"2024-04-25T19:22:06.078999+0000","last_unstale":"2024-04-25T19:23:33.866122+0000","last_undegraded":"2024-04-25T19:23:33.866122+0000","last_fullsized":"2024-04-25T19:23:33.866122+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_clean_scrub_stamp":"2024-04-25T19:22:04.921147+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:30.543734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":942080,"data_stored":723901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":335872,"data_stored":127266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":335872,"data_stored":127266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T19:23:39.537 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T19:23:39.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.843+0000 7f2671000640 1 Processor -- start 2024-04-25T19:23:39.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.844+0000 7f2671000640 1 -- start start 2024-04-25T19:23:39.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.846+0000 7f2671000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f266c06d560 0x7f266c15c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:39.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.846+0000 7f2671000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f266c06f180 0x7f266c0b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:39.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.846+0000 7f2671000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f266c071230 con 0x7f266c070e20 2024-04-25T19:23:39.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.846+0000 7f2671000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f266c06f8f0 con 0x7f266c06d560 2024-04-25T19:23:39.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.846+0000 7f2671000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f266c06fbd0 con 0x7f266c06f180 2024-04-25T19:23:39.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.846+0000 7f266b400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f266c070e20 0x7f266c06ce50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:40222/0 (socket says 172.21.15.131:40222) 2024-04-25T19:23:39.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.846+0000 7f266b400640 1 -- 172.21.15.131:0/3946935800 learned_addr learned my addr 172.21.15.131:0/3946935800 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:39.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.846+0000 7f266be00640 1 --2- 172.21.15.131:0/3946935800 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f266c06f180 0x7f266c0b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:39.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.846+0000 7f2662a00640 1 --2- 172.21.15.131:0/3946935800 >> v2:172.21.15.195:3300/0 conn(0x7f266c06d560 0x7f266c15c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:39.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.846+0000 7f266aa00640 1 -- 172.21.15.131:0/3946935800 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3102706327 0 0) 0x7f266c071230 con 0x7f266c070e20 2024-04-25T19:23:39.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.846+0000 7f266aa00640 1 -- 172.21.15.131:0/3946935800 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2650005730 con 0x7f266c070e20 2024-04-25T19:23:39.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.847+0000 7f266aa00640 1 -- 172.21.15.131:0/3946935800 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1592836610 0 0) 0x7f2650005730 con 0x7f266c070e20 2024-04-25T19:23:39.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.847+0000 7f266aa00640 1 -- 172.21.15.131:0/3946935800 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f266c06f180 msgr2=0x7f266c0b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:39.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.847+0000 7f266aa00640 1 --2- 172.21.15.131:0/3946935800 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f266c06f180 0x7f266c0b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:39.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.847+0000 7f266aa00640 1 -- 172.21.15.131:0/3946935800 >> v2:172.21.15.195:3300/0 conn(0x7f266c06d560 msgr2=0x7f266c15c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:39.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.847+0000 7f266aa00640 1 --2- 172.21.15.131:0/3946935800 >> v2:172.21.15.195:3300/0 conn(0x7f266c06d560 0x7f266c15c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:39.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.847+0000 7f266aa00640 1 -- 172.21.15.131:0/3946935800 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f266c06feb0 con 0x7f266c070e20 2024-04-25T19:23:39.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.847+0000 7f266aa00640 1 -- 172.21.15.131:0/3946935800 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f265c001670 con 0x7f266c070e20 2024-04-25T19:23:39.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.847+0000 7f266be00640 1 --2- 172.21.15.131:0/3946935800 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f266c06f180 0x7f266c0b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T19:23:39.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.847+0000 7f266aa00640 1 -- 172.21.15.131:0/3946935800 >> v1:172.21.15.131:6789/0 conn(0x7f266c070e20 legacy=0x7f266c06ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:39.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.847+0000 7f266aa00640 1 --2- 172.21.15.131:0/3946935800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2650005bc0 0x7f2650006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:39.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.847+0000 7f266aa00640 1 --2- 172.21.15.131:0/3946935800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2650006a10 0x7f2650006e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:39.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.847+0000 7f266aa00640 1 --2- 172.21.15.131:0/3946935800 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f266c06f180 0x7f2650007360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:39.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.847+0000 7f266aa00640 1 -- 172.21.15.131:0/3946935800 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f266c06f8f0 con 0x7f2650006a10 2024-04-25T19:23:39.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.847+0000 7f266aa00640 1 -- 172.21.15.131:0/3946935800 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f266c06fbd0 con 0x7f2650005bc0 2024-04-25T19:23:39.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.847+0000 7f266aa00640 1 -- 172.21.15.131:0/3946935800 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f265000dc80 con 0x7f266c06f180 2024-04-25T19:23:39.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.847+0000 7f2662a00640 1 --2- 172.21.15.131:0/3946935800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2650006a10 0x7f2650006e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:39.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.848+0000 7f266be00640 1 --2- 172.21.15.131:0/3946935800 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f266c06f180 0x7f2650007360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:39.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.848+0000 7f266b400640 1 --2- 172.21.15.131:0/3946935800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2650005bc0 0x7f2650006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:39.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.848+0000 7f2662a00640 1 -- 172.21.15.131:0/3946935800 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f266c06f180 msgr2=0x7f2650007360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:39.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.848+0000 7f2662a00640 1 --2- 172.21.15.131:0/3946935800 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f266c06f180 0x7f2650007360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:39.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.848+0000 7f2662a00640 1 -- 172.21.15.131:0/3946935800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2650005bc0 msgr2=0x7f2650006030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:39.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.848+0000 7f2662a00640 1 --2- 172.21.15.131:0/3946935800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2650005bc0 0x7f2650006030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:39.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.848+0000 7f2662a00640 1 -- 172.21.15.131:0/3946935800 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2650005730 con 0x7f2650006a10 2024-04-25T19:23:39.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.849+0000 7f2662a00640 1 --2- 172.21.15.131:0/3946935800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2650006a10 0x7f2650006e20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2654009ac0 tx=0x7f2650007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482f580d97bfad0b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:39.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.849+0000 7f266aa00640 1 -- 172.21.15.131:0/3946935800 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2654036070 con 0x7f2650006a10 2024-04-25T19:23:39.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.849+0000 7f266aa00640 1 -- 172.21.15.131:0/3946935800 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2654031400 con 0x7f2650006a10 2024-04-25T19:23:39.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.849+0000 7f266aa00640 1 -- 172.21.15.131:0/3946935800 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2654009690 con 0x7f2650006a10 2024-04-25T19:23:39.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.850+0000 7f2671000640 1 -- 172.21.15.131:0/3946935800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2650006a10 msgr2=0x7f2650006e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:39.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.850+0000 7f2671000640 1 --2- 172.21.15.131:0/3946935800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2650006a10 0x7f2650006e20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2654009ac0 tx=0x7f2650007a40 comp rx=0 tx=0).stop 2024-04-25T19:23:39.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.850+0000 7f266be00640 1 -- 172.21.15.131:0/3946935800 reap_dead start 2024-04-25T19:23:39.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.850+0000 7f2671000640 1 -- 172.21.15.131:0/3946935800 shutdown_connections 2024-04-25T19:23:39.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.850+0000 7f2671000640 1 -- 172.21.15.131:0/3946935800 >> 172.21.15.131:0/3946935800 conn(0x7f266c0d1720 msgr2=0x7f266c0d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:39.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.850+0000 7f2671000640 1 -- 172.21.15.131:0/3946935800 shutdown_connections 2024-04-25T19:23:39.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.850+0000 7f2671000640 1 -- 172.21.15.131:0/3946935800 wait complete. 2024-04-25T19:23:39.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.852+0000 7f2671000640 1 Processor -- start 2024-04-25T19:23:39.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.853+0000 7f2671000640 1 -- start start 2024-04-25T19:23:39.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.854+0000 7f2671000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2650006a10 0x7f266c154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:39.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.854+0000 7f2671000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f266c14f650 0x7f266c0cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:39.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.854+0000 7f2671000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f266c0cc1d0 0x7f266c1f9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:39.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.854+0000 7f2671000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f266c06c5c0 con 0x7f2650006a10 2024-04-25T19:23:39.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.854+0000 7f2671000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f266c06f590 con 0x7f266c0cc1d0 2024-04-25T19:23:39.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.854+0000 7f2671000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f266c06c740 con 0x7f266c14f650 2024-04-25T19:23:39.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.854+0000 7f266b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2650006a10 0x7f266c154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:39.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.854+0000 7f266b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2650006a10 0x7f266c154ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51718/0 (socket says 172.21.15.131:51718) 2024-04-25T19:23:39.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.854+0000 7f266b400640 1 -- 172.21.15.131:0/662454240 learned_addr learned my addr 172.21.15.131:0/662454240 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:39.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.855+0000 7f2662a00640 1 --2- 172.21.15.131:0/662454240 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f266c14f650 0x7f266c0cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:39.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.855+0000 7f266be00640 1 --2- 172.21.15.131:0/662454240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f266c0cc1d0 0x7f266c1f9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:39.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.855+0000 7f266b400640 1 -- 172.21.15.131:0/662454240 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f266c14f650 msgr2=0x7f266c0cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:39.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.855+0000 7f266b400640 1 --2- 172.21.15.131:0/662454240 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f266c14f650 0x7f266c0cbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:39.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.855+0000 7f266b400640 1 -- 172.21.15.131:0/662454240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f266c0cc1d0 msgr2=0x7f266c1f9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:39.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.855+0000 7f266b400640 1 --2- 172.21.15.131:0/662454240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f266c0cc1d0 0x7f266c1f9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:39.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.855+0000 7f266b400640 1 -- 172.21.15.131:0/662454240 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f266c0cc5e0 con 0x7f2650006a10 2024-04-25T19:23:39.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.855+0000 7f266be00640 1 --2- 172.21.15.131:0/662454240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f266c0cc1d0 0x7f266c1f9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:39.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.855+0000 7f266b400640 1 --2- 172.21.15.131:0/662454240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2650006a10 0x7f266c154ed0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f265c001200 tx=0x7f265c00dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:39.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.855+0000 7f2663e00640 1 -- 172.21.15.131:0/662454240 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c019070 con 0x7f2650006a10 2024-04-25T19:23:39.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.856+0000 7f2663e00640 1 -- 172.21.15.131:0/662454240 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f265c0074e0 con 0x7f2650006a10 2024-04-25T19:23:39.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.856+0000 7f2671000640 1 -- 172.21.15.131:0/662454240 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f266c1516f0 con 0x7f2650006a10 2024-04-25T19:23:39.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.856+0000 7f2663e00640 1 -- 172.21.15.131:0/662454240 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c007690 con 0x7f2650006a10 2024-04-25T19:23:39.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.856+0000 7f2671000640 1 -- 172.21.15.131:0/662454240 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f266c152330 con 0x7f2650006a10 2024-04-25T19:23:39.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.857+0000 7f2671000640 1 -- 172.21.15.131:0/662454240 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f266c050740 con 0x7f2650006a10 2024-04-25T19:23:39.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.858+0000 7f2663e00640 1 -- 172.21.15.131:0/662454240 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f265c01c070 con 0x7f2650006a10 2024-04-25T19:23:39.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.859+0000 7f2663e00640 1 --2- 172.21.15.131:0/662454240 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f26480744b0 0x7f26480769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:39.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.859+0000 7f2663e00640 1 -- 172.21.15.131:0/662454240 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f265c094ea0 con 0x7f2650006a10 2024-04-25T19:23:39.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.860+0000 7f2662a00640 1 --2- 172.21.15.131:0/662454240 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f26480744b0 0x7f26480769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:39.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.861+0000 7f2662a00640 1 --2- 172.21.15.131:0/662454240 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f26480744b0 0x7f26480769c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2654009ac0 tx=0x7f2654008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:39.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:39.863+0000 7f2663e00640 1 -- 172.21.15.131:0/662454240 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f266c0cc5e0 con 0x7f2650006a10 2024-04-25T19:23:40.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.058+0000 7f2671000640 1 -- 172.21.15.131:0/662454240 --> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f266c0b67f0 con 0x7f26480744b0 2024-04-25T19:23:40.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.078+0000 7f2663e00640 1 -- 172.21.15.131:0/662454240 <== mgr.4105 v2:172.21.15.195:6832/2541913764 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246620 (secure 0 0 0) 0x7f266c0b67f0 con 0x7f26480744b0 2024-04-25T19:23:40.083 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:40.084 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-04-25T19:23:40.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.084+0000 7f2671000640 1 -- 172.21.15.131:0/662454240 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f26480744b0 msgr2=0x7f26480769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:40.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.084+0000 7f2671000640 1 --2- 172.21.15.131:0/662454240 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f26480744b0 0x7f26480769c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2654009ac0 tx=0x7f2654008030 comp rx=0 tx=0).stop 2024-04-25T19:23:40.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.084+0000 7f2671000640 1 -- 172.21.15.131:0/662454240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2650006a10 msgr2=0x7f266c154ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:40.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.084+0000 7f2671000640 1 --2- 172.21.15.131:0/662454240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2650006a10 0x7f266c154ed0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f265c001200 tx=0x7f265c00dd20 comp rx=0 tx=0).stop 2024-04-25T19:23:40.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.084+0000 7f2671000640 1 -- 172.21.15.131:0/662454240 shutdown_connections 2024-04-25T19:23:40.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.084+0000 7f2671000640 1 --2- 172.21.15.131:0/662454240 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f26480744b0 0x7f26480769c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:40.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.084+0000 7f2671000640 1 --2- 172.21.15.131:0/662454240 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f266c14f650 0x7f266c0cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:40.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.084+0000 7f2671000640 1 --2- 172.21.15.131:0/662454240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f266c0cc1d0 0x7f266c1f9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:40.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.084+0000 7f2671000640 1 --2- 172.21.15.131:0/662454240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2650006a10 0x7f266c154ed0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:40.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.084+0000 7f2671000640 1 -- 172.21.15.131:0/662454240 >> 172.21.15.131:0/662454240 conn(0x7f266c0d1720 msgr2=0x7f266c15a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:40.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.084+0000 7f2671000640 1 -- 172.21.15.131:0/662454240 shutdown_connections 2024-04-25T19:23:40.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.084+0000 7f2671000640 1 -- 172.21.15.131:0/662454240 wait complete. 2024-04-25T19:23:40.111 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-04-25T19:23:38.168366+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236632,"kb_used_data":3820,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738088,"statfs":{"total":773094113280,"available":772851802112,"internally_reserved":0,"allocated":3911680,"data_stored":2217665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.356739"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.852456+0000","last_change":"2024-04-25T19:23:33.852456+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.852456+0000","last_undegraded":"2024-04-25T19:23:33.852456+0000","last_fullsized":"2024-04-25T19:23:33.852456+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.843476+0000","last_change":"2024-04-25T19:23:33.843476+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.843476+0000","last_undegraded":"2024-04-25T19:23:33.843476+0000","last_fullsized":"2024-04-25T19:23:33.843476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.843011+0000","last_change":"2024-04-25T19:23:33.843011+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.843011+0000","last_undegraded":"2024-04-25T19:23:33.843011+0000","last_fullsized":"2024-04-25T19:23:33.843011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.846795+0000","last_change":"2024-04-25T19:23:33.846795+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.846795+0000","last_undegraded":"2024-04-25T19:23:33.846795+0000","last_fullsized":"2024-04-25T19:23:33.846795+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.846078+0000","last_change":"2024-04-25T19:23:33.846078+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.846078+0000","last_undegraded":"2024-04-25T19:23:33.846078+0000","last_fullsized":"2024-04-25T19:23:33.846078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.839576+0000","last_change":"2024-04-25T19:23:33.839576+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.839576+0000","last_undegraded":"2024-04-25T19:23:33.839576+0000","last_fullsized":"2024-04-25T19:23:33.839576+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.854199+0000","last_change":"2024-04-25T19:23:33.854199+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.854199+0000","last_undegraded":"2024-04-25T19:23:33.854199+0000","last_fullsized":"2024-04-25T19:23:33.854199+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.858259+0000","last_change":"2024-04-25T19:23:33.858259+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.858259+0000","last_undegraded":"2024-04-25T19:23:33.858259+0000","last_fullsized":"2024-04-25T19:23:33.858259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.847955+0000","last_change":"2024-04-25T19:23:33.847955+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.847955+0000","last_undegraded":"2024-04-25T19:23:33.847955+0000","last_fullsized":"2024-04-25T19:23:33.847955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.855311+0000","last_change":"2024-04-25T19:23:33.855311+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.855311+0000","last_undegraded":"2024-04-25T19:23:33.855311+0000","last_fullsized":"2024-04-25T19:23:33.855311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.864320+0000","last_change":"2024-04-25T19:23:33.864320+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.864320+0000","last_undegraded":"2024-04-25T19:23:33.864320+0000","last_fullsized":"2024-04-25T19:23:33.864320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.845030+0000","last_change":"2024-04-25T19:23:33.845030+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.845030+0000","last_undegraded":"2024-04-25T19:23:33.845030+0000","last_fullsized":"2024-04-25T19:23:33.845030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.845367+0000","last_change":"2024-04-25T19:23:33.845367+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.845367+0000","last_undegraded":"2024-04-25T19:23:33.845367+0000","last_fullsized":"2024-04-25T19:23:33.845367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.839071+0000","last_change":"2024-04-25T19:23:33.839071+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.839071+0000","last_undegraded":"2024-04-25T19:23:33.839071+0000","last_fullsized":"2024-04-25T19:23:33.839071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.839013+0000","last_change":"2024-04-25T19:23:33.839013+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.839013+0000","last_undegraded":"2024-04-25T19:23:33.839013+0000","last_fullsized":"2024-04-25T19:23:33.839013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.851459+0000","last_change":"2024-04-25T19:23:33.851459+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.851459+0000","last_undegraded":"2024-04-25T19:23:33.851459+0000","last_fullsized":"2024-04-25T19:23:33.851459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.858677+0000","last_change":"2024-04-25T19:23:33.858677+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.858677+0000","last_undegraded":"2024-04-25T19:23:33.858677+0000","last_fullsized":"2024-04-25T19:23:33.858677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.843011+0000","last_change":"2024-04-25T19:23:33.843011+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.843011+0000","last_undegraded":"2024-04-25T19:23:33.843011+0000","last_fullsized":"2024-04-25T19:23:33.843011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.841312+0000","last_change":"2024-04-25T19:23:33.841312+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.841312+0000","last_undegraded":"2024-04-25T19:23:33.841312+0000","last_fullsized":"2024-04-25T19:23:33.841312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.841229+0000","last_change":"2024-04-25T19:23:33.841229+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.841229+0000","last_undegraded":"2024-04-25T19:23:33.841229+0000","last_fullsized":"2024-04-25T19:23:33.841229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.846480+0000","last_change":"2024-04-25T19:23:33.846480+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.846480+0000","last_undegraded":"2024-04-25T19:23:33.846480+0000","last_fullsized":"2024-04-25T19:23:33.846480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.842673+0000","last_change":"2024-04-25T19:23:33.842673+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.842673+0000","last_undegraded":"2024-04-25T19:23:33.842673+0000","last_fullsized":"2024-04-25T19:23:33.842673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.838143+0000","last_change":"2024-04-25T19:23:33.838143+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.838143+0000","last_undegraded":"2024-04-25T19:23:33.838143+0000","last_fullsized":"2024-04-25T19:23:33.838143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.846185+0000","last_change":"2024-04-25T19:23:33.846185+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.846185+0000","last_undegraded":"2024-04-25T19:23:33.846185+0000","last_fullsized":"2024-04-25T19:23:33.846185+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.851461+0000","last_change":"2024-04-25T19:23:33.851461+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.851461+0000","last_undegraded":"2024-04-25T19:23:33.851461+0000","last_fullsized":"2024-04-25T19:23:33.851461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.842442+0000","last_change":"2024-04-25T19:23:33.842442+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.842442+0000","last_undegraded":"2024-04-25T19:23:33.842442+0000","last_fullsized":"2024-04-25T19:23:33.842442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.851546+0000","last_change":"2024-04-25T19:23:33.851546+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.851546+0000","last_undegraded":"2024-04-25T19:23:33.851546+0000","last_fullsized":"2024-04-25T19:23:33.851546+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.838999+0000","last_change":"2024-04-25T19:23:33.838999+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.838999+0000","last_undegraded":"2024-04-25T19:23:33.838999+0000","last_fullsized":"2024-04-25T19:23:33.838999+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.845408+0000","last_change":"2024-04-25T19:23:33.845408+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.845408+0000","last_undegraded":"2024-04-25T19:23:33.845408+0000","last_fullsized":"2024-04-25T19:23:33.845408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.862047+0000","last_change":"2024-04-25T19:23:33.862047+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.862047+0000","last_undegraded":"2024-04-25T19:23:33.862047+0000","last_fullsized":"2024-04-25T19:23:33.862047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.849621+0000","last_change":"2024-04-25T19:23:33.849621+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.849621+0000","last_undegraded":"2024-04-25T19:23:33.849621+0000","last_fullsized":"2024-04-25T19:23:33.849621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.857745+0000","last_change":"2024-04-25T19:23:33.857745+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.857745+0000","last_undegraded":"2024-04-25T19:23:33.857745+0000","last_fullsized":"2024-04-25T19:23:33.857745+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.838883+0000","last_change":"2024-04-25T19:23:33.838883+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.838883+0000","last_undegraded":"2024-04-25T19:23:33.838883+0000","last_fullsized":"2024-04-25T19:23:33.838883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.871051+0000","last_change":"2024-04-25T19:23:33.869661+0000","last_active":"2024-04-25T19:23:33.871051+0000","last_peered":"2024-04-25T19:23:33.871051+0000","last_clean":"2024-04-25T19:23:33.871051+0000","last_became_active":"2024-04-25T19:23:33.869333+0000","last_became_peered":"2024-04-25T19:23:33.869333+0000","last_unstale":"2024-04-25T19:23:33.871051+0000","last_undegraded":"2024-04-25T19:23:33.871051+0000","last_fullsized":"2024-04-25T19:23:33.871051+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:08.115832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.850256+0000","last_change":"2024-04-25T19:23:33.850256+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.850256+0000","last_undegraded":"2024-04-25T19:23:33.850256+0000","last_fullsized":"2024-04-25T19:23:33.850256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.868093+0000","last_change":"2024-04-25T19:23:33.862637+0000","last_active":"2024-04-25T19:23:33.868093+0000","last_peered":"2024-04-25T19:23:33.868093+0000","last_clean":"2024-04-25T19:23:33.868093+0000","last_became_active":"2024-04-25T19:23:33.862409+0000","last_became_peered":"2024-04-25T19:23:33.862409+0000","last_unstale":"2024-04-25T19:23:33.868093+0000","last_undegraded":"2024-04-25T19:23:33.868093+0000","last_fullsized":"2024-04-25T19:23:33.868093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:08.115832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.848944+0000","last_change":"2024-04-25T19:23:33.848944+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.848944+0000","last_undegraded":"2024-04-25T19:23:33.848944+0000","last_fullsized":"2024-04-25T19:23:33.848944+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.868677+0000","last_change":"2024-04-25T19:23:33.861801+0000","last_active":"2024-04-25T19:23:33.868677+0000","last_peered":"2024-04-25T19:23:33.868677+0000","last_clean":"2024-04-25T19:23:33.868677+0000","last_became_active":"2024-04-25T19:23:33.861477+0000","last_became_peered":"2024-04-25T19:23:33.861477+0000","last_unstale":"2024-04-25T19:23:33.868677+0000","last_undegraded":"2024-04-25T19:23:33.868677+0000","last_fullsized":"2024-04-25T19:23:33.868677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:29.370419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.850965+0000","last_change":"2024-04-25T19:23:33.850965+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.850965+0000","last_undegraded":"2024-04-25T19:23:33.850965+0000","last_fullsized":"2024-04-25T19:23:33.850965+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.867447+0000","last_change":"2024-04-25T19:23:33.861932+0000","last_active":"2024-04-25T19:23:33.867447+0000","last_peered":"2024-04-25T19:23:33.867447+0000","last_clean":"2024-04-25T19:23:33.867447+0000","last_became_active":"2024-04-25T19:23:33.860394+0000","last_became_peered":"2024-04-25T19:23:33.860394+0000","last_unstale":"2024-04-25T19:23:33.867447+0000","last_undegraded":"2024-04-25T19:23:33.867447+0000","last_fullsized":"2024-04-25T19:23:33.867447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:25.649340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.851805+0000","last_change":"2024-04-25T19:23:33.851805+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.851805+0000","last_undegraded":"2024-04-25T19:23:33.851805+0000","last_fullsized":"2024-04-25T19:23:33.851805+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.865809+0000","last_change":"2024-04-25T19:23:33.861192+0000","last_active":"2024-04-25T19:23:33.865809+0000","last_peered":"2024-04-25T19:23:33.865809+0000","last_clean":"2024-04-25T19:23:33.865809+0000","last_became_active":"2024-04-25T19:23:33.860848+0000","last_became_peered":"2024-04-25T19:23:33.860848+0000","last_unstale":"2024-04-25T19:23:33.865809+0000","last_undegraded":"2024-04-25T19:23:33.865809+0000","last_fullsized":"2024-04-25T19:23:33.865809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:30:21.396542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.841507+0000","last_change":"2024-04-25T19:23:33.841507+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.841507+0000","last_undegraded":"2024-04-25T19:23:33.841507+0000","last_fullsized":"2024-04-25T19:23:33.841507+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.865378+0000","last_change":"2024-04-25T19:23:33.859288+0000","last_active":"2024-04-25T19:23:33.865378+0000","last_peered":"2024-04-25T19:23:33.865378+0000","last_clean":"2024-04-25T19:23:33.865378+0000","last_became_active":"2024-04-25T19:23:33.858841+0000","last_became_peered":"2024-04-25T19:23:33.858841+0000","last_unstale":"2024-04-25T19:23:33.865378+0000","last_undegraded":"2024-04-25T19:23:33.865378+0000","last_fullsized":"2024-04-25T19:23:33.865378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:07:55.891874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.847021+0000","last_change":"2024-04-25T19:23:33.847021+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.847021+0000","last_undegraded":"2024-04-25T19:23:33.847021+0000","last_fullsized":"2024-04-25T19:23:33.847021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.859647+0000","last_change":"2024-04-25T19:23:33.853794+0000","last_active":"2024-04-25T19:23:33.859647+0000","last_peered":"2024-04-25T19:23:33.859647+0000","last_clean":"2024-04-25T19:23:33.859647+0000","last_became_active":"2024-04-25T19:23:33.853451+0000","last_became_peered":"2024-04-25T19:23:33.853451+0000","last_unstale":"2024-04-25T19:23:33.859647+0000","last_undegraded":"2024-04-25T19:23:33.859647+0000","last_fullsized":"2024-04-25T19:23:33.859647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:31:03.100180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.842949+0000","last_change":"2024-04-25T19:23:33.842949+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.842949+0000","last_undegraded":"2024-04-25T19:23:33.842949+0000","last_fullsized":"2024-04-25T19:23:33.842949+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.865843+0000","last_change":"2024-04-25T19:23:33.861563+0000","last_active":"2024-04-25T19:23:33.865843+0000","last_peered":"2024-04-25T19:23:33.865843+0000","last_clean":"2024-04-25T19:23:33.865843+0000","last_became_active":"2024-04-25T19:23:33.859069+0000","last_became_peered":"2024-04-25T19:23:33.859069+0000","last_unstale":"2024-04-25T19:23:33.865843+0000","last_undegraded":"2024-04-25T19:23:33.865843+0000","last_fullsized":"2024-04-25T19:23:33.865843+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:38.558221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.839477+0000","last_change":"2024-04-25T19:23:33.839477+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.839477+0000","last_undegraded":"2024-04-25T19:23:33.839477+0000","last_fullsized":"2024-04-25T19:23:33.839477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.869873+0000","last_change":"2024-04-25T19:23:33.867663+0000","last_active":"2024-04-25T19:23:33.869873+0000","last_peered":"2024-04-25T19:23:33.869873+0000","last_clean":"2024-04-25T19:23:33.869873+0000","last_became_active":"2024-04-25T19:23:33.867106+0000","last_became_peered":"2024-04-25T19:23:33.867106+0000","last_unstale":"2024-04-25T19:23:33.869873+0000","last_undegraded":"2024-04-25T19:23:33.869873+0000","last_fullsized":"2024-04-25T19:23:33.869873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:51.486951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.842841+0000","last_change":"2024-04-25T19:23:33.842841+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.842841+0000","last_undegraded":"2024-04-25T19:23:33.842841+0000","last_fullsized":"2024-04-25T19:23:33.842841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.857348+0000","last_change":"2024-04-25T19:23:33.853876+0000","last_active":"2024-04-25T19:23:33.857348+0000","last_peered":"2024-04-25T19:23:33.857348+0000","last_clean":"2024-04-25T19:23:33.857348+0000","last_became_active":"2024-04-25T19:23:33.853522+0000","last_became_peered":"2024-04-25T19:23:33.853522+0000","last_unstale":"2024-04-25T19:23:33.857348+0000","last_undegraded":"2024-04-25T19:23:33.857348+0000","last_fullsized":"2024-04-25T19:23:33.857348+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:26.949430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.840803+0000","last_change":"2024-04-25T19:23:33.840803+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.840803+0000","last_undegraded":"2024-04-25T19:23:33.840803+0000","last_fullsized":"2024-04-25T19:23:33.840803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.873134+0000","last_change":"2024-04-25T19:23:33.871669+0000","last_active":"2024-04-25T19:23:33.873134+0000","last_peered":"2024-04-25T19:23:33.873134+0000","last_clean":"2024-04-25T19:23:33.873134+0000","last_became_active":"2024-04-25T19:23:33.870470+0000","last_became_peered":"2024-04-25T19:23:33.870470+0000","last_unstale":"2024-04-25T19:23:33.873134+0000","last_undegraded":"2024-04-25T19:23:33.873134+0000","last_fullsized":"2024-04-25T19:23:33.873134+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:00.480595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.844292+0000","last_change":"2024-04-25T19:23:33.844292+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.844292+0000","last_undegraded":"2024-04-25T19:23:33.844292+0000","last_fullsized":"2024-04-25T19:23:33.844292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.863488+0000","last_change":"2024-04-25T19:23:33.859210+0000","last_active":"2024-04-25T19:23:33.863488+0000","last_peered":"2024-04-25T19:23:33.863488+0000","last_clean":"2024-04-25T19:23:33.863488+0000","last_became_active":"2024-04-25T19:23:33.858457+0000","last_became_peered":"2024-04-25T19:23:33.858457+0000","last_unstale":"2024-04-25T19:23:33.863488+0000","last_undegraded":"2024-04-25T19:23:33.863488+0000","last_fullsized":"2024-04-25T19:23:33.863488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:42.202405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.844212+0000","last_change":"2024-04-25T19:23:33.844212+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.844212+0000","last_undegraded":"2024-04-25T19:23:33.844212+0000","last_fullsized":"2024-04-25T19:23:33.844212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.865836+0000","last_change":"2024-04-25T19:23:33.859947+0000","last_active":"2024-04-25T19:23:33.865836+0000","last_peered":"2024-04-25T19:23:33.865836+0000","last_clean":"2024-04-25T19:23:33.865836+0000","last_became_active":"2024-04-25T19:23:33.859569+0000","last_became_peered":"2024-04-25T19:23:33.859569+0000","last_unstale":"2024-04-25T19:23:33.865836+0000","last_undegraded":"2024-04-25T19:23:33.865836+0000","last_fullsized":"2024-04-25T19:23:33.865836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:01.440217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.841834+0000","last_change":"2024-04-25T19:23:33.841834+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.841834+0000","last_undegraded":"2024-04-25T19:23:33.841834+0000","last_fullsized":"2024-04-25T19:23:33.841834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.867689+0000","last_change":"2024-04-25T19:23:33.865049+0000","last_active":"2024-04-25T19:23:33.867689+0000","last_peered":"2024-04-25T19:23:33.867689+0000","last_clean":"2024-04-25T19:23:33.867689+0000","last_became_active":"2024-04-25T19:23:33.864681+0000","last_became_peered":"2024-04-25T19:23:33.864681+0000","last_unstale":"2024-04-25T19:23:33.867689+0000","last_undegraded":"2024-04-25T19:23:33.867689+0000","last_fullsized":"2024-04-25T19:23:33.867689+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:12:04.487364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.857136+0000","last_change":"2024-04-25T19:23:33.857136+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.857136+0000","last_undegraded":"2024-04-25T19:23:33.857136+0000","last_fullsized":"2024-04-25T19:23:33.857136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.869856+0000","last_change":"2024-04-25T19:23:33.867671+0000","last_active":"2024-04-25T19:23:33.869856+0000","last_peered":"2024-04-25T19:23:33.869856+0000","last_clean":"2024-04-25T19:23:33.869856+0000","last_became_active":"2024-04-25T19:23:33.866592+0000","last_became_peered":"2024-04-25T19:23:33.866592+0000","last_unstale":"2024-04-25T19:23:33.869856+0000","last_undegraded":"2024-04-25T19:23:33.869856+0000","last_fullsized":"2024-04-25T19:23:33.869856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:03:16.565706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.848339+0000","last_change":"2024-04-25T19:23:33.848339+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.848339+0000","last_undegraded":"2024-04-25T19:23:33.848339+0000","last_fullsized":"2024-04-25T19:23:33.848339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.862172+0000","last_change":"2024-04-25T19:23:33.857697+0000","last_active":"2024-04-25T19:23:33.862172+0000","last_peered":"2024-04-25T19:23:33.862172+0000","last_clean":"2024-04-25T19:23:33.862172+0000","last_became_active":"2024-04-25T19:23:33.857359+0000","last_became_peered":"2024-04-25T19:23:33.857359+0000","last_unstale":"2024-04-25T19:23:33.862172+0000","last_undegraded":"2024-04-25T19:23:33.862172+0000","last_fullsized":"2024-04-25T19:23:33.862172+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:08.115832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.847662+0000","last_change":"2024-04-25T19:23:33.847662+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.847662+0000","last_undegraded":"2024-04-25T19:23:33.847662+0000","last_fullsized":"2024-04-25T19:23:33.847662+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.867826+0000","last_change":"2024-04-25T19:23:33.866277+0000","last_active":"2024-04-25T19:23:33.867826+0000","last_peered":"2024-04-25T19:23:33.867826+0000","last_clean":"2024-04-25T19:23:33.867826+0000","last_became_active":"2024-04-25T19:23:33.865920+0000","last_became_peered":"2024-04-25T19:23:33.865920+0000","last_unstale":"2024-04-25T19:23:33.867826+0000","last_undegraded":"2024-04-25T19:23:33.867826+0000","last_fullsized":"2024-04-25T19:23:33.867826+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:31:03.100180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.842680+0000","last_change":"2024-04-25T19:23:33.842680+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.842680+0000","last_undegraded":"2024-04-25T19:23:33.842680+0000","last_fullsized":"2024-04-25T19:23:33.842680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.867948+0000","last_change":"2024-04-25T19:23:33.863747+0000","last_active":"2024-04-25T19:23:33.867948+0000","last_peered":"2024-04-25T19:23:33.867948+0000","last_clean":"2024-04-25T19:23:33.867948+0000","last_became_active":"2024-04-25T19:23:33.863073+0000","last_became_peered":"2024-04-25T19:23:33.863073+0000","last_unstale":"2024-04-25T19:23:33.867948+0000","last_undegraded":"2024-04-25T19:23:33.867948+0000","last_fullsized":"2024-04-25T19:23:33.867948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:04:54.536294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.846322+0000","last_change":"2024-04-25T19:23:33.846322+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.846322+0000","last_undegraded":"2024-04-25T19:23:33.846322+0000","last_fullsized":"2024-04-25T19:23:33.846322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.868097+0000","last_change":"2024-04-25T19:23:33.863501+0000","last_active":"2024-04-25T19:23:33.868097+0000","last_peered":"2024-04-25T19:23:33.868097+0000","last_clean":"2024-04-25T19:23:33.868097+0000","last_became_active":"2024-04-25T19:23:33.863105+0000","last_became_peered":"2024-04-25T19:23:33.863105+0000","last_unstale":"2024-04-25T19:23:33.868097+0000","last_undegraded":"2024-04-25T19:23:33.868097+0000","last_fullsized":"2024-04-25T19:23:33.868097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:58.887186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.842874+0000","last_change":"2024-04-25T19:23:33.842874+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.842874+0000","last_undegraded":"2024-04-25T19:23:33.842874+0000","last_fullsized":"2024-04-25T19:23:33.842874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.865883+0000","last_change":"2024-04-25T19:23:33.861614+0000","last_active":"2024-04-25T19:23:33.865883+0000","last_peered":"2024-04-25T19:23:33.865883+0000","last_clean":"2024-04-25T19:23:33.865883+0000","last_became_active":"2024-04-25T19:23:33.861269+0000","last_became_peered":"2024-04-25T19:23:33.861269+0000","last_unstale":"2024-04-25T19:23:33.865883+0000","last_undegraded":"2024-04-25T19:23:33.865883+0000","last_fullsized":"2024-04-25T19:23:33.865883+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:15:56.625735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.840716+0000","last_change":"2024-04-25T19:23:33.840716+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.840716+0000","last_undegraded":"2024-04-25T19:23:33.840716+0000","last_fullsized":"2024-04-25T19:23:33.840716+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.859307+0000","last_change":"2024-04-25T19:23:33.856541+0000","last_active":"2024-04-25T19:23:33.859307+0000","last_peered":"2024-04-25T19:23:33.859307+0000","last_clean":"2024-04-25T19:23:33.859307+0000","last_became_active":"2024-04-25T19:23:33.856217+0000","last_became_peered":"2024-04-25T19:23:33.856217+0000","last_unstale":"2024-04-25T19:23:33.859307+0000","last_undegraded":"2024-04-25T19:23:33.859307+0000","last_fullsized":"2024-04-25T19:23:33.859307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:12:04.487364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.840305+0000","last_change":"2024-04-25T19:23:33.840305+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.840305+0000","last_undegraded":"2024-04-25T19:23:33.840305+0000","last_fullsized":"2024-04-25T19:23:33.840305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.868821+0000","last_change":"2024-04-25T19:23:33.865209+0000","last_active":"2024-04-25T19:23:33.868821+0000","last_peered":"2024-04-25T19:23:33.868821+0000","last_clean":"2024-04-25T19:23:33.868821+0000","last_became_active":"2024-04-25T19:23:33.864805+0000","last_became_peered":"2024-04-25T19:23:33.864805+0000","last_unstale":"2024-04-25T19:23:33.868821+0000","last_undegraded":"2024-04-25T19:23:33.868821+0000","last_fullsized":"2024-04-25T19:23:33.868821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:31:03.100180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.840703+0000","last_change":"2024-04-25T19:23:33.840703+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.840703+0000","last_undegraded":"2024-04-25T19:23:33.840703+0000","last_fullsized":"2024-04-25T19:23:33.840703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.865594+0000","last_change":"2024-04-25T19:23:33.860629+0000","last_active":"2024-04-25T19:23:33.865594+0000","last_peered":"2024-04-25T19:23:33.865594+0000","last_clean":"2024-04-25T19:23:33.865594+0000","last_became_active":"2024-04-25T19:23:33.860264+0000","last_became_peered":"2024-04-25T19:23:33.860264+0000","last_unstale":"2024-04-25T19:23:33.865594+0000","last_undegraded":"2024-04-25T19:23:33.865594+0000","last_fullsized":"2024-04-25T19:23:33.865594+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:25.649340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.858404+0000","last_change":"2024-04-25T19:23:33.858404+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.858404+0000","last_undegraded":"2024-04-25T19:23:33.858404+0000","last_fullsized":"2024-04-25T19:23:33.858404+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.871646+0000","last_change":"2024-04-25T19:23:33.869661+0000","last_active":"2024-04-25T19:23:33.871646+0000","last_peered":"2024-04-25T19:23:33.871646+0000","last_clean":"2024-04-25T19:23:33.871646+0000","last_became_active":"2024-04-25T19:23:33.869274+0000","last_became_peered":"2024-04-25T19:23:33.869274+0000","last_unstale":"2024-04-25T19:23:33.871646+0000","last_undegraded":"2024-04-25T19:23:33.871646+0000","last_fullsized":"2024-04-25T19:23:33.871646+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:50.633103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.843801+0000","last_change":"2024-04-25T19:23:33.843801+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.843801+0000","last_undegraded":"2024-04-25T19:23:33.843801+0000","last_fullsized":"2024-04-25T19:23:33.843801+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.870549+0000","last_change":"2024-04-25T19:23:33.869537+0000","last_active":"2024-04-25T19:23:33.870549+0000","last_peered":"2024-04-25T19:23:33.870549+0000","last_clean":"2024-04-25T19:23:33.870549+0000","last_became_active":"2024-04-25T19:23:33.869181+0000","last_became_peered":"2024-04-25T19:23:33.869181+0000","last_unstale":"2024-04-25T19:23:33.870549+0000","last_undegraded":"2024-04-25T19:23:33.870549+0000","last_fullsized":"2024-04-25T19:23:33.870549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:08.115832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.841192+0000","last_change":"2024-04-25T19:23:33.841192+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.841192+0000","last_undegraded":"2024-04-25T19:23:33.841192+0000","last_fullsized":"2024-04-25T19:23:33.841192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.864815+0000","last_change":"2024-04-25T19:23:33.860892+0000","last_active":"2024-04-25T19:23:33.864815+0000","last_peered":"2024-04-25T19:23:33.864815+0000","last_clean":"2024-04-25T19:23:33.864815+0000","last_became_active":"2024-04-25T19:23:33.860529+0000","last_became_peered":"2024-04-25T19:23:33.860529+0000","last_unstale":"2024-04-25T19:23:33.864815+0000","last_undegraded":"2024-04-25T19:23:33.864815+0000","last_fullsized":"2024-04-25T19:23:33.864815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:31:03.100180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.838586+0000","last_change":"2024-04-25T19:23:33.838586+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.838586+0000","last_undegraded":"2024-04-25T19:23:33.838586+0000","last_fullsized":"2024-04-25T19:23:33.838586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.863455+0000","last_change":"2024-04-25T19:23:33.859331+0000","last_active":"2024-04-25T19:23:33.863455+0000","last_peered":"2024-04-25T19:23:33.863455+0000","last_clean":"2024-04-25T19:23:33.863455+0000","last_became_active":"2024-04-25T19:23:33.858500+0000","last_became_peered":"2024-04-25T19:23:33.858500+0000","last_unstale":"2024-04-25T19:23:33.863455+0000","last_undegraded":"2024-04-25T19:23:33.863455+0000","last_fullsized":"2024-04-25T19:23:33.863455+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:56:59.616393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.851297+0000","last_change":"2024-04-25T19:23:33.851297+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.851297+0000","last_undegraded":"2024-04-25T19:23:33.851297+0000","last_fullsized":"2024-04-25T19:23:33.851297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.859280+0000","last_change":"2024-04-25T19:23:33.855462+0000","last_active":"2024-04-25T19:23:33.859280+0000","last_peered":"2024-04-25T19:23:33.859280+0000","last_clean":"2024-04-25T19:23:33.859280+0000","last_became_active":"2024-04-25T19:23:33.855113+0000","last_became_peered":"2024-04-25T19:23:33.855113+0000","last_unstale":"2024-04-25T19:23:33.859280+0000","last_undegraded":"2024-04-25T19:23:33.859280+0000","last_fullsized":"2024-04-25T19:23:33.859280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:56:59.616393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.838151+0000","last_change":"2024-04-25T19:23:33.838151+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.838151+0000","last_undegraded":"2024-04-25T19:23:33.838151+0000","last_fullsized":"2024-04-25T19:23:33.838151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.870591+0000","last_change":"2024-04-25T19:23:33.869538+0000","last_active":"2024-04-25T19:23:33.870591+0000","last_peered":"2024-04-25T19:23:33.870591+0000","last_clean":"2024-04-25T19:23:33.870591+0000","last_became_active":"2024-04-25T19:23:33.869167+0000","last_became_peered":"2024-04-25T19:23:33.869167+0000","last_unstale":"2024-04-25T19:23:33.870591+0000","last_undegraded":"2024-04-25T19:23:33.870591+0000","last_fullsized":"2024-04-25T19:23:33.870591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:42.202405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.839704+0000","last_change":"2024-04-25T19:23:33.839704+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.839704+0000","last_undegraded":"2024-04-25T19:23:33.839704+0000","last_fullsized":"2024-04-25T19:23:33.839704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.865567+0000","last_change":"2024-04-25T19:23:33.860231+0000","last_active":"2024-04-25T19:23:33.865567+0000","last_peered":"2024-04-25T19:23:33.865567+0000","last_clean":"2024-04-25T19:23:33.865567+0000","last_became_active":"2024-04-25T19:23:33.859759+0000","last_became_peered":"2024-04-25T19:23:33.859759+0000","last_unstale":"2024-04-25T19:23:33.865567+0000","last_undegraded":"2024-04-25T19:23:33.865567+0000","last_fullsized":"2024-04-25T19:23:33.865567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:56:35.512857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.841340+0000","last_change":"2024-04-25T19:23:33.841340+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.841340+0000","last_undegraded":"2024-04-25T19:23:33.841340+0000","last_fullsized":"2024-04-25T19:23:33.841340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.870123+0000","last_change":"2024-04-25T19:23:33.868354+0000","last_active":"2024-04-25T19:23:33.870123+0000","last_peered":"2024-04-25T19:23:33.870123+0000","last_clean":"2024-04-25T19:23:33.870123+0000","last_became_active":"2024-04-25T19:23:33.867050+0000","last_became_peered":"2024-04-25T19:23:33.867050+0000","last_unstale":"2024-04-25T19:23:33.870123+0000","last_undegraded":"2024-04-25T19:23:33.870123+0000","last_fullsized":"2024-04-25T19:23:33.870123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:50.633103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-25T19:23:33.851993+0000","last_change":"2024-04-25T19:23:33.851993+0000","last_active":"2024-04-25T19:23:33.810452+0000","last_peered":"2024-04-25T19:23:33.810452+0000","last_clean":"2024-04-25T19:23:33.810452+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T19:23:33.851993+0000","last_undegraded":"2024-04-25T19:23:33.851993+0000","last_fullsized":"2024-04-25T19:23:33.851993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.872978+0000","last_change":"2024-04-25T19:23:33.871947+0000","last_active":"2024-04-25T19:23:33.872978+0000","last_peered":"2024-04-25T19:23:33.872978+0000","last_clean":"2024-04-25T19:23:33.872978+0000","last_became_active":"2024-04-25T19:23:33.870719+0000","last_became_peered":"2024-04-25T19:23:33.870719+0000","last_unstale":"2024-04-25T19:23:33.872978+0000","last_undegraded":"2024-04-25T19:23:33.872978+0000","last_fullsized":"2024-04-25T19:23:33.872978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:42.202405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":129,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T19:23:33.866122+0000","last_change":"2024-04-25T19:22:06.081655+0000","last_active":"2024-04-25T19:23:33.866122+0000","last_peered":"2024-04-25T19:23:33.866122+0000","last_clean":"2024-04-25T19:23:33.866122+0000","last_became_active":"2024-04-25T19:22:06.078999+0000","last_became_peered":"2024-04-25T19:22:06.078999+0000","last_unstale":"2024-04-25T19:23:33.866122+0000","last_undegraded":"2024-04-25T19:23:33.866122+0000","last_fullsized":"2024-04-25T19:23:33.866122+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_clean_scrub_stamp":"2024-04-25T19:22:04.921147+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:30.543734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":942080,"data_stored":723901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":335872,"data_stored":127266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":335872,"data_stored":127266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T19:23:40.115 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T19:23:40.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.424+0000 7f86f3200640 1 Processor -- start 2024-04-25T19:23:40.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.425+0000 7f86f3200640 1 -- start start 2024-04-25T19:23:40.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.427+0000 7f86f3200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86ec0cf9e0 0x7f86ec161090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:40.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.427+0000 7f86f3200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f86ec0b0800 0x7f86ec070290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:40.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.427+0000 7f86f3200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86ec1615d0 con 0x7f86ec0707d0 2024-04-25T19:23:40.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.427+0000 7f86f3200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f86ec070be0 con 0x7f86ec0b0800 2024-04-25T19:23:40.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.427+0000 7f86f3200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f86ec0cffc0 con 0x7f86ec0cf9e0 2024-04-25T19:23:40.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.427+0000 7f86f1400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f86ec0b0800 0x7f86ec070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:40.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.427+0000 7f86f1400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f86ec0b0800 0x7f86ec070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51728/0 (socket says 172.21.15.131:51728) 2024-04-25T19:23:40.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.427+0000 7f86f1400640 1 -- 172.21.15.131:0/244110058 learned_addr learned my addr 172.21.15.131:0/244110058 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:40.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.428+0000 7f86f1400640 1 -- 172.21.15.131:0/244110058 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86ec0cf9e0 msgr2=0x7f86ec161090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:40.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.428+0000 7f86f1e00640 1 --2- 172.21.15.131:0/244110058 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86ec0cf9e0 0x7f86ec161090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:40.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.428+0000 7f86f1400640 1 --2- 172.21.15.131:0/244110058 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86ec0cf9e0 0x7f86ec161090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:40.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.428+0000 7f86f1400640 1 -- 172.21.15.131:0/244110058 >> v1:172.21.15.131:6789/0 conn(0x7f86ec0707d0 legacy=0x7f86ec1569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:40.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.428+0000 7f86f1400640 1 -- 172.21.15.131:0/244110058 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86ec0d02a0 con 0x7f86ec0b0800 2024-04-25T19:23:40.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.428+0000 7f86f1e00640 1 --2- 172.21.15.131:0/244110058 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86ec0cf9e0 0x7f86ec161090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:40.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.429+0000 7f86f1400640 1 --2- 172.21.15.131:0/244110058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ec0b0800 0x7f86ec070290 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009870 tx=0x7f86dc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a384439af2d690b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:40.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.429+0000 7f86f0a00640 1 -- 172.21.15.131:0/244110058 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86dc037070 con 0x7f86ec0b0800 2024-04-25T19:23:40.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.429+0000 7f86f0a00640 1 -- 172.21.15.131:0/244110058 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86dc032440 con 0x7f86ec0b0800 2024-04-25T19:23:40.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.429+0000 7f86f0a00640 1 -- 172.21.15.131:0/244110058 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86dc032810 con 0x7f86ec0b0800 2024-04-25T19:23:40.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.430+0000 7f86f3200640 1 -- 172.21.15.131:0/244110058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ec0b0800 msgr2=0x7f86ec070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:40.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.430+0000 7f86f3200640 1 --2- 172.21.15.131:0/244110058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ec0b0800 0x7f86ec070290 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009870 tx=0x7f86dc02a1c0 comp rx=0 tx=0).stop 2024-04-25T19:23:40.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.430+0000 7f86f3200640 1 -- 172.21.15.131:0/244110058 shutdown_connections 2024-04-25T19:23:40.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.430+0000 7f86f3200640 1 --2- 172.21.15.131:0/244110058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ec0b0800 0x7f86ec070290 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:40.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.430+0000 7f86f3200640 1 --2- 172.21.15.131:0/244110058 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86ec0cf9e0 0x7f86ec161090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:40.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.430+0000 7f86f3200640 1 -- 172.21.15.131:0/244110058 >> 172.21.15.131:0/244110058 conn(0x7f86ec0d1720 msgr2=0x7f86ec0d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:40.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.430+0000 7f86f3200640 1 -- 172.21.15.131:0/244110058 shutdown_connections 2024-04-25T19:23:40.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.430+0000 7f86f3200640 1 -- 172.21.15.131:0/244110058 wait complete. 2024-04-25T19:23:40.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.433+0000 7f86f3200640 1 Processor -- start 2024-04-25T19:23:40.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.433+0000 7f86f3200640 1 -- start start 2024-04-25T19:23:40.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.434+0000 7f86f3200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ec0707d0 0x7f86ec14a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:40.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.434+0000 7f86f3200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86ec0b0800 0x7f86ec1eb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:40.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.434+0000 7f86f3200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86ec0cf9e0 0x7f86ec162930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:40.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.434+0000 7f86f3200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec0b0c10 con 0x7f86ec0707d0 2024-04-25T19:23:40.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.434+0000 7f86f3200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec0d0860 con 0x7f86ec0b0800 2024-04-25T19:23:40.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.434+0000 7f86f3200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f86ec0b0d90 con 0x7f86ec0cf9e0 2024-04-25T19:23:40.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.435+0000 7f86f1e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ec0707d0 0x7f86ec14a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:40.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.435+0000 7f86f1e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ec0707d0 0x7f86ec14a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51736/0 (socket says 172.21.15.131:51736) 2024-04-25T19:23:40.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.435+0000 7f86f1e00640 1 -- 172.21.15.131:0/2632149994 learned_addr learned my addr 172.21.15.131:0/2632149994 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:40.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.435+0000 7f86f1e00640 1 -- 172.21.15.131:0/2632149994 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86ec0cf9e0 msgr2=0x7f86ec162930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:40.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.435+0000 7f86f1e00640 1 --2- 172.21.15.131:0/2632149994 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86ec0cf9e0 0x7f86ec162930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:40.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.435+0000 7f86f1e00640 1 -- 172.21.15.131:0/2632149994 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86ec0b0800 msgr2=0x7f86ec1eb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:40.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.435+0000 7f86f1400640 1 --2- 172.21.15.131:0/2632149994 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86ec0b0800 0x7f86ec1eb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:40.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.435+0000 7f86f1e00640 1 --2- 172.21.15.131:0/2632149994 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86ec0b0800 0x7f86ec1eb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:40.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.435+0000 7f86f1e00640 1 -- 172.21.15.131:0/2632149994 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86ec0b74e0 con 0x7f86ec0707d0 2024-04-25T19:23:40.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.435+0000 7f86f1e00640 1 --2- 172.21.15.131:0/2632149994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ec0707d0 0x7f86ec14a360 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f86e000c820 tx=0x7f86e000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:40.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.436+0000 7f86e6000640 1 -- 172.21.15.131:0/2632149994 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e0015070 con 0x7f86ec0707d0 2024-04-25T19:23:40.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.436+0000 7f86e6000640 1 -- 172.21.15.131:0/2632149994 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86e0007a30 con 0x7f86ec0707d0 2024-04-25T19:23:40.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.436+0000 7f86f3200640 1 -- 172.21.15.131:0/2632149994 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86ec0b7a60 con 0x7f86ec0707d0 2024-04-25T19:23:40.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.436+0000 7f86e6000640 1 -- 172.21.15.131:0/2632149994 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e0007e20 con 0x7f86ec0707d0 2024-04-25T19:23:40.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.436+0000 7f86f3200640 1 -- 172.21.15.131:0/2632149994 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86ec1f6370 con 0x7f86ec0707d0 2024-04-25T19:23:40.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.437+0000 7f86f3200640 1 -- 172.21.15.131:0/2632149994 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86ec0b7240 con 0x7f86ec0707d0 2024-04-25T19:23:40.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.438+0000 7f86e6000640 1 -- 172.21.15.131:0/2632149994 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f86e0018070 con 0x7f86ec0707d0 2024-04-25T19:23:40.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.439+0000 7f86e6000640 1 --2- 172.21.15.131:0/2632149994 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f86d00744b0 0x7f86d00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:40.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.439+0000 7f86e6000640 1 -- 172.21.15.131:0/2632149994 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f86e0094ef0 con 0x7f86ec0707d0 2024-04-25T19:23:40.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.440+0000 7f86f1400640 1 --2- 172.21.15.131:0/2632149994 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f86d00744b0 0x7f86d00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:40.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.441+0000 7f86f1400640 1 --2- 172.21.15.131:0/2632149994 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f86d00744b0 0x7f86d00769c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f86dc034000 tx=0x7f86dc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:40.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.444+0000 7f86e6000640 1 -- 172.21.15.131:0/2632149994 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f86ec0b7240 con 0x7f86ec0707d0 2024-04-25T19:23:40.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.631+0000 7f86f3200640 1 -- 172.21.15.131:0/2632149994 --> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f86ec1ebb20 con 0x7f86d00744b0 2024-04-25T19:23:40.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.650+0000 7f86e6000640 1 -- 172.21.15.131:0/2632149994 <== mgr.4105 v2:172.21.15.195:6832/2541913764 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251939 (secure 0 0 0) 0x7f86ec1ebb20 con 0x7f86d00744b0 2024-04-25T19:23:40.655 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:40.657 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-04-25T19:23:40.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.656+0000 7f86f3200640 1 -- 172.21.15.131:0/2632149994 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f86d00744b0 msgr2=0x7f86d00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:40.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.656+0000 7f86f3200640 1 --2- 172.21.15.131:0/2632149994 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f86d00744b0 0x7f86d00769c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f86dc034000 tx=0x7f86dc02e000 comp rx=0 tx=0).stop 2024-04-25T19:23:40.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.656+0000 7f86f3200640 1 -- 172.21.15.131:0/2632149994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ec0707d0 msgr2=0x7f86ec14a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:40.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.656+0000 7f86f3200640 1 --2- 172.21.15.131:0/2632149994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ec0707d0 0x7f86ec14a360 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f86e000c820 tx=0x7f86e000cce0 comp rx=0 tx=0).stop 2024-04-25T19:23:40.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.656+0000 7f86f3200640 1 -- 172.21.15.131:0/2632149994 shutdown_connections 2024-04-25T19:23:40.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.656+0000 7f86f3200640 1 --2- 172.21.15.131:0/2632149994 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f86d00744b0 0x7f86d00769c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:40.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.656+0000 7f86f3200640 1 --2- 172.21.15.131:0/2632149994 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86ec0cf9e0 0x7f86ec162930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:40.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.656+0000 7f86f3200640 1 --2- 172.21.15.131:0/2632149994 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86ec0b0800 0x7f86ec1eb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:40.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.656+0000 7f86f3200640 1 --2- 172.21.15.131:0/2632149994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ec0707d0 0x7f86ec14a360 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:40.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.656+0000 7f86f3200640 1 -- 172.21.15.131:0/2632149994 >> 172.21.15.131:0/2632149994 conn(0x7f86ec0d1720 msgr2=0x7f86ec073610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:40.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.656+0000 7f86f3200640 1 -- 172.21.15.131:0/2632149994 shutdown_connections 2024-04-25T19:23:40.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:40.656+0000 7f86f3200640 1 -- 172.21.15.131:0/2632149994 wait complete. 2024-04-25T19:23:40.684 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-04-25T19:23:40.169061+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236940,"kb_used_data":4136,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737780,"statfs":{"total":773094113280,"available":772851486720,"internally_reserved":0,"allocated":4235264,"data_stored":2358420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.337836"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.967899+0000","last_change":"2024-04-25T19:23:34.867693+0000","last_active":"2024-04-25T19:23:35.967899+0000","last_peered":"2024-04-25T19:23:35.967899+0000","last_clean":"2024-04-25T19:23:35.967899+0000","last_became_active":"2024-04-25T19:23:34.867366+0000","last_became_peered":"2024-04-25T19:23:34.867366+0000","last_unstale":"2024-04-25T19:23:35.967899+0000","last_undegraded":"2024-04-25T19:23:35.967899+0000","last_fullsized":"2024-04-25T19:23:35.967899+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:05.430035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.966511+0000","last_change":"2024-04-25T19:23:34.876857+0000","last_active":"2024-04-25T19:23:35.966511+0000","last_peered":"2024-04-25T19:23:35.966511+0000","last_clean":"2024-04-25T19:23:35.966511+0000","last_became_active":"2024-04-25T19:23:34.874632+0000","last_became_peered":"2024-04-25T19:23:34.874632+0000","last_unstale":"2024-04-25T19:23:35.966511+0000","last_undegraded":"2024-04-25T19:23:35.966511+0000","last_fullsized":"2024-04-25T19:23:35.966511+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:03.921924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.881249+0000","last_change":"2024-04-25T19:23:34.884258+0000","last_active":"2024-04-25T19:23:35.881249+0000","last_peered":"2024-04-25T19:23:35.881249+0000","last_clean":"2024-04-25T19:23:35.881249+0000","last_became_active":"2024-04-25T19:23:34.883917+0000","last_became_peered":"2024-04-25T19:23:34.883917+0000","last_unstale":"2024-04-25T19:23:35.881249+0000","last_undegraded":"2024-04-25T19:23:35.881249+0000","last_fullsized":"2024-04-25T19:23:35.881249+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:12:01.307874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882586+0000","last_change":"2024-04-25T19:23:34.884212+0000","last_active":"2024-04-25T19:23:35.882586+0000","last_peered":"2024-04-25T19:23:35.882586+0000","last_clean":"2024-04-25T19:23:35.882586+0000","last_became_active":"2024-04-25T19:23:34.883545+0000","last_became_peered":"2024-04-25T19:23:34.883545+0000","last_unstale":"2024-04-25T19:23:35.882586+0000","last_undegraded":"2024-04-25T19:23:35.882586+0000","last_fullsized":"2024-04-25T19:23:35.882586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:27.032825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.964061+0000","last_change":"2024-04-25T19:23:34.866307+0000","last_active":"2024-04-25T19:23:35.964061+0000","last_peered":"2024-04-25T19:23:35.964061+0000","last_clean":"2024-04-25T19:23:35.964061+0000","last_became_active":"2024-04-25T19:23:34.865877+0000","last_became_peered":"2024-04-25T19:23:34.865877+0000","last_unstale":"2024-04-25T19:23:35.964061+0000","last_undegraded":"2024-04-25T19:23:35.964061+0000","last_fullsized":"2024-04-25T19:23:35.964061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:27.964742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965594+0000","last_change":"2024-04-25T19:23:34.862481+0000","last_active":"2024-04-25T19:23:35.965594+0000","last_peered":"2024-04-25T19:23:35.965594+0000","last_clean":"2024-04-25T19:23:35.965594+0000","last_became_active":"2024-04-25T19:23:34.862068+0000","last_became_peered":"2024-04-25T19:23:34.862068+0000","last_unstale":"2024-04-25T19:23:35.965594+0000","last_undegraded":"2024-04-25T19:23:35.965594+0000","last_fullsized":"2024-04-25T19:23:35.965594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:44:01.779997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.967634+0000","last_change":"2024-04-25T19:23:34.880256+0000","last_active":"2024-04-25T19:23:35.967634+0000","last_peered":"2024-04-25T19:23:35.967634+0000","last_clean":"2024-04-25T19:23:35.967634+0000","last_became_active":"2024-04-25T19:23:34.879974+0000","last_became_peered":"2024-04-25T19:23:34.879974+0000","last_unstale":"2024-04-25T19:23:35.967634+0000","last_undegraded":"2024-04-25T19:23:35.967634+0000","last_fullsized":"2024-04-25T19:23:35.967634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:38.266247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.967058+0000","last_change":"2024-04-25T19:23:34.878985+0000","last_active":"2024-04-25T19:23:35.967058+0000","last_peered":"2024-04-25T19:23:35.967058+0000","last_clean":"2024-04-25T19:23:35.967058+0000","last_became_active":"2024-04-25T19:23:34.878612+0000","last_became_peered":"2024-04-25T19:23:34.878612+0000","last_unstale":"2024-04-25T19:23:35.967058+0000","last_undegraded":"2024-04-25T19:23:35.967058+0000","last_fullsized":"2024-04-25T19:23:35.967058+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:50.863400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880504+0000","last_change":"2024-04-25T19:23:34.881612+0000","last_active":"2024-04-25T19:23:35.880504+0000","last_peered":"2024-04-25T19:23:35.880504+0000","last_clean":"2024-04-25T19:23:35.880504+0000","last_became_active":"2024-04-25T19:23:34.881317+0000","last_became_peered":"2024-04-25T19:23:34.881317+0000","last_unstale":"2024-04-25T19:23:35.880504+0000","last_undegraded":"2024-04-25T19:23:35.880504+0000","last_fullsized":"2024-04-25T19:23:35.880504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:34.075093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.883031+0000","last_change":"2024-04-25T19:23:34.878492+0000","last_active":"2024-04-25T19:23:35.883031+0000","last_peered":"2024-04-25T19:23:35.883031+0000","last_clean":"2024-04-25T19:23:35.883031+0000","last_became_active":"2024-04-25T19:23:34.878151+0000","last_became_peered":"2024-04-25T19:23:34.878151+0000","last_unstale":"2024-04-25T19:23:35.883031+0000","last_undegraded":"2024-04-25T19:23:35.883031+0000","last_fullsized":"2024-04-25T19:23:35.883031+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:38.266247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.969637+0000","last_change":"2024-04-25T19:23:34.882973+0000","last_active":"2024-04-25T19:23:35.969637+0000","last_peered":"2024-04-25T19:23:35.969637+0000","last_clean":"2024-04-25T19:23:35.969637+0000","last_became_active":"2024-04-25T19:23:34.882656+0000","last_became_peered":"2024-04-25T19:23:34.882656+0000","last_unstale":"2024-04-25T19:23:35.969637+0000","last_undegraded":"2024-04-25T19:23:35.969637+0000","last_fullsized":"2024-04-25T19:23:35.969637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:53.321590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.881523+0000","last_change":"2024-04-25T19:23:34.864005+0000","last_active":"2024-04-25T19:23:35.881523+0000","last_peered":"2024-04-25T19:23:35.881523+0000","last_clean":"2024-04-25T19:23:35.881523+0000","last_became_active":"2024-04-25T19:23:34.863664+0000","last_became_peered":"2024-04-25T19:23:34.863664+0000","last_unstale":"2024-04-25T19:23:35.881523+0000","last_undegraded":"2024-04-25T19:23:35.881523+0000","last_fullsized":"2024-04-25T19:23:35.881523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:44:01.779997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.964086+0000","last_change":"2024-04-25T19:23:34.874078+0000","last_active":"2024-04-25T19:23:35.964086+0000","last_peered":"2024-04-25T19:23:35.964086+0000","last_clean":"2024-04-25T19:23:35.964086+0000","last_became_active":"2024-04-25T19:23:34.873735+0000","last_became_peered":"2024-04-25T19:23:34.873735+0000","last_unstale":"2024-04-25T19:23:35.964086+0000","last_undegraded":"2024-04-25T19:23:35.964086+0000","last_fullsized":"2024-04-25T19:23:35.964086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:57:00.631705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965594+0000","last_change":"2024-04-25T19:23:34.861100+0000","last_active":"2024-04-25T19:23:35.965594+0000","last_peered":"2024-04-25T19:23:35.965594+0000","last_clean":"2024-04-25T19:23:35.965594+0000","last_became_active":"2024-04-25T19:23:34.860162+0000","last_became_peered":"2024-04-25T19:23:34.860162+0000","last_unstale":"2024-04-25T19:23:35.965594+0000","last_undegraded":"2024-04-25T19:23:35.965594+0000","last_fullsized":"2024-04-25T19:23:35.965594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:13:21.629386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880387+0000","last_change":"2024-04-25T19:23:34.865302+0000","last_active":"2024-04-25T19:23:35.880387+0000","last_peered":"2024-04-25T19:23:35.880387+0000","last_clean":"2024-04-25T19:23:35.880387+0000","last_became_active":"2024-04-25T19:23:34.864920+0000","last_became_peered":"2024-04-25T19:23:34.864920+0000","last_unstale":"2024-04-25T19:23:35.880387+0000","last_undegraded":"2024-04-25T19:23:35.880387+0000","last_fullsized":"2024-04-25T19:23:35.880387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:38.266247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.969557+0000","last_change":"2024-04-25T19:23:34.878134+0000","last_active":"2024-04-25T19:23:35.969557+0000","last_peered":"2024-04-25T19:23:35.969557+0000","last_clean":"2024-04-25T19:23:35.969557+0000","last_became_active":"2024-04-25T19:23:34.873035+0000","last_became_peered":"2024-04-25T19:23:34.873035+0000","last_unstale":"2024-04-25T19:23:35.969557+0000","last_undegraded":"2024-04-25T19:23:35.969557+0000","last_fullsized":"2024-04-25T19:23:35.969557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:28.601231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.969347+0000","last_change":"2024-04-25T19:23:34.881996+0000","last_active":"2024-04-25T19:23:35.969347+0000","last_peered":"2024-04-25T19:23:35.969347+0000","last_clean":"2024-04-25T19:23:35.969347+0000","last_became_active":"2024-04-25T19:23:34.879575+0000","last_became_peered":"2024-04-25T19:23:34.879575+0000","last_unstale":"2024-04-25T19:23:35.969347+0000","last_undegraded":"2024-04-25T19:23:35.969347+0000","last_fullsized":"2024-04-25T19:23:35.969347+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:42:43.538944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.966552+0000","last_change":"2024-04-25T19:23:34.882530+0000","last_active":"2024-04-25T19:23:35.966552+0000","last_peered":"2024-04-25T19:23:35.966552+0000","last_clean":"2024-04-25T19:23:35.966552+0000","last_became_active":"2024-04-25T19:23:34.882177+0000","last_became_peered":"2024-04-25T19:23:34.882177+0000","last_unstale":"2024-04-25T19:23:35.966552+0000","last_undegraded":"2024-04-25T19:23:35.966552+0000","last_fullsized":"2024-04-25T19:23:35.966552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:05:02.728856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965977+0000","last_change":"2024-04-25T19:23:34.881785+0000","last_active":"2024-04-25T19:23:35.965977+0000","last_peered":"2024-04-25T19:23:35.965977+0000","last_clean":"2024-04-25T19:23:35.965977+0000","last_became_active":"2024-04-25T19:23:34.880764+0000","last_became_peered":"2024-04-25T19:23:34.880764+0000","last_unstale":"2024-04-25T19:23:35.965977+0000","last_undegraded":"2024-04-25T19:23:35.965977+0000","last_fullsized":"2024-04-25T19:23:35.965977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:28.601231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.964648+0000","last_change":"2024-04-25T19:23:34.865442+0000","last_active":"2024-04-25T19:23:35.964648+0000","last_peered":"2024-04-25T19:23:35.964648+0000","last_clean":"2024-04-25T19:23:35.964648+0000","last_became_active":"2024-04-25T19:23:34.865135+0000","last_became_peered":"2024-04-25T19:23:34.865135+0000","last_unstale":"2024-04-25T19:23:35.964648+0000","last_undegraded":"2024-04-25T19:23:35.964648+0000","last_fullsized":"2024-04-25T19:23:35.964648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:43.217717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.879611+0000","last_change":"2024-04-25T19:23:34.883923+0000","last_active":"2024-04-25T19:23:35.879611+0000","last_peered":"2024-04-25T19:23:35.879611+0000","last_clean":"2024-04-25T19:23:35.879611+0000","last_became_active":"2024-04-25T19:23:34.879560+0000","last_became_peered":"2024-04-25T19:23:34.879560+0000","last_unstale":"2024-04-25T19:23:35.879611+0000","last_undegraded":"2024-04-25T19:23:35.879611+0000","last_fullsized":"2024-04-25T19:23:35.879611+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:00:08.044331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880586+0000","last_change":"2024-04-25T19:23:34.866849+0000","last_active":"2024-04-25T19:23:35.880586+0000","last_peered":"2024-04-25T19:23:35.880586+0000","last_clean":"2024-04-25T19:23:35.880586+0000","last_became_active":"2024-04-25T19:23:34.866413+0000","last_became_peered":"2024-04-25T19:23:34.866413+0000","last_unstale":"2024-04-25T19:23:35.880586+0000","last_undegraded":"2024-04-25T19:23:35.880586+0000","last_fullsized":"2024-04-25T19:23:35.880586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:10.762030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876078+0000","last_change":"2024-04-25T19:23:34.871608+0000","last_active":"2024-04-25T19:23:35.876078+0000","last_peered":"2024-04-25T19:23:35.876078+0000","last_clean":"2024-04-25T19:23:35.876078+0000","last_became_active":"2024-04-25T19:23:34.871267+0000","last_became_peered":"2024-04-25T19:23:34.871267+0000","last_unstale":"2024-04-25T19:23:35.876078+0000","last_undegraded":"2024-04-25T19:23:35.876078+0000","last_fullsized":"2024-04-25T19:23:35.876078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:05.430035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.878558+0000","last_change":"2024-04-25T19:23:34.875883+0000","last_active":"2024-04-25T19:23:35.878558+0000","last_peered":"2024-04-25T19:23:35.878558+0000","last_clean":"2024-04-25T19:23:35.878558+0000","last_became_active":"2024-04-25T19:23:34.875534+0000","last_became_peered":"2024-04-25T19:23:34.875534+0000","last_unstale":"2024-04-25T19:23:35.878558+0000","last_undegraded":"2024-04-25T19:23:35.878558+0000","last_fullsized":"2024-04-25T19:23:35.878558+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:48.768523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882696+0000","last_change":"2024-04-25T19:23:34.884658+0000","last_active":"2024-04-25T19:23:35.882696+0000","last_peered":"2024-04-25T19:23:35.882696+0000","last_clean":"2024-04-25T19:23:35.882696+0000","last_became_active":"2024-04-25T19:23:34.883491+0000","last_became_peered":"2024-04-25T19:23:34.883491+0000","last_unstale":"2024-04-25T19:23:35.882696+0000","last_undegraded":"2024-04-25T19:23:35.882696+0000","last_fullsized":"2024-04-25T19:23:35.882696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:47:22.676497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.966674+0000","last_change":"2024-04-25T19:23:34.869510+0000","last_active":"2024-04-25T19:23:35.966674+0000","last_peered":"2024-04-25T19:23:35.966674+0000","last_clean":"2024-04-25T19:23:35.966674+0000","last_became_active":"2024-04-25T19:23:34.869160+0000","last_became_peered":"2024-04-25T19:23:34.869160+0000","last_unstale":"2024-04-25T19:23:35.966674+0000","last_undegraded":"2024-04-25T19:23:35.966674+0000","last_fullsized":"2024-04-25T19:23:35.966674+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:10.419265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882907+0000","last_change":"2024-04-25T19:23:34.884515+0000","last_active":"2024-04-25T19:23:35.882907+0000","last_peered":"2024-04-25T19:23:35.882907+0000","last_clean":"2024-04-25T19:23:35.882907+0000","last_became_active":"2024-04-25T19:23:34.884123+0000","last_became_peered":"2024-04-25T19:23:34.884123+0000","last_unstale":"2024-04-25T19:23:35.882907+0000","last_undegraded":"2024-04-25T19:23:35.882907+0000","last_fullsized":"2024-04-25T19:23:35.882907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:50.863400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.881873+0000","last_change":"2024-04-25T19:23:34.869345+0000","last_active":"2024-04-25T19:23:35.881873+0000","last_peered":"2024-04-25T19:23:35.881873+0000","last_clean":"2024-04-25T19:23:35.881873+0000","last_became_active":"2024-04-25T19:23:34.867833+0000","last_became_peered":"2024-04-25T19:23:34.867833+0000","last_unstale":"2024-04-25T19:23:35.881873+0000","last_undegraded":"2024-04-25T19:23:35.881873+0000","last_fullsized":"2024-04-25T19:23:35.881873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:13:21.629386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.879765+0000","last_change":"2024-04-25T19:23:34.863884+0000","last_active":"2024-04-25T19:23:35.879765+0000","last_peered":"2024-04-25T19:23:35.879765+0000","last_clean":"2024-04-25T19:23:35.879765+0000","last_became_active":"2024-04-25T19:23:34.863497+0000","last_became_peered":"2024-04-25T19:23:34.863497+0000","last_unstale":"2024-04-25T19:23:35.879765+0000","last_undegraded":"2024-04-25T19:23:35.879765+0000","last_fullsized":"2024-04-25T19:23:35.879765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:11.081868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.967665+0000","last_change":"2024-04-25T19:23:34.867175+0000","last_active":"2024-04-25T19:23:35.967665+0000","last_peered":"2024-04-25T19:23:35.967665+0000","last_clean":"2024-04-25T19:23:35.967665+0000","last_became_active":"2024-04-25T19:23:34.866604+0000","last_became_peered":"2024-04-25T19:23:34.866604+0000","last_unstale":"2024-04-25T19:23:35.967665+0000","last_undegraded":"2024-04-25T19:23:35.967665+0000","last_fullsized":"2024-04-25T19:23:35.967665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:01.314162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.967920+0000","last_change":"2024-04-25T19:23:34.878585+0000","last_active":"2024-04-25T19:23:35.967920+0000","last_peered":"2024-04-25T19:23:35.967920+0000","last_clean":"2024-04-25T19:23:35.967920+0000","last_became_active":"2024-04-25T19:23:34.874819+0000","last_became_peered":"2024-04-25T19:23:34.874819+0000","last_unstale":"2024-04-25T19:23:35.967920+0000","last_undegraded":"2024-04-25T19:23:35.967920+0000","last_fullsized":"2024-04-25T19:23:35.967920+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:00:08.044331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.968487+0000","last_change":"2024-04-25T19:23:34.885533+0000","last_active":"2024-04-25T19:23:35.968487+0000","last_peered":"2024-04-25T19:23:35.968487+0000","last_clean":"2024-04-25T19:23:35.968487+0000","last_became_active":"2024-04-25T19:23:34.885171+0000","last_became_peered":"2024-04-25T19:23:34.885171+0000","last_unstale":"2024-04-25T19:23:35.968487+0000","last_undegraded":"2024-04-25T19:23:35.968487+0000","last_fullsized":"2024-04-25T19:23:35.968487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:12:01.307874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876755+0000","last_change":"2024-04-25T19:23:34.877363+0000","last_active":"2024-04-25T19:23:35.876755+0000","last_peered":"2024-04-25T19:23:35.876755+0000","last_clean":"2024-04-25T19:23:35.876755+0000","last_became_active":"2024-04-25T19:23:34.877059+0000","last_became_peered":"2024-04-25T19:23:34.877059+0000","last_unstale":"2024-04-25T19:23:35.876755+0000","last_undegraded":"2024-04-25T19:23:35.876755+0000","last_fullsized":"2024-04-25T19:23:35.876755+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:34.075093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.968221+0000","last_change":"2024-04-25T19:23:33.869661+0000","last_active":"2024-04-25T19:23:35.968221+0000","last_peered":"2024-04-25T19:23:35.968221+0000","last_clean":"2024-04-25T19:23:35.968221+0000","last_became_active":"2024-04-25T19:23:33.869333+0000","last_became_peered":"2024-04-25T19:23:33.869333+0000","last_unstale":"2024-04-25T19:23:35.968221+0000","last_undegraded":"2024-04-25T19:23:35.968221+0000","last_fullsized":"2024-04-25T19:23:35.968221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:29.370419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.968291+0000","last_change":"2024-04-25T19:23:34.872260+0000","last_active":"2024-04-25T19:23:35.968291+0000","last_peered":"2024-04-25T19:23:35.968291+0000","last_clean":"2024-04-25T19:23:35.968291+0000","last_became_active":"2024-04-25T19:23:34.871927+0000","last_became_peered":"2024-04-25T19:23:34.871927+0000","last_unstale":"2024-04-25T19:23:35.968291+0000","last_undegraded":"2024-04-25T19:23:35.968291+0000","last_fullsized":"2024-04-25T19:23:35.968291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:34.178623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876893+0000","last_change":"2024-04-25T19:23:33.862637+0000","last_active":"2024-04-25T19:23:35.876893+0000","last_peered":"2024-04-25T19:23:35.876893+0000","last_clean":"2024-04-25T19:23:35.876893+0000","last_became_active":"2024-04-25T19:23:33.862409+0000","last_became_peered":"2024-04-25T19:23:33.862409+0000","last_unstale":"2024-04-25T19:23:35.876893+0000","last_undegraded":"2024-04-25T19:23:35.876893+0000","last_fullsized":"2024-04-25T19:23:35.876893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:42.202405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.879858+0000","last_change":"2024-04-25T19:23:34.879297+0000","last_active":"2024-04-25T19:23:35.879858+0000","last_peered":"2024-04-25T19:23:35.879858+0000","last_clean":"2024-04-25T19:23:35.879858+0000","last_became_active":"2024-04-25T19:23:34.876596+0000","last_became_peered":"2024-04-25T19:23:34.876596+0000","last_unstale":"2024-04-25T19:23:35.879858+0000","last_undegraded":"2024-04-25T19:23:35.879858+0000","last_fullsized":"2024-04-25T19:23:35.879858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:05.430035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.966027+0000","last_change":"2024-04-25T19:23:33.861801+0000","last_active":"2024-04-25T19:23:35.966027+0000","last_peered":"2024-04-25T19:23:35.966027+0000","last_clean":"2024-04-25T19:23:35.966027+0000","last_became_active":"2024-04-25T19:23:33.861477+0000","last_became_peered":"2024-04-25T19:23:33.861477+0000","last_unstale":"2024-04-25T19:23:35.966027+0000","last_undegraded":"2024-04-25T19:23:35.966027+0000","last_fullsized":"2024-04-25T19:23:35.966027+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:10.066556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.883088+0000","last_change":"2024-04-25T19:23:34.890813+0000","last_active":"2024-04-25T19:23:35.883088+0000","last_peered":"2024-04-25T19:23:35.883088+0000","last_clean":"2024-04-25T19:23:35.883088+0000","last_became_active":"2024-04-25T19:23:34.889398+0000","last_became_peered":"2024-04-25T19:23:34.889398+0000","last_unstale":"2024-04-25T19:23:35.883088+0000","last_undegraded":"2024-04-25T19:23:35.883088+0000","last_fullsized":"2024-04-25T19:23:35.883088+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:01.314162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965032+0000","last_change":"2024-04-25T19:23:33.861932+0000","last_active":"2024-04-25T19:23:35.965032+0000","last_peered":"2024-04-25T19:23:35.965032+0000","last_clean":"2024-04-25T19:23:35.965032+0000","last_became_active":"2024-04-25T19:23:33.860394+0000","last_became_peered":"2024-04-25T19:23:33.860394+0000","last_unstale":"2024-04-25T19:23:35.965032+0000","last_undegraded":"2024-04-25T19:23:35.965032+0000","last_fullsized":"2024-04-25T19:23:35.965032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:30:21.396542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.968756+0000","last_change":"2024-04-25T19:23:34.877686+0000","last_active":"2024-04-25T19:23:35.968756+0000","last_peered":"2024-04-25T19:23:35.968756+0000","last_clean":"2024-04-25T19:23:35.968756+0000","last_became_active":"2024-04-25T19:23:34.876701+0000","last_became_peered":"2024-04-25T19:23:34.876701+0000","last_unstale":"2024-04-25T19:23:35.968756+0000","last_undegraded":"2024-04-25T19:23:35.968756+0000","last_fullsized":"2024-04-25T19:23:35.968756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:49.384633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880075+0000","last_change":"2024-04-25T19:23:33.861192+0000","last_active":"2024-04-25T19:23:35.880075+0000","last_peered":"2024-04-25T19:23:35.880075+0000","last_clean":"2024-04-25T19:23:35.880075+0000","last_became_active":"2024-04-25T19:23:33.860848+0000","last_became_peered":"2024-04-25T19:23:33.860848+0000","last_unstale":"2024-04-25T19:23:35.880075+0000","last_undegraded":"2024-04-25T19:23:35.880075+0000","last_fullsized":"2024-04-25T19:23:35.880075+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:10:33.260974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880892+0000","last_change":"2024-04-25T19:23:34.868910+0000","last_active":"2024-04-25T19:23:35.880892+0000","last_peered":"2024-04-25T19:23:35.880892+0000","last_clean":"2024-04-25T19:23:35.880892+0000","last_became_active":"2024-04-25T19:23:34.868475+0000","last_became_peered":"2024-04-25T19:23:34.868475+0000","last_unstale":"2024-04-25T19:23:35.880892+0000","last_undegraded":"2024-04-25T19:23:35.880892+0000","last_fullsized":"2024-04-25T19:23:35.880892+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:01.314162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880941+0000","last_change":"2024-04-25T19:23:33.859288+0000","last_active":"2024-04-25T19:23:35.880941+0000","last_peered":"2024-04-25T19:23:35.880941+0000","last_clean":"2024-04-25T19:23:35.880941+0000","last_became_active":"2024-04-25T19:23:33.858841+0000","last_became_peered":"2024-04-25T19:23:33.858841+0000","last_unstale":"2024-04-25T19:23:35.880941+0000","last_undegraded":"2024-04-25T19:23:35.880941+0000","last_fullsized":"2024-04-25T19:23:35.880941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:56:59.616393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.879395+0000","last_change":"2024-04-25T19:23:34.874492+0000","last_active":"2024-04-25T19:23:35.879395+0000","last_peered":"2024-04-25T19:23:35.879395+0000","last_clean":"2024-04-25T19:23:35.879395+0000","last_became_active":"2024-04-25T19:23:34.874045+0000","last_became_peered":"2024-04-25T19:23:34.874045+0000","last_unstale":"2024-04-25T19:23:35.879395+0000","last_undegraded":"2024-04-25T19:23:35.879395+0000","last_fullsized":"2024-04-25T19:23:35.879395+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:46.850558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965400+0000","last_change":"2024-04-25T19:23:33.853794+0000","last_active":"2024-04-25T19:23:35.965400+0000","last_peered":"2024-04-25T19:23:35.965400+0000","last_clean":"2024-04-25T19:23:35.965400+0000","last_became_active":"2024-04-25T19:23:33.853451+0000","last_became_peered":"2024-04-25T19:23:33.853451+0000","last_unstale":"2024-04-25T19:23:35.965400+0000","last_undegraded":"2024-04-25T19:23:35.965400+0000","last_fullsized":"2024-04-25T19:23:35.965400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:20:43.666409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882941+0000","last_change":"2024-04-25T19:23:34.879256+0000","last_active":"2024-04-25T19:23:35.882941+0000","last_peered":"2024-04-25T19:23:35.882941+0000","last_clean":"2024-04-25T19:23:35.882941+0000","last_became_active":"2024-04-25T19:23:34.878927+0000","last_became_peered":"2024-04-25T19:23:34.878927+0000","last_unstale":"2024-04-25T19:23:35.882941+0000","last_undegraded":"2024-04-25T19:23:35.882941+0000","last_fullsized":"2024-04-25T19:23:35.882941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:48.768523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.879439+0000","last_change":"2024-04-25T19:23:33.861563+0000","last_active":"2024-04-25T19:23:35.879439+0000","last_peered":"2024-04-25T19:23:35.879439+0000","last_clean":"2024-04-25T19:23:35.879439+0000","last_became_active":"2024-04-25T19:23:33.859069+0000","last_became_peered":"2024-04-25T19:23:33.859069+0000","last_unstale":"2024-04-25T19:23:35.879439+0000","last_undegraded":"2024-04-25T19:23:35.879439+0000","last_fullsized":"2024-04-25T19:23:35.879439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:31:03.100180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.881916+0000","last_change":"2024-04-25T19:23:34.868229+0000","last_active":"2024-04-25T19:23:35.881916+0000","last_peered":"2024-04-25T19:23:35.881916+0000","last_clean":"2024-04-25T19:23:35.881916+0000","last_became_active":"2024-04-25T19:23:34.867693+0000","last_became_peered":"2024-04-25T19:23:34.867693+0000","last_unstale":"2024-04-25T19:23:35.881916+0000","last_undegraded":"2024-04-25T19:23:35.881916+0000","last_fullsized":"2024-04-25T19:23:35.881916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:28.601231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.966342+0000","last_change":"2024-04-25T19:23:33.867663+0000","last_active":"2024-04-25T19:23:35.966342+0000","last_peered":"2024-04-25T19:23:35.966342+0000","last_clean":"2024-04-25T19:23:35.966342+0000","last_became_active":"2024-04-25T19:23:33.867106+0000","last_became_peered":"2024-04-25T19:23:33.867106+0000","last_unstale":"2024-04-25T19:23:35.966342+0000","last_undegraded":"2024-04-25T19:23:35.966342+0000","last_fullsized":"2024-04-25T19:23:35.966342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:00:07.029019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.966209+0000","last_change":"2024-04-25T19:23:34.885804+0000","last_active":"2024-04-25T19:23:35.966209+0000","last_peered":"2024-04-25T19:23:35.966209+0000","last_clean":"2024-04-25T19:23:35.966209+0000","last_became_active":"2024-04-25T19:23:34.885410+0000","last_became_peered":"2024-04-25T19:23:34.885410+0000","last_unstale":"2024-04-25T19:23:35.966209+0000","last_undegraded":"2024-04-25T19:23:35.966209+0000","last_fullsized":"2024-04-25T19:23:35.966209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:13.843985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876849+0000","last_change":"2024-04-25T19:23:33.853876+0000","last_active":"2024-04-25T19:23:35.876849+0000","last_peered":"2024-04-25T19:23:35.876849+0000","last_clean":"2024-04-25T19:23:35.876849+0000","last_became_active":"2024-04-25T19:23:33.853522+0000","last_became_peered":"2024-04-25T19:23:33.853522+0000","last_unstale":"2024-04-25T19:23:35.876849+0000","last_undegraded":"2024-04-25T19:23:35.876849+0000","last_fullsized":"2024-04-25T19:23:35.876849+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:29.370419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.966150+0000","last_change":"2024-04-25T19:23:34.870953+0000","last_active":"2024-04-25T19:23:35.966150+0000","last_peered":"2024-04-25T19:23:35.966150+0000","last_clean":"2024-04-25T19:23:35.966150+0000","last_became_active":"2024-04-25T19:23:34.870048+0000","last_became_peered":"2024-04-25T19:23:34.870048+0000","last_unstale":"2024-04-25T19:23:35.966150+0000","last_undegraded":"2024-04-25T19:23:35.966150+0000","last_fullsized":"2024-04-25T19:23:35.966150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:53.321590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.881352+0000","last_change":"2024-04-25T19:23:33.871669+0000","last_active":"2024-04-25T19:23:35.881352+0000","last_peered":"2024-04-25T19:23:35.881352+0000","last_clean":"2024-04-25T19:23:35.881352+0000","last_became_active":"2024-04-25T19:23:33.870470+0000","last_became_peered":"2024-04-25T19:23:33.870470+0000","last_unstale":"2024-04-25T19:23:35.881352+0000","last_undegraded":"2024-04-25T19:23:35.881352+0000","last_fullsized":"2024-04-25T19:23:35.881352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:15.587996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.881327+0000","last_change":"2024-04-25T19:23:34.888624+0000","last_active":"2024-04-25T19:23:35.881327+0000","last_peered":"2024-04-25T19:23:35.881327+0000","last_clean":"2024-04-25T19:23:35.881327+0000","last_became_active":"2024-04-25T19:23:34.888261+0000","last_became_peered":"2024-04-25T19:23:34.888261+0000","last_unstale":"2024-04-25T19:23:35.881327+0000","last_undegraded":"2024-04-25T19:23:35.881327+0000","last_fullsized":"2024-04-25T19:23:35.881327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:49.384633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.966302+0000","last_change":"2024-04-25T19:23:33.859210+0000","last_active":"2024-04-25T19:23:35.966302+0000","last_peered":"2024-04-25T19:23:35.966302+0000","last_clean":"2024-04-25T19:23:35.966302+0000","last_became_active":"2024-04-25T19:23:33.858457+0000","last_became_peered":"2024-04-25T19:23:33.858457+0000","last_unstale":"2024-04-25T19:23:35.966302+0000","last_undegraded":"2024-04-25T19:23:35.966302+0000","last_fullsized":"2024-04-25T19:23:35.966302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:15.587996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882123+0000","last_change":"2024-04-25T19:23:34.880105+0000","last_active":"2024-04-25T19:23:35.882123+0000","last_peered":"2024-04-25T19:23:35.882123+0000","last_clean":"2024-04-25T19:23:35.882123+0000","last_became_active":"2024-04-25T19:23:34.879850+0000","last_became_peered":"2024-04-25T19:23:34.879850+0000","last_unstale":"2024-04-25T19:23:35.882123+0000","last_undegraded":"2024-04-25T19:23:35.882123+0000","last_fullsized":"2024-04-25T19:23:35.882123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:10.762030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880540+0000","last_change":"2024-04-25T19:23:33.859947+0000","last_active":"2024-04-25T19:23:35.880540+0000","last_peered":"2024-04-25T19:23:35.880540+0000","last_clean":"2024-04-25T19:23:35.880540+0000","last_became_active":"2024-04-25T19:23:33.859569+0000","last_became_peered":"2024-04-25T19:23:33.859569+0000","last_unstale":"2024-04-25T19:23:35.880540+0000","last_undegraded":"2024-04-25T19:23:35.880540+0000","last_fullsized":"2024-04-25T19:23:35.880540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:53.116651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965885+0000","last_change":"2024-04-25T19:23:34.865901+0000","last_active":"2024-04-25T19:23:35.965885+0000","last_peered":"2024-04-25T19:23:35.965885+0000","last_clean":"2024-04-25T19:23:35.965885+0000","last_became_active":"2024-04-25T19:23:34.865562+0000","last_became_peered":"2024-04-25T19:23:34.865562+0000","last_unstale":"2024-04-25T19:23:35.965885+0000","last_undegraded":"2024-04-25T19:23:35.965885+0000","last_fullsized":"2024-04-25T19:23:35.965885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:42:43.538944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882299+0000","last_change":"2024-04-25T19:23:33.865049+0000","last_active":"2024-04-25T19:23:35.882299+0000","last_peered":"2024-04-25T19:23:35.882299+0000","last_clean":"2024-04-25T19:23:35.882299+0000","last_became_active":"2024-04-25T19:23:33.864681+0000","last_became_peered":"2024-04-25T19:23:33.864681+0000","last_unstale":"2024-04-25T19:23:35.882299+0000","last_undegraded":"2024-04-25T19:23:35.882299+0000","last_fullsized":"2024-04-25T19:23:35.882299+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:50.633103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.969103+0000","last_change":"2024-04-25T19:23:34.884245+0000","last_active":"2024-04-25T19:23:35.969103+0000","last_peered":"2024-04-25T19:23:35.969103+0000","last_clean":"2024-04-25T19:23:35.969103+0000","last_became_active":"2024-04-25T19:23:34.883423+0000","last_became_peered":"2024-04-25T19:23:34.883423+0000","last_unstale":"2024-04-25T19:23:35.969103+0000","last_undegraded":"2024-04-25T19:23:35.969103+0000","last_fullsized":"2024-04-25T19:23:35.969103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:13:21.629386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965235+0000","last_change":"2024-04-25T19:23:33.867671+0000","last_active":"2024-04-25T19:23:35.965235+0000","last_peered":"2024-04-25T19:23:35.965235+0000","last_clean":"2024-04-25T19:23:35.965235+0000","last_became_active":"2024-04-25T19:23:33.866592+0000","last_became_peered":"2024-04-25T19:23:33.866592+0000","last_unstale":"2024-04-25T19:23:35.965235+0000","last_undegraded":"2024-04-25T19:23:35.965235+0000","last_fullsized":"2024-04-25T19:23:35.965235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:00.480595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.968438+0000","last_change":"2024-04-25T19:23:34.865331+0000","last_active":"2024-04-25T19:23:35.968438+0000","last_peered":"2024-04-25T19:23:35.968438+0000","last_clean":"2024-04-25T19:23:35.968438+0000","last_became_active":"2024-04-25T19:23:34.863941+0000","last_became_peered":"2024-04-25T19:23:34.863941+0000","last_unstale":"2024-04-25T19:23:35.968438+0000","last_undegraded":"2024-04-25T19:23:35.968438+0000","last_fullsized":"2024-04-25T19:23:35.968438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:34.075093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965648+0000","last_change":"2024-04-25T19:23:33.857697+0000","last_active":"2024-04-25T19:23:35.965648+0000","last_peered":"2024-04-25T19:23:35.965648+0000","last_clean":"2024-04-25T19:23:35.965648+0000","last_became_active":"2024-04-25T19:23:33.857359+0000","last_became_peered":"2024-04-25T19:23:33.857359+0000","last_unstale":"2024-04-25T19:23:35.965648+0000","last_undegraded":"2024-04-25T19:23:35.965648+0000","last_fullsized":"2024-04-25T19:23:35.965648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:04.414723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880308+0000","last_change":"2024-04-25T19:23:34.860729+0000","last_active":"2024-04-25T19:23:35.880308+0000","last_peered":"2024-04-25T19:23:35.880308+0000","last_clean":"2024-04-25T19:23:35.880308+0000","last_became_active":"2024-04-25T19:23:34.860341+0000","last_became_peered":"2024-04-25T19:23:34.860341+0000","last_unstale":"2024-04-25T19:23:35.880308+0000","last_undegraded":"2024-04-25T19:23:35.880308+0000","last_fullsized":"2024-04-25T19:23:35.880308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:34.178623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882877+0000","last_change":"2024-04-25T19:23:33.866277+0000","last_active":"2024-04-25T19:23:35.882877+0000","last_peered":"2024-04-25T19:23:35.882877+0000","last_clean":"2024-04-25T19:23:35.882877+0000","last_became_active":"2024-04-25T19:23:33.865920+0000","last_became_peered":"2024-04-25T19:23:33.865920+0000","last_unstale":"2024-04-25T19:23:35.882877+0000","last_undegraded":"2024-04-25T19:23:35.882877+0000","last_fullsized":"2024-04-25T19:23:35.882877+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:51.486951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882134+0000","last_change":"2024-04-25T19:23:34.860463+0000","last_active":"2024-04-25T19:23:35.882134+0000","last_peered":"2024-04-25T19:23:35.882134+0000","last_clean":"2024-04-25T19:23:35.882134+0000","last_became_active":"2024-04-25T19:23:34.860115+0000","last_became_peered":"2024-04-25T19:23:34.860115+0000","last_unstale":"2024-04-25T19:23:35.882134+0000","last_undegraded":"2024-04-25T19:23:35.882134+0000","last_fullsized":"2024-04-25T19:23:35.882134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:53.321590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880589+0000","last_change":"2024-04-25T19:23:33.863747+0000","last_active":"2024-04-25T19:23:35.880589+0000","last_peered":"2024-04-25T19:23:35.880589+0000","last_clean":"2024-04-25T19:23:35.880589+0000","last_became_active":"2024-04-25T19:23:33.863073+0000","last_became_peered":"2024-04-25T19:23:33.863073+0000","last_unstale":"2024-04-25T19:23:35.880589+0000","last_undegraded":"2024-04-25T19:23:35.880589+0000","last_fullsized":"2024-04-25T19:23:35.880589+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:22:45.334470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882746+0000","last_change":"2024-04-25T19:23:34.884965+0000","last_active":"2024-04-25T19:23:35.882746+0000","last_peered":"2024-04-25T19:23:35.882746+0000","last_clean":"2024-04-25T19:23:35.882746+0000","last_became_active":"2024-04-25T19:23:34.884057+0000","last_became_peered":"2024-04-25T19:23:34.884057+0000","last_unstale":"2024-04-25T19:23:35.882746+0000","last_undegraded":"2024-04-25T19:23:35.882746+0000","last_fullsized":"2024-04-25T19:23:35.882746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:22:16.525112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880108+0000","last_change":"2024-04-25T19:23:33.863501+0000","last_active":"2024-04-25T19:23:35.880108+0000","last_peered":"2024-04-25T19:23:35.880108+0000","last_clean":"2024-04-25T19:23:35.880108+0000","last_became_active":"2024-04-25T19:23:33.863105+0000","last_became_peered":"2024-04-25T19:23:33.863105+0000","last_unstale":"2024-04-25T19:23:35.880108+0000","last_undegraded":"2024-04-25T19:23:35.880108+0000","last_fullsized":"2024-04-25T19:23:35.880108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:26.949430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965267+0000","last_change":"2024-04-25T19:23:34.873219+0000","last_active":"2024-04-25T19:23:35.965267+0000","last_peered":"2024-04-25T19:23:35.965267+0000","last_clean":"2024-04-25T19:23:35.965267+0000","last_became_active":"2024-04-25T19:23:34.872851+0000","last_became_peered":"2024-04-25T19:23:34.872851+0000","last_unstale":"2024-04-25T19:23:35.965267+0000","last_undegraded":"2024-04-25T19:23:35.965267+0000","last_fullsized":"2024-04-25T19:23:35.965267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:30.385732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880267+0000","last_change":"2024-04-25T19:23:33.861614+0000","last_active":"2024-04-25T19:23:35.880267+0000","last_peered":"2024-04-25T19:23:35.880267+0000","last_clean":"2024-04-25T19:23:35.880267+0000","last_became_active":"2024-04-25T19:23:33.861269+0000","last_became_peered":"2024-04-25T19:23:33.861269+0000","last_unstale":"2024-04-25T19:23:35.880267+0000","last_undegraded":"2024-04-25T19:23:35.880267+0000","last_fullsized":"2024-04-25T19:23:35.880267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:12:04.487364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.964269+0000","last_change":"2024-04-25T19:23:34.874432+0000","last_active":"2024-04-25T19:23:35.964269+0000","last_peered":"2024-04-25T19:23:35.964269+0000","last_clean":"2024-04-25T19:23:35.964269+0000","last_became_active":"2024-04-25T19:23:34.871916+0000","last_became_peered":"2024-04-25T19:23:34.871916+0000","last_unstale":"2024-04-25T19:23:35.964269+0000","last_undegraded":"2024-04-25T19:23:35.964269+0000","last_fullsized":"2024-04-25T19:23:35.964269+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:31:04.115493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876202+0000","last_change":"2024-04-25T19:23:33.856541+0000","last_active":"2024-04-25T19:23:35.876202+0000","last_peered":"2024-04-25T19:23:35.876202+0000","last_clean":"2024-04-25T19:23:35.876202+0000","last_became_active":"2024-04-25T19:23:33.856217+0000","last_became_peered":"2024-04-25T19:23:33.856217+0000","last_unstale":"2024-04-25T19:23:35.876202+0000","last_undegraded":"2024-04-25T19:23:35.876202+0000","last_fullsized":"2024-04-25T19:23:35.876202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:51.486951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.964495+0000","last_change":"2024-04-25T19:23:34.874258+0000","last_active":"2024-04-25T19:23:35.964495+0000","last_peered":"2024-04-25T19:23:35.964495+0000","last_clean":"2024-04-25T19:23:35.964495+0000","last_became_active":"2024-04-25T19:23:34.873947+0000","last_became_peered":"2024-04-25T19:23:34.873947+0000","last_unstale":"2024-04-25T19:23:35.964495+0000","last_undegraded":"2024-04-25T19:23:35.964495+0000","last_fullsized":"2024-04-25T19:23:35.964495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:09.131145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.968204+0000","last_change":"2024-04-25T19:23:33.865209+0000","last_active":"2024-04-25T19:23:35.968204+0000","last_peered":"2024-04-25T19:23:35.968204+0000","last_clean":"2024-04-25T19:23:35.968204+0000","last_became_active":"2024-04-25T19:23:33.864805+0000","last_became_peered":"2024-04-25T19:23:33.864805+0000","last_unstale":"2024-04-25T19:23:35.968204+0000","last_undegraded":"2024-04-25T19:23:35.968204+0000","last_fullsized":"2024-04-25T19:23:35.968204+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:51.486951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.964197+0000","last_change":"2024-04-25T19:23:34.870418+0000","last_active":"2024-04-25T19:23:35.964197+0000","last_peered":"2024-04-25T19:23:35.964197+0000","last_clean":"2024-04-25T19:23:35.964197+0000","last_became_active":"2024-04-25T19:23:34.870084+0000","last_became_peered":"2024-04-25T19:23:34.870084+0000","last_unstale":"2024-04-25T19:23:35.964197+0000","last_undegraded":"2024-04-25T19:23:35.964197+0000","last_fullsized":"2024-04-25T19:23:35.964197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:12:05.502676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880428+0000","last_change":"2024-04-25T19:23:33.860629+0000","last_active":"2024-04-25T19:23:35.880428+0000","last_peered":"2024-04-25T19:23:35.880428+0000","last_clean":"2024-04-25T19:23:35.880428+0000","last_became_active":"2024-04-25T19:23:33.860264+0000","last_became_peered":"2024-04-25T19:23:33.860264+0000","last_unstale":"2024-04-25T19:23:35.880428+0000","last_undegraded":"2024-04-25T19:23:35.880428+0000","last_fullsized":"2024-04-25T19:23:35.880428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:43.245901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.967492+0000","last_change":"2024-04-25T19:23:34.882245+0000","last_active":"2024-04-25T19:23:35.967492+0000","last_peered":"2024-04-25T19:23:35.967492+0000","last_clean":"2024-04-25T19:23:35.967492+0000","last_became_active":"2024-04-25T19:23:34.880684+0000","last_became_peered":"2024-04-25T19:23:34.880684+0000","last_unstale":"2024-04-25T19:23:35.967492+0000","last_undegraded":"2024-04-25T19:23:35.967492+0000","last_fullsized":"2024-04-25T19:23:35.967492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:48.768523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.879130+0000","last_change":"2024-04-25T19:23:33.869661+0000","last_active":"2024-04-25T19:23:35.879130+0000","last_peered":"2024-04-25T19:23:35.879130+0000","last_clean":"2024-04-25T19:23:35.879130+0000","last_became_active":"2024-04-25T19:23:33.869274+0000","last_became_peered":"2024-04-25T19:23:33.869274+0000","last_unstale":"2024-04-25T19:23:35.879130+0000","last_undegraded":"2024-04-25T19:23:35.879130+0000","last_fullsized":"2024-04-25T19:23:35.879130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:45.835245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965406+0000","last_change":"2024-04-25T19:23:34.873322+0000","last_active":"2024-04-25T19:23:35.965406+0000","last_peered":"2024-04-25T19:23:35.965406+0000","last_clean":"2024-04-25T19:23:35.965406+0000","last_became_active":"2024-04-25T19:23:34.873003+0000","last_became_peered":"2024-04-25T19:23:34.873003+0000","last_unstale":"2024-04-25T19:23:35.965406+0000","last_undegraded":"2024-04-25T19:23:35.965406+0000","last_fullsized":"2024-04-25T19:23:35.965406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:52.502263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882959+0000","last_change":"2024-04-25T19:23:33.869537+0000","last_active":"2024-04-25T19:23:35.882959+0000","last_peered":"2024-04-25T19:23:35.882959+0000","last_clean":"2024-04-25T19:23:35.882959+0000","last_became_active":"2024-04-25T19:23:33.869181+0000","last_became_peered":"2024-04-25T19:23:33.869181+0000","last_unstale":"2024-04-25T19:23:35.882959+0000","last_undegraded":"2024-04-25T19:23:35.882959+0000","last_fullsized":"2024-04-25T19:23:35.882959+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:03:16.565706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.881949+0000","last_change":"2024-04-25T19:23:34.887744+0000","last_active":"2024-04-25T19:23:35.881949+0000","last_peered":"2024-04-25T19:23:35.881949+0000","last_clean":"2024-04-25T19:23:35.881949+0000","last_became_active":"2024-04-25T19:23:34.887465+0000","last_became_peered":"2024-04-25T19:23:34.887465+0000","last_unstale":"2024-04-25T19:23:35.881949+0000","last_undegraded":"2024-04-25T19:23:35.881949+0000","last_fullsized":"2024-04-25T19:23:35.881949+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:42:43.538944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876981+0000","last_change":"2024-04-25T19:23:33.860892+0000","last_active":"2024-04-25T19:23:35.876981+0000","last_peered":"2024-04-25T19:23:35.876981+0000","last_clean":"2024-04-25T19:23:35.876981+0000","last_became_active":"2024-04-25T19:23:33.860529+0000","last_became_peered":"2024-04-25T19:23:33.860529+0000","last_unstale":"2024-04-25T19:23:35.876981+0000","last_undegraded":"2024-04-25T19:23:35.876981+0000","last_fullsized":"2024-04-25T19:23:35.876981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:03:16.565706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876262+0000","last_change":"2024-04-25T19:23:34.886345+0000","last_active":"2024-04-25T19:23:35.876262+0000","last_peered":"2024-04-25T19:23:35.876262+0000","last_clean":"2024-04-25T19:23:35.876262+0000","last_became_active":"2024-04-25T19:23:34.885598+0000","last_became_peered":"2024-04-25T19:23:34.885598+0000","last_unstale":"2024-04-25T19:23:35.876262+0000","last_undegraded":"2024-04-25T19:23:35.876262+0000","last_fullsized":"2024-04-25T19:23:35.876262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:00:08.044331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882731+0000","last_change":"2024-04-25T19:23:33.859331+0000","last_active":"2024-04-25T19:23:35.882731+0000","last_peered":"2024-04-25T19:23:35.882731+0000","last_clean":"2024-04-25T19:23:35.882731+0000","last_became_active":"2024-04-25T19:23:33.858500+0000","last_became_peered":"2024-04-25T19:23:33.858500+0000","last_unstale":"2024-04-25T19:23:35.882731+0000","last_undegraded":"2024-04-25T19:23:35.882731+0000","last_fullsized":"2024-04-25T19:23:35.882731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:29.370419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.967861+0000","last_change":"2024-04-25T19:23:34.866340+0000","last_active":"2024-04-25T19:23:35.967861+0000","last_peered":"2024-04-25T19:23:35.967861+0000","last_clean":"2024-04-25T19:23:35.967861+0000","last_became_active":"2024-04-25T19:23:34.865996+0000","last_became_peered":"2024-04-25T19:23:34.865996+0000","last_unstale":"2024-04-25T19:23:35.967861+0000","last_undegraded":"2024-04-25T19:23:35.967861+0000","last_fullsized":"2024-04-25T19:23:35.967861+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:11.081868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876393+0000","last_change":"2024-04-25T19:23:33.855462+0000","last_active":"2024-04-25T19:23:35.876393+0000","last_peered":"2024-04-25T19:23:35.876393+0000","last_clean":"2024-04-25T19:23:35.876393+0000","last_became_active":"2024-04-25T19:23:33.855113+0000","last_became_peered":"2024-04-25T19:23:33.855113+0000","last_unstale":"2024-04-25T19:23:35.876393+0000","last_undegraded":"2024-04-25T19:23:35.876393+0000","last_fullsized":"2024-04-25T19:23:35.876393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:50.633103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876567+0000","last_change":"2024-04-25T19:23:34.865944+0000","last_active":"2024-04-25T19:23:35.876567+0000","last_peered":"2024-04-25T19:23:35.876567+0000","last_clean":"2024-04-25T19:23:35.876567+0000","last_became_active":"2024-04-25T19:23:34.865591+0000","last_became_peered":"2024-04-25T19:23:34.865591+0000","last_unstale":"2024-04-25T19:23:35.876567+0000","last_undegraded":"2024-04-25T19:23:35.876567+0000","last_fullsized":"2024-04-25T19:23:35.876567+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:34.178623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882425+0000","last_change":"2024-04-25T19:23:33.869538+0000","last_active":"2024-04-25T19:23:35.882425+0000","last_peered":"2024-04-25T19:23:35.882425+0000","last_clean":"2024-04-25T19:23:35.882425+0000","last_became_active":"2024-04-25T19:23:33.869167+0000","last_became_peered":"2024-04-25T19:23:33.869167+0000","last_unstale":"2024-04-25T19:23:35.882425+0000","last_undegraded":"2024-04-25T19:23:35.882425+0000","last_fullsized":"2024-04-25T19:23:35.882425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:00.480595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965288+0000","last_change":"2024-04-25T19:23:34.881366+0000","last_active":"2024-04-25T19:23:35.965288+0000","last_peered":"2024-04-25T19:23:35.965288+0000","last_clean":"2024-04-25T19:23:35.965288+0000","last_became_active":"2024-04-25T19:23:34.881035+0000","last_became_peered":"2024-04-25T19:23:34.881035+0000","last_unstale":"2024-04-25T19:23:35.965288+0000","last_undegraded":"2024-04-25T19:23:35.965288+0000","last_fullsized":"2024-04-25T19:23:35.965288+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:49.384633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880084+0000","last_change":"2024-04-25T19:23:33.860231+0000","last_active":"2024-04-25T19:23:35.880084+0000","last_peered":"2024-04-25T19:23:35.880084+0000","last_clean":"2024-04-25T19:23:35.880084+0000","last_became_active":"2024-04-25T19:23:33.859759+0000","last_became_peered":"2024-04-25T19:23:33.859759+0000","last_unstale":"2024-04-25T19:23:35.880084+0000","last_undegraded":"2024-04-25T19:23:35.880084+0000","last_fullsized":"2024-04-25T19:23:35.880084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:43.913546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.878990+0000","last_change":"2024-04-25T19:23:34.884267+0000","last_active":"2024-04-25T19:23:35.878990+0000","last_peered":"2024-04-25T19:23:35.878990+0000","last_clean":"2024-04-25T19:23:35.878990+0000","last_became_active":"2024-04-25T19:23:34.883765+0000","last_became_peered":"2024-04-25T19:23:34.883765+0000","last_unstale":"2024-04-25T19:23:35.878990+0000","last_undegraded":"2024-04-25T19:23:35.878990+0000","last_fullsized":"2024-04-25T19:23:35.878990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:16.603308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965963+0000","last_change":"2024-04-25T19:23:33.868354+0000","last_active":"2024-04-25T19:23:35.965963+0000","last_peered":"2024-04-25T19:23:35.965963+0000","last_clean":"2024-04-25T19:23:35.965963+0000","last_became_active":"2024-04-25T19:23:33.867050+0000","last_became_peered":"2024-04-25T19:23:33.867050+0000","last_unstale":"2024-04-25T19:23:35.965963+0000","last_undegraded":"2024-04-25T19:23:35.965963+0000","last_fullsized":"2024-04-25T19:23:35.965963+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:45.835245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.968849+0000","last_change":"2024-04-25T19:23:34.874503+0000","last_active":"2024-04-25T19:23:35.968849+0000","last_peered":"2024-04-25T19:23:35.968849+0000","last_clean":"2024-04-25T19:23:35.968849+0000","last_became_active":"2024-04-25T19:23:34.874028+0000","last_became_peered":"2024-04-25T19:23:34.874028+0000","last_unstale":"2024-04-25T19:23:35.968849+0000","last_undegraded":"2024-04-25T19:23:35.968849+0000","last_fullsized":"2024-04-25T19:23:35.968849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:44:01.779997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.968534+0000","last_change":"2024-04-25T19:23:33.871947+0000","last_active":"2024-04-25T19:23:35.968534+0000","last_peered":"2024-04-25T19:23:35.968534+0000","last_clean":"2024-04-25T19:23:35.968534+0000","last_became_active":"2024-04-25T19:23:33.870719+0000","last_became_peered":"2024-04-25T19:23:33.870719+0000","last_unstale":"2024-04-25T19:23:35.968534+0000","last_undegraded":"2024-04-25T19:23:35.968534+0000","last_fullsized":"2024-04-25T19:23:35.968534+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:03:16.565706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":133,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.969409+0000","last_change":"2024-04-25T19:22:06.081655+0000","last_active":"2024-04-25T19:23:35.969409+0000","last_peered":"2024-04-25T19:23:35.969409+0000","last_clean":"2024-04-25T19:23:35.969409+0000","last_became_active":"2024-04-25T19:22:06.078999+0000","last_became_peered":"2024-04-25T19:22:06.078999+0000","last_unstale":"2024-04-25T19:23:35.969409+0000","last_undegraded":"2024-04-25T19:23:35.969409+0000","last_fullsized":"2024-04-25T19:23:35.969409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_clean_scrub_stamp":"2024-04-25T19:22:04.921147+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:30.543734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":737066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":380928,"data_stored":147224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":380928,"data_stored":147280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":380928,"data_stored":146712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":148242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":146678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":148242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":966656,"data_stored":736976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T19:23:40.688 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T19:23:41.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.002+0000 7f1c33200640 1 Processor -- start 2024-04-25T19:23:41.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.003+0000 7f1c33200640 1 -- start start 2024-04-25T19:23:41.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.004+0000 7f1c33200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1c340b1ba0 0x7f1c34160200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:41.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.005+0000 7f1c33200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c34071780 0x7f1c34071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:41.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.005+0000 7f1c33200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c340720d0 con 0x7f1c340d1f80 2024-04-25T19:23:41.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.005+0000 7f1c33200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f1c340c8f70 con 0x7f1c340b1ba0 2024-04-25T19:23:41.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.005+0000 7f1c33200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1c340c9250 con 0x7f1c34071780 2024-04-25T19:23:41.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.005+0000 7f1c2be00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f1c340d1f80 0x7f1c340c7640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:40232/0 (socket says 172.21.15.131:40232) 2024-04-25T19:23:41.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.005+0000 7f1c2be00640 1 -- 172.21.15.131:0/1095125700 learned_addr learned my addr 172.21.15.131:0/1095125700 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:41.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.005+0000 7f1c31e00640 1 --2- 172.21.15.131:0/1095125700 >> v2:172.21.15.195:3300/0 conn(0x7f1c340b1ba0 0x7f1c34160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:41.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.005+0000 7f1c32800640 1 --2- 172.21.15.131:0/1095125700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c34071780 0x7f1c34071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:41.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.005+0000 7f1c31400640 1 -- 172.21.15.131:0/1095125700 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3744021331 0 0) 0x7f1c1c001110 con 0x7f1c340d1f80 2024-04-25T19:23:41.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.005+0000 7f1c31400640 1 -- 172.21.15.131:0/1095125700 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c18003520 con 0x7f1c340d1f80 2024-04-25T19:23:41.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.006+0000 7f1c31400640 1 -- 172.21.15.131:0/1095125700 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3829513985 0 0) 0x7f1c18003520 con 0x7f1c340d1f80 2024-04-25T19:23:41.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.006+0000 7f1c31400640 1 -- 172.21.15.131:0/1095125700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c34071780 msgr2=0x7f1c34071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:41.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.006+0000 7f1c31400640 1 --2- 172.21.15.131:0/1095125700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c34071780 0x7f1c34071b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:41.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.006+0000 7f1c31400640 1 -- 172.21.15.131:0/1095125700 >> v2:172.21.15.195:3300/0 conn(0x7f1c340b1ba0 msgr2=0x7f1c34160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:41.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.006+0000 7f1c31400640 1 --2- 172.21.15.131:0/1095125700 >> v2:172.21.15.195:3300/0 conn(0x7f1c340b1ba0 0x7f1c34160200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:41.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.006+0000 7f1c31400640 1 -- 172.21.15.131:0/1095125700 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c340c9530 con 0x7f1c340d1f80 2024-04-25T19:23:41.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.006+0000 7f1c31400640 1 -- 172.21.15.131:0/1095125700 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f1c1c001840 con 0x7f1c340d1f80 2024-04-25T19:23:41.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.006+0000 7f1c31e00640 1 --2- 172.21.15.131:0/1095125700 >> v2:172.21.15.195:3300/0 conn(0x7f1c340b1ba0 0x7f1c34160200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T19:23:41.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.006+0000 7f1c31400640 1 -- 172.21.15.131:0/1095125700 >> v1:172.21.15.131:6789/0 conn(0x7f1c340d1f80 legacy=0x7f1c340c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:41.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.006+0000 7f1c31400640 1 --2- 172.21.15.131:0/1095125700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c180039b0 0x7f1c18003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:41.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.006+0000 7f1c31400640 1 --2- 172.21.15.131:0/1095125700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c34071780 0x7f1c18004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:41.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.006+0000 7f1c31400640 1 --2- 172.21.15.131:0/1095125700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c18004d40 0x7f1c18005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:41.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.006+0000 7f1c31400640 1 -- 172.21.15.131:0/1095125700 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1c340c8f70 con 0x7f1c180039b0 2024-04-25T19:23:41.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.006+0000 7f1c31400640 1 -- 172.21.15.131:0/1095125700 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1c340c9250 con 0x7f1c18004d40 2024-04-25T19:23:41.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.006+0000 7f1c31400640 1 -- 172.21.15.131:0/1095125700 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1c1800bc00 con 0x7f1c34071780 2024-04-25T19:23:41.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.006+0000 7f1c31e00640 1 --2- 172.21.15.131:0/1095125700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c180039b0 0x7f1c18003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:41.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.007+0000 7f1c2be00640 1 --2- 172.21.15.131:0/1095125700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c34071780 0x7f1c18004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:41.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.007+0000 7f1c32800640 1 --2- 172.21.15.131:0/1095125700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c18004d40 0x7f1c18005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:41.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.007+0000 7f1c31e00640 1 -- 172.21.15.131:0/1095125700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c34071780 msgr2=0x7f1c18004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:41.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.007+0000 7f1c31e00640 1 --2- 172.21.15.131:0/1095125700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c34071780 0x7f1c18004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:41.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.007+0000 7f1c31e00640 1 -- 172.21.15.131:0/1095125700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c18004d40 msgr2=0x7f1c18005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:41.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.007+0000 7f1c31e00640 1 --2- 172.21.15.131:0/1095125700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c18004d40 0x7f1c18005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:41.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.007+0000 7f1c31e00640 1 -- 172.21.15.131:0/1095125700 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c18003520 con 0x7f1c180039b0 2024-04-25T19:23:41.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.007+0000 7f1c32800640 1 --2- 172.21.15.131:0/1095125700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c18004d40 0x7f1c18005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:41.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.009+0000 7f1c31e00640 1 --2- 172.21.15.131:0/1095125700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c180039b0 0x7f1c18003e20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1c34073780 tx=0x7f1c18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c25571a3e999b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:41.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.009+0000 7f1c31400640 1 -- 172.21.15.131:0/1095125700 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c24037070 con 0x7f1c180039b0 2024-04-25T19:23:41.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.009+0000 7f1c31400640 1 -- 172.21.15.131:0/1095125700 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c2402ad00 con 0x7f1c180039b0 2024-04-25T19:23:41.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.009+0000 7f1c31400640 1 -- 172.21.15.131:0/1095125700 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2400f040 con 0x7f1c180039b0 2024-04-25T19:23:41.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.010+0000 7f1c33200640 1 -- 172.21.15.131:0/1095125700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c180039b0 msgr2=0x7f1c18003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:41.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.010+0000 7f1c33200640 1 --2- 172.21.15.131:0/1095125700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c180039b0 0x7f1c18003e20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1c34073780 tx=0x7f1c18005830 comp rx=0 tx=0).stop 2024-04-25T19:23:41.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.010+0000 7f1c32800640 1 -- 172.21.15.131:0/1095125700 reap_dead start 2024-04-25T19:23:41.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.010+0000 7f1c33200640 1 -- 172.21.15.131:0/1095125700 shutdown_connections 2024-04-25T19:23:41.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.010+0000 7f1c33200640 1 -- 172.21.15.131:0/1095125700 >> 172.21.15.131:0/1095125700 conn(0x7f1c340cf240 msgr2=0x7f1c340cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:41.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.010+0000 7f1c33200640 1 -- 172.21.15.131:0/1095125700 shutdown_connections 2024-04-25T19:23:41.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.010+0000 7f1c33200640 1 -- 172.21.15.131:0/1095125700 wait complete. 2024-04-25T19:23:41.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.012+0000 7f1c33200640 1 Processor -- start 2024-04-25T19:23:41.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.013+0000 7f1c33200640 1 -- start start 2024-04-25T19:23:41.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.014+0000 7f1c33200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c180039b0 0x7f1c340b7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:41.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.014+0000 7f1c33200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c340ca220 0x7f1c340b0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:41.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.014+0000 7f1c33200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c340b0d50 0x7f1c341f9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:41.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.014+0000 7f1c33200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1c340cef30 con 0x7f1c340b0d50 2024-04-25T19:23:41.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.014+0000 7f1c33200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1c340cedb0 con 0x7f1c340ca220 2024-04-25T19:23:41.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.014+0000 7f1c33200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1c34071b90 con 0x7f1c180039b0 2024-04-25T19:23:41.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.014+0000 7f1c32800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c340b0d50 0x7f1c341f9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:41.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.014+0000 7f1c32800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c340b0d50 0x7f1c341f9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51740/0 (socket says 172.21.15.131:51740) 2024-04-25T19:23:41.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.014+0000 7f1c32800640 1 -- 172.21.15.131:0/1313110199 learned_addr learned my addr 172.21.15.131:0/1313110199 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:41.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.015+0000 7f1c31e00640 1 --2- 172.21.15.131:0/1313110199 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c180039b0 0x7f1c340b7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:41.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.015+0000 7f1c2be00640 1 --2- 172.21.15.131:0/1313110199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c340ca220 0x7f1c340b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:41.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.015+0000 7f1c32800640 1 -- 172.21.15.131:0/1313110199 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c180039b0 msgr2=0x7f1c340b7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:41.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.015+0000 7f1c32800640 1 --2- 172.21.15.131:0/1313110199 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c180039b0 0x7f1c340b7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:41.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.015+0000 7f1c32800640 1 -- 172.21.15.131:0/1313110199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c340ca220 msgr2=0x7f1c340b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:41.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.015+0000 7f1c32800640 1 --2- 172.21.15.131:0/1313110199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c340ca220 0x7f1c340b0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:41.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.015+0000 7f1c32800640 1 -- 172.21.15.131:0/1313110199 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c340b1160 con 0x7f1c340b0d50 2024-04-25T19:23:41.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.015+0000 7f1c2be00640 1 --2- 172.21.15.131:0/1313110199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c340ca220 0x7f1c340b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:41.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.015+0000 7f1c32800640 1 --2- 172.21.15.131:0/1313110199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c340b0d50 0x7f1c341f9870 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1c340c7d70 tx=0x7f1c2c00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:41.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.015+0000 7f1c2a000640 1 -- 172.21.15.131:0/1313110199 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c01c070 con 0x7f1c340b0d50 2024-04-25T19:23:41.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.015+0000 7f1c2a000640 1 -- 172.21.15.131:0/1313110199 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c2c017400 con 0x7f1c340b0d50 2024-04-25T19:23:41.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.015+0000 7f1c2a000640 1 -- 172.21.15.131:0/1313110199 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c0177d0 con 0x7f1c340b0d50 2024-04-25T19:23:41.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.016+0000 7f1c33200640 1 -- 172.21.15.131:0/1313110199 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c341f6250 con 0x7f1c340b0d50 2024-04-25T19:23:41.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.016+0000 7f1c33200640 1 -- 172.21.15.131:0/1313110199 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c341f6a60 con 0x7f1c340b0d50 2024-04-25T19:23:41.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.017+0000 7f1c33200640 1 -- 172.21.15.131:0/1313110199 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c341f7440 con 0x7f1c340b0d50 2024-04-25T19:23:41.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.018+0000 7f1c2a000640 1 -- 172.21.15.131:0/1313110199 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1c2c005d10 con 0x7f1c340b0d50 2024-04-25T19:23:41.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.019+0000 7f1c2a000640 1 --2- 172.21.15.131:0/1313110199 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1c100744b0 0x7f1c100769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:41.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.019+0000 7f1c2a000640 1 -- 172.21.15.131:0/1313110199 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f1c2c0958d0 con 0x7f1c340b0d50 2024-04-25T19:23:41.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.020+0000 7f1c31e00640 1 --2- 172.21.15.131:0/1313110199 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1c100744b0 0x7f1c100769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:41.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.021+0000 7f1c31e00640 1 --2- 172.21.15.131:0/1313110199 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1c100744b0 0x7f1c100769c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1c24034000 tx=0x7f1c2402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:41.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.023+0000 7f1c2a000640 1 -- 172.21.15.131:0/1313110199 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1c340b1160 con 0x7f1c340b0d50 2024-04-25T19:23:41.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.296+0000 7f1c33200640 1 -- 172.21.15.131:0/1313110199 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f1c341f6510 con 0x7f1c340b0d50 2024-04-25T19:23:41.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.297+0000 7f1c2a000640 1 -- 172.21.15.131:0/1313110199 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1013 (secure 0 0 0) 0x7f1c2c012070 con 0x7f1c340b0d50 2024-04-25T19:23:41.299 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:41.299 INFO:teuthology.orchestra.run.smithi131.stdout:{"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":110,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":33,"num_osds":8,"num_up_osds":8,"osd_up_since":1714072923,"num_in_osds":8,"osd_in_since":1714072914,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":242626560,"bytes_avail":772851486720,"bytes_total":773094113280,"write_bytes_sec":2261,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":4729}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-25T19:23:22.163385+0000","services":{}},"progress_events":{}} 2024-04-25T19:23:41.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.300+0000 7f1c33200640 1 -- 172.21.15.131:0/1313110199 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1c100744b0 msgr2=0x7f1c100769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:41.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.300+0000 7f1c33200640 1 --2- 172.21.15.131:0/1313110199 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1c100744b0 0x7f1c100769c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1c24034000 tx=0x7f1c2402e000 comp rx=0 tx=0).stop 2024-04-25T19:23:41.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.300+0000 7f1c33200640 1 -- 172.21.15.131:0/1313110199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c340b0d50 msgr2=0x7f1c341f9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:41.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.300+0000 7f1c33200640 1 --2- 172.21.15.131:0/1313110199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c340b0d50 0x7f1c341f9870 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1c340c7d70 tx=0x7f1c2c00f4a0 comp rx=0 tx=0).stop 2024-04-25T19:23:41.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.300+0000 7f1c33200640 1 -- 172.21.15.131:0/1313110199 shutdown_connections 2024-04-25T19:23:41.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.300+0000 7f1c33200640 1 --2- 172.21.15.131:0/1313110199 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1c100744b0 0x7f1c100769c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:41.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.300+0000 7f1c33200640 1 --2- 172.21.15.131:0/1313110199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c340b0d50 0x7f1c341f9870 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:41.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.300+0000 7f1c33200640 1 --2- 172.21.15.131:0/1313110199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c340ca220 0x7f1c340b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:41.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.300+0000 7f1c33200640 1 --2- 172.21.15.131:0/1313110199 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c180039b0 0x7f1c340b7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:41.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.300+0000 7f1c33200640 1 -- 172.21.15.131:0/1313110199 >> 172.21.15.131:0/1313110199 conn(0x7f1c340cf240 msgr2=0x7f1c3406c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:41.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.300+0000 7f1c33200640 1 -- 172.21.15.131:0/1313110199 shutdown_connections 2024-04-25T19:23:41.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.300+0000 7f1c33200640 1 -- 172.21.15.131:0/1313110199 wait complete. 2024-04-25T19:23:41.327 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T19:23:41.327 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T19:23:41.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.595+0000 7f8d6d600640 1 Processor -- start 2024-04-25T19:23:41.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.595+0000 7f8d6d600640 1 -- start start 2024-04-25T19:23:41.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.598+0000 7f8d6d600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8d680709a0 0x7f8d681569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:41.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.598+0000 7f8d6d600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d680cffc0 con 0x7f8d680cf9e0 2024-04-25T19:23:41.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.598+0000 7f8d6d600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d680d02a0 con 0x7f8d680b0800 2024-04-25T19:23:41.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.598+0000 7f8d6d600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f8d680d0580 con 0x7f8d680709a0 2024-04-25T19:23:41.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.598+0000 7f8d6cc00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8d680709a0 0x7f8d681569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:41.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.598+0000 7f8d67e00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f8d680cf9e0 0x7f8d68161090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:40238/0 (socket says 172.21.15.131:40238) 2024-04-25T19:23:41.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.598+0000 7f8d6cc00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8d680709a0 0x7f8d681569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51754/0 (socket says 172.21.15.131:51754) 2024-04-25T19:23:41.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.598+0000 7f8d67e00640 1 -- 172.21.15.131:0/585682601 learned_addr learned my addr 172.21.15.131:0/585682601 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:41.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.599+0000 7f8d6cc00640 1 -- 172.21.15.131:0/585682601 >> v1:172.21.15.195:6789/0 conn(0x7f8d680b0800 legacy=0x7f8d68070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:41.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.599+0000 7f8d6cc00640 1 -- 172.21.15.131:0/585682601 >> v1:172.21.15.131:6789/0 conn(0x7f8d680cf9e0 legacy=0x7f8d68161090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:41.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.599+0000 7f8d67400640 1 -- 172.21.15.131:0/585682601 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 78508813 0 0) 0x7f8d680cffc0 con 0x7f8d680cf9e0 2024-04-25T19:23:41.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.599+0000 7f8d6cc00640 1 -- 172.21.15.131:0/585682601 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d680d0860 con 0x7f8d680709a0 2024-04-25T19:23:41.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.600+0000 7f8d6cc00640 1 --2- 172.21.15.131:0/585682601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d680709a0 0x7f8d681569b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009d90 tx=0x7f8d6002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49782b58baec230a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:41.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.600+0000 7f8d67400640 1 -- 172.21.15.131:0/585682601 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d60031600 con 0x7f8d680709a0 2024-04-25T19:23:41.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.600+0000 7f8d67400640 1 -- 172.21.15.131:0/585682601 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d600317a0 con 0x7f8d680709a0 2024-04-25T19:23:41.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.600+0000 7f8d67400640 1 -- 172.21.15.131:0/585682601 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d60031b70 con 0x7f8d680709a0 2024-04-25T19:23:41.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.601+0000 7f8d6d600640 1 -- 172.21.15.131:0/585682601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d680709a0 msgr2=0x7f8d681569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:41.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.601+0000 7f8d6d600640 1 --2- 172.21.15.131:0/585682601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d680709a0 0x7f8d681569b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009d90 tx=0x7f8d6002a610 comp rx=0 tx=0).stop 2024-04-25T19:23:41.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.601+0000 7f8d6d600640 1 -- 172.21.15.131:0/585682601 shutdown_connections 2024-04-25T19:23:41.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.601+0000 7f8d6d600640 1 --2- 172.21.15.131:0/585682601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d680709a0 0x7f8d681569b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:41.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.601+0000 7f8d6d600640 1 -- 172.21.15.131:0/585682601 >> 172.21.15.131:0/585682601 conn(0x7f8d680d1720 msgr2=0x7f8d680d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:41.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.601+0000 7f8d6d600640 1 -- 172.21.15.131:0/585682601 shutdown_connections 2024-04-25T19:23:41.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.601+0000 7f8d6d600640 1 -- 172.21.15.131:0/585682601 wait complete. 2024-04-25T19:23:41.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.603+0000 7f8d6d600640 1 Processor -- start 2024-04-25T19:23:41.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.603+0000 7f8d6d600640 1 -- start start 2024-04-25T19:23:41.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.605+0000 7f8d6d600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d680b0800 0x7f8d68161920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:41.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.605+0000 7f8d6d600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8d680cf9e0 0x7f8d68161e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:41.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.605+0000 7f8d6d600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d681623a0 0x7f8d681f9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:41.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.605+0000 7f8d6d600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6806d9b0 con 0x7f8d681623a0 2024-04-25T19:23:41.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.605+0000 7f8d6d600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8d680b0e60 con 0x7f8d680b0800 2024-04-25T19:23:41.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.605+0000 7f8d6d600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8d6806db30 con 0x7f8d680cf9e0 2024-04-25T19:23:41.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.605+0000 7f8d6cc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d681623a0 0x7f8d681f9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:41.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.605+0000 7f8d6cc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d681623a0 0x7f8d681f9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51762/0 (socket says 172.21.15.131:51762) 2024-04-25T19:23:41.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.605+0000 7f8d6cc00640 1 -- 172.21.15.131:0/1405750280 learned_addr learned my addr 172.21.15.131:0/1405750280 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:41.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.606+0000 7f8d67e00640 1 --2- 172.21.15.131:0/1405750280 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d680b0800 0x7f8d68161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:41.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.606+0000 7f8d5fe00640 1 --2- 172.21.15.131:0/1405750280 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8d680cf9e0 0x7f8d68161e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:41.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.606+0000 7f8d6cc00640 1 -- 172.21.15.131:0/1405750280 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8d680cf9e0 msgr2=0x7f8d68161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:41.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.606+0000 7f8d6cc00640 1 --2- 172.21.15.131:0/1405750280 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8d680cf9e0 0x7f8d68161e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:41.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.606+0000 7f8d6cc00640 1 -- 172.21.15.131:0/1405750280 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d680b0800 msgr2=0x7f8d68161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:41.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.606+0000 7f8d6cc00640 1 --2- 172.21.15.131:0/1405750280 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d680b0800 0x7f8d68161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:41.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.606+0000 7f8d6cc00640 1 -- 172.21.15.131:0/1405750280 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d68158cf0 con 0x7f8d681623a0 2024-04-25T19:23:41.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.606+0000 7f8d6cc00640 1 --2- 172.21.15.131:0/1405750280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d681623a0 0x7f8d681f9850 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009d90 tx=0x7f8d60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:41.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.606+0000 7f8d64c00640 1 -- 172.21.15.131:0/1405750280 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d60040070 con 0x7f8d681623a0 2024-04-25T19:23:41.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.606+0000 7f8d64c00640 1 -- 172.21.15.131:0/1405750280 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d60030be0 con 0x7f8d681623a0 2024-04-25T19:23:41.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.606+0000 7f8d64c00640 1 -- 172.21.15.131:0/1405750280 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d60009450 con 0x7f8d681623a0 2024-04-25T19:23:41.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.607+0000 7f8d6d600640 1 -- 172.21.15.131:0/1405750280 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d681561f0 con 0x7f8d681623a0 2024-04-25T19:23:41.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.607+0000 7f8d6d600640 1 -- 172.21.15.131:0/1405750280 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d681567b0 con 0x7f8d681623a0 2024-04-25T19:23:41.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.608+0000 7f8d6d600640 1 -- 172.21.15.131:0/1405750280 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d68050740 con 0x7f8d681623a0 2024-04-25T19:23:41.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.609+0000 7f8d64c00640 1 -- 172.21.15.131:0/1405750280 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8d60039040 con 0x7f8d681623a0 2024-04-25T19:23:41.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.610+0000 7f8d64c00640 1 --2- 172.21.15.131:0/1405750280 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8d440744b0 0x7f8d440769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:41.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.610+0000 7f8d64c00640 1 -- 172.21.15.131:0/1405750280 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f8d600b6020 con 0x7f8d681623a0 2024-04-25T19:23:41.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.610+0000 7f8d67e00640 1 --2- 172.21.15.131:0/1405750280 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8d440744b0 0x7f8d440769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:41.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.612+0000 7f8d67e00640 1 --2- 172.21.15.131:0/1405750280 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8d440744b0 0x7f8d440769c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8d58000f60 tx=0x7f8d58007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:41.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.615+0000 7f8d64c00640 1 -- 172.21.15.131:0/1405750280 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8d600807b0 con 0x7f8d681623a0 2024-04-25T19:23:41.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.812+0000 7f8d6d600640 1 -- 172.21.15.131:0/1405750280 --> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8d68158a80 con 0x7f8d440744b0 2024-04-25T19:23:41.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.832+0000 7f8d64c00640 1 -- 172.21.15.131:0/1405750280 <== mgr.4105 v2:172.21.15.195:6832/2541913764 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251939 (secure 0 0 0) 0x7f8d68158a80 con 0x7f8d440744b0 2024-04-25T19:23:41.838 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:41.839 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-04-25T19:23:41.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.839+0000 7f8d6d600640 1 -- 172.21.15.131:0/1405750280 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8d440744b0 msgr2=0x7f8d440769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:41.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.839+0000 7f8d6d600640 1 --2- 172.21.15.131:0/1405750280 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8d440744b0 0x7f8d440769c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8d58000f60 tx=0x7f8d58007c00 comp rx=0 tx=0).stop 2024-04-25T19:23:41.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.839+0000 7f8d6d600640 1 -- 172.21.15.131:0/1405750280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d681623a0 msgr2=0x7f8d681f9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:41.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.839+0000 7f8d6d600640 1 --2- 172.21.15.131:0/1405750280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d681623a0 0x7f8d681f9850 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009d90 tx=0x7f8d60004a40 comp rx=0 tx=0).stop 2024-04-25T19:23:41.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.839+0000 7f8d6d600640 1 -- 172.21.15.131:0/1405750280 shutdown_connections 2024-04-25T19:23:41.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.839+0000 7f8d6d600640 1 --2- 172.21.15.131:0/1405750280 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8d440744b0 0x7f8d440769c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:41.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.839+0000 7f8d6d600640 1 --2- 172.21.15.131:0/1405750280 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8d680cf9e0 0x7f8d68161e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:41.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.839+0000 7f8d6d600640 1 --2- 172.21.15.131:0/1405750280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d681623a0 0x7f8d681f9850 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:41.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.839+0000 7f8d6d600640 1 --2- 172.21.15.131:0/1405750280 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d680b0800 0x7f8d68161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:41.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.839+0000 7f8d6d600640 1 -- 172.21.15.131:0/1405750280 >> 172.21.15.131:0/1405750280 conn(0x7f8d680d1720 msgr2=0x7f8d681644a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:41.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.839+0000 7f8d6d600640 1 -- 172.21.15.131:0/1405750280 shutdown_connections 2024-04-25T19:23:41.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:41.840+0000 7f8d6d600640 1 -- 172.21.15.131:0/1405750280 wait complete. 2024-04-25T19:23:41.873 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-04-25T19:23:40.169061+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236940,"kb_used_data":4136,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737780,"statfs":{"total":773094113280,"available":772851486720,"internally_reserved":0,"allocated":4235264,"data_stored":2358420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.337836"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.967899+0000","last_change":"2024-04-25T19:23:34.867693+0000","last_active":"2024-04-25T19:23:35.967899+0000","last_peered":"2024-04-25T19:23:35.967899+0000","last_clean":"2024-04-25T19:23:35.967899+0000","last_became_active":"2024-04-25T19:23:34.867366+0000","last_became_peered":"2024-04-25T19:23:34.867366+0000","last_unstale":"2024-04-25T19:23:35.967899+0000","last_undegraded":"2024-04-25T19:23:35.967899+0000","last_fullsized":"2024-04-25T19:23:35.967899+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:05.430035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.966511+0000","last_change":"2024-04-25T19:23:34.876857+0000","last_active":"2024-04-25T19:23:35.966511+0000","last_peered":"2024-04-25T19:23:35.966511+0000","last_clean":"2024-04-25T19:23:35.966511+0000","last_became_active":"2024-04-25T19:23:34.874632+0000","last_became_peered":"2024-04-25T19:23:34.874632+0000","last_unstale":"2024-04-25T19:23:35.966511+0000","last_undegraded":"2024-04-25T19:23:35.966511+0000","last_fullsized":"2024-04-25T19:23:35.966511+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:03.921924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.881249+0000","last_change":"2024-04-25T19:23:34.884258+0000","last_active":"2024-04-25T19:23:35.881249+0000","last_peered":"2024-04-25T19:23:35.881249+0000","last_clean":"2024-04-25T19:23:35.881249+0000","last_became_active":"2024-04-25T19:23:34.883917+0000","last_became_peered":"2024-04-25T19:23:34.883917+0000","last_unstale":"2024-04-25T19:23:35.881249+0000","last_undegraded":"2024-04-25T19:23:35.881249+0000","last_fullsized":"2024-04-25T19:23:35.881249+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:12:01.307874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882586+0000","last_change":"2024-04-25T19:23:34.884212+0000","last_active":"2024-04-25T19:23:35.882586+0000","last_peered":"2024-04-25T19:23:35.882586+0000","last_clean":"2024-04-25T19:23:35.882586+0000","last_became_active":"2024-04-25T19:23:34.883545+0000","last_became_peered":"2024-04-25T19:23:34.883545+0000","last_unstale":"2024-04-25T19:23:35.882586+0000","last_undegraded":"2024-04-25T19:23:35.882586+0000","last_fullsized":"2024-04-25T19:23:35.882586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:27.032825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.964061+0000","last_change":"2024-04-25T19:23:34.866307+0000","last_active":"2024-04-25T19:23:35.964061+0000","last_peered":"2024-04-25T19:23:35.964061+0000","last_clean":"2024-04-25T19:23:35.964061+0000","last_became_active":"2024-04-25T19:23:34.865877+0000","last_became_peered":"2024-04-25T19:23:34.865877+0000","last_unstale":"2024-04-25T19:23:35.964061+0000","last_undegraded":"2024-04-25T19:23:35.964061+0000","last_fullsized":"2024-04-25T19:23:35.964061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:27.964742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965594+0000","last_change":"2024-04-25T19:23:34.862481+0000","last_active":"2024-04-25T19:23:35.965594+0000","last_peered":"2024-04-25T19:23:35.965594+0000","last_clean":"2024-04-25T19:23:35.965594+0000","last_became_active":"2024-04-25T19:23:34.862068+0000","last_became_peered":"2024-04-25T19:23:34.862068+0000","last_unstale":"2024-04-25T19:23:35.965594+0000","last_undegraded":"2024-04-25T19:23:35.965594+0000","last_fullsized":"2024-04-25T19:23:35.965594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:44:01.779997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.967634+0000","last_change":"2024-04-25T19:23:34.880256+0000","last_active":"2024-04-25T19:23:35.967634+0000","last_peered":"2024-04-25T19:23:35.967634+0000","last_clean":"2024-04-25T19:23:35.967634+0000","last_became_active":"2024-04-25T19:23:34.879974+0000","last_became_peered":"2024-04-25T19:23:34.879974+0000","last_unstale":"2024-04-25T19:23:35.967634+0000","last_undegraded":"2024-04-25T19:23:35.967634+0000","last_fullsized":"2024-04-25T19:23:35.967634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:38.266247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.967058+0000","last_change":"2024-04-25T19:23:34.878985+0000","last_active":"2024-04-25T19:23:35.967058+0000","last_peered":"2024-04-25T19:23:35.967058+0000","last_clean":"2024-04-25T19:23:35.967058+0000","last_became_active":"2024-04-25T19:23:34.878612+0000","last_became_peered":"2024-04-25T19:23:34.878612+0000","last_unstale":"2024-04-25T19:23:35.967058+0000","last_undegraded":"2024-04-25T19:23:35.967058+0000","last_fullsized":"2024-04-25T19:23:35.967058+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:50.863400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880504+0000","last_change":"2024-04-25T19:23:34.881612+0000","last_active":"2024-04-25T19:23:35.880504+0000","last_peered":"2024-04-25T19:23:35.880504+0000","last_clean":"2024-04-25T19:23:35.880504+0000","last_became_active":"2024-04-25T19:23:34.881317+0000","last_became_peered":"2024-04-25T19:23:34.881317+0000","last_unstale":"2024-04-25T19:23:35.880504+0000","last_undegraded":"2024-04-25T19:23:35.880504+0000","last_fullsized":"2024-04-25T19:23:35.880504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:34.075093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.883031+0000","last_change":"2024-04-25T19:23:34.878492+0000","last_active":"2024-04-25T19:23:35.883031+0000","last_peered":"2024-04-25T19:23:35.883031+0000","last_clean":"2024-04-25T19:23:35.883031+0000","last_became_active":"2024-04-25T19:23:34.878151+0000","last_became_peered":"2024-04-25T19:23:34.878151+0000","last_unstale":"2024-04-25T19:23:35.883031+0000","last_undegraded":"2024-04-25T19:23:35.883031+0000","last_fullsized":"2024-04-25T19:23:35.883031+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:38.266247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.969637+0000","last_change":"2024-04-25T19:23:34.882973+0000","last_active":"2024-04-25T19:23:35.969637+0000","last_peered":"2024-04-25T19:23:35.969637+0000","last_clean":"2024-04-25T19:23:35.969637+0000","last_became_active":"2024-04-25T19:23:34.882656+0000","last_became_peered":"2024-04-25T19:23:34.882656+0000","last_unstale":"2024-04-25T19:23:35.969637+0000","last_undegraded":"2024-04-25T19:23:35.969637+0000","last_fullsized":"2024-04-25T19:23:35.969637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:53.321590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.881523+0000","last_change":"2024-04-25T19:23:34.864005+0000","last_active":"2024-04-25T19:23:35.881523+0000","last_peered":"2024-04-25T19:23:35.881523+0000","last_clean":"2024-04-25T19:23:35.881523+0000","last_became_active":"2024-04-25T19:23:34.863664+0000","last_became_peered":"2024-04-25T19:23:34.863664+0000","last_unstale":"2024-04-25T19:23:35.881523+0000","last_undegraded":"2024-04-25T19:23:35.881523+0000","last_fullsized":"2024-04-25T19:23:35.881523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:44:01.779997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.964086+0000","last_change":"2024-04-25T19:23:34.874078+0000","last_active":"2024-04-25T19:23:35.964086+0000","last_peered":"2024-04-25T19:23:35.964086+0000","last_clean":"2024-04-25T19:23:35.964086+0000","last_became_active":"2024-04-25T19:23:34.873735+0000","last_became_peered":"2024-04-25T19:23:34.873735+0000","last_unstale":"2024-04-25T19:23:35.964086+0000","last_undegraded":"2024-04-25T19:23:35.964086+0000","last_fullsized":"2024-04-25T19:23:35.964086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:57:00.631705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965594+0000","last_change":"2024-04-25T19:23:34.861100+0000","last_active":"2024-04-25T19:23:35.965594+0000","last_peered":"2024-04-25T19:23:35.965594+0000","last_clean":"2024-04-25T19:23:35.965594+0000","last_became_active":"2024-04-25T19:23:34.860162+0000","last_became_peered":"2024-04-25T19:23:34.860162+0000","last_unstale":"2024-04-25T19:23:35.965594+0000","last_undegraded":"2024-04-25T19:23:35.965594+0000","last_fullsized":"2024-04-25T19:23:35.965594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:13:21.629386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880387+0000","last_change":"2024-04-25T19:23:34.865302+0000","last_active":"2024-04-25T19:23:35.880387+0000","last_peered":"2024-04-25T19:23:35.880387+0000","last_clean":"2024-04-25T19:23:35.880387+0000","last_became_active":"2024-04-25T19:23:34.864920+0000","last_became_peered":"2024-04-25T19:23:34.864920+0000","last_unstale":"2024-04-25T19:23:35.880387+0000","last_undegraded":"2024-04-25T19:23:35.880387+0000","last_fullsized":"2024-04-25T19:23:35.880387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:38.266247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.969557+0000","last_change":"2024-04-25T19:23:34.878134+0000","last_active":"2024-04-25T19:23:35.969557+0000","last_peered":"2024-04-25T19:23:35.969557+0000","last_clean":"2024-04-25T19:23:35.969557+0000","last_became_active":"2024-04-25T19:23:34.873035+0000","last_became_peered":"2024-04-25T19:23:34.873035+0000","last_unstale":"2024-04-25T19:23:35.969557+0000","last_undegraded":"2024-04-25T19:23:35.969557+0000","last_fullsized":"2024-04-25T19:23:35.969557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:28.601231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.969347+0000","last_change":"2024-04-25T19:23:34.881996+0000","last_active":"2024-04-25T19:23:35.969347+0000","last_peered":"2024-04-25T19:23:35.969347+0000","last_clean":"2024-04-25T19:23:35.969347+0000","last_became_active":"2024-04-25T19:23:34.879575+0000","last_became_peered":"2024-04-25T19:23:34.879575+0000","last_unstale":"2024-04-25T19:23:35.969347+0000","last_undegraded":"2024-04-25T19:23:35.969347+0000","last_fullsized":"2024-04-25T19:23:35.969347+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:42:43.538944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.966552+0000","last_change":"2024-04-25T19:23:34.882530+0000","last_active":"2024-04-25T19:23:35.966552+0000","last_peered":"2024-04-25T19:23:35.966552+0000","last_clean":"2024-04-25T19:23:35.966552+0000","last_became_active":"2024-04-25T19:23:34.882177+0000","last_became_peered":"2024-04-25T19:23:34.882177+0000","last_unstale":"2024-04-25T19:23:35.966552+0000","last_undegraded":"2024-04-25T19:23:35.966552+0000","last_fullsized":"2024-04-25T19:23:35.966552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:05:02.728856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965977+0000","last_change":"2024-04-25T19:23:34.881785+0000","last_active":"2024-04-25T19:23:35.965977+0000","last_peered":"2024-04-25T19:23:35.965977+0000","last_clean":"2024-04-25T19:23:35.965977+0000","last_became_active":"2024-04-25T19:23:34.880764+0000","last_became_peered":"2024-04-25T19:23:34.880764+0000","last_unstale":"2024-04-25T19:23:35.965977+0000","last_undegraded":"2024-04-25T19:23:35.965977+0000","last_fullsized":"2024-04-25T19:23:35.965977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:28.601231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.964648+0000","last_change":"2024-04-25T19:23:34.865442+0000","last_active":"2024-04-25T19:23:35.964648+0000","last_peered":"2024-04-25T19:23:35.964648+0000","last_clean":"2024-04-25T19:23:35.964648+0000","last_became_active":"2024-04-25T19:23:34.865135+0000","last_became_peered":"2024-04-25T19:23:34.865135+0000","last_unstale":"2024-04-25T19:23:35.964648+0000","last_undegraded":"2024-04-25T19:23:35.964648+0000","last_fullsized":"2024-04-25T19:23:35.964648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:43.217717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.879611+0000","last_change":"2024-04-25T19:23:34.883923+0000","last_active":"2024-04-25T19:23:35.879611+0000","last_peered":"2024-04-25T19:23:35.879611+0000","last_clean":"2024-04-25T19:23:35.879611+0000","last_became_active":"2024-04-25T19:23:34.879560+0000","last_became_peered":"2024-04-25T19:23:34.879560+0000","last_unstale":"2024-04-25T19:23:35.879611+0000","last_undegraded":"2024-04-25T19:23:35.879611+0000","last_fullsized":"2024-04-25T19:23:35.879611+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:00:08.044331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880586+0000","last_change":"2024-04-25T19:23:34.866849+0000","last_active":"2024-04-25T19:23:35.880586+0000","last_peered":"2024-04-25T19:23:35.880586+0000","last_clean":"2024-04-25T19:23:35.880586+0000","last_became_active":"2024-04-25T19:23:34.866413+0000","last_became_peered":"2024-04-25T19:23:34.866413+0000","last_unstale":"2024-04-25T19:23:35.880586+0000","last_undegraded":"2024-04-25T19:23:35.880586+0000","last_fullsized":"2024-04-25T19:23:35.880586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:10.762030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876078+0000","last_change":"2024-04-25T19:23:34.871608+0000","last_active":"2024-04-25T19:23:35.876078+0000","last_peered":"2024-04-25T19:23:35.876078+0000","last_clean":"2024-04-25T19:23:35.876078+0000","last_became_active":"2024-04-25T19:23:34.871267+0000","last_became_peered":"2024-04-25T19:23:34.871267+0000","last_unstale":"2024-04-25T19:23:35.876078+0000","last_undegraded":"2024-04-25T19:23:35.876078+0000","last_fullsized":"2024-04-25T19:23:35.876078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:05.430035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.878558+0000","last_change":"2024-04-25T19:23:34.875883+0000","last_active":"2024-04-25T19:23:35.878558+0000","last_peered":"2024-04-25T19:23:35.878558+0000","last_clean":"2024-04-25T19:23:35.878558+0000","last_became_active":"2024-04-25T19:23:34.875534+0000","last_became_peered":"2024-04-25T19:23:34.875534+0000","last_unstale":"2024-04-25T19:23:35.878558+0000","last_undegraded":"2024-04-25T19:23:35.878558+0000","last_fullsized":"2024-04-25T19:23:35.878558+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:48.768523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882696+0000","last_change":"2024-04-25T19:23:34.884658+0000","last_active":"2024-04-25T19:23:35.882696+0000","last_peered":"2024-04-25T19:23:35.882696+0000","last_clean":"2024-04-25T19:23:35.882696+0000","last_became_active":"2024-04-25T19:23:34.883491+0000","last_became_peered":"2024-04-25T19:23:34.883491+0000","last_unstale":"2024-04-25T19:23:35.882696+0000","last_undegraded":"2024-04-25T19:23:35.882696+0000","last_fullsized":"2024-04-25T19:23:35.882696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:47:22.676497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.966674+0000","last_change":"2024-04-25T19:23:34.869510+0000","last_active":"2024-04-25T19:23:35.966674+0000","last_peered":"2024-04-25T19:23:35.966674+0000","last_clean":"2024-04-25T19:23:35.966674+0000","last_became_active":"2024-04-25T19:23:34.869160+0000","last_became_peered":"2024-04-25T19:23:34.869160+0000","last_unstale":"2024-04-25T19:23:35.966674+0000","last_undegraded":"2024-04-25T19:23:35.966674+0000","last_fullsized":"2024-04-25T19:23:35.966674+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:10.419265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882907+0000","last_change":"2024-04-25T19:23:34.884515+0000","last_active":"2024-04-25T19:23:35.882907+0000","last_peered":"2024-04-25T19:23:35.882907+0000","last_clean":"2024-04-25T19:23:35.882907+0000","last_became_active":"2024-04-25T19:23:34.884123+0000","last_became_peered":"2024-04-25T19:23:34.884123+0000","last_unstale":"2024-04-25T19:23:35.882907+0000","last_undegraded":"2024-04-25T19:23:35.882907+0000","last_fullsized":"2024-04-25T19:23:35.882907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:50.863400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.881873+0000","last_change":"2024-04-25T19:23:34.869345+0000","last_active":"2024-04-25T19:23:35.881873+0000","last_peered":"2024-04-25T19:23:35.881873+0000","last_clean":"2024-04-25T19:23:35.881873+0000","last_became_active":"2024-04-25T19:23:34.867833+0000","last_became_peered":"2024-04-25T19:23:34.867833+0000","last_unstale":"2024-04-25T19:23:35.881873+0000","last_undegraded":"2024-04-25T19:23:35.881873+0000","last_fullsized":"2024-04-25T19:23:35.881873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:13:21.629386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.879765+0000","last_change":"2024-04-25T19:23:34.863884+0000","last_active":"2024-04-25T19:23:35.879765+0000","last_peered":"2024-04-25T19:23:35.879765+0000","last_clean":"2024-04-25T19:23:35.879765+0000","last_became_active":"2024-04-25T19:23:34.863497+0000","last_became_peered":"2024-04-25T19:23:34.863497+0000","last_unstale":"2024-04-25T19:23:35.879765+0000","last_undegraded":"2024-04-25T19:23:35.879765+0000","last_fullsized":"2024-04-25T19:23:35.879765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:11.081868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.967665+0000","last_change":"2024-04-25T19:23:34.867175+0000","last_active":"2024-04-25T19:23:35.967665+0000","last_peered":"2024-04-25T19:23:35.967665+0000","last_clean":"2024-04-25T19:23:35.967665+0000","last_became_active":"2024-04-25T19:23:34.866604+0000","last_became_peered":"2024-04-25T19:23:34.866604+0000","last_unstale":"2024-04-25T19:23:35.967665+0000","last_undegraded":"2024-04-25T19:23:35.967665+0000","last_fullsized":"2024-04-25T19:23:35.967665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:01.314162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.967920+0000","last_change":"2024-04-25T19:23:34.878585+0000","last_active":"2024-04-25T19:23:35.967920+0000","last_peered":"2024-04-25T19:23:35.967920+0000","last_clean":"2024-04-25T19:23:35.967920+0000","last_became_active":"2024-04-25T19:23:34.874819+0000","last_became_peered":"2024-04-25T19:23:34.874819+0000","last_unstale":"2024-04-25T19:23:35.967920+0000","last_undegraded":"2024-04-25T19:23:35.967920+0000","last_fullsized":"2024-04-25T19:23:35.967920+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:00:08.044331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.968487+0000","last_change":"2024-04-25T19:23:34.885533+0000","last_active":"2024-04-25T19:23:35.968487+0000","last_peered":"2024-04-25T19:23:35.968487+0000","last_clean":"2024-04-25T19:23:35.968487+0000","last_became_active":"2024-04-25T19:23:34.885171+0000","last_became_peered":"2024-04-25T19:23:34.885171+0000","last_unstale":"2024-04-25T19:23:35.968487+0000","last_undegraded":"2024-04-25T19:23:35.968487+0000","last_fullsized":"2024-04-25T19:23:35.968487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:12:01.307874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876755+0000","last_change":"2024-04-25T19:23:34.877363+0000","last_active":"2024-04-25T19:23:35.876755+0000","last_peered":"2024-04-25T19:23:35.876755+0000","last_clean":"2024-04-25T19:23:35.876755+0000","last_became_active":"2024-04-25T19:23:34.877059+0000","last_became_peered":"2024-04-25T19:23:34.877059+0000","last_unstale":"2024-04-25T19:23:35.876755+0000","last_undegraded":"2024-04-25T19:23:35.876755+0000","last_fullsized":"2024-04-25T19:23:35.876755+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:34.075093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.968221+0000","last_change":"2024-04-25T19:23:33.869661+0000","last_active":"2024-04-25T19:23:35.968221+0000","last_peered":"2024-04-25T19:23:35.968221+0000","last_clean":"2024-04-25T19:23:35.968221+0000","last_became_active":"2024-04-25T19:23:33.869333+0000","last_became_peered":"2024-04-25T19:23:33.869333+0000","last_unstale":"2024-04-25T19:23:35.968221+0000","last_undegraded":"2024-04-25T19:23:35.968221+0000","last_fullsized":"2024-04-25T19:23:35.968221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:29.370419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.968291+0000","last_change":"2024-04-25T19:23:34.872260+0000","last_active":"2024-04-25T19:23:35.968291+0000","last_peered":"2024-04-25T19:23:35.968291+0000","last_clean":"2024-04-25T19:23:35.968291+0000","last_became_active":"2024-04-25T19:23:34.871927+0000","last_became_peered":"2024-04-25T19:23:34.871927+0000","last_unstale":"2024-04-25T19:23:35.968291+0000","last_undegraded":"2024-04-25T19:23:35.968291+0000","last_fullsized":"2024-04-25T19:23:35.968291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:34.178623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876893+0000","last_change":"2024-04-25T19:23:33.862637+0000","last_active":"2024-04-25T19:23:35.876893+0000","last_peered":"2024-04-25T19:23:35.876893+0000","last_clean":"2024-04-25T19:23:35.876893+0000","last_became_active":"2024-04-25T19:23:33.862409+0000","last_became_peered":"2024-04-25T19:23:33.862409+0000","last_unstale":"2024-04-25T19:23:35.876893+0000","last_undegraded":"2024-04-25T19:23:35.876893+0000","last_fullsized":"2024-04-25T19:23:35.876893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:42.202405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.879858+0000","last_change":"2024-04-25T19:23:34.879297+0000","last_active":"2024-04-25T19:23:35.879858+0000","last_peered":"2024-04-25T19:23:35.879858+0000","last_clean":"2024-04-25T19:23:35.879858+0000","last_became_active":"2024-04-25T19:23:34.876596+0000","last_became_peered":"2024-04-25T19:23:34.876596+0000","last_unstale":"2024-04-25T19:23:35.879858+0000","last_undegraded":"2024-04-25T19:23:35.879858+0000","last_fullsized":"2024-04-25T19:23:35.879858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:05.430035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.966027+0000","last_change":"2024-04-25T19:23:33.861801+0000","last_active":"2024-04-25T19:23:35.966027+0000","last_peered":"2024-04-25T19:23:35.966027+0000","last_clean":"2024-04-25T19:23:35.966027+0000","last_became_active":"2024-04-25T19:23:33.861477+0000","last_became_peered":"2024-04-25T19:23:33.861477+0000","last_unstale":"2024-04-25T19:23:35.966027+0000","last_undegraded":"2024-04-25T19:23:35.966027+0000","last_fullsized":"2024-04-25T19:23:35.966027+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:10.066556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.883088+0000","last_change":"2024-04-25T19:23:34.890813+0000","last_active":"2024-04-25T19:23:35.883088+0000","last_peered":"2024-04-25T19:23:35.883088+0000","last_clean":"2024-04-25T19:23:35.883088+0000","last_became_active":"2024-04-25T19:23:34.889398+0000","last_became_peered":"2024-04-25T19:23:34.889398+0000","last_unstale":"2024-04-25T19:23:35.883088+0000","last_undegraded":"2024-04-25T19:23:35.883088+0000","last_fullsized":"2024-04-25T19:23:35.883088+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:01.314162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965032+0000","last_change":"2024-04-25T19:23:33.861932+0000","last_active":"2024-04-25T19:23:35.965032+0000","last_peered":"2024-04-25T19:23:35.965032+0000","last_clean":"2024-04-25T19:23:35.965032+0000","last_became_active":"2024-04-25T19:23:33.860394+0000","last_became_peered":"2024-04-25T19:23:33.860394+0000","last_unstale":"2024-04-25T19:23:35.965032+0000","last_undegraded":"2024-04-25T19:23:35.965032+0000","last_fullsized":"2024-04-25T19:23:35.965032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:30:21.396542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.968756+0000","last_change":"2024-04-25T19:23:34.877686+0000","last_active":"2024-04-25T19:23:35.968756+0000","last_peered":"2024-04-25T19:23:35.968756+0000","last_clean":"2024-04-25T19:23:35.968756+0000","last_became_active":"2024-04-25T19:23:34.876701+0000","last_became_peered":"2024-04-25T19:23:34.876701+0000","last_unstale":"2024-04-25T19:23:35.968756+0000","last_undegraded":"2024-04-25T19:23:35.968756+0000","last_fullsized":"2024-04-25T19:23:35.968756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:49.384633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880075+0000","last_change":"2024-04-25T19:23:33.861192+0000","last_active":"2024-04-25T19:23:35.880075+0000","last_peered":"2024-04-25T19:23:35.880075+0000","last_clean":"2024-04-25T19:23:35.880075+0000","last_became_active":"2024-04-25T19:23:33.860848+0000","last_became_peered":"2024-04-25T19:23:33.860848+0000","last_unstale":"2024-04-25T19:23:35.880075+0000","last_undegraded":"2024-04-25T19:23:35.880075+0000","last_fullsized":"2024-04-25T19:23:35.880075+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:10:33.260974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880892+0000","last_change":"2024-04-25T19:23:34.868910+0000","last_active":"2024-04-25T19:23:35.880892+0000","last_peered":"2024-04-25T19:23:35.880892+0000","last_clean":"2024-04-25T19:23:35.880892+0000","last_became_active":"2024-04-25T19:23:34.868475+0000","last_became_peered":"2024-04-25T19:23:34.868475+0000","last_unstale":"2024-04-25T19:23:35.880892+0000","last_undegraded":"2024-04-25T19:23:35.880892+0000","last_fullsized":"2024-04-25T19:23:35.880892+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:01.314162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880941+0000","last_change":"2024-04-25T19:23:33.859288+0000","last_active":"2024-04-25T19:23:35.880941+0000","last_peered":"2024-04-25T19:23:35.880941+0000","last_clean":"2024-04-25T19:23:35.880941+0000","last_became_active":"2024-04-25T19:23:33.858841+0000","last_became_peered":"2024-04-25T19:23:33.858841+0000","last_unstale":"2024-04-25T19:23:35.880941+0000","last_undegraded":"2024-04-25T19:23:35.880941+0000","last_fullsized":"2024-04-25T19:23:35.880941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:56:59.616393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.879395+0000","last_change":"2024-04-25T19:23:34.874492+0000","last_active":"2024-04-25T19:23:35.879395+0000","last_peered":"2024-04-25T19:23:35.879395+0000","last_clean":"2024-04-25T19:23:35.879395+0000","last_became_active":"2024-04-25T19:23:34.874045+0000","last_became_peered":"2024-04-25T19:23:34.874045+0000","last_unstale":"2024-04-25T19:23:35.879395+0000","last_undegraded":"2024-04-25T19:23:35.879395+0000","last_fullsized":"2024-04-25T19:23:35.879395+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:46.850558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965400+0000","last_change":"2024-04-25T19:23:33.853794+0000","last_active":"2024-04-25T19:23:35.965400+0000","last_peered":"2024-04-25T19:23:35.965400+0000","last_clean":"2024-04-25T19:23:35.965400+0000","last_became_active":"2024-04-25T19:23:33.853451+0000","last_became_peered":"2024-04-25T19:23:33.853451+0000","last_unstale":"2024-04-25T19:23:35.965400+0000","last_undegraded":"2024-04-25T19:23:35.965400+0000","last_fullsized":"2024-04-25T19:23:35.965400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:20:43.666409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882941+0000","last_change":"2024-04-25T19:23:34.879256+0000","last_active":"2024-04-25T19:23:35.882941+0000","last_peered":"2024-04-25T19:23:35.882941+0000","last_clean":"2024-04-25T19:23:35.882941+0000","last_became_active":"2024-04-25T19:23:34.878927+0000","last_became_peered":"2024-04-25T19:23:34.878927+0000","last_unstale":"2024-04-25T19:23:35.882941+0000","last_undegraded":"2024-04-25T19:23:35.882941+0000","last_fullsized":"2024-04-25T19:23:35.882941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:48.768523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.879439+0000","last_change":"2024-04-25T19:23:33.861563+0000","last_active":"2024-04-25T19:23:35.879439+0000","last_peered":"2024-04-25T19:23:35.879439+0000","last_clean":"2024-04-25T19:23:35.879439+0000","last_became_active":"2024-04-25T19:23:33.859069+0000","last_became_peered":"2024-04-25T19:23:33.859069+0000","last_unstale":"2024-04-25T19:23:35.879439+0000","last_undegraded":"2024-04-25T19:23:35.879439+0000","last_fullsized":"2024-04-25T19:23:35.879439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:31:03.100180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.881916+0000","last_change":"2024-04-25T19:23:34.868229+0000","last_active":"2024-04-25T19:23:35.881916+0000","last_peered":"2024-04-25T19:23:35.881916+0000","last_clean":"2024-04-25T19:23:35.881916+0000","last_became_active":"2024-04-25T19:23:34.867693+0000","last_became_peered":"2024-04-25T19:23:34.867693+0000","last_unstale":"2024-04-25T19:23:35.881916+0000","last_undegraded":"2024-04-25T19:23:35.881916+0000","last_fullsized":"2024-04-25T19:23:35.881916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:28.601231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.966342+0000","last_change":"2024-04-25T19:23:33.867663+0000","last_active":"2024-04-25T19:23:35.966342+0000","last_peered":"2024-04-25T19:23:35.966342+0000","last_clean":"2024-04-25T19:23:35.966342+0000","last_became_active":"2024-04-25T19:23:33.867106+0000","last_became_peered":"2024-04-25T19:23:33.867106+0000","last_unstale":"2024-04-25T19:23:35.966342+0000","last_undegraded":"2024-04-25T19:23:35.966342+0000","last_fullsized":"2024-04-25T19:23:35.966342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:00:07.029019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.966209+0000","last_change":"2024-04-25T19:23:34.885804+0000","last_active":"2024-04-25T19:23:35.966209+0000","last_peered":"2024-04-25T19:23:35.966209+0000","last_clean":"2024-04-25T19:23:35.966209+0000","last_became_active":"2024-04-25T19:23:34.885410+0000","last_became_peered":"2024-04-25T19:23:34.885410+0000","last_unstale":"2024-04-25T19:23:35.966209+0000","last_undegraded":"2024-04-25T19:23:35.966209+0000","last_fullsized":"2024-04-25T19:23:35.966209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:13.843985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876849+0000","last_change":"2024-04-25T19:23:33.853876+0000","last_active":"2024-04-25T19:23:35.876849+0000","last_peered":"2024-04-25T19:23:35.876849+0000","last_clean":"2024-04-25T19:23:35.876849+0000","last_became_active":"2024-04-25T19:23:33.853522+0000","last_became_peered":"2024-04-25T19:23:33.853522+0000","last_unstale":"2024-04-25T19:23:35.876849+0000","last_undegraded":"2024-04-25T19:23:35.876849+0000","last_fullsized":"2024-04-25T19:23:35.876849+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:29.370419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.966150+0000","last_change":"2024-04-25T19:23:34.870953+0000","last_active":"2024-04-25T19:23:35.966150+0000","last_peered":"2024-04-25T19:23:35.966150+0000","last_clean":"2024-04-25T19:23:35.966150+0000","last_became_active":"2024-04-25T19:23:34.870048+0000","last_became_peered":"2024-04-25T19:23:34.870048+0000","last_unstale":"2024-04-25T19:23:35.966150+0000","last_undegraded":"2024-04-25T19:23:35.966150+0000","last_fullsized":"2024-04-25T19:23:35.966150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:53.321590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.881352+0000","last_change":"2024-04-25T19:23:33.871669+0000","last_active":"2024-04-25T19:23:35.881352+0000","last_peered":"2024-04-25T19:23:35.881352+0000","last_clean":"2024-04-25T19:23:35.881352+0000","last_became_active":"2024-04-25T19:23:33.870470+0000","last_became_peered":"2024-04-25T19:23:33.870470+0000","last_unstale":"2024-04-25T19:23:35.881352+0000","last_undegraded":"2024-04-25T19:23:35.881352+0000","last_fullsized":"2024-04-25T19:23:35.881352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:15.587996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.881327+0000","last_change":"2024-04-25T19:23:34.888624+0000","last_active":"2024-04-25T19:23:35.881327+0000","last_peered":"2024-04-25T19:23:35.881327+0000","last_clean":"2024-04-25T19:23:35.881327+0000","last_became_active":"2024-04-25T19:23:34.888261+0000","last_became_peered":"2024-04-25T19:23:34.888261+0000","last_unstale":"2024-04-25T19:23:35.881327+0000","last_undegraded":"2024-04-25T19:23:35.881327+0000","last_fullsized":"2024-04-25T19:23:35.881327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:49.384633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.966302+0000","last_change":"2024-04-25T19:23:33.859210+0000","last_active":"2024-04-25T19:23:35.966302+0000","last_peered":"2024-04-25T19:23:35.966302+0000","last_clean":"2024-04-25T19:23:35.966302+0000","last_became_active":"2024-04-25T19:23:33.858457+0000","last_became_peered":"2024-04-25T19:23:33.858457+0000","last_unstale":"2024-04-25T19:23:35.966302+0000","last_undegraded":"2024-04-25T19:23:35.966302+0000","last_fullsized":"2024-04-25T19:23:35.966302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:15.587996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882123+0000","last_change":"2024-04-25T19:23:34.880105+0000","last_active":"2024-04-25T19:23:35.882123+0000","last_peered":"2024-04-25T19:23:35.882123+0000","last_clean":"2024-04-25T19:23:35.882123+0000","last_became_active":"2024-04-25T19:23:34.879850+0000","last_became_peered":"2024-04-25T19:23:34.879850+0000","last_unstale":"2024-04-25T19:23:35.882123+0000","last_undegraded":"2024-04-25T19:23:35.882123+0000","last_fullsized":"2024-04-25T19:23:35.882123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:10.762030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880540+0000","last_change":"2024-04-25T19:23:33.859947+0000","last_active":"2024-04-25T19:23:35.880540+0000","last_peered":"2024-04-25T19:23:35.880540+0000","last_clean":"2024-04-25T19:23:35.880540+0000","last_became_active":"2024-04-25T19:23:33.859569+0000","last_became_peered":"2024-04-25T19:23:33.859569+0000","last_unstale":"2024-04-25T19:23:35.880540+0000","last_undegraded":"2024-04-25T19:23:35.880540+0000","last_fullsized":"2024-04-25T19:23:35.880540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:53.116651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965885+0000","last_change":"2024-04-25T19:23:34.865901+0000","last_active":"2024-04-25T19:23:35.965885+0000","last_peered":"2024-04-25T19:23:35.965885+0000","last_clean":"2024-04-25T19:23:35.965885+0000","last_became_active":"2024-04-25T19:23:34.865562+0000","last_became_peered":"2024-04-25T19:23:34.865562+0000","last_unstale":"2024-04-25T19:23:35.965885+0000","last_undegraded":"2024-04-25T19:23:35.965885+0000","last_fullsized":"2024-04-25T19:23:35.965885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:42:43.538944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882299+0000","last_change":"2024-04-25T19:23:33.865049+0000","last_active":"2024-04-25T19:23:35.882299+0000","last_peered":"2024-04-25T19:23:35.882299+0000","last_clean":"2024-04-25T19:23:35.882299+0000","last_became_active":"2024-04-25T19:23:33.864681+0000","last_became_peered":"2024-04-25T19:23:33.864681+0000","last_unstale":"2024-04-25T19:23:35.882299+0000","last_undegraded":"2024-04-25T19:23:35.882299+0000","last_fullsized":"2024-04-25T19:23:35.882299+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:50.633103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.969103+0000","last_change":"2024-04-25T19:23:34.884245+0000","last_active":"2024-04-25T19:23:35.969103+0000","last_peered":"2024-04-25T19:23:35.969103+0000","last_clean":"2024-04-25T19:23:35.969103+0000","last_became_active":"2024-04-25T19:23:34.883423+0000","last_became_peered":"2024-04-25T19:23:34.883423+0000","last_unstale":"2024-04-25T19:23:35.969103+0000","last_undegraded":"2024-04-25T19:23:35.969103+0000","last_fullsized":"2024-04-25T19:23:35.969103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:13:21.629386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965235+0000","last_change":"2024-04-25T19:23:33.867671+0000","last_active":"2024-04-25T19:23:35.965235+0000","last_peered":"2024-04-25T19:23:35.965235+0000","last_clean":"2024-04-25T19:23:35.965235+0000","last_became_active":"2024-04-25T19:23:33.866592+0000","last_became_peered":"2024-04-25T19:23:33.866592+0000","last_unstale":"2024-04-25T19:23:35.965235+0000","last_undegraded":"2024-04-25T19:23:35.965235+0000","last_fullsized":"2024-04-25T19:23:35.965235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:00.480595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.968438+0000","last_change":"2024-04-25T19:23:34.865331+0000","last_active":"2024-04-25T19:23:35.968438+0000","last_peered":"2024-04-25T19:23:35.968438+0000","last_clean":"2024-04-25T19:23:35.968438+0000","last_became_active":"2024-04-25T19:23:34.863941+0000","last_became_peered":"2024-04-25T19:23:34.863941+0000","last_unstale":"2024-04-25T19:23:35.968438+0000","last_undegraded":"2024-04-25T19:23:35.968438+0000","last_fullsized":"2024-04-25T19:23:35.968438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:34.075093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965648+0000","last_change":"2024-04-25T19:23:33.857697+0000","last_active":"2024-04-25T19:23:35.965648+0000","last_peered":"2024-04-25T19:23:35.965648+0000","last_clean":"2024-04-25T19:23:35.965648+0000","last_became_active":"2024-04-25T19:23:33.857359+0000","last_became_peered":"2024-04-25T19:23:33.857359+0000","last_unstale":"2024-04-25T19:23:35.965648+0000","last_undegraded":"2024-04-25T19:23:35.965648+0000","last_fullsized":"2024-04-25T19:23:35.965648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:04.414723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880308+0000","last_change":"2024-04-25T19:23:34.860729+0000","last_active":"2024-04-25T19:23:35.880308+0000","last_peered":"2024-04-25T19:23:35.880308+0000","last_clean":"2024-04-25T19:23:35.880308+0000","last_became_active":"2024-04-25T19:23:34.860341+0000","last_became_peered":"2024-04-25T19:23:34.860341+0000","last_unstale":"2024-04-25T19:23:35.880308+0000","last_undegraded":"2024-04-25T19:23:35.880308+0000","last_fullsized":"2024-04-25T19:23:35.880308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:34.178623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882877+0000","last_change":"2024-04-25T19:23:33.866277+0000","last_active":"2024-04-25T19:23:35.882877+0000","last_peered":"2024-04-25T19:23:35.882877+0000","last_clean":"2024-04-25T19:23:35.882877+0000","last_became_active":"2024-04-25T19:23:33.865920+0000","last_became_peered":"2024-04-25T19:23:33.865920+0000","last_unstale":"2024-04-25T19:23:35.882877+0000","last_undegraded":"2024-04-25T19:23:35.882877+0000","last_fullsized":"2024-04-25T19:23:35.882877+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:51.486951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882134+0000","last_change":"2024-04-25T19:23:34.860463+0000","last_active":"2024-04-25T19:23:35.882134+0000","last_peered":"2024-04-25T19:23:35.882134+0000","last_clean":"2024-04-25T19:23:35.882134+0000","last_became_active":"2024-04-25T19:23:34.860115+0000","last_became_peered":"2024-04-25T19:23:34.860115+0000","last_unstale":"2024-04-25T19:23:35.882134+0000","last_undegraded":"2024-04-25T19:23:35.882134+0000","last_fullsized":"2024-04-25T19:23:35.882134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:53.321590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880589+0000","last_change":"2024-04-25T19:23:33.863747+0000","last_active":"2024-04-25T19:23:35.880589+0000","last_peered":"2024-04-25T19:23:35.880589+0000","last_clean":"2024-04-25T19:23:35.880589+0000","last_became_active":"2024-04-25T19:23:33.863073+0000","last_became_peered":"2024-04-25T19:23:33.863073+0000","last_unstale":"2024-04-25T19:23:35.880589+0000","last_undegraded":"2024-04-25T19:23:35.880589+0000","last_fullsized":"2024-04-25T19:23:35.880589+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:22:45.334470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882746+0000","last_change":"2024-04-25T19:23:34.884965+0000","last_active":"2024-04-25T19:23:35.882746+0000","last_peered":"2024-04-25T19:23:35.882746+0000","last_clean":"2024-04-25T19:23:35.882746+0000","last_became_active":"2024-04-25T19:23:34.884057+0000","last_became_peered":"2024-04-25T19:23:34.884057+0000","last_unstale":"2024-04-25T19:23:35.882746+0000","last_undegraded":"2024-04-25T19:23:35.882746+0000","last_fullsized":"2024-04-25T19:23:35.882746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:22:16.525112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880108+0000","last_change":"2024-04-25T19:23:33.863501+0000","last_active":"2024-04-25T19:23:35.880108+0000","last_peered":"2024-04-25T19:23:35.880108+0000","last_clean":"2024-04-25T19:23:35.880108+0000","last_became_active":"2024-04-25T19:23:33.863105+0000","last_became_peered":"2024-04-25T19:23:33.863105+0000","last_unstale":"2024-04-25T19:23:35.880108+0000","last_undegraded":"2024-04-25T19:23:35.880108+0000","last_fullsized":"2024-04-25T19:23:35.880108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:26.949430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965267+0000","last_change":"2024-04-25T19:23:34.873219+0000","last_active":"2024-04-25T19:23:35.965267+0000","last_peered":"2024-04-25T19:23:35.965267+0000","last_clean":"2024-04-25T19:23:35.965267+0000","last_became_active":"2024-04-25T19:23:34.872851+0000","last_became_peered":"2024-04-25T19:23:34.872851+0000","last_unstale":"2024-04-25T19:23:35.965267+0000","last_undegraded":"2024-04-25T19:23:35.965267+0000","last_fullsized":"2024-04-25T19:23:35.965267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:30.385732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880267+0000","last_change":"2024-04-25T19:23:33.861614+0000","last_active":"2024-04-25T19:23:35.880267+0000","last_peered":"2024-04-25T19:23:35.880267+0000","last_clean":"2024-04-25T19:23:35.880267+0000","last_became_active":"2024-04-25T19:23:33.861269+0000","last_became_peered":"2024-04-25T19:23:33.861269+0000","last_unstale":"2024-04-25T19:23:35.880267+0000","last_undegraded":"2024-04-25T19:23:35.880267+0000","last_fullsized":"2024-04-25T19:23:35.880267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:12:04.487364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.964269+0000","last_change":"2024-04-25T19:23:34.874432+0000","last_active":"2024-04-25T19:23:35.964269+0000","last_peered":"2024-04-25T19:23:35.964269+0000","last_clean":"2024-04-25T19:23:35.964269+0000","last_became_active":"2024-04-25T19:23:34.871916+0000","last_became_peered":"2024-04-25T19:23:34.871916+0000","last_unstale":"2024-04-25T19:23:35.964269+0000","last_undegraded":"2024-04-25T19:23:35.964269+0000","last_fullsized":"2024-04-25T19:23:35.964269+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:31:04.115493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876202+0000","last_change":"2024-04-25T19:23:33.856541+0000","last_active":"2024-04-25T19:23:35.876202+0000","last_peered":"2024-04-25T19:23:35.876202+0000","last_clean":"2024-04-25T19:23:35.876202+0000","last_became_active":"2024-04-25T19:23:33.856217+0000","last_became_peered":"2024-04-25T19:23:33.856217+0000","last_unstale":"2024-04-25T19:23:35.876202+0000","last_undegraded":"2024-04-25T19:23:35.876202+0000","last_fullsized":"2024-04-25T19:23:35.876202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:51.486951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.964495+0000","last_change":"2024-04-25T19:23:34.874258+0000","last_active":"2024-04-25T19:23:35.964495+0000","last_peered":"2024-04-25T19:23:35.964495+0000","last_clean":"2024-04-25T19:23:35.964495+0000","last_became_active":"2024-04-25T19:23:34.873947+0000","last_became_peered":"2024-04-25T19:23:34.873947+0000","last_unstale":"2024-04-25T19:23:35.964495+0000","last_undegraded":"2024-04-25T19:23:35.964495+0000","last_fullsized":"2024-04-25T19:23:35.964495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:09.131145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.968204+0000","last_change":"2024-04-25T19:23:33.865209+0000","last_active":"2024-04-25T19:23:35.968204+0000","last_peered":"2024-04-25T19:23:35.968204+0000","last_clean":"2024-04-25T19:23:35.968204+0000","last_became_active":"2024-04-25T19:23:33.864805+0000","last_became_peered":"2024-04-25T19:23:33.864805+0000","last_unstale":"2024-04-25T19:23:35.968204+0000","last_undegraded":"2024-04-25T19:23:35.968204+0000","last_fullsized":"2024-04-25T19:23:35.968204+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:51.486951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.964197+0000","last_change":"2024-04-25T19:23:34.870418+0000","last_active":"2024-04-25T19:23:35.964197+0000","last_peered":"2024-04-25T19:23:35.964197+0000","last_clean":"2024-04-25T19:23:35.964197+0000","last_became_active":"2024-04-25T19:23:34.870084+0000","last_became_peered":"2024-04-25T19:23:34.870084+0000","last_unstale":"2024-04-25T19:23:35.964197+0000","last_undegraded":"2024-04-25T19:23:35.964197+0000","last_fullsized":"2024-04-25T19:23:35.964197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:12:05.502676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880428+0000","last_change":"2024-04-25T19:23:33.860629+0000","last_active":"2024-04-25T19:23:35.880428+0000","last_peered":"2024-04-25T19:23:35.880428+0000","last_clean":"2024-04-25T19:23:35.880428+0000","last_became_active":"2024-04-25T19:23:33.860264+0000","last_became_peered":"2024-04-25T19:23:33.860264+0000","last_unstale":"2024-04-25T19:23:35.880428+0000","last_undegraded":"2024-04-25T19:23:35.880428+0000","last_fullsized":"2024-04-25T19:23:35.880428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:43.245901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.967492+0000","last_change":"2024-04-25T19:23:34.882245+0000","last_active":"2024-04-25T19:23:35.967492+0000","last_peered":"2024-04-25T19:23:35.967492+0000","last_clean":"2024-04-25T19:23:35.967492+0000","last_became_active":"2024-04-25T19:23:34.880684+0000","last_became_peered":"2024-04-25T19:23:34.880684+0000","last_unstale":"2024-04-25T19:23:35.967492+0000","last_undegraded":"2024-04-25T19:23:35.967492+0000","last_fullsized":"2024-04-25T19:23:35.967492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:48.768523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.879130+0000","last_change":"2024-04-25T19:23:33.869661+0000","last_active":"2024-04-25T19:23:35.879130+0000","last_peered":"2024-04-25T19:23:35.879130+0000","last_clean":"2024-04-25T19:23:35.879130+0000","last_became_active":"2024-04-25T19:23:33.869274+0000","last_became_peered":"2024-04-25T19:23:33.869274+0000","last_unstale":"2024-04-25T19:23:35.879130+0000","last_undegraded":"2024-04-25T19:23:35.879130+0000","last_fullsized":"2024-04-25T19:23:35.879130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:45.835245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965406+0000","last_change":"2024-04-25T19:23:34.873322+0000","last_active":"2024-04-25T19:23:35.965406+0000","last_peered":"2024-04-25T19:23:35.965406+0000","last_clean":"2024-04-25T19:23:35.965406+0000","last_became_active":"2024-04-25T19:23:34.873003+0000","last_became_peered":"2024-04-25T19:23:34.873003+0000","last_unstale":"2024-04-25T19:23:35.965406+0000","last_undegraded":"2024-04-25T19:23:35.965406+0000","last_fullsized":"2024-04-25T19:23:35.965406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:52.502263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882959+0000","last_change":"2024-04-25T19:23:33.869537+0000","last_active":"2024-04-25T19:23:35.882959+0000","last_peered":"2024-04-25T19:23:35.882959+0000","last_clean":"2024-04-25T19:23:35.882959+0000","last_became_active":"2024-04-25T19:23:33.869181+0000","last_became_peered":"2024-04-25T19:23:33.869181+0000","last_unstale":"2024-04-25T19:23:35.882959+0000","last_undegraded":"2024-04-25T19:23:35.882959+0000","last_fullsized":"2024-04-25T19:23:35.882959+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:03:16.565706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.881949+0000","last_change":"2024-04-25T19:23:34.887744+0000","last_active":"2024-04-25T19:23:35.881949+0000","last_peered":"2024-04-25T19:23:35.881949+0000","last_clean":"2024-04-25T19:23:35.881949+0000","last_became_active":"2024-04-25T19:23:34.887465+0000","last_became_peered":"2024-04-25T19:23:34.887465+0000","last_unstale":"2024-04-25T19:23:35.881949+0000","last_undegraded":"2024-04-25T19:23:35.881949+0000","last_fullsized":"2024-04-25T19:23:35.881949+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:42:43.538944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876981+0000","last_change":"2024-04-25T19:23:33.860892+0000","last_active":"2024-04-25T19:23:35.876981+0000","last_peered":"2024-04-25T19:23:35.876981+0000","last_clean":"2024-04-25T19:23:35.876981+0000","last_became_active":"2024-04-25T19:23:33.860529+0000","last_became_peered":"2024-04-25T19:23:33.860529+0000","last_unstale":"2024-04-25T19:23:35.876981+0000","last_undegraded":"2024-04-25T19:23:35.876981+0000","last_fullsized":"2024-04-25T19:23:35.876981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:03:16.565706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876262+0000","last_change":"2024-04-25T19:23:34.886345+0000","last_active":"2024-04-25T19:23:35.876262+0000","last_peered":"2024-04-25T19:23:35.876262+0000","last_clean":"2024-04-25T19:23:35.876262+0000","last_became_active":"2024-04-25T19:23:34.885598+0000","last_became_peered":"2024-04-25T19:23:34.885598+0000","last_unstale":"2024-04-25T19:23:35.876262+0000","last_undegraded":"2024-04-25T19:23:35.876262+0000","last_fullsized":"2024-04-25T19:23:35.876262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:00:08.044331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882731+0000","last_change":"2024-04-25T19:23:33.859331+0000","last_active":"2024-04-25T19:23:35.882731+0000","last_peered":"2024-04-25T19:23:35.882731+0000","last_clean":"2024-04-25T19:23:35.882731+0000","last_became_active":"2024-04-25T19:23:33.858500+0000","last_became_peered":"2024-04-25T19:23:33.858500+0000","last_unstale":"2024-04-25T19:23:35.882731+0000","last_undegraded":"2024-04-25T19:23:35.882731+0000","last_fullsized":"2024-04-25T19:23:35.882731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:29.370419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.967861+0000","last_change":"2024-04-25T19:23:34.866340+0000","last_active":"2024-04-25T19:23:35.967861+0000","last_peered":"2024-04-25T19:23:35.967861+0000","last_clean":"2024-04-25T19:23:35.967861+0000","last_became_active":"2024-04-25T19:23:34.865996+0000","last_became_peered":"2024-04-25T19:23:34.865996+0000","last_unstale":"2024-04-25T19:23:35.967861+0000","last_undegraded":"2024-04-25T19:23:35.967861+0000","last_fullsized":"2024-04-25T19:23:35.967861+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:11.081868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876393+0000","last_change":"2024-04-25T19:23:33.855462+0000","last_active":"2024-04-25T19:23:35.876393+0000","last_peered":"2024-04-25T19:23:35.876393+0000","last_clean":"2024-04-25T19:23:35.876393+0000","last_became_active":"2024-04-25T19:23:33.855113+0000","last_became_peered":"2024-04-25T19:23:33.855113+0000","last_unstale":"2024-04-25T19:23:35.876393+0000","last_undegraded":"2024-04-25T19:23:35.876393+0000","last_fullsized":"2024-04-25T19:23:35.876393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:50.633103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876567+0000","last_change":"2024-04-25T19:23:34.865944+0000","last_active":"2024-04-25T19:23:35.876567+0000","last_peered":"2024-04-25T19:23:35.876567+0000","last_clean":"2024-04-25T19:23:35.876567+0000","last_became_active":"2024-04-25T19:23:34.865591+0000","last_became_peered":"2024-04-25T19:23:34.865591+0000","last_unstale":"2024-04-25T19:23:35.876567+0000","last_undegraded":"2024-04-25T19:23:35.876567+0000","last_fullsized":"2024-04-25T19:23:35.876567+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:34.178623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882425+0000","last_change":"2024-04-25T19:23:33.869538+0000","last_active":"2024-04-25T19:23:35.882425+0000","last_peered":"2024-04-25T19:23:35.882425+0000","last_clean":"2024-04-25T19:23:35.882425+0000","last_became_active":"2024-04-25T19:23:33.869167+0000","last_became_peered":"2024-04-25T19:23:33.869167+0000","last_unstale":"2024-04-25T19:23:35.882425+0000","last_undegraded":"2024-04-25T19:23:35.882425+0000","last_fullsized":"2024-04-25T19:23:35.882425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:00.480595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965288+0000","last_change":"2024-04-25T19:23:34.881366+0000","last_active":"2024-04-25T19:23:35.965288+0000","last_peered":"2024-04-25T19:23:35.965288+0000","last_clean":"2024-04-25T19:23:35.965288+0000","last_became_active":"2024-04-25T19:23:34.881035+0000","last_became_peered":"2024-04-25T19:23:34.881035+0000","last_unstale":"2024-04-25T19:23:35.965288+0000","last_undegraded":"2024-04-25T19:23:35.965288+0000","last_fullsized":"2024-04-25T19:23:35.965288+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:49.384633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880084+0000","last_change":"2024-04-25T19:23:33.860231+0000","last_active":"2024-04-25T19:23:35.880084+0000","last_peered":"2024-04-25T19:23:35.880084+0000","last_clean":"2024-04-25T19:23:35.880084+0000","last_became_active":"2024-04-25T19:23:33.859759+0000","last_became_peered":"2024-04-25T19:23:33.859759+0000","last_unstale":"2024-04-25T19:23:35.880084+0000","last_undegraded":"2024-04-25T19:23:35.880084+0000","last_fullsized":"2024-04-25T19:23:35.880084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:43.913546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.878990+0000","last_change":"2024-04-25T19:23:34.884267+0000","last_active":"2024-04-25T19:23:35.878990+0000","last_peered":"2024-04-25T19:23:35.878990+0000","last_clean":"2024-04-25T19:23:35.878990+0000","last_became_active":"2024-04-25T19:23:34.883765+0000","last_became_peered":"2024-04-25T19:23:34.883765+0000","last_unstale":"2024-04-25T19:23:35.878990+0000","last_undegraded":"2024-04-25T19:23:35.878990+0000","last_fullsized":"2024-04-25T19:23:35.878990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:16.603308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965963+0000","last_change":"2024-04-25T19:23:33.868354+0000","last_active":"2024-04-25T19:23:35.965963+0000","last_peered":"2024-04-25T19:23:35.965963+0000","last_clean":"2024-04-25T19:23:35.965963+0000","last_became_active":"2024-04-25T19:23:33.867050+0000","last_became_peered":"2024-04-25T19:23:33.867050+0000","last_unstale":"2024-04-25T19:23:35.965963+0000","last_undegraded":"2024-04-25T19:23:35.965963+0000","last_fullsized":"2024-04-25T19:23:35.965963+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:45.835245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.968849+0000","last_change":"2024-04-25T19:23:34.874503+0000","last_active":"2024-04-25T19:23:35.968849+0000","last_peered":"2024-04-25T19:23:35.968849+0000","last_clean":"2024-04-25T19:23:35.968849+0000","last_became_active":"2024-04-25T19:23:34.874028+0000","last_became_peered":"2024-04-25T19:23:34.874028+0000","last_unstale":"2024-04-25T19:23:35.968849+0000","last_undegraded":"2024-04-25T19:23:35.968849+0000","last_fullsized":"2024-04-25T19:23:35.968849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:44:01.779997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.968534+0000","last_change":"2024-04-25T19:23:33.871947+0000","last_active":"2024-04-25T19:23:35.968534+0000","last_peered":"2024-04-25T19:23:35.968534+0000","last_clean":"2024-04-25T19:23:35.968534+0000","last_became_active":"2024-04-25T19:23:33.870719+0000","last_became_peered":"2024-04-25T19:23:33.870719+0000","last_unstale":"2024-04-25T19:23:35.968534+0000","last_undegraded":"2024-04-25T19:23:35.968534+0000","last_fullsized":"2024-04-25T19:23:35.968534+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:03:16.565706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":133,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.969409+0000","last_change":"2024-04-25T19:22:06.081655+0000","last_active":"2024-04-25T19:23:35.969409+0000","last_peered":"2024-04-25T19:23:35.969409+0000","last_clean":"2024-04-25T19:23:35.969409+0000","last_became_active":"2024-04-25T19:22:06.078999+0000","last_became_peered":"2024-04-25T19:22:06.078999+0000","last_unstale":"2024-04-25T19:23:35.969409+0000","last_undegraded":"2024-04-25T19:23:35.969409+0000","last_fullsized":"2024-04-25T19:23:35.969409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_clean_scrub_stamp":"2024-04-25T19:22:04.921147+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:30.543734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":737066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":380928,"data_stored":147224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":380928,"data_stored":147280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":380928,"data_stored":146712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":148242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":146678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":148242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":966656,"data_stored":736976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T19:23:44.877 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T19:23:45.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.159+0000 7f9756a00640 1 Processor -- start 2024-04-25T19:23:45.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.159+0000 7f9756a00640 1 -- start start 2024-04-25T19:23:45.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.161+0000 7f9756a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f97500b6e10 0x7f975015a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:45.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.161+0000 7f9756a00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97500b7220 con 0x7f97500cf2f0 2024-04-25T19:23:45.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.161+0000 7f9756a00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97500b74d0 con 0x7f97501608d0 2024-04-25T19:23:45.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.161+0000 7f9756a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f975006f870 con 0x7f97500b6e10 2024-04-25T19:23:45.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.162+0000 7f9755600640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f97500cf2f0 0x7f97500b4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:40244/0 (socket says 172.21.15.131:40244) 2024-04-25T19:23:45.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.162+0000 7f9755600640 1 -- 172.21.15.131:0/1136618146 learned_addr learned my addr 172.21.15.131:0/1136618146 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:45.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.162+0000 7f974fe00640 1 -- 172.21.15.131:0/1136618146 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3370372222 0 0) 0x7f97500b7220 con 0x7f97500cf2f0 2024-04-25T19:23:45.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.162+0000 7f9754c00640 1 --2- 172.21.15.131:0/1136618146 >> v2:172.21.15.195:3300/0 conn(0x7f97500b6e10 0x7f975015a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:45.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.162+0000 7f974fe00640 1 -- 172.21.15.131:0/1136618146 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9738003520 con 0x7f97500cf2f0 2024-04-25T19:23:45.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.162+0000 7f974fe00640 1 -- 172.21.15.131:0/1136618146 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 82930807 0 0) 0x7f9738003520 con 0x7f97500cf2f0 2024-04-25T19:23:45.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.162+0000 7f974fe00640 1 -- 172.21.15.131:0/1136618146 >> v2:172.21.15.195:3300/0 conn(0x7f97500b6e10 msgr2=0x7f975015a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:45.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.162+0000 7f974fe00640 1 --2- 172.21.15.131:0/1136618146 >> v2:172.21.15.195:3300/0 conn(0x7f97500b6e10 0x7f975015a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:45.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.162+0000 7f974fe00640 1 -- 172.21.15.131:0/1136618146 >> v1:172.21.15.195:6789/0 conn(0x7f97501608d0 legacy=0x7f9750160ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:45.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.162+0000 7f974fe00640 1 -- 172.21.15.131:0/1136618146 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97500b77b0 con 0x7f97500cf2f0 2024-04-25T19:23:45.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.163+0000 7f974fe00640 1 -- 172.21.15.131:0/1136618146 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f9744001670 con 0x7f97500cf2f0 2024-04-25T19:23:45.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.163+0000 7f974fe00640 1 -- 172.21.15.131:0/1136618146 >> v1:172.21.15.131:6789/0 conn(0x7f97500cf2f0 legacy=0x7f97500b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:45.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.163+0000 7f974fe00640 1 --2- 172.21.15.131:0/1136618146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9738003a00 0x7f9738003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:45.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.163+0000 7f974fe00640 1 --2- 172.21.15.131:0/1136618146 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9738004800 0x7f9738004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:45.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.163+0000 7f974fe00640 1 --2- 172.21.15.131:0/1136618146 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9738005270 0x7f973800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:45.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.163+0000 7f974fe00640 1 -- 172.21.15.131:0/1136618146 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f975006f870 con 0x7f9738003a00 2024-04-25T19:23:45.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.163+0000 7f974fe00640 1 -- 172.21.15.131:0/1136618146 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f973800c190 con 0x7f9738004800 2024-04-25T19:23:45.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.163+0000 7f974fe00640 1 -- 172.21.15.131:0/1136618146 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f973800c390 con 0x7f9738005270 2024-04-25T19:23:45.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.163+0000 7f9755600640 1 --2- 172.21.15.131:0/1136618146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9738003a00 0x7f9738003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:45.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.163+0000 7f9754c00640 1 --2- 172.21.15.131:0/1136618146 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9738004800 0x7f9738004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:45.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.163+0000 7f9755600640 1 -- 172.21.15.131:0/1136618146 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9738005270 msgr2=0x7f973800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:45.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.163+0000 7f9756000640 1 --2- 172.21.15.131:0/1136618146 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9738005270 0x7f973800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:45.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.164+0000 7f9755600640 1 --2- 172.21.15.131:0/1136618146 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9738005270 0x7f973800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:45.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.164+0000 7f9755600640 1 -- 172.21.15.131:0/1136618146 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9738004800 msgr2=0x7f9738004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:45.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.164+0000 7f9755600640 1 --2- 172.21.15.131:0/1136618146 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9738004800 0x7f9738004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:45.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.164+0000 7f9755600640 1 -- 172.21.15.131:0/1136618146 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9738003520 con 0x7f9738003a00 2024-04-25T19:23:45.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.164+0000 7f9754c00640 1 --2- 172.21.15.131:0/1136618146 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9738004800 0x7f9738004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:45.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.164+0000 7f9756000640 1 --2- 172.21.15.131:0/1136618146 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9738005270 0x7f973800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:45.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.164+0000 7f9756000640 1 -- 172.21.15.131:0/1136618146 reap_dead start 2024-04-25T19:23:45.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.165+0000 7f9755600640 1 --2- 172.21.15.131:0/1136618146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9738003a00 0x7f9738003e50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f974400c110 tx=0x7f9738005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699ef7c8e0c12fb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:45.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.165+0000 7f974fe00640 1 -- 172.21.15.131:0/1136618146 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9744007c40 con 0x7f9738003a00 2024-04-25T19:23:45.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.165+0000 7f974fe00640 1 -- 172.21.15.131:0/1136618146 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9744005af0 con 0x7f9738003a00 2024-04-25T19:23:45.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.165+0000 7f974fe00640 1 -- 172.21.15.131:0/1136618146 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9744007070 con 0x7f9738003a00 2024-04-25T19:23:45.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.166+0000 7f9756a00640 1 -- 172.21.15.131:0/1136618146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9738003a00 msgr2=0x7f9738003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:45.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.166+0000 7f9756a00640 1 --2- 172.21.15.131:0/1136618146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9738003a00 0x7f9738003e50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f974400c110 tx=0x7f9738005830 comp rx=0 tx=0).stop 2024-04-25T19:23:45.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.166+0000 7f9756a00640 1 -- 172.21.15.131:0/1136618146 shutdown_connections 2024-04-25T19:23:45.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.166+0000 7f9756a00640 1 --2- 172.21.15.131:0/1136618146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9738003a00 0x7f9738003e50 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:45.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.166+0000 7f9756a00640 1 -- 172.21.15.131:0/1136618146 >> 172.21.15.131:0/1136618146 conn(0x7f97500d1720 msgr2=0x7f97500d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:45.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.166+0000 7f9756a00640 1 -- 172.21.15.131:0/1136618146 shutdown_connections 2024-04-25T19:23:45.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.166+0000 7f9756a00640 1 -- 172.21.15.131:0/1136618146 wait complete. 2024-04-25T19:23:45.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.168+0000 7f9756a00640 1 Processor -- start 2024-04-25T19:23:45.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.168+0000 7f9756a00640 1 -- start start 2024-04-25T19:23:45.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.170+0000 7f9756a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9738003a00 0x7f9750140010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:45.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.170+0000 7f9756a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9750143550 0x7f97501f9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:45.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.170+0000 7f9756a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97501fa200 0x7f975015ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:45.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.170+0000 7f9756a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f975015a810 con 0x7f97501fa200 2024-04-25T19:23:45.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.170+0000 7f9756a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f975006f500 con 0x7f9750143550 2024-04-25T19:23:45.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.170+0000 7f9756a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f975015a990 con 0x7f9738003a00 2024-04-25T19:23:45.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.170+0000 7f9756000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97501fa200 0x7f975015ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:45.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.170+0000 7f9756000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97501fa200 0x7f975015ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51778/0 (socket says 172.21.15.131:51778) 2024-04-25T19:23:45.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.170+0000 7f9756000640 1 -- 172.21.15.131:0/2334253489 learned_addr learned my addr 172.21.15.131:0/2334253489 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:45.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.171+0000 7f9755600640 1 --2- 172.21.15.131:0/2334253489 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9738003a00 0x7f9750140010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:45.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.171+0000 7f9754c00640 1 --2- 172.21.15.131:0/2334253489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9750143550 0x7f97501f9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:45.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.171+0000 7f9756000640 1 -- 172.21.15.131:0/2334253489 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9738003a00 msgr2=0x7f9750140010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:45.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.171+0000 7f9756000640 1 --2- 172.21.15.131:0/2334253489 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9738003a00 0x7f9750140010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:45.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.171+0000 7f9756000640 1 -- 172.21.15.131:0/2334253489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9750143550 msgr2=0x7f97501f9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:45.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.171+0000 7f9756000640 1 --2- 172.21.15.131:0/2334253489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9750143550 0x7f97501f9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:45.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.171+0000 7f9756000640 1 -- 172.21.15.131:0/2334253489 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97500cbae0 con 0x7f97501fa200 2024-04-25T19:23:45.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.171+0000 7f9754c00640 1 --2- 172.21.15.131:0/2334253489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9750143550 0x7f97501f9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:45.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.171+0000 7f9756000640 1 --2- 172.21.15.131:0/2334253489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97501fa200 0x7f975015ad20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9750071180 tx=0x7f974800d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:45.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.171+0000 7f974d600640 1 -- 172.21.15.131:0/2334253489 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9748006b50 con 0x7f97501fa200 2024-04-25T19:23:45.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.171+0000 7f974d600640 1 -- 172.21.15.131:0/2334253489 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9748006d10 con 0x7f97501fa200 2024-04-25T19:23:45.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.171+0000 7f974d600640 1 -- 172.21.15.131:0/2334253489 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9748012840 con 0x7f97501fa200 2024-04-25T19:23:45.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.171+0000 7f9756a00640 1 -- 172.21.15.131:0/2334253489 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f975013de50 con 0x7f97501fa200 2024-04-25T19:23:45.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.172+0000 7f9756a00640 1 -- 172.21.15.131:0/2334253489 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f975013e410 con 0x7f97501fa200 2024-04-25T19:23:45.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.173+0000 7f9756a00640 1 -- 172.21.15.131:0/2334253489 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97500cb850 con 0x7f97501fa200 2024-04-25T19:23:45.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.174+0000 7f974d600640 1 -- 172.21.15.131:0/2334253489 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f974801b020 con 0x7f97501fa200 2024-04-25T19:23:45.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.175+0000 7f974d600640 1 --2- 172.21.15.131:0/2334253489 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f97300744b0 0x7f97300769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:45.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.175+0000 7f974d600640 1 -- 172.21.15.131:0/2334253489 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f97480948d0 con 0x7f97501fa200 2024-04-25T19:23:45.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.176+0000 7f9755600640 1 --2- 172.21.15.131:0/2334253489 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f97300744b0 0x7f97300769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:45.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.177+0000 7f9755600640 1 --2- 172.21.15.131:0/2334253489 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f97300744b0 0x7f97300769c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9744032000 tx=0x7f9744007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:45.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.180+0000 7f974d600640 1 -- 172.21.15.131:0/2334253489 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f974805f050 con 0x7f97501fa200 2024-04-25T19:23:45.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.375+0000 7f9756a00640 1 -- 172.21.15.131:0/2334253489 --> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9750143960 con 0x7f97300744b0 2024-04-25T19:23:45.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.393+0000 7f974d600640 1 -- 172.21.15.131:0/2334253489 <== mgr.4105 v2:172.21.15.195:6832/2541913764 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251939 (secure 0 0 0) 0x7f9750143960 con 0x7f97300744b0 2024-04-25T19:23:45.398 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:45.400 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-04-25T19:23:45.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.399+0000 7f9756a00640 1 -- 172.21.15.131:0/2334253489 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f97300744b0 msgr2=0x7f97300769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:45.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.399+0000 7f9756a00640 1 --2- 172.21.15.131:0/2334253489 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f97300744b0 0x7f97300769c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9744032000 tx=0x7f9744007000 comp rx=0 tx=0).stop 2024-04-25T19:23:45.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.400+0000 7f9756a00640 1 -- 172.21.15.131:0/2334253489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97501fa200 msgr2=0x7f975015ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:45.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.400+0000 7f9756a00640 1 --2- 172.21.15.131:0/2334253489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97501fa200 0x7f975015ad20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9750071180 tx=0x7f974800d9d0 comp rx=0 tx=0).stop 2024-04-25T19:23:45.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.400+0000 7f9756a00640 1 -- 172.21.15.131:0/2334253489 shutdown_connections 2024-04-25T19:23:45.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.400+0000 7f9756a00640 1 --2- 172.21.15.131:0/2334253489 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f97300744b0 0x7f97300769c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:45.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.400+0000 7f9756a00640 1 --2- 172.21.15.131:0/2334253489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97501fa200 0x7f975015ad20 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:45.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.400+0000 7f9756a00640 1 --2- 172.21.15.131:0/2334253489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9750143550 0x7f97501f9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:45.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.400+0000 7f9756a00640 1 --2- 172.21.15.131:0/2334253489 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9738003a00 0x7f9750140010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:45.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.400+0000 7f9756a00640 1 -- 172.21.15.131:0/2334253489 >> 172.21.15.131:0/2334253489 conn(0x7f97500d1720 msgr2=0x7f97500739e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:45.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.400+0000 7f9756a00640 1 -- 172.21.15.131:0/2334253489 shutdown_connections 2024-04-25T19:23:45.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.400+0000 7f9756a00640 1 -- 172.21.15.131:0/2334253489 wait complete. 2024-04-25T19:23:45.428 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2024-04-25T19:23:44.171019+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236940,"kb_used_data":4136,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737780,"statfs":{"total":773094113280,"available":772851486720,"internally_reserved":0,"allocated":4235264,"data_stored":2358420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.334869"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.967899+0000","last_change":"2024-04-25T19:23:34.867693+0000","last_active":"2024-04-25T19:23:35.967899+0000","last_peered":"2024-04-25T19:23:35.967899+0000","last_clean":"2024-04-25T19:23:35.967899+0000","last_became_active":"2024-04-25T19:23:34.867366+0000","last_became_peered":"2024-04-25T19:23:34.867366+0000","last_unstale":"2024-04-25T19:23:35.967899+0000","last_undegraded":"2024-04-25T19:23:35.967899+0000","last_fullsized":"2024-04-25T19:23:35.967899+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:05.430035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.966511+0000","last_change":"2024-04-25T19:23:34.876857+0000","last_active":"2024-04-25T19:23:35.966511+0000","last_peered":"2024-04-25T19:23:35.966511+0000","last_clean":"2024-04-25T19:23:35.966511+0000","last_became_active":"2024-04-25T19:23:34.874632+0000","last_became_peered":"2024-04-25T19:23:34.874632+0000","last_unstale":"2024-04-25T19:23:35.966511+0000","last_undegraded":"2024-04-25T19:23:35.966511+0000","last_fullsized":"2024-04-25T19:23:35.966511+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:03.921924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.881249+0000","last_change":"2024-04-25T19:23:34.884258+0000","last_active":"2024-04-25T19:23:35.881249+0000","last_peered":"2024-04-25T19:23:35.881249+0000","last_clean":"2024-04-25T19:23:35.881249+0000","last_became_active":"2024-04-25T19:23:34.883917+0000","last_became_peered":"2024-04-25T19:23:34.883917+0000","last_unstale":"2024-04-25T19:23:35.881249+0000","last_undegraded":"2024-04-25T19:23:35.881249+0000","last_fullsized":"2024-04-25T19:23:35.881249+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:12:01.307874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882586+0000","last_change":"2024-04-25T19:23:34.884212+0000","last_active":"2024-04-25T19:23:35.882586+0000","last_peered":"2024-04-25T19:23:35.882586+0000","last_clean":"2024-04-25T19:23:35.882586+0000","last_became_active":"2024-04-25T19:23:34.883545+0000","last_became_peered":"2024-04-25T19:23:34.883545+0000","last_unstale":"2024-04-25T19:23:35.882586+0000","last_undegraded":"2024-04-25T19:23:35.882586+0000","last_fullsized":"2024-04-25T19:23:35.882586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:27.032825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.964061+0000","last_change":"2024-04-25T19:23:34.866307+0000","last_active":"2024-04-25T19:23:35.964061+0000","last_peered":"2024-04-25T19:23:35.964061+0000","last_clean":"2024-04-25T19:23:35.964061+0000","last_became_active":"2024-04-25T19:23:34.865877+0000","last_became_peered":"2024-04-25T19:23:34.865877+0000","last_unstale":"2024-04-25T19:23:35.964061+0000","last_undegraded":"2024-04-25T19:23:35.964061+0000","last_fullsized":"2024-04-25T19:23:35.964061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:27.964742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965594+0000","last_change":"2024-04-25T19:23:34.862481+0000","last_active":"2024-04-25T19:23:35.965594+0000","last_peered":"2024-04-25T19:23:35.965594+0000","last_clean":"2024-04-25T19:23:35.965594+0000","last_became_active":"2024-04-25T19:23:34.862068+0000","last_became_peered":"2024-04-25T19:23:34.862068+0000","last_unstale":"2024-04-25T19:23:35.965594+0000","last_undegraded":"2024-04-25T19:23:35.965594+0000","last_fullsized":"2024-04-25T19:23:35.965594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:44:01.779997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.967634+0000","last_change":"2024-04-25T19:23:34.880256+0000","last_active":"2024-04-25T19:23:35.967634+0000","last_peered":"2024-04-25T19:23:35.967634+0000","last_clean":"2024-04-25T19:23:35.967634+0000","last_became_active":"2024-04-25T19:23:34.879974+0000","last_became_peered":"2024-04-25T19:23:34.879974+0000","last_unstale":"2024-04-25T19:23:35.967634+0000","last_undegraded":"2024-04-25T19:23:35.967634+0000","last_fullsized":"2024-04-25T19:23:35.967634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:38.266247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.967058+0000","last_change":"2024-04-25T19:23:34.878985+0000","last_active":"2024-04-25T19:23:35.967058+0000","last_peered":"2024-04-25T19:23:35.967058+0000","last_clean":"2024-04-25T19:23:35.967058+0000","last_became_active":"2024-04-25T19:23:34.878612+0000","last_became_peered":"2024-04-25T19:23:34.878612+0000","last_unstale":"2024-04-25T19:23:35.967058+0000","last_undegraded":"2024-04-25T19:23:35.967058+0000","last_fullsized":"2024-04-25T19:23:35.967058+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:50.863400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880504+0000","last_change":"2024-04-25T19:23:34.881612+0000","last_active":"2024-04-25T19:23:35.880504+0000","last_peered":"2024-04-25T19:23:35.880504+0000","last_clean":"2024-04-25T19:23:35.880504+0000","last_became_active":"2024-04-25T19:23:34.881317+0000","last_became_peered":"2024-04-25T19:23:34.881317+0000","last_unstale":"2024-04-25T19:23:35.880504+0000","last_undegraded":"2024-04-25T19:23:35.880504+0000","last_fullsized":"2024-04-25T19:23:35.880504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:34.075093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.883031+0000","last_change":"2024-04-25T19:23:34.878492+0000","last_active":"2024-04-25T19:23:35.883031+0000","last_peered":"2024-04-25T19:23:35.883031+0000","last_clean":"2024-04-25T19:23:35.883031+0000","last_became_active":"2024-04-25T19:23:34.878151+0000","last_became_peered":"2024-04-25T19:23:34.878151+0000","last_unstale":"2024-04-25T19:23:35.883031+0000","last_undegraded":"2024-04-25T19:23:35.883031+0000","last_fullsized":"2024-04-25T19:23:35.883031+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:38.266247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.969637+0000","last_change":"2024-04-25T19:23:34.882973+0000","last_active":"2024-04-25T19:23:35.969637+0000","last_peered":"2024-04-25T19:23:35.969637+0000","last_clean":"2024-04-25T19:23:35.969637+0000","last_became_active":"2024-04-25T19:23:34.882656+0000","last_became_peered":"2024-04-25T19:23:34.882656+0000","last_unstale":"2024-04-25T19:23:35.969637+0000","last_undegraded":"2024-04-25T19:23:35.969637+0000","last_fullsized":"2024-04-25T19:23:35.969637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:53.321590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.881523+0000","last_change":"2024-04-25T19:23:34.864005+0000","last_active":"2024-04-25T19:23:35.881523+0000","last_peered":"2024-04-25T19:23:35.881523+0000","last_clean":"2024-04-25T19:23:35.881523+0000","last_became_active":"2024-04-25T19:23:34.863664+0000","last_became_peered":"2024-04-25T19:23:34.863664+0000","last_unstale":"2024-04-25T19:23:35.881523+0000","last_undegraded":"2024-04-25T19:23:35.881523+0000","last_fullsized":"2024-04-25T19:23:35.881523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:44:01.779997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.964086+0000","last_change":"2024-04-25T19:23:34.874078+0000","last_active":"2024-04-25T19:23:35.964086+0000","last_peered":"2024-04-25T19:23:35.964086+0000","last_clean":"2024-04-25T19:23:35.964086+0000","last_became_active":"2024-04-25T19:23:34.873735+0000","last_became_peered":"2024-04-25T19:23:34.873735+0000","last_unstale":"2024-04-25T19:23:35.964086+0000","last_undegraded":"2024-04-25T19:23:35.964086+0000","last_fullsized":"2024-04-25T19:23:35.964086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:57:00.631705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965594+0000","last_change":"2024-04-25T19:23:34.861100+0000","last_active":"2024-04-25T19:23:35.965594+0000","last_peered":"2024-04-25T19:23:35.965594+0000","last_clean":"2024-04-25T19:23:35.965594+0000","last_became_active":"2024-04-25T19:23:34.860162+0000","last_became_peered":"2024-04-25T19:23:34.860162+0000","last_unstale":"2024-04-25T19:23:35.965594+0000","last_undegraded":"2024-04-25T19:23:35.965594+0000","last_fullsized":"2024-04-25T19:23:35.965594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:13:21.629386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880387+0000","last_change":"2024-04-25T19:23:34.865302+0000","last_active":"2024-04-25T19:23:35.880387+0000","last_peered":"2024-04-25T19:23:35.880387+0000","last_clean":"2024-04-25T19:23:35.880387+0000","last_became_active":"2024-04-25T19:23:34.864920+0000","last_became_peered":"2024-04-25T19:23:34.864920+0000","last_unstale":"2024-04-25T19:23:35.880387+0000","last_undegraded":"2024-04-25T19:23:35.880387+0000","last_fullsized":"2024-04-25T19:23:35.880387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:38.266247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.969557+0000","last_change":"2024-04-25T19:23:34.878134+0000","last_active":"2024-04-25T19:23:35.969557+0000","last_peered":"2024-04-25T19:23:35.969557+0000","last_clean":"2024-04-25T19:23:35.969557+0000","last_became_active":"2024-04-25T19:23:34.873035+0000","last_became_peered":"2024-04-25T19:23:34.873035+0000","last_unstale":"2024-04-25T19:23:35.969557+0000","last_undegraded":"2024-04-25T19:23:35.969557+0000","last_fullsized":"2024-04-25T19:23:35.969557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:28.601231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.969347+0000","last_change":"2024-04-25T19:23:34.881996+0000","last_active":"2024-04-25T19:23:35.969347+0000","last_peered":"2024-04-25T19:23:35.969347+0000","last_clean":"2024-04-25T19:23:35.969347+0000","last_became_active":"2024-04-25T19:23:34.879575+0000","last_became_peered":"2024-04-25T19:23:34.879575+0000","last_unstale":"2024-04-25T19:23:35.969347+0000","last_undegraded":"2024-04-25T19:23:35.969347+0000","last_fullsized":"2024-04-25T19:23:35.969347+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:42:43.538944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.966552+0000","last_change":"2024-04-25T19:23:34.882530+0000","last_active":"2024-04-25T19:23:35.966552+0000","last_peered":"2024-04-25T19:23:35.966552+0000","last_clean":"2024-04-25T19:23:35.966552+0000","last_became_active":"2024-04-25T19:23:34.882177+0000","last_became_peered":"2024-04-25T19:23:34.882177+0000","last_unstale":"2024-04-25T19:23:35.966552+0000","last_undegraded":"2024-04-25T19:23:35.966552+0000","last_fullsized":"2024-04-25T19:23:35.966552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:05:02.728856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965977+0000","last_change":"2024-04-25T19:23:34.881785+0000","last_active":"2024-04-25T19:23:35.965977+0000","last_peered":"2024-04-25T19:23:35.965977+0000","last_clean":"2024-04-25T19:23:35.965977+0000","last_became_active":"2024-04-25T19:23:34.880764+0000","last_became_peered":"2024-04-25T19:23:34.880764+0000","last_unstale":"2024-04-25T19:23:35.965977+0000","last_undegraded":"2024-04-25T19:23:35.965977+0000","last_fullsized":"2024-04-25T19:23:35.965977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:28.601231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.964648+0000","last_change":"2024-04-25T19:23:34.865442+0000","last_active":"2024-04-25T19:23:35.964648+0000","last_peered":"2024-04-25T19:23:35.964648+0000","last_clean":"2024-04-25T19:23:35.964648+0000","last_became_active":"2024-04-25T19:23:34.865135+0000","last_became_peered":"2024-04-25T19:23:34.865135+0000","last_unstale":"2024-04-25T19:23:35.964648+0000","last_undegraded":"2024-04-25T19:23:35.964648+0000","last_fullsized":"2024-04-25T19:23:35.964648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:43.217717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.879611+0000","last_change":"2024-04-25T19:23:34.883923+0000","last_active":"2024-04-25T19:23:35.879611+0000","last_peered":"2024-04-25T19:23:35.879611+0000","last_clean":"2024-04-25T19:23:35.879611+0000","last_became_active":"2024-04-25T19:23:34.879560+0000","last_became_peered":"2024-04-25T19:23:34.879560+0000","last_unstale":"2024-04-25T19:23:35.879611+0000","last_undegraded":"2024-04-25T19:23:35.879611+0000","last_fullsized":"2024-04-25T19:23:35.879611+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:00:08.044331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880586+0000","last_change":"2024-04-25T19:23:34.866849+0000","last_active":"2024-04-25T19:23:35.880586+0000","last_peered":"2024-04-25T19:23:35.880586+0000","last_clean":"2024-04-25T19:23:35.880586+0000","last_became_active":"2024-04-25T19:23:34.866413+0000","last_became_peered":"2024-04-25T19:23:34.866413+0000","last_unstale":"2024-04-25T19:23:35.880586+0000","last_undegraded":"2024-04-25T19:23:35.880586+0000","last_fullsized":"2024-04-25T19:23:35.880586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:10.762030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876078+0000","last_change":"2024-04-25T19:23:34.871608+0000","last_active":"2024-04-25T19:23:35.876078+0000","last_peered":"2024-04-25T19:23:35.876078+0000","last_clean":"2024-04-25T19:23:35.876078+0000","last_became_active":"2024-04-25T19:23:34.871267+0000","last_became_peered":"2024-04-25T19:23:34.871267+0000","last_unstale":"2024-04-25T19:23:35.876078+0000","last_undegraded":"2024-04-25T19:23:35.876078+0000","last_fullsized":"2024-04-25T19:23:35.876078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:05.430035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.878558+0000","last_change":"2024-04-25T19:23:34.875883+0000","last_active":"2024-04-25T19:23:35.878558+0000","last_peered":"2024-04-25T19:23:35.878558+0000","last_clean":"2024-04-25T19:23:35.878558+0000","last_became_active":"2024-04-25T19:23:34.875534+0000","last_became_peered":"2024-04-25T19:23:34.875534+0000","last_unstale":"2024-04-25T19:23:35.878558+0000","last_undegraded":"2024-04-25T19:23:35.878558+0000","last_fullsized":"2024-04-25T19:23:35.878558+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:48.768523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882696+0000","last_change":"2024-04-25T19:23:34.884658+0000","last_active":"2024-04-25T19:23:35.882696+0000","last_peered":"2024-04-25T19:23:35.882696+0000","last_clean":"2024-04-25T19:23:35.882696+0000","last_became_active":"2024-04-25T19:23:34.883491+0000","last_became_peered":"2024-04-25T19:23:34.883491+0000","last_unstale":"2024-04-25T19:23:35.882696+0000","last_undegraded":"2024-04-25T19:23:35.882696+0000","last_fullsized":"2024-04-25T19:23:35.882696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:47:22.676497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.966674+0000","last_change":"2024-04-25T19:23:34.869510+0000","last_active":"2024-04-25T19:23:35.966674+0000","last_peered":"2024-04-25T19:23:35.966674+0000","last_clean":"2024-04-25T19:23:35.966674+0000","last_became_active":"2024-04-25T19:23:34.869160+0000","last_became_peered":"2024-04-25T19:23:34.869160+0000","last_unstale":"2024-04-25T19:23:35.966674+0000","last_undegraded":"2024-04-25T19:23:35.966674+0000","last_fullsized":"2024-04-25T19:23:35.966674+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:10.419265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882907+0000","last_change":"2024-04-25T19:23:34.884515+0000","last_active":"2024-04-25T19:23:35.882907+0000","last_peered":"2024-04-25T19:23:35.882907+0000","last_clean":"2024-04-25T19:23:35.882907+0000","last_became_active":"2024-04-25T19:23:34.884123+0000","last_became_peered":"2024-04-25T19:23:34.884123+0000","last_unstale":"2024-04-25T19:23:35.882907+0000","last_undegraded":"2024-04-25T19:23:35.882907+0000","last_fullsized":"2024-04-25T19:23:35.882907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:50.863400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.881873+0000","last_change":"2024-04-25T19:23:34.869345+0000","last_active":"2024-04-25T19:23:35.881873+0000","last_peered":"2024-04-25T19:23:35.881873+0000","last_clean":"2024-04-25T19:23:35.881873+0000","last_became_active":"2024-04-25T19:23:34.867833+0000","last_became_peered":"2024-04-25T19:23:34.867833+0000","last_unstale":"2024-04-25T19:23:35.881873+0000","last_undegraded":"2024-04-25T19:23:35.881873+0000","last_fullsized":"2024-04-25T19:23:35.881873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:13:21.629386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.879765+0000","last_change":"2024-04-25T19:23:34.863884+0000","last_active":"2024-04-25T19:23:35.879765+0000","last_peered":"2024-04-25T19:23:35.879765+0000","last_clean":"2024-04-25T19:23:35.879765+0000","last_became_active":"2024-04-25T19:23:34.863497+0000","last_became_peered":"2024-04-25T19:23:34.863497+0000","last_unstale":"2024-04-25T19:23:35.879765+0000","last_undegraded":"2024-04-25T19:23:35.879765+0000","last_fullsized":"2024-04-25T19:23:35.879765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:11.081868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.967665+0000","last_change":"2024-04-25T19:23:34.867175+0000","last_active":"2024-04-25T19:23:35.967665+0000","last_peered":"2024-04-25T19:23:35.967665+0000","last_clean":"2024-04-25T19:23:35.967665+0000","last_became_active":"2024-04-25T19:23:34.866604+0000","last_became_peered":"2024-04-25T19:23:34.866604+0000","last_unstale":"2024-04-25T19:23:35.967665+0000","last_undegraded":"2024-04-25T19:23:35.967665+0000","last_fullsized":"2024-04-25T19:23:35.967665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:01.314162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.967920+0000","last_change":"2024-04-25T19:23:34.878585+0000","last_active":"2024-04-25T19:23:35.967920+0000","last_peered":"2024-04-25T19:23:35.967920+0000","last_clean":"2024-04-25T19:23:35.967920+0000","last_became_active":"2024-04-25T19:23:34.874819+0000","last_became_peered":"2024-04-25T19:23:34.874819+0000","last_unstale":"2024-04-25T19:23:35.967920+0000","last_undegraded":"2024-04-25T19:23:35.967920+0000","last_fullsized":"2024-04-25T19:23:35.967920+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:00:08.044331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.968487+0000","last_change":"2024-04-25T19:23:34.885533+0000","last_active":"2024-04-25T19:23:35.968487+0000","last_peered":"2024-04-25T19:23:35.968487+0000","last_clean":"2024-04-25T19:23:35.968487+0000","last_became_active":"2024-04-25T19:23:34.885171+0000","last_became_peered":"2024-04-25T19:23:34.885171+0000","last_unstale":"2024-04-25T19:23:35.968487+0000","last_undegraded":"2024-04-25T19:23:35.968487+0000","last_fullsized":"2024-04-25T19:23:35.968487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:12:01.307874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876755+0000","last_change":"2024-04-25T19:23:34.877363+0000","last_active":"2024-04-25T19:23:35.876755+0000","last_peered":"2024-04-25T19:23:35.876755+0000","last_clean":"2024-04-25T19:23:35.876755+0000","last_became_active":"2024-04-25T19:23:34.877059+0000","last_became_peered":"2024-04-25T19:23:34.877059+0000","last_unstale":"2024-04-25T19:23:35.876755+0000","last_undegraded":"2024-04-25T19:23:35.876755+0000","last_fullsized":"2024-04-25T19:23:35.876755+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:34.075093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.968221+0000","last_change":"2024-04-25T19:23:33.869661+0000","last_active":"2024-04-25T19:23:35.968221+0000","last_peered":"2024-04-25T19:23:35.968221+0000","last_clean":"2024-04-25T19:23:35.968221+0000","last_became_active":"2024-04-25T19:23:33.869333+0000","last_became_peered":"2024-04-25T19:23:33.869333+0000","last_unstale":"2024-04-25T19:23:35.968221+0000","last_undegraded":"2024-04-25T19:23:35.968221+0000","last_fullsized":"2024-04-25T19:23:35.968221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:29.370419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.968291+0000","last_change":"2024-04-25T19:23:34.872260+0000","last_active":"2024-04-25T19:23:35.968291+0000","last_peered":"2024-04-25T19:23:35.968291+0000","last_clean":"2024-04-25T19:23:35.968291+0000","last_became_active":"2024-04-25T19:23:34.871927+0000","last_became_peered":"2024-04-25T19:23:34.871927+0000","last_unstale":"2024-04-25T19:23:35.968291+0000","last_undegraded":"2024-04-25T19:23:35.968291+0000","last_fullsized":"2024-04-25T19:23:35.968291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:34.178623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876893+0000","last_change":"2024-04-25T19:23:33.862637+0000","last_active":"2024-04-25T19:23:35.876893+0000","last_peered":"2024-04-25T19:23:35.876893+0000","last_clean":"2024-04-25T19:23:35.876893+0000","last_became_active":"2024-04-25T19:23:33.862409+0000","last_became_peered":"2024-04-25T19:23:33.862409+0000","last_unstale":"2024-04-25T19:23:35.876893+0000","last_undegraded":"2024-04-25T19:23:35.876893+0000","last_fullsized":"2024-04-25T19:23:35.876893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:42.202405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.879858+0000","last_change":"2024-04-25T19:23:34.879297+0000","last_active":"2024-04-25T19:23:35.879858+0000","last_peered":"2024-04-25T19:23:35.879858+0000","last_clean":"2024-04-25T19:23:35.879858+0000","last_became_active":"2024-04-25T19:23:34.876596+0000","last_became_peered":"2024-04-25T19:23:34.876596+0000","last_unstale":"2024-04-25T19:23:35.879858+0000","last_undegraded":"2024-04-25T19:23:35.879858+0000","last_fullsized":"2024-04-25T19:23:35.879858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:05.430035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.966027+0000","last_change":"2024-04-25T19:23:33.861801+0000","last_active":"2024-04-25T19:23:35.966027+0000","last_peered":"2024-04-25T19:23:35.966027+0000","last_clean":"2024-04-25T19:23:35.966027+0000","last_became_active":"2024-04-25T19:23:33.861477+0000","last_became_peered":"2024-04-25T19:23:33.861477+0000","last_unstale":"2024-04-25T19:23:35.966027+0000","last_undegraded":"2024-04-25T19:23:35.966027+0000","last_fullsized":"2024-04-25T19:23:35.966027+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:10.066556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.883088+0000","last_change":"2024-04-25T19:23:34.890813+0000","last_active":"2024-04-25T19:23:35.883088+0000","last_peered":"2024-04-25T19:23:35.883088+0000","last_clean":"2024-04-25T19:23:35.883088+0000","last_became_active":"2024-04-25T19:23:34.889398+0000","last_became_peered":"2024-04-25T19:23:34.889398+0000","last_unstale":"2024-04-25T19:23:35.883088+0000","last_undegraded":"2024-04-25T19:23:35.883088+0000","last_fullsized":"2024-04-25T19:23:35.883088+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:01.314162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965032+0000","last_change":"2024-04-25T19:23:33.861932+0000","last_active":"2024-04-25T19:23:35.965032+0000","last_peered":"2024-04-25T19:23:35.965032+0000","last_clean":"2024-04-25T19:23:35.965032+0000","last_became_active":"2024-04-25T19:23:33.860394+0000","last_became_peered":"2024-04-25T19:23:33.860394+0000","last_unstale":"2024-04-25T19:23:35.965032+0000","last_undegraded":"2024-04-25T19:23:35.965032+0000","last_fullsized":"2024-04-25T19:23:35.965032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:30:21.396542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.968756+0000","last_change":"2024-04-25T19:23:34.877686+0000","last_active":"2024-04-25T19:23:35.968756+0000","last_peered":"2024-04-25T19:23:35.968756+0000","last_clean":"2024-04-25T19:23:35.968756+0000","last_became_active":"2024-04-25T19:23:34.876701+0000","last_became_peered":"2024-04-25T19:23:34.876701+0000","last_unstale":"2024-04-25T19:23:35.968756+0000","last_undegraded":"2024-04-25T19:23:35.968756+0000","last_fullsized":"2024-04-25T19:23:35.968756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:49.384633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880075+0000","last_change":"2024-04-25T19:23:33.861192+0000","last_active":"2024-04-25T19:23:35.880075+0000","last_peered":"2024-04-25T19:23:35.880075+0000","last_clean":"2024-04-25T19:23:35.880075+0000","last_became_active":"2024-04-25T19:23:33.860848+0000","last_became_peered":"2024-04-25T19:23:33.860848+0000","last_unstale":"2024-04-25T19:23:35.880075+0000","last_undegraded":"2024-04-25T19:23:35.880075+0000","last_fullsized":"2024-04-25T19:23:35.880075+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:10:33.260974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880892+0000","last_change":"2024-04-25T19:23:34.868910+0000","last_active":"2024-04-25T19:23:35.880892+0000","last_peered":"2024-04-25T19:23:35.880892+0000","last_clean":"2024-04-25T19:23:35.880892+0000","last_became_active":"2024-04-25T19:23:34.868475+0000","last_became_peered":"2024-04-25T19:23:34.868475+0000","last_unstale":"2024-04-25T19:23:35.880892+0000","last_undegraded":"2024-04-25T19:23:35.880892+0000","last_fullsized":"2024-04-25T19:23:35.880892+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:01.314162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880941+0000","last_change":"2024-04-25T19:23:33.859288+0000","last_active":"2024-04-25T19:23:35.880941+0000","last_peered":"2024-04-25T19:23:35.880941+0000","last_clean":"2024-04-25T19:23:35.880941+0000","last_became_active":"2024-04-25T19:23:33.858841+0000","last_became_peered":"2024-04-25T19:23:33.858841+0000","last_unstale":"2024-04-25T19:23:35.880941+0000","last_undegraded":"2024-04-25T19:23:35.880941+0000","last_fullsized":"2024-04-25T19:23:35.880941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:56:59.616393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.879395+0000","last_change":"2024-04-25T19:23:34.874492+0000","last_active":"2024-04-25T19:23:35.879395+0000","last_peered":"2024-04-25T19:23:35.879395+0000","last_clean":"2024-04-25T19:23:35.879395+0000","last_became_active":"2024-04-25T19:23:34.874045+0000","last_became_peered":"2024-04-25T19:23:34.874045+0000","last_unstale":"2024-04-25T19:23:35.879395+0000","last_undegraded":"2024-04-25T19:23:35.879395+0000","last_fullsized":"2024-04-25T19:23:35.879395+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:46.850558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965400+0000","last_change":"2024-04-25T19:23:33.853794+0000","last_active":"2024-04-25T19:23:35.965400+0000","last_peered":"2024-04-25T19:23:35.965400+0000","last_clean":"2024-04-25T19:23:35.965400+0000","last_became_active":"2024-04-25T19:23:33.853451+0000","last_became_peered":"2024-04-25T19:23:33.853451+0000","last_unstale":"2024-04-25T19:23:35.965400+0000","last_undegraded":"2024-04-25T19:23:35.965400+0000","last_fullsized":"2024-04-25T19:23:35.965400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:20:43.666409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882941+0000","last_change":"2024-04-25T19:23:34.879256+0000","last_active":"2024-04-25T19:23:35.882941+0000","last_peered":"2024-04-25T19:23:35.882941+0000","last_clean":"2024-04-25T19:23:35.882941+0000","last_became_active":"2024-04-25T19:23:34.878927+0000","last_became_peered":"2024-04-25T19:23:34.878927+0000","last_unstale":"2024-04-25T19:23:35.882941+0000","last_undegraded":"2024-04-25T19:23:35.882941+0000","last_fullsized":"2024-04-25T19:23:35.882941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:48.768523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.879439+0000","last_change":"2024-04-25T19:23:33.861563+0000","last_active":"2024-04-25T19:23:35.879439+0000","last_peered":"2024-04-25T19:23:35.879439+0000","last_clean":"2024-04-25T19:23:35.879439+0000","last_became_active":"2024-04-25T19:23:33.859069+0000","last_became_peered":"2024-04-25T19:23:33.859069+0000","last_unstale":"2024-04-25T19:23:35.879439+0000","last_undegraded":"2024-04-25T19:23:35.879439+0000","last_fullsized":"2024-04-25T19:23:35.879439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:31:03.100180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.881916+0000","last_change":"2024-04-25T19:23:34.868229+0000","last_active":"2024-04-25T19:23:35.881916+0000","last_peered":"2024-04-25T19:23:35.881916+0000","last_clean":"2024-04-25T19:23:35.881916+0000","last_became_active":"2024-04-25T19:23:34.867693+0000","last_became_peered":"2024-04-25T19:23:34.867693+0000","last_unstale":"2024-04-25T19:23:35.881916+0000","last_undegraded":"2024-04-25T19:23:35.881916+0000","last_fullsized":"2024-04-25T19:23:35.881916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:28.601231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.966342+0000","last_change":"2024-04-25T19:23:33.867663+0000","last_active":"2024-04-25T19:23:35.966342+0000","last_peered":"2024-04-25T19:23:35.966342+0000","last_clean":"2024-04-25T19:23:35.966342+0000","last_became_active":"2024-04-25T19:23:33.867106+0000","last_became_peered":"2024-04-25T19:23:33.867106+0000","last_unstale":"2024-04-25T19:23:35.966342+0000","last_undegraded":"2024-04-25T19:23:35.966342+0000","last_fullsized":"2024-04-25T19:23:35.966342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:00:07.029019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.966209+0000","last_change":"2024-04-25T19:23:34.885804+0000","last_active":"2024-04-25T19:23:35.966209+0000","last_peered":"2024-04-25T19:23:35.966209+0000","last_clean":"2024-04-25T19:23:35.966209+0000","last_became_active":"2024-04-25T19:23:34.885410+0000","last_became_peered":"2024-04-25T19:23:34.885410+0000","last_unstale":"2024-04-25T19:23:35.966209+0000","last_undegraded":"2024-04-25T19:23:35.966209+0000","last_fullsized":"2024-04-25T19:23:35.966209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:13.843985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876849+0000","last_change":"2024-04-25T19:23:33.853876+0000","last_active":"2024-04-25T19:23:35.876849+0000","last_peered":"2024-04-25T19:23:35.876849+0000","last_clean":"2024-04-25T19:23:35.876849+0000","last_became_active":"2024-04-25T19:23:33.853522+0000","last_became_peered":"2024-04-25T19:23:33.853522+0000","last_unstale":"2024-04-25T19:23:35.876849+0000","last_undegraded":"2024-04-25T19:23:35.876849+0000","last_fullsized":"2024-04-25T19:23:35.876849+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:29.370419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.966150+0000","last_change":"2024-04-25T19:23:34.870953+0000","last_active":"2024-04-25T19:23:35.966150+0000","last_peered":"2024-04-25T19:23:35.966150+0000","last_clean":"2024-04-25T19:23:35.966150+0000","last_became_active":"2024-04-25T19:23:34.870048+0000","last_became_peered":"2024-04-25T19:23:34.870048+0000","last_unstale":"2024-04-25T19:23:35.966150+0000","last_undegraded":"2024-04-25T19:23:35.966150+0000","last_fullsized":"2024-04-25T19:23:35.966150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:53.321590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.881352+0000","last_change":"2024-04-25T19:23:33.871669+0000","last_active":"2024-04-25T19:23:35.881352+0000","last_peered":"2024-04-25T19:23:35.881352+0000","last_clean":"2024-04-25T19:23:35.881352+0000","last_became_active":"2024-04-25T19:23:33.870470+0000","last_became_peered":"2024-04-25T19:23:33.870470+0000","last_unstale":"2024-04-25T19:23:35.881352+0000","last_undegraded":"2024-04-25T19:23:35.881352+0000","last_fullsized":"2024-04-25T19:23:35.881352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:15.587996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.881327+0000","last_change":"2024-04-25T19:23:34.888624+0000","last_active":"2024-04-25T19:23:35.881327+0000","last_peered":"2024-04-25T19:23:35.881327+0000","last_clean":"2024-04-25T19:23:35.881327+0000","last_became_active":"2024-04-25T19:23:34.888261+0000","last_became_peered":"2024-04-25T19:23:34.888261+0000","last_unstale":"2024-04-25T19:23:35.881327+0000","last_undegraded":"2024-04-25T19:23:35.881327+0000","last_fullsized":"2024-04-25T19:23:35.881327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:49.384633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.966302+0000","last_change":"2024-04-25T19:23:33.859210+0000","last_active":"2024-04-25T19:23:35.966302+0000","last_peered":"2024-04-25T19:23:35.966302+0000","last_clean":"2024-04-25T19:23:35.966302+0000","last_became_active":"2024-04-25T19:23:33.858457+0000","last_became_peered":"2024-04-25T19:23:33.858457+0000","last_unstale":"2024-04-25T19:23:35.966302+0000","last_undegraded":"2024-04-25T19:23:35.966302+0000","last_fullsized":"2024-04-25T19:23:35.966302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:15.587996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882123+0000","last_change":"2024-04-25T19:23:34.880105+0000","last_active":"2024-04-25T19:23:35.882123+0000","last_peered":"2024-04-25T19:23:35.882123+0000","last_clean":"2024-04-25T19:23:35.882123+0000","last_became_active":"2024-04-25T19:23:34.879850+0000","last_became_peered":"2024-04-25T19:23:34.879850+0000","last_unstale":"2024-04-25T19:23:35.882123+0000","last_undegraded":"2024-04-25T19:23:35.882123+0000","last_fullsized":"2024-04-25T19:23:35.882123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:10.762030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880540+0000","last_change":"2024-04-25T19:23:33.859947+0000","last_active":"2024-04-25T19:23:35.880540+0000","last_peered":"2024-04-25T19:23:35.880540+0000","last_clean":"2024-04-25T19:23:35.880540+0000","last_became_active":"2024-04-25T19:23:33.859569+0000","last_became_peered":"2024-04-25T19:23:33.859569+0000","last_unstale":"2024-04-25T19:23:35.880540+0000","last_undegraded":"2024-04-25T19:23:35.880540+0000","last_fullsized":"2024-04-25T19:23:35.880540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:53.116651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965885+0000","last_change":"2024-04-25T19:23:34.865901+0000","last_active":"2024-04-25T19:23:35.965885+0000","last_peered":"2024-04-25T19:23:35.965885+0000","last_clean":"2024-04-25T19:23:35.965885+0000","last_became_active":"2024-04-25T19:23:34.865562+0000","last_became_peered":"2024-04-25T19:23:34.865562+0000","last_unstale":"2024-04-25T19:23:35.965885+0000","last_undegraded":"2024-04-25T19:23:35.965885+0000","last_fullsized":"2024-04-25T19:23:35.965885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:42:43.538944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882299+0000","last_change":"2024-04-25T19:23:33.865049+0000","last_active":"2024-04-25T19:23:35.882299+0000","last_peered":"2024-04-25T19:23:35.882299+0000","last_clean":"2024-04-25T19:23:35.882299+0000","last_became_active":"2024-04-25T19:23:33.864681+0000","last_became_peered":"2024-04-25T19:23:33.864681+0000","last_unstale":"2024-04-25T19:23:35.882299+0000","last_undegraded":"2024-04-25T19:23:35.882299+0000","last_fullsized":"2024-04-25T19:23:35.882299+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:50.633103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.969103+0000","last_change":"2024-04-25T19:23:34.884245+0000","last_active":"2024-04-25T19:23:35.969103+0000","last_peered":"2024-04-25T19:23:35.969103+0000","last_clean":"2024-04-25T19:23:35.969103+0000","last_became_active":"2024-04-25T19:23:34.883423+0000","last_became_peered":"2024-04-25T19:23:34.883423+0000","last_unstale":"2024-04-25T19:23:35.969103+0000","last_undegraded":"2024-04-25T19:23:35.969103+0000","last_fullsized":"2024-04-25T19:23:35.969103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:13:21.629386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965235+0000","last_change":"2024-04-25T19:23:33.867671+0000","last_active":"2024-04-25T19:23:35.965235+0000","last_peered":"2024-04-25T19:23:35.965235+0000","last_clean":"2024-04-25T19:23:35.965235+0000","last_became_active":"2024-04-25T19:23:33.866592+0000","last_became_peered":"2024-04-25T19:23:33.866592+0000","last_unstale":"2024-04-25T19:23:35.965235+0000","last_undegraded":"2024-04-25T19:23:35.965235+0000","last_fullsized":"2024-04-25T19:23:35.965235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:00.480595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.968438+0000","last_change":"2024-04-25T19:23:34.865331+0000","last_active":"2024-04-25T19:23:35.968438+0000","last_peered":"2024-04-25T19:23:35.968438+0000","last_clean":"2024-04-25T19:23:35.968438+0000","last_became_active":"2024-04-25T19:23:34.863941+0000","last_became_peered":"2024-04-25T19:23:34.863941+0000","last_unstale":"2024-04-25T19:23:35.968438+0000","last_undegraded":"2024-04-25T19:23:35.968438+0000","last_fullsized":"2024-04-25T19:23:35.968438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:34.075093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965648+0000","last_change":"2024-04-25T19:23:33.857697+0000","last_active":"2024-04-25T19:23:35.965648+0000","last_peered":"2024-04-25T19:23:35.965648+0000","last_clean":"2024-04-25T19:23:35.965648+0000","last_became_active":"2024-04-25T19:23:33.857359+0000","last_became_peered":"2024-04-25T19:23:33.857359+0000","last_unstale":"2024-04-25T19:23:35.965648+0000","last_undegraded":"2024-04-25T19:23:35.965648+0000","last_fullsized":"2024-04-25T19:23:35.965648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:04.414723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880308+0000","last_change":"2024-04-25T19:23:34.860729+0000","last_active":"2024-04-25T19:23:35.880308+0000","last_peered":"2024-04-25T19:23:35.880308+0000","last_clean":"2024-04-25T19:23:35.880308+0000","last_became_active":"2024-04-25T19:23:34.860341+0000","last_became_peered":"2024-04-25T19:23:34.860341+0000","last_unstale":"2024-04-25T19:23:35.880308+0000","last_undegraded":"2024-04-25T19:23:35.880308+0000","last_fullsized":"2024-04-25T19:23:35.880308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:34.178623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882877+0000","last_change":"2024-04-25T19:23:33.866277+0000","last_active":"2024-04-25T19:23:35.882877+0000","last_peered":"2024-04-25T19:23:35.882877+0000","last_clean":"2024-04-25T19:23:35.882877+0000","last_became_active":"2024-04-25T19:23:33.865920+0000","last_became_peered":"2024-04-25T19:23:33.865920+0000","last_unstale":"2024-04-25T19:23:35.882877+0000","last_undegraded":"2024-04-25T19:23:35.882877+0000","last_fullsized":"2024-04-25T19:23:35.882877+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:51.486951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882134+0000","last_change":"2024-04-25T19:23:34.860463+0000","last_active":"2024-04-25T19:23:35.882134+0000","last_peered":"2024-04-25T19:23:35.882134+0000","last_clean":"2024-04-25T19:23:35.882134+0000","last_became_active":"2024-04-25T19:23:34.860115+0000","last_became_peered":"2024-04-25T19:23:34.860115+0000","last_unstale":"2024-04-25T19:23:35.882134+0000","last_undegraded":"2024-04-25T19:23:35.882134+0000","last_fullsized":"2024-04-25T19:23:35.882134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:53.321590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880589+0000","last_change":"2024-04-25T19:23:33.863747+0000","last_active":"2024-04-25T19:23:35.880589+0000","last_peered":"2024-04-25T19:23:35.880589+0000","last_clean":"2024-04-25T19:23:35.880589+0000","last_became_active":"2024-04-25T19:23:33.863073+0000","last_became_peered":"2024-04-25T19:23:33.863073+0000","last_unstale":"2024-04-25T19:23:35.880589+0000","last_undegraded":"2024-04-25T19:23:35.880589+0000","last_fullsized":"2024-04-25T19:23:35.880589+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:22:45.334470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882746+0000","last_change":"2024-04-25T19:23:34.884965+0000","last_active":"2024-04-25T19:23:35.882746+0000","last_peered":"2024-04-25T19:23:35.882746+0000","last_clean":"2024-04-25T19:23:35.882746+0000","last_became_active":"2024-04-25T19:23:34.884057+0000","last_became_peered":"2024-04-25T19:23:34.884057+0000","last_unstale":"2024-04-25T19:23:35.882746+0000","last_undegraded":"2024-04-25T19:23:35.882746+0000","last_fullsized":"2024-04-25T19:23:35.882746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:22:16.525112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880108+0000","last_change":"2024-04-25T19:23:33.863501+0000","last_active":"2024-04-25T19:23:35.880108+0000","last_peered":"2024-04-25T19:23:35.880108+0000","last_clean":"2024-04-25T19:23:35.880108+0000","last_became_active":"2024-04-25T19:23:33.863105+0000","last_became_peered":"2024-04-25T19:23:33.863105+0000","last_unstale":"2024-04-25T19:23:35.880108+0000","last_undegraded":"2024-04-25T19:23:35.880108+0000","last_fullsized":"2024-04-25T19:23:35.880108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:26.949430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965267+0000","last_change":"2024-04-25T19:23:34.873219+0000","last_active":"2024-04-25T19:23:35.965267+0000","last_peered":"2024-04-25T19:23:35.965267+0000","last_clean":"2024-04-25T19:23:35.965267+0000","last_became_active":"2024-04-25T19:23:34.872851+0000","last_became_peered":"2024-04-25T19:23:34.872851+0000","last_unstale":"2024-04-25T19:23:35.965267+0000","last_undegraded":"2024-04-25T19:23:35.965267+0000","last_fullsized":"2024-04-25T19:23:35.965267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:30.385732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880267+0000","last_change":"2024-04-25T19:23:33.861614+0000","last_active":"2024-04-25T19:23:35.880267+0000","last_peered":"2024-04-25T19:23:35.880267+0000","last_clean":"2024-04-25T19:23:35.880267+0000","last_became_active":"2024-04-25T19:23:33.861269+0000","last_became_peered":"2024-04-25T19:23:33.861269+0000","last_unstale":"2024-04-25T19:23:35.880267+0000","last_undegraded":"2024-04-25T19:23:35.880267+0000","last_fullsized":"2024-04-25T19:23:35.880267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:12:04.487364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.964269+0000","last_change":"2024-04-25T19:23:34.874432+0000","last_active":"2024-04-25T19:23:35.964269+0000","last_peered":"2024-04-25T19:23:35.964269+0000","last_clean":"2024-04-25T19:23:35.964269+0000","last_became_active":"2024-04-25T19:23:34.871916+0000","last_became_peered":"2024-04-25T19:23:34.871916+0000","last_unstale":"2024-04-25T19:23:35.964269+0000","last_undegraded":"2024-04-25T19:23:35.964269+0000","last_fullsized":"2024-04-25T19:23:35.964269+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:31:04.115493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876202+0000","last_change":"2024-04-25T19:23:33.856541+0000","last_active":"2024-04-25T19:23:35.876202+0000","last_peered":"2024-04-25T19:23:35.876202+0000","last_clean":"2024-04-25T19:23:35.876202+0000","last_became_active":"2024-04-25T19:23:33.856217+0000","last_became_peered":"2024-04-25T19:23:33.856217+0000","last_unstale":"2024-04-25T19:23:35.876202+0000","last_undegraded":"2024-04-25T19:23:35.876202+0000","last_fullsized":"2024-04-25T19:23:35.876202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:51.486951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.964495+0000","last_change":"2024-04-25T19:23:34.874258+0000","last_active":"2024-04-25T19:23:35.964495+0000","last_peered":"2024-04-25T19:23:35.964495+0000","last_clean":"2024-04-25T19:23:35.964495+0000","last_became_active":"2024-04-25T19:23:34.873947+0000","last_became_peered":"2024-04-25T19:23:34.873947+0000","last_unstale":"2024-04-25T19:23:35.964495+0000","last_undegraded":"2024-04-25T19:23:35.964495+0000","last_fullsized":"2024-04-25T19:23:35.964495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:09.131145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.968204+0000","last_change":"2024-04-25T19:23:33.865209+0000","last_active":"2024-04-25T19:23:35.968204+0000","last_peered":"2024-04-25T19:23:35.968204+0000","last_clean":"2024-04-25T19:23:35.968204+0000","last_became_active":"2024-04-25T19:23:33.864805+0000","last_became_peered":"2024-04-25T19:23:33.864805+0000","last_unstale":"2024-04-25T19:23:35.968204+0000","last_undegraded":"2024-04-25T19:23:35.968204+0000","last_fullsized":"2024-04-25T19:23:35.968204+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:51.486951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.964197+0000","last_change":"2024-04-25T19:23:34.870418+0000","last_active":"2024-04-25T19:23:35.964197+0000","last_peered":"2024-04-25T19:23:35.964197+0000","last_clean":"2024-04-25T19:23:35.964197+0000","last_became_active":"2024-04-25T19:23:34.870084+0000","last_became_peered":"2024-04-25T19:23:34.870084+0000","last_unstale":"2024-04-25T19:23:35.964197+0000","last_undegraded":"2024-04-25T19:23:35.964197+0000","last_fullsized":"2024-04-25T19:23:35.964197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:12:05.502676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880428+0000","last_change":"2024-04-25T19:23:33.860629+0000","last_active":"2024-04-25T19:23:35.880428+0000","last_peered":"2024-04-25T19:23:35.880428+0000","last_clean":"2024-04-25T19:23:35.880428+0000","last_became_active":"2024-04-25T19:23:33.860264+0000","last_became_peered":"2024-04-25T19:23:33.860264+0000","last_unstale":"2024-04-25T19:23:35.880428+0000","last_undegraded":"2024-04-25T19:23:35.880428+0000","last_fullsized":"2024-04-25T19:23:35.880428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:43.245901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.967492+0000","last_change":"2024-04-25T19:23:34.882245+0000","last_active":"2024-04-25T19:23:35.967492+0000","last_peered":"2024-04-25T19:23:35.967492+0000","last_clean":"2024-04-25T19:23:35.967492+0000","last_became_active":"2024-04-25T19:23:34.880684+0000","last_became_peered":"2024-04-25T19:23:34.880684+0000","last_unstale":"2024-04-25T19:23:35.967492+0000","last_undegraded":"2024-04-25T19:23:35.967492+0000","last_fullsized":"2024-04-25T19:23:35.967492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:48.768523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.879130+0000","last_change":"2024-04-25T19:23:33.869661+0000","last_active":"2024-04-25T19:23:35.879130+0000","last_peered":"2024-04-25T19:23:35.879130+0000","last_clean":"2024-04-25T19:23:35.879130+0000","last_became_active":"2024-04-25T19:23:33.869274+0000","last_became_peered":"2024-04-25T19:23:33.869274+0000","last_unstale":"2024-04-25T19:23:35.879130+0000","last_undegraded":"2024-04-25T19:23:35.879130+0000","last_fullsized":"2024-04-25T19:23:35.879130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:45.835245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965406+0000","last_change":"2024-04-25T19:23:34.873322+0000","last_active":"2024-04-25T19:23:35.965406+0000","last_peered":"2024-04-25T19:23:35.965406+0000","last_clean":"2024-04-25T19:23:35.965406+0000","last_became_active":"2024-04-25T19:23:34.873003+0000","last_became_peered":"2024-04-25T19:23:34.873003+0000","last_unstale":"2024-04-25T19:23:35.965406+0000","last_undegraded":"2024-04-25T19:23:35.965406+0000","last_fullsized":"2024-04-25T19:23:35.965406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:52.502263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882959+0000","last_change":"2024-04-25T19:23:33.869537+0000","last_active":"2024-04-25T19:23:35.882959+0000","last_peered":"2024-04-25T19:23:35.882959+0000","last_clean":"2024-04-25T19:23:35.882959+0000","last_became_active":"2024-04-25T19:23:33.869181+0000","last_became_peered":"2024-04-25T19:23:33.869181+0000","last_unstale":"2024-04-25T19:23:35.882959+0000","last_undegraded":"2024-04-25T19:23:35.882959+0000","last_fullsized":"2024-04-25T19:23:35.882959+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:03:16.565706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.881949+0000","last_change":"2024-04-25T19:23:34.887744+0000","last_active":"2024-04-25T19:23:35.881949+0000","last_peered":"2024-04-25T19:23:35.881949+0000","last_clean":"2024-04-25T19:23:35.881949+0000","last_became_active":"2024-04-25T19:23:34.887465+0000","last_became_peered":"2024-04-25T19:23:34.887465+0000","last_unstale":"2024-04-25T19:23:35.881949+0000","last_undegraded":"2024-04-25T19:23:35.881949+0000","last_fullsized":"2024-04-25T19:23:35.881949+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:42:43.538944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876981+0000","last_change":"2024-04-25T19:23:33.860892+0000","last_active":"2024-04-25T19:23:35.876981+0000","last_peered":"2024-04-25T19:23:35.876981+0000","last_clean":"2024-04-25T19:23:35.876981+0000","last_became_active":"2024-04-25T19:23:33.860529+0000","last_became_peered":"2024-04-25T19:23:33.860529+0000","last_unstale":"2024-04-25T19:23:35.876981+0000","last_undegraded":"2024-04-25T19:23:35.876981+0000","last_fullsized":"2024-04-25T19:23:35.876981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:03:16.565706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876262+0000","last_change":"2024-04-25T19:23:34.886345+0000","last_active":"2024-04-25T19:23:35.876262+0000","last_peered":"2024-04-25T19:23:35.876262+0000","last_clean":"2024-04-25T19:23:35.876262+0000","last_became_active":"2024-04-25T19:23:34.885598+0000","last_became_peered":"2024-04-25T19:23:34.885598+0000","last_unstale":"2024-04-25T19:23:35.876262+0000","last_undegraded":"2024-04-25T19:23:35.876262+0000","last_fullsized":"2024-04-25T19:23:35.876262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:00:08.044331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882731+0000","last_change":"2024-04-25T19:23:33.859331+0000","last_active":"2024-04-25T19:23:35.882731+0000","last_peered":"2024-04-25T19:23:35.882731+0000","last_clean":"2024-04-25T19:23:35.882731+0000","last_became_active":"2024-04-25T19:23:33.858500+0000","last_became_peered":"2024-04-25T19:23:33.858500+0000","last_unstale":"2024-04-25T19:23:35.882731+0000","last_undegraded":"2024-04-25T19:23:35.882731+0000","last_fullsized":"2024-04-25T19:23:35.882731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:29.370419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.967861+0000","last_change":"2024-04-25T19:23:34.866340+0000","last_active":"2024-04-25T19:23:35.967861+0000","last_peered":"2024-04-25T19:23:35.967861+0000","last_clean":"2024-04-25T19:23:35.967861+0000","last_became_active":"2024-04-25T19:23:34.865996+0000","last_became_peered":"2024-04-25T19:23:34.865996+0000","last_unstale":"2024-04-25T19:23:35.967861+0000","last_undegraded":"2024-04-25T19:23:35.967861+0000","last_fullsized":"2024-04-25T19:23:35.967861+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:11.081868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876393+0000","last_change":"2024-04-25T19:23:33.855462+0000","last_active":"2024-04-25T19:23:35.876393+0000","last_peered":"2024-04-25T19:23:35.876393+0000","last_clean":"2024-04-25T19:23:35.876393+0000","last_became_active":"2024-04-25T19:23:33.855113+0000","last_became_peered":"2024-04-25T19:23:33.855113+0000","last_unstale":"2024-04-25T19:23:35.876393+0000","last_undegraded":"2024-04-25T19:23:35.876393+0000","last_fullsized":"2024-04-25T19:23:35.876393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:50.633103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.876567+0000","last_change":"2024-04-25T19:23:34.865944+0000","last_active":"2024-04-25T19:23:35.876567+0000","last_peered":"2024-04-25T19:23:35.876567+0000","last_clean":"2024-04-25T19:23:35.876567+0000","last_became_active":"2024-04-25T19:23:34.865591+0000","last_became_peered":"2024-04-25T19:23:34.865591+0000","last_unstale":"2024-04-25T19:23:35.876567+0000","last_undegraded":"2024-04-25T19:23:35.876567+0000","last_fullsized":"2024-04-25T19:23:35.876567+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:34.178623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.882425+0000","last_change":"2024-04-25T19:23:33.869538+0000","last_active":"2024-04-25T19:23:35.882425+0000","last_peered":"2024-04-25T19:23:35.882425+0000","last_clean":"2024-04-25T19:23:35.882425+0000","last_became_active":"2024-04-25T19:23:33.869167+0000","last_became_peered":"2024-04-25T19:23:33.869167+0000","last_unstale":"2024-04-25T19:23:35.882425+0000","last_undegraded":"2024-04-25T19:23:35.882425+0000","last_fullsized":"2024-04-25T19:23:35.882425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:00.480595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965288+0000","last_change":"2024-04-25T19:23:34.881366+0000","last_active":"2024-04-25T19:23:35.965288+0000","last_peered":"2024-04-25T19:23:35.965288+0000","last_clean":"2024-04-25T19:23:35.965288+0000","last_became_active":"2024-04-25T19:23:34.881035+0000","last_became_peered":"2024-04-25T19:23:34.881035+0000","last_unstale":"2024-04-25T19:23:35.965288+0000","last_undegraded":"2024-04-25T19:23:35.965288+0000","last_fullsized":"2024-04-25T19:23:35.965288+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:49.384633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.880084+0000","last_change":"2024-04-25T19:23:33.860231+0000","last_active":"2024-04-25T19:23:35.880084+0000","last_peered":"2024-04-25T19:23:35.880084+0000","last_clean":"2024-04-25T19:23:35.880084+0000","last_became_active":"2024-04-25T19:23:33.859759+0000","last_became_peered":"2024-04-25T19:23:33.859759+0000","last_unstale":"2024-04-25T19:23:35.880084+0000","last_undegraded":"2024-04-25T19:23:35.880084+0000","last_fullsized":"2024-04-25T19:23:35.880084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:43.913546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.878990+0000","last_change":"2024-04-25T19:23:34.884267+0000","last_active":"2024-04-25T19:23:35.878990+0000","last_peered":"2024-04-25T19:23:35.878990+0000","last_clean":"2024-04-25T19:23:35.878990+0000","last_became_active":"2024-04-25T19:23:34.883765+0000","last_became_peered":"2024-04-25T19:23:34.883765+0000","last_unstale":"2024-04-25T19:23:35.878990+0000","last_undegraded":"2024-04-25T19:23:35.878990+0000","last_fullsized":"2024-04-25T19:23:35.878990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:16.603308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.965963+0000","last_change":"2024-04-25T19:23:33.868354+0000","last_active":"2024-04-25T19:23:35.965963+0000","last_peered":"2024-04-25T19:23:35.965963+0000","last_clean":"2024-04-25T19:23:35.965963+0000","last_became_active":"2024-04-25T19:23:33.867050+0000","last_became_peered":"2024-04-25T19:23:33.867050+0000","last_unstale":"2024-04-25T19:23:35.965963+0000","last_undegraded":"2024-04-25T19:23:35.965963+0000","last_fullsized":"2024-04-25T19:23:35.965963+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:45.835245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.968849+0000","last_change":"2024-04-25T19:23:34.874503+0000","last_active":"2024-04-25T19:23:35.968849+0000","last_peered":"2024-04-25T19:23:35.968849+0000","last_clean":"2024-04-25T19:23:35.968849+0000","last_became_active":"2024-04-25T19:23:34.874028+0000","last_became_peered":"2024-04-25T19:23:34.874028+0000","last_unstale":"2024-04-25T19:23:35.968849+0000","last_undegraded":"2024-04-25T19:23:35.968849+0000","last_fullsized":"2024-04-25T19:23:35.968849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:33.810452+0000","last_clean_scrub_stamp":"2024-04-25T19:23:33.810452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:44:01.779997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.968534+0000","last_change":"2024-04-25T19:23:33.871947+0000","last_active":"2024-04-25T19:23:35.968534+0000","last_peered":"2024-04-25T19:23:35.968534+0000","last_clean":"2024-04-25T19:23:35.968534+0000","last_became_active":"2024-04-25T19:23:33.870719+0000","last_became_peered":"2024-04-25T19:23:33.870719+0000","last_unstale":"2024-04-25T19:23:35.968534+0000","last_undegraded":"2024-04-25T19:23:35.968534+0000","last_fullsized":"2024-04-25T19:23:35.968534+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:23:32.795139+0000","last_clean_scrub_stamp":"2024-04-25T19:23:32.795139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:03:16.565706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":133,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T19:23:35.969409+0000","last_change":"2024-04-25T19:22:06.081655+0000","last_active":"2024-04-25T19:23:35.969409+0000","last_peered":"2024-04-25T19:23:35.969409+0000","last_clean":"2024-04-25T19:23:35.969409+0000","last_became_active":"2024-04-25T19:22:06.078999+0000","last_became_peered":"2024-04-25T19:22:06.078999+0000","last_unstale":"2024-04-25T19:23:35.969409+0000","last_undegraded":"2024-04-25T19:23:35.969409+0000","last_fullsized":"2024-04-25T19:23:35.969409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_clean_scrub_stamp":"2024-04-25T19:22:04.921147+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:30.543734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":737066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":380928,"data_stored":147224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":380928,"data_stored":147280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":380928,"data_stored":146712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":148242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":146678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":148242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":966656,"data_stored":736976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T19:23:45.432 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T19:23:45.432 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T19:23:45.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.751+0000 7f4aeb000640 1 Processor -- start 2024-04-25T19:23:45.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.752+0000 7f4aeb000640 1 -- start start 2024-04-25T19:23:45.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.754+0000 7f4aeb000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4ae4144340 0x7f4ae406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:45.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.754+0000 7f4aeb000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ae415ee60 0x7f4ae415f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:45.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.754+0000 7f4aeb000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ae406df20 con 0x7f4ae406db10 2024-04-25T19:23:45.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.754+0000 7f4aeb000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4ae415f270 con 0x7f4ae4144340 2024-04-25T19:23:45.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.754+0000 7f4aeb000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4ae4144750 con 0x7f4ae415ee60 2024-04-25T19:23:45.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.755+0000 7f4aea600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ae415ee60 0x7f4ae415f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:45.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.755+0000 7f4ae9200640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f4ae406db10 0x7f4ae415e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.131:49034/0 (socket says 172.21.15.131:49034) 2024-04-25T19:23:45.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.755+0000 7f4ae9200640 1 -- 172.21.15.131:0/3477245099 learned_addr learned my addr 172.21.15.131:0/3477245099 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:45.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.755+0000 7f4ae9c00640 1 --2- 172.21.15.131:0/3477245099 >> v2:172.21.15.195:3300/0 conn(0x7f4ae4144340 0x7f4ae406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:45.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.756+0000 7f4ae3e00640 1 -- 172.21.15.131:0/3477245099 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3381202372 0 0) 0x7f4ad0001110 con 0x7f4ae406db10 2024-04-25T19:23:45.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.756+0000 7f4ae3e00640 1 -- 172.21.15.131:0/3477245099 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4acc003520 con 0x7f4ae406db10 2024-04-25T19:23:45.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.756+0000 7f4aea600640 1 -- 172.21.15.131:0/3477245099 >> v2:172.21.15.195:3300/0 conn(0x7f4ae4144340 msgr2=0x7f4ae406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:45.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.756+0000 7f4aea600640 1 --2- 172.21.15.131:0/3477245099 >> v2:172.21.15.195:3300/0 conn(0x7f4ae4144340 0x7f4ae406d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:45.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.756+0000 7f4aea600640 1 -- 172.21.15.131:0/3477245099 >> v1:172.21.15.195:6789/0 conn(0x7f4ae406db10 legacy=0x7f4ae415e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:45.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.756+0000 7f4aea600640 1 -- 172.21.15.131:0/3477245099 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae4070000 con 0x7f4ae415ee60 2024-04-25T19:23:45.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.756+0000 7f4ae9c00640 1 --2- 172.21.15.131:0/3477245099 >> v2:172.21.15.195:3300/0 conn(0x7f4ae4144340 0x7f4ae406d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T19:23:45.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.757+0000 7f4aea600640 1 --2- 172.21.15.131:0/3477245099 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ae415ee60 0x7f4ae415f4a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4adc009d90 tx=0x7f4adc02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b18ea75352f5aeb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:45.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.758+0000 7f4ae3e00640 1 -- 172.21.15.131:0/3477245099 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc007740 con 0x7f4ae415ee60 2024-04-25T19:23:45.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.758+0000 7f4ae3e00640 1 -- 172.21.15.131:0/3477245099 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4adc0078e0 con 0x7f4ae415ee60 2024-04-25T19:23:45.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.758+0000 7f4ae3e00640 1 -- 172.21.15.131:0/3477245099 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc007cb0 con 0x7f4ae415ee60 2024-04-25T19:23:45.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.759+0000 7f4aeb000640 1 -- 172.21.15.131:0/3477245099 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ae415ee60 msgr2=0x7f4ae415f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:45.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.759+0000 7f4aeb000640 1 --2- 172.21.15.131:0/3477245099 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ae415ee60 0x7f4ae415f4a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4adc009d90 tx=0x7f4adc02a660 comp rx=0 tx=0).stop 2024-04-25T19:23:45.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.759+0000 7f4aeb000640 1 -- 172.21.15.131:0/3477245099 shutdown_connections 2024-04-25T19:23:45.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.759+0000 7f4aeb000640 1 --2- 172.21.15.131:0/3477245099 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ae415ee60 0x7f4ae415f4a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:45.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.759+0000 7f4aeb000640 1 --2- 172.21.15.131:0/3477245099 >> v2:172.21.15.195:3300/0 conn(0x7f4ae4144340 0x7f4ae406d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:45.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.759+0000 7f4aeb000640 1 -- 172.21.15.131:0/3477245099 >> 172.21.15.131:0/3477245099 conn(0x7f4ae4072f40 msgr2=0x7f4ae4073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:45.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.759+0000 7f4aeb000640 1 -- 172.21.15.131:0/3477245099 shutdown_connections 2024-04-25T19:23:45.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.759+0000 7f4aeb000640 1 -- 172.21.15.131:0/3477245099 wait complete. 2024-04-25T19:23:45.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.762+0000 7f4aeb000640 1 Processor -- start 2024-04-25T19:23:45.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.763+0000 7f4aeb000640 1 -- start start 2024-04-25T19:23:45.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.764+0000 7f4aeb000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ae406db10 0x7f4ae41fa220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:45.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.764+0000 7f4aeb000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ae4144340 0x7f4ae41fa760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:45.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.765+0000 7f4aeb000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ae415ee60 0x7f4ae4134c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:45.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.765+0000 7f4aeb000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae406f800 con 0x7f4ae4144340 2024-04-25T19:23:45.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.765+0000 7f4aeb000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae406f520 con 0x7f4ae406db10 2024-04-25T19:23:45.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.765+0000 7f4aeb000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4ae406fae0 con 0x7f4ae415ee60 2024-04-25T19:23:45.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.765+0000 7f4ae9200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ae4144340 0x7f4ae41fa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:45.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.765+0000 7f4ae9200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ae4144340 0x7f4ae41fa760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51782/0 (socket says 172.21.15.131:51782) 2024-04-25T19:23:45.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.765+0000 7f4ae9200640 1 -- 172.21.15.131:0/3878415646 learned_addr learned my addr 172.21.15.131:0/3878415646 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:45.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.765+0000 7f4aea600640 1 --2- 172.21.15.131:0/3878415646 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ae415ee60 0x7f4ae4134c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:45.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.765+0000 7f4ae9c00640 1 --2- 172.21.15.131:0/3878415646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ae406db10 0x7f4ae41fa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:45.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.765+0000 7f4ae9200640 1 -- 172.21.15.131:0/3878415646 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ae415ee60 msgr2=0x7f4ae4134c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:45.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.765+0000 7f4ae9200640 1 --2- 172.21.15.131:0/3878415646 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ae415ee60 0x7f4ae4134c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:45.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.765+0000 7f4ae9200640 1 -- 172.21.15.131:0/3878415646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ae406db10 msgr2=0x7f4ae41fa220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:45.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.765+0000 7f4ae9200640 1 --2- 172.21.15.131:0/3878415646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ae406db10 0x7f4ae41fa220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:45.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.765+0000 7f4ae9200640 1 -- 172.21.15.131:0/3878415646 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae4154040 con 0x7f4ae4144340 2024-04-25T19:23:45.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.766+0000 7f4aea600640 1 --2- 172.21.15.131:0/3878415646 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ae415ee60 0x7f4ae4134c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:45.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.766+0000 7f4ae9200640 1 --2- 172.21.15.131:0/3878415646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ae4144340 0x7f4ae41fa760 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000c3c0 tx=0x7f4ad000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:45.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.766+0000 7f4ae1600640 1 -- 172.21.15.131:0/3878415646 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0017070 con 0x7f4ae4144340 2024-04-25T19:23:45.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.766+0000 7f4ae1600640 1 -- 172.21.15.131:0/3878415646 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad0005ce0 con 0x7f4ae4144340 2024-04-25T19:23:45.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.766+0000 7f4ae1600640 1 -- 172.21.15.131:0/3878415646 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad00072f0 con 0x7f4ae4144340 2024-04-25T19:23:45.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.766+0000 7f4aeb000640 1 -- 172.21.15.131:0/3878415646 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae4138d00 con 0x7f4ae4144340 2024-04-25T19:23:45.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.766+0000 7f4aeb000640 1 -- 172.21.15.131:0/3878415646 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae41392c0 con 0x7f4ae4144340 2024-04-25T19:23:45.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.768+0000 7f4aeb000640 1 -- 172.21.15.131:0/3878415646 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ae4138a70 con 0x7f4ae4144340 2024-04-25T19:23:45.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.769+0000 7f4ae1600640 1 -- 172.21.15.131:0/3878415646 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4ad001a070 con 0x7f4ae4144340 2024-04-25T19:23:45.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.770+0000 7f4ae1600640 1 --2- 172.21.15.131:0/3878415646 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f4ac40744b0 0x7f4ac40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:45.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.770+0000 7f4ae1600640 1 -- 172.21.15.131:0/3878415646 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f4ad0094510 con 0x7f4ae4144340 2024-04-25T19:23:45.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.770+0000 7f4ae9c00640 1 --2- 172.21.15.131:0/3878415646 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f4ac40744b0 0x7f4ac40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:45.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.772+0000 7f4ae9c00640 1 --2- 172.21.15.131:0/3878415646 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f4ac40744b0 0x7f4ac40769c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009a30 tx=0x7f4ad8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:45.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:45.775+0000 7f4ae1600640 1 -- 172.21.15.131:0/3878415646 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4ae406df20 con 0x7f4ae4144340 2024-04-25T19:23:46.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.043+0000 7f4aeb000640 1 -- 172.21.15.131:0/3878415646 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f4ae4076c60 con 0x7f4ae4144340 2024-04-25T19:23:46.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.050+0000 7f4ae1600640 1 -- 172.21.15.131:0/3878415646 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f4ad005edc0 con 0x7f4ae4144340 2024-04-25T19:23:46.052 INFO:teuthology.orchestra.run.smithi131.stdout:[client.0] 2024-04-25T19:23:46.052 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAnrSpmvjE7CxAABw7VdVfflQSjatWfjdHUXQ== 2024-04-25T19:23:46.052 INFO:teuthology.orchestra.run.smithi131.stdout: caps mds = "allow" 2024-04-25T19:23:46.052 INFO:teuthology.orchestra.run.smithi131.stdout: caps mon = "allow r" 2024-04-25T19:23:46.052 INFO:teuthology.orchestra.run.smithi131.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T19:23:46.053 INFO:teuthology.orchestra.run.smithi131.stderr:updated caps for client.0 2024-04-25T19:23:46.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.053+0000 7f4aeb000640 1 -- 172.21.15.131:0/3878415646 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f4ac40744b0 msgr2=0x7f4ac40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:46.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.053+0000 7f4aeb000640 1 --2- 172.21.15.131:0/3878415646 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f4ac40744b0 0x7f4ac40769c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009a30 tx=0x7f4ad8008040 comp rx=0 tx=0).stop 2024-04-25T19:23:46.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.053+0000 7f4aeb000640 1 -- 172.21.15.131:0/3878415646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ae4144340 msgr2=0x7f4ae41fa760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:46.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.053+0000 7f4aeb000640 1 --2- 172.21.15.131:0/3878415646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ae4144340 0x7f4ae41fa760 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000c3c0 tx=0x7f4ad000c880 comp rx=0 tx=0).stop 2024-04-25T19:23:46.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.053+0000 7f4aeb000640 1 -- 172.21.15.131:0/3878415646 shutdown_connections 2024-04-25T19:23:46.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.053+0000 7f4aeb000640 1 --2- 172.21.15.131:0/3878415646 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f4ac40744b0 0x7f4ac40769c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:46.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.053+0000 7f4aeb000640 1 --2- 172.21.15.131:0/3878415646 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ae415ee60 0x7f4ae4134c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:46.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.053+0000 7f4aeb000640 1 --2- 172.21.15.131:0/3878415646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ae4144340 0x7f4ae41fa760 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:46.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.053+0000 7f4aeb000640 1 --2- 172.21.15.131:0/3878415646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ae406db10 0x7f4ae41fa220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:46.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.053+0000 7f4aeb000640 1 -- 172.21.15.131:0/3878415646 >> 172.21.15.131:0/3878415646 conn(0x7f4ae4072f40 msgr2=0x7f4ae415d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:46.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.053+0000 7f4aeb000640 1 -- 172.21.15.131:0/3878415646 shutdown_connections 2024-04-25T19:23:46.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.053+0000 7f4aeb000640 1 -- 172.21.15.131:0/3878415646 wait complete. 2024-04-25T19:23:46.080 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:23:46.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.337+0000 7f893be00640 1 Processor -- start 2024-04-25T19:23:46.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.337+0000 7f893be00640 1 -- start start 2024-04-25T19:23:46.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.339+0000 7f893be00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f893c0b90e0 0x7f893c0b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:46.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.339+0000 7f893be00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f893c08cd60 0x7f893c08d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:46.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.339+0000 7f893be00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f893c08d6b0 con 0x7f893c06e680 2024-04-25T19:23:46.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.339+0000 7f893be00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f893c0d1d70 con 0x7f893c0b90e0 2024-04-25T19:23:46.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.339+0000 7f893be00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f893c0ce6d0 con 0x7f893c08cd60 2024-04-25T19:23:46.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.339+0000 7f893a000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f893c0b90e0 0x7f893c0b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:46.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.339+0000 7f893a000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f893c0b90e0 0x7f893c0b4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51784/0 (socket says 172.21.15.131:51784) 2024-04-25T19:23:46.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.339+0000 7f893a000640 1 -- 172.21.15.131:0/1256358197 learned_addr learned my addr 172.21.15.131:0/1256358197 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:46.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.340+0000 7f893b400640 1 --2- 172.21.15.131:0/1256358197 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f893c08cd60 0x7f893c08d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:46.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.340+0000 7f893a000640 1 -- 172.21.15.131:0/1256358197 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f893c08cd60 msgr2=0x7f893c08d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:46.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.340+0000 7f893a000640 1 --2- 172.21.15.131:0/1256358197 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f893c08cd60 0x7f893c08d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:46.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.340+0000 7f893a000640 1 -- 172.21.15.131:0/1256358197 >> v1:172.21.15.131:6789/0 conn(0x7f893c06e680 legacy=0x7f893c0cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:46.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.340+0000 7f893a000640 1 -- 172.21.15.131:0/1256358197 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893c0d1fa0 con 0x7f893c0b90e0 2024-04-25T19:23:46.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.341+0000 7f893a000640 1 --2- 172.21.15.131:0/1256358197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f893c0b90e0 0x7f893c0b4e80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8924009870 tx=0x7f892402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caadacf575b8ffda server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:46.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.341+0000 7f8939600640 1 -- 172.21.15.131:0/1256358197 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924037070 con 0x7f893c0b90e0 2024-04-25T19:23:46.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.341+0000 7f8939600640 1 -- 172.21.15.131:0/1256358197 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8924032440 con 0x7f893c0b90e0 2024-04-25T19:23:46.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.341+0000 7f8939600640 1 -- 172.21.15.131:0/1256358197 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924032810 con 0x7f893c0b90e0 2024-04-25T19:23:46.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.342+0000 7f893be00640 1 -- 172.21.15.131:0/1256358197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f893c0b90e0 msgr2=0x7f893c0b4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:46.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.342+0000 7f893be00640 1 --2- 172.21.15.131:0/1256358197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f893c0b90e0 0x7f893c0b4e80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8924009870 tx=0x7f892402a1c0 comp rx=0 tx=0).stop 2024-04-25T19:23:46.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.342+0000 7f893be00640 1 -- 172.21.15.131:0/1256358197 shutdown_connections 2024-04-25T19:23:46.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.342+0000 7f893be00640 1 --2- 172.21.15.131:0/1256358197 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f893c08cd60 0x7f893c08d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:46.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.342+0000 7f893be00640 1 --2- 172.21.15.131:0/1256358197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f893c0b90e0 0x7f893c0b4e80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:46.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.342+0000 7f893be00640 1 -- 172.21.15.131:0/1256358197 >> 172.21.15.131:0/1256358197 conn(0x7f893c0b5460 msgr2=0x7f893c0b5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:46.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.342+0000 7f893be00640 1 -- 172.21.15.131:0/1256358197 shutdown_connections 2024-04-25T19:23:46.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.342+0000 7f893be00640 1 -- 172.21.15.131:0/1256358197 wait complete. 2024-04-25T19:23:46.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.344+0000 7f893be00640 1 Processor -- start 2024-04-25T19:23:46.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.344+0000 7f893be00640 1 -- start start 2024-04-25T19:23:46.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.346+0000 7f893be00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f893c06e680 0x7f893c15bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:46.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.346+0000 7f893be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f893c08cd60 0x7f893c1ec5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:46.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.346+0000 7f893be00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f893c0b90e0 0x7f893c15ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:46.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.346+0000 7f893be00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f893c0d2560 con 0x7f893c08cd60 2024-04-25T19:23:46.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.346+0000 7f893be00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f893c0b94f0 con 0x7f893c0b90e0 2024-04-25T19:23:46.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.346+0000 7f893be00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f893c0d2840 con 0x7f893c06e680 2024-04-25T19:23:46.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.346+0000 7f893a000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f893c08cd60 0x7f893c1ec5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:46.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.346+0000 7f893a000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f893c08cd60 0x7f893c1ec5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51794/0 (socket says 172.21.15.131:51794) 2024-04-25T19:23:46.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.346+0000 7f893a000640 1 -- 172.21.15.131:0/3084018727 learned_addr learned my addr 172.21.15.131:0/3084018727 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:46.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.347+0000 7f893a000640 1 -- 172.21.15.131:0/3084018727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f893c06e680 msgr2=0x7f893c15bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:46.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.347+0000 7f893b400640 1 --2- 172.21.15.131:0/3084018727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f893c0b90e0 0x7f893c15ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:46.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.347+0000 7f893a000640 1 --2- 172.21.15.131:0/3084018727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f893c06e680 0x7f893c15bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:46.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.347+0000 7f893a000640 1 -- 172.21.15.131:0/3084018727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f893c0b90e0 msgr2=0x7f893c15ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:46.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.347+0000 7f893a000640 1 --2- 172.21.15.131:0/3084018727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f893c0b90e0 0x7f893c15ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:46.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.347+0000 7f893a000640 1 -- 172.21.15.131:0/3084018727 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893c161580 con 0x7f893c08cd60 2024-04-25T19:23:46.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.347+0000 7f893a000640 1 --2- 172.21.15.131:0/3084018727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f893c08cd60 0x7f893c1ec5a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f892402a200 tx=0x7f89240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:46.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.347+0000 7f8932a00640 1 -- 172.21.15.131:0/3084018727 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924037040 con 0x7f893c08cd60 2024-04-25T19:23:46.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.347+0000 7f8932a00640 1 -- 172.21.15.131:0/3084018727 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8924042070 con 0x7f893c08cd60 2024-04-25T19:23:46.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.347+0000 7f8932a00640 1 -- 172.21.15.131:0/3084018727 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924030bd0 con 0x7f893c08cd60 2024-04-25T19:23:46.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.347+0000 7f893be00640 1 -- 172.21.15.131:0/3084018727 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f893c161860 con 0x7f893c08cd60 2024-04-25T19:23:46.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.347+0000 7f893be00640 1 -- 172.21.15.131:0/3084018727 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f893c161e20 con 0x7f893c08cd60 2024-04-25T19:23:46.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.349+0000 7f893be00640 1 -- 172.21.15.131:0/3084018727 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f893c050740 con 0x7f893c08cd60 2024-04-25T19:23:46.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.350+0000 7f8932a00640 1 -- 172.21.15.131:0/3084018727 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f892402ad10 con 0x7f893c08cd60 2024-04-25T19:23:46.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.350+0000 7f8932a00640 1 --2- 172.21.15.131:0/3084018727 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f89180744e0 0x7f89180769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:46.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.351+0000 7f8932a00640 1 -- 172.21.15.131:0/3084018727 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f89240b5c80 con 0x7f893c08cd60 2024-04-25T19:23:46.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.351+0000 7f893aa00640 1 --2- 172.21.15.131:0/3084018727 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f89180744e0 0x7f89180769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:46.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.352+0000 7f893aa00640 1 --2- 172.21.15.131:0/3084018727 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f89180744e0 0x7f89180769f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f893c074b10 tx=0x7f892c007cd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:46.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.355+0000 7f8932a00640 1 -- 172.21.15.131:0/3084018727 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f892407fd20 con 0x7f893c08cd60 2024-04-25T19:23:46.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.593+0000 7f893be00640 1 -- 172.21.15.131:0/3084018727 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f893c0b8550 con 0x7f893c08cd60 2024-04-25T19:23:46.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.595+0000 7f8932a00640 1 -- 172.21.15.131:0/3084018727 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5193 (secure 0 0 0) 0x7f8924084020 con 0x7f893c08cd60 2024-04-25T19:23:46.597 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:46.597 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3675320819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3675320819},{"type":"v1","addr":"172.21.15.131:6834","nonce":3675320819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/2332391948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":2332391948},{"type":"v1","addr":"172.21.15.195:6835","nonce":2332391948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4726,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2008890338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2008890338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2008890338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T19:23:34.379246+0000","modified":"2024-04-25T19:23:37.485292+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4729":{"gid":4729,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6837/2364484867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2364484867},{"type":"v1","addr":"172.21.15.195:6837","nonce":2364484867}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4729,"qdb_cluster":[4729]},"id":2}]} 2024-04-25T19:23:46.597 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 16 2024-04-25T19:23:46.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.597+0000 7f893be00640 1 -- 172.21.15.131:0/3084018727 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f89180744e0 msgr2=0x7f89180769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:46.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.597+0000 7f893be00640 1 --2- 172.21.15.131:0/3084018727 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f89180744e0 0x7f89180769f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f893c074b10 tx=0x7f892c007cd0 comp rx=0 tx=0).stop 2024-04-25T19:23:46.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.597+0000 7f893be00640 1 -- 172.21.15.131:0/3084018727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f893c08cd60 msgr2=0x7f893c1ec5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:46.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.597+0000 7f893be00640 1 --2- 172.21.15.131:0/3084018727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f893c08cd60 0x7f893c1ec5a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f892402a200 tx=0x7f89240046c0 comp rx=0 tx=0).stop 2024-04-25T19:23:46.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.597+0000 7f893be00640 1 -- 172.21.15.131:0/3084018727 shutdown_connections 2024-04-25T19:23:46.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.597+0000 7f893be00640 1 --2- 172.21.15.131:0/3084018727 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f89180744e0 0x7f89180769f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:46.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.598+0000 7f893be00640 1 --2- 172.21.15.131:0/3084018727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f893c0b90e0 0x7f893c15ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:46.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.598+0000 7f893be00640 1 --2- 172.21.15.131:0/3084018727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f893c08cd60 0x7f893c1ec5a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:46.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.598+0000 7f893be00640 1 --2- 172.21.15.131:0/3084018727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f893c06e680 0x7f893c15bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:46.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.598+0000 7f893be00640 1 -- 172.21.15.131:0/3084018727 >> 172.21.15.131:0/3084018727 conn(0x7f893c0b5460 msgr2=0x7f893c0b4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:46.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.598+0000 7f893be00640 1 -- 172.21.15.131:0/3084018727 shutdown_connections 2024-04-25T19:23:46.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:46.598+0000 7f893be00640 1 -- 172.21.15.131:0/3084018727 wait complete. 2024-04-25T19:23:47.027 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T19:23:34.379246+0000', 'modified': '2024-04-25T19:23:37.485292+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4729}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4729': {'gid': 4729, 'name': 'd', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.195:6837/2364484867', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6836', 'nonce': 2364484867}, {'type': 'v1', 'addr': '172.21.15.195:6837', 'nonce': 2364484867}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4729, 'qdb_cluster': [4729]} 2024-04-25T19:23:47.028 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T19:23:47.028 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T19:23:47.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.308+0000 7f45bdc00640 1 Processor -- start 2024-04-25T19:23:47.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.308+0000 7f45bdc00640 1 -- start start 2024-04-25T19:23:47.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.311+0000 7f45bdc00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f45b80d1070 0x7f45b8162200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.311+0000 7f45bdc00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f45b8144e60 0x7f45b8145270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.311+0000 7f45bdc00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45b806fc70 con 0x7f45b8144350 2024-04-25T19:23:47.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.311+0000 7f45bdc00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f45b806ff50 con 0x7f45b8144e60 2024-04-25T19:23:47.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.311+0000 7f45bdc00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f45b8070230 con 0x7f45b80d1070 2024-04-25T19:23:47.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.311+0000 7f45bd200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f45b8144e60 0x7f45b8145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:47.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.311+0000 7f45bd200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f45b8144e60 0x7f45b8145270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51802/0 (socket says 172.21.15.131:51802) 2024-04-25T19:23:47.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.311+0000 7f45bd200640 1 -- 172.21.15.131:0/165188569 learned_addr learned my addr 172.21.15.131:0/165188569 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:47.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.311+0000 7f45bd200640 1 -- 172.21.15.131:0/165188569 >> v2:172.21.15.195:3300/0 conn(0x7f45b80d1070 msgr2=0x7f45b8162200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:47.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.311+0000 7f45bd200640 1 --2- 172.21.15.131:0/165188569 >> v2:172.21.15.195:3300/0 conn(0x7f45b80d1070 0x7f45b8162200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.311+0000 7f45bd200640 1 -- 172.21.15.131:0/165188569 >> v1:172.21.15.195:6789/0 conn(0x7f45b8144350 legacy=0x7f45b8161af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:47.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.311+0000 7f45bd200640 1 -- 172.21.15.131:0/165188569 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b8070510 con 0x7f45b8144e60 2024-04-25T19:23:47.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.312+0000 7f45bd200640 1 --2- 172.21.15.131:0/165188569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45b8144e60 0x7f45b8145270 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f45b80b6c10 tx=0x7f45b002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c6e360b3d8704e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:47.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.313+0000 7f45b7400640 1 -- 172.21.15.131:0/165188569 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b0036070 con 0x7f45b8144e60 2024-04-25T19:23:47.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.313+0000 7f45b7400640 1 -- 172.21.15.131:0/165188569 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45b0031600 con 0x7f45b8144e60 2024-04-25T19:23:47.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.313+0000 7f45b7400640 1 -- 172.21.15.131:0/165188569 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b00319d0 con 0x7f45b8144e60 2024-04-25T19:23:47.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.313+0000 7f45bdc00640 1 -- 172.21.15.131:0/165188569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45b8144e60 msgr2=0x7f45b8145270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:47.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.313+0000 7f45bdc00640 1 --2- 172.21.15.131:0/165188569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45b8144e60 0x7f45b8145270 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f45b80b6c10 tx=0x7f45b002a6f0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.314+0000 7f45bdc00640 1 -- 172.21.15.131:0/165188569 shutdown_connections 2024-04-25T19:23:47.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.314+0000 7f45bdc00640 1 --2- 172.21.15.131:0/165188569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45b8144e60 0x7f45b8145270 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.314+0000 7f45bdc00640 1 --2- 172.21.15.131:0/165188569 >> v2:172.21.15.195:3300/0 conn(0x7f45b80d1070 0x7f45b8162200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.314+0000 7f45bdc00640 1 -- 172.21.15.131:0/165188569 >> 172.21.15.131:0/165188569 conn(0x7f45b80d1720 msgr2=0x7f45b80d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:47.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.314+0000 7f45bdc00640 1 -- 172.21.15.131:0/165188569 shutdown_connections 2024-04-25T19:23:47.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.314+0000 7f45bdc00640 1 -- 172.21.15.131:0/165188569 wait complete. 2024-04-25T19:23:47.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.316+0000 7f45bdc00640 1 Processor -- start 2024-04-25T19:23:47.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.316+0000 7f45bdc00640 1 -- start start 2024-04-25T19:23:47.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.317+0000 7f45bdc00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45b80d1070 0x7f45b815f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.318+0000 7f45bdc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45b8144350 0x7f45b8142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.318+0000 7f45bdc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45b8144e60 0x7f45b815c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.318+0000 7f45bdc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f45b8162740 con 0x7f45b8144350 2024-04-25T19:23:47.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.318+0000 7f45bdc00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f45b8147910 con 0x7f45b80d1070 2024-04-25T19:23:47.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.318+0000 7f45bdc00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f45b81628c0 con 0x7f45b8144e60 2024-04-25T19:23:47.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.318+0000 7f45afe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45b8144350 0x7f45b8142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:47.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.318+0000 7f45afe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45b8144350 0x7f45b8142b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51816/0 (socket says 172.21.15.131:51816) 2024-04-25T19:23:47.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.318+0000 7f45afe00640 1 -- 172.21.15.131:0/2938937777 learned_addr learned my addr 172.21.15.131:0/2938937777 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:47.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.318+0000 7f45bd200640 1 --2- 172.21.15.131:0/2938937777 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45b8144e60 0x7f45b815c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:47.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.318+0000 7f45b7e00640 1 --2- 172.21.15.131:0/2938937777 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45b80d1070 0x7f45b815f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:47.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.318+0000 7f45afe00640 1 -- 172.21.15.131:0/2938937777 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45b8144e60 msgr2=0x7f45b815c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:47.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.318+0000 7f45afe00640 1 --2- 172.21.15.131:0/2938937777 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45b8144e60 0x7f45b815c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.318+0000 7f45afe00640 1 -- 172.21.15.131:0/2938937777 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45b80d1070 msgr2=0x7f45b815f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:47.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.318+0000 7f45afe00640 1 --2- 172.21.15.131:0/2938937777 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45b80d1070 0x7f45b815f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.318+0000 7f45afe00640 1 -- 172.21.15.131:0/2938937777 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b80b5f60 con 0x7f45b8144350 2024-04-25T19:23:47.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.318+0000 7f45b7e00640 1 --2- 172.21.15.131:0/2938937777 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45b80d1070 0x7f45b815f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:47.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.318+0000 7f45bd200640 1 --2- 172.21.15.131:0/2938937777 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45b8144e60 0x7f45b815c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:47.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.319+0000 7f45afe00640 1 --2- 172.21.15.131:0/2938937777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45b8144350 0x7f45b8142b90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f45a000b440 tx=0x7f45a000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:47.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.319+0000 7f45b4c00640 1 -- 172.21.15.131:0/2938937777 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a0015020 con 0x7f45b8144350 2024-04-25T19:23:47.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.319+0000 7f45b4c00640 1 -- 172.21.15.131:0/2938937777 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45a0011890 con 0x7f45b8144350 2024-04-25T19:23:47.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.319+0000 7f45b4c00640 1 -- 172.21.15.131:0/2938937777 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a0011c80 con 0x7f45b8144350 2024-04-25T19:23:47.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.319+0000 7f45bdc00640 1 -- 172.21.15.131:0/2938937777 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45b815e660 con 0x7f45b8144350 2024-04-25T19:23:47.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.319+0000 7f45bdc00640 1 -- 172.21.15.131:0/2938937777 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45b815ebe0 con 0x7f45b8144350 2024-04-25T19:23:47.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.322+0000 7f45b4c00640 1 -- 172.21.15.131:0/2938937777 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f45a0018020 con 0x7f45b8144350 2024-04-25T19:23:47.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.323+0000 7f45b4c00640 1 --2- 172.21.15.131:0/2938937777 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f45940744b0 0x7f45940769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.323+0000 7f45b4c00640 1 -- 172.21.15.131:0/2938937777 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f45a0095320 con 0x7f45b8144350 2024-04-25T19:23:47.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.323+0000 7f45c61bd740 1 Processor -- start 2024-04-25T19:23:47.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.323+0000 7f45b7e00640 1 --2- 172.21.15.131:0/2938937777 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f45940744b0 0x7f45940769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:47.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.324+0000 7f45c61bd740 1 -- start start 2024-04-25T19:23:47.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.325+0000 7f45b7e00640 1 --2- 172.21.15.131:0/2938937777 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f45940744b0 0x7f45940769c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f45b8147d40 tx=0x7f45a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:47.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.325+0000 7f45c61bd740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55b9850f8270 0x55b9854c5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.325+0000 7f45c61bd740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9850cf3b0 0x55b9854dff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.325+0000 7f45c61bd740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850d7590 0x55b9854e0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.325+0000 7f45c61bd740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55b9853fe600 con 0x55b9850d7590 2024-04-25T19:23:47.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.325+0000 7f45c61bd740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55b98539b100 con 0x55b9850cf3b0 2024-04-25T19:23:47.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.325+0000 7f45c61bd740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x55b9853fa5c0 con 0x55b9850f8270 2024-04-25T19:23:47.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.326+0000 7f45bd200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850d7590 0x55b9854e0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:47.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.326+0000 7f45bd200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850d7590 0x55b9854e0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51830/0 (socket says 172.21.15.131:51830) 2024-04-25T19:23:47.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.326+0000 7f45bd200640 1 -- 172.21.15.131:0/2717710725 learned_addr learned my addr 172.21.15.131:0/2717710725 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:47.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.326+0000 7f45b7e00640 1 --2- 172.21.15.131:0/2717710725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55b9850f8270 0x55b9854c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:47.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.326+0000 7f45afe00640 1 --2- 172.21.15.131:0/2717710725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9850cf3b0 0x55b9854dff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:47.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.326+0000 7f45bd200640 1 -- 172.21.15.131:0/2717710725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55b9850f8270 msgr2=0x55b9854c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:47.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.326+0000 7f45bd200640 1 --2- 172.21.15.131:0/2717710725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55b9850f8270 0x55b9854c5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.326+0000 7f45bd200640 1 -- 172.21.15.131:0/2717710725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9850cf3b0 msgr2=0x55b9854dff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:47.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.326+0000 7f45bd200640 1 --2- 172.21.15.131:0/2717710725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9850cf3b0 0x55b9854dff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.326+0000 7f45bd200640 1 -- 172.21.15.131:0/2717710725 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9851102d0 con 0x55b9850d7590 2024-04-25T19:23:47.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.326+0000 7f45bd200640 1 --2- 172.21.15.131:0/2717710725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850d7590 0x55b9854e0480 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f45b0034040 tx=0x7f45b002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d64c0ee4dda92b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:47.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.327+0000 7f45acc00640 1 -- 172.21.15.131:0/2717710725 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b0036040 con 0x55b9850d7590 2024-04-25T19:23:47.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.327+0000 7f45acc00640 1 -- 172.21.15.131:0/2717710725 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45b0031680 con 0x55b9850d7590 2024-04-25T19:23:47.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.327+0000 7f45acc00640 1 -- 172.21.15.131:0/2717710725 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b0031a70 con 0x55b9850d7590 2024-04-25T19:23:47.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.327+0000 7f45c61bd740 1 -- 172.21.15.131:0/2717710725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850d7590 msgr2=0x55b9854e0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:47.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.327+0000 7f45c61bd740 1 --2- 172.21.15.131:0/2717710725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850d7590 0x55b9854e0480 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f45b0034040 tx=0x7f45b002e000 comp rx=0 tx=0).stop 2024-04-25T19:23:47.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.327+0000 7f45c61bd740 1 -- 172.21.15.131:0/2717710725 shutdown_connections 2024-04-25T19:23:47.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.327+0000 7f45c61bd740 1 --2- 172.21.15.131:0/2717710725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850d7590 0x55b9854e0480 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.327+0000 7f45c61bd740 1 --2- 172.21.15.131:0/2717710725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9850cf3b0 0x55b9854dff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.327+0000 7f45c61bd740 1 --2- 172.21.15.131:0/2717710725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55b9850f8270 0x55b9854c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.327+0000 7f45c61bd740 1 -- 172.21.15.131:0/2717710725 >> 172.21.15.131:0/2717710725 conn(0x55b9850ec3c0 msgr2=0x55b98549a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:47.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.328+0000 7f45c61bd740 1 -- 172.21.15.131:0/2717710725 shutdown_connections 2024-04-25T19:23:47.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.328+0000 7f45c61bd740 1 -- 172.21.15.131:0/2717710725 wait complete. 2024-04-25T19:23:47.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.329+0000 7f45c61bd740 1 -- start start 2024-04-25T19:23:47.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.329+0000 7f45c61bd740 1 Processor -- start 2024-04-25T19:23:47.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.330+0000 7f45c61bd740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55b9850cf3b0 0x55b9854c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.330+0000 7f45c61bd740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9850d7590 0x55b9854de5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.330+0000 7f45c61bd740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850f8270 0x55b9854c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.330+0000 7f45c61bd740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55b985385f70 con 0x55b9850f8270 2024-04-25T19:23:47.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.330+0000 7f45c61bd740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55b9854c2190 con 0x55b9850d7590 2024-04-25T19:23:47.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.330+0000 7f45c61bd740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x55b9854da570 con 0x55b9850cf3b0 2024-04-25T19:23:47.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.330+0000 7f45c61bd740 10 client.0 _ll_register_callbacks cb 0x55b9853f4480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T19:23:47.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.331+0000 7f45bd200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850f8270 0x55b9854c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:47.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.331+0000 7f45bd200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850f8270 0x55b9854c42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51846/0 (socket says 172.21.15.131:51846) 2024-04-25T19:23:47.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.331+0000 7f45bd200640 1 -- 172.21.15.131:0/1422584464 learned_addr learned my addr 172.21.15.131:0/1422584464 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:47.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.331+0000 7f45bd200640 1 -- 172.21.15.131:0/1422584464 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55b9850cf3b0 msgr2=0x55b9854c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:47.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.331+0000 7f45bd200640 1 --2- 172.21.15.131:0/1422584464 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55b9850cf3b0 0x55b9854c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.331+0000 7f45bd200640 1 -- 172.21.15.131:0/1422584464 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9850d7590 msgr2=0x55b9854de5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:47.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.331+0000 7f45bd200640 1 --2- 172.21.15.131:0/1422584464 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9850d7590 0x55b9854de5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.331+0000 7f45bd200640 1 -- 172.21.15.131:0/1422584464 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9851da6b0 con 0x55b9850f8270 2024-04-25T19:23:47.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.331+0000 7f45bd200640 1 --2- 172.21.15.131:0/1422584464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850f8270 0x55b9854c42e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009f40 tx=0x7f45b002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881101f488ed054a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:47.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.331+0000 7f45a5600640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-04-25T19:23:47.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.332+0000 7f45a5600640 1 -- 172.21.15.131:0/1422584464 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b0036070 con 0x55b9850f8270 2024-04-25T19:23:47.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.332+0000 7f45a5600640 1 -- 172.21.15.131:0/1422584464 <== mon.0 v2:172.21.15.131:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f45b0031a40 con 0x55b9850f8270 2024-04-25T19:23:47.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.332+0000 7f45c61bd740 1 -- 172.21.15.131:0/1422584464 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45b0031680 con 0x55b9850f8270 2024-04-25T19:23:47.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.332+0000 7f45a5600640 1 -- 172.21.15.131:0/1422584464 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f45b0054050 con 0x55b9850f8270 2024-04-25T19:23:47.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.332+0000 7f45c61bd740 10 client.5280 fetch_fsmap learned FSMap version 16 2024-04-25T19:23:47.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.332+0000 7f45c61bd740 1 -- 172.21.15.131:0/1422584464 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55b9854c4be0 con 0x55b9850f8270 2024-04-25T19:23:47.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.332+0000 7f45a5600640 1 -- 172.21.15.131:0/1422584464 <== mon.0 v2:172.21.15.131:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45b0031680 con 0x55b9850f8270 2024-04-25T19:23:47.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.332+0000 7f45a5600640 1 -- 172.21.15.131:0/1422584464 <== mon.0 v2:172.21.15.131:3300/0 5 ==== fsmap(e 16) ==== 3494+0+0 (secure 0 0 0) 0x7f45b0057020 con 0x55b9850f8270 2024-04-25T19:23:47.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.332+0000 7f45c61bd740 10 client.5280 fetch_fsmap finished waiting for FSMap version 16 2024-04-25T19:23:47.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.332+0000 7f45c61bd740 10 client.5280 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T19:23:47.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.332+0000 7f45c61bd740 20 client.5280 populate_metadata read hostname 'smithi131' 2024-04-25T19:23:47.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.332+0000 7f45c61bd740 1 --2- 172.21.15.131:0/1422584464 >> [v2:172.21.15.195:6836/2364484867,v1:172.21.15.195:6837/2364484867] conn(0x55b9850b6e40 0x55b9854fce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.332+0000 7f45c61bd740 4 client.5280 mds_command: new command op to 4729 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T19:23:47.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.332+0000 7f45c61bd740 1 -- 172.21.15.131:0/1422584464 --> [v2:172.21.15.195:6836/2364484867,v1:172.21.15.195:6837/2364484867] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b98540c210 con 0x55b9850b6e40 2024-04-25T19:23:47.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.333+0000 7f45b7e00640 1 --2- 172.21.15.131:0/1422584464 >> [v2:172.21.15.195:6836/2364484867,v1:172.21.15.195:6837/2364484867] conn(0x55b9850b6e40 0x55b9854fce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:47.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.334+0000 7f45b7e00640 1 --2- 172.21.15.131:0/1422584464 >> [v2:172.21.15.195:6836/2364484867,v1:172.21.15.195:6837/2364484867] conn(0x55b9850b6e40 0x55b9854fce90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5c129d1823fa665 server_cookie=42e8b450eb8a9bff in_seq=0 out_seq=0 2024-04-25T19:23:47.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.334+0000 7f45a5600640 10 client.5280 ms_handle_connect on v2:172.21.15.195:6836/2364484867 2024-04-25T19:23:47.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.336+0000 7f45a5600640 1 -- 172.21.15.131:0/1422584464 <== mds.0 v2:172.21.15.195:6836/2364484867 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b98540c210 con 0x55b9850b6e40 2024-04-25T19:23:47.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.336+0000 7f45a5600640 10 client.5280 handle_command_reply: tid=0 2024-04-25T19:23:47.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.337+0000 7f45c61bd740 1 client.5280 shutdown 2024-04-25T19:23:47.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.337+0000 7f45c61bd740 1 -- 172.21.15.131:0/1422584464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850f8270 msgr2=0x55b9854c42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:47.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.337+0000 7f45c61bd740 1 --2- 172.21.15.131:0/1422584464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850f8270 0x55b9854c42e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009f40 tx=0x7f45b002c000 comp rx=0 tx=0).stop 2024-04-25T19:23:47.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.337+0000 7f45c61bd740 1 -- 172.21.15.131:0/1422584464 shutdown_connections 2024-04-25T19:23:47.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.337+0000 7f45c61bd740 1 --2- 172.21.15.131:0/1422584464 >> [v2:172.21.15.195:6836/2364484867,v1:172.21.15.195:6837/2364484867] conn(0x55b9850b6e40 0x55b9854fce90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.337+0000 7f45c61bd740 1 --2- 172.21.15.131:0/1422584464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850f8270 0x55b9854c42e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.337+0000 7f45c61bd740 1 --2- 172.21.15.131:0/1422584464 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9850d7590 0x55b9854de5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.337+0000 7f45c61bd740 1 --2- 172.21.15.131:0/1422584464 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55b9850cf3b0 0x55b9854c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.337+0000 7f45a5600640 0 client.5280 ms_handle_reset on v2:172.21.15.195:6836/2364484867 2024-04-25T19:23:47.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.337+0000 7f45c61bd740 1 -- 172.21.15.131:0/1422584464 >> 172.21.15.131:0/1422584464 conn(0x55b9850ec3c0 msgr2=0x55b9854c5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:47.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.337+0000 7f45c61bd740 1 -- 172.21.15.131:0/1422584464 shutdown_connections 2024-04-25T19:23:47.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.337+0000 7f45c61bd740 1 -- 172.21.15.131:0/1422584464 wait complete. 2024-04-25T19:23:47.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.337+0000 7f45c61bd740 20 client.5280 trim_cache size 0 max 16384 2024-04-25T19:23:47.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.357+0000 7f45c61bd740 1 Processor -- start 2024-04-25T19:23:47.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.358+0000 7f45c61bd740 1 -- start start 2024-04-25T19:23:47.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.359+0000 7f45c61bd740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9850cf3b0 0x55b985498f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.359+0000 7f45c61bd740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55b9850d7590 0x55b985499450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.359+0000 7f45c61bd740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850f8270 0x55b985558390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.359+0000 7f45c61bd740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f45b80b52e0 con 0x55b9850f8270 2024-04-25T19:23:47.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.359+0000 7f45c61bd740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f45b80b4640 con 0x55b9850cf3b0 2024-04-25T19:23:47.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.359+0000 7f45c61bd740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f45b80b4c90 con 0x55b9850d7590 2024-04-25T19:23:47.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.360+0000 7f45bd200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850f8270 0x55b985558390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:47.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.360+0000 7f45bd200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850f8270 0x55b985558390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51862/0 (socket says 172.21.15.131:51862) 2024-04-25T19:23:47.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.360+0000 7f45bd200640 1 -- 172.21.15.131:0/3595205613 learned_addr learned my addr 172.21.15.131:0/3595205613 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:47.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.360+0000 7f45afe00640 1 --2- 172.21.15.131:0/3595205613 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55b9850d7590 0x55b985499450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:47.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.360+0000 7f45b7e00640 1 --2- 172.21.15.131:0/3595205613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9850cf3b0 0x55b985498f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:47.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.360+0000 7f45bd200640 1 -- 172.21.15.131:0/3595205613 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55b9850d7590 msgr2=0x55b985499450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:47.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.360+0000 7f45bd200640 1 --2- 172.21.15.131:0/3595205613 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55b9850d7590 0x55b985499450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.360+0000 7f45bd200640 1 -- 172.21.15.131:0/3595205613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9850cf3b0 msgr2=0x55b985498f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:47.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.360+0000 7f45bd200640 1 --2- 172.21.15.131:0/3595205613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9850cf3b0 0x55b985498f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.360+0000 7f45bd200640 1 -- 172.21.15.131:0/3595205613 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9854de920 con 0x55b9850f8270 2024-04-25T19:23:47.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.360+0000 7f45bd200640 1 --2- 172.21.15.131:0/3595205613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850f8270 0x55b985558390 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f45b00072a0 tx=0x7f45b003b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1291bb8b7118ed86 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:47.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.360+0000 7f45a7e00640 1 -- 172.21.15.131:0/3595205613 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b0036070 con 0x55b9850f8270 2024-04-25T19:23:47.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.360+0000 7f45a7e00640 1 -- 172.21.15.131:0/3595205613 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45b0049070 con 0x55b9850f8270 2024-04-25T19:23:47.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.360+0000 7f45a7e00640 1 -- 172.21.15.131:0/3595205613 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b0031c40 con 0x55b9850f8270 2024-04-25T19:23:47.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.361+0000 7f45c61bd740 1 -- 172.21.15.131:0/3595205613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850f8270 msgr2=0x55b985558390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:47.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.361+0000 7f45c61bd740 1 --2- 172.21.15.131:0/3595205613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850f8270 0x55b985558390 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f45b00072a0 tx=0x7f45b003b000 comp rx=0 tx=0).stop 2024-04-25T19:23:47.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.361+0000 7f45c61bd740 1 -- 172.21.15.131:0/3595205613 shutdown_connections 2024-04-25T19:23:47.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.361+0000 7f45c61bd740 1 --2- 172.21.15.131:0/3595205613 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55b9850d7590 0x55b985499450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.361+0000 7f45c61bd740 1 --2- 172.21.15.131:0/3595205613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850f8270 0x55b985558390 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.361+0000 7f45c61bd740 1 --2- 172.21.15.131:0/3595205613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9850cf3b0 0x55b985498f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.361+0000 7f45c61bd740 1 -- 172.21.15.131:0/3595205613 >> 172.21.15.131:0/3595205613 conn(0x55b9850ec3c0 msgr2=0x55b9854c0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:47.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.361+0000 7f45c61bd740 1 -- 172.21.15.131:0/3595205613 shutdown_connections 2024-04-25T19:23:47.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.361+0000 7f45c61bd740 1 -- 172.21.15.131:0/3595205613 wait complete. 2024-04-25T19:23:47.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.362+0000 7f45c61bd740 1 -- start start 2024-04-25T19:23:47.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.363+0000 7f45c61bd740 1 Processor -- start 2024-04-25T19:23:47.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.364+0000 7f45c61bd740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55b9850cf3b0 0x55b98555aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.364+0000 7f45c61bd740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9850d7590 0x55b9854c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.364+0000 7f45c61bd740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850f8270 0x55b9854c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.364+0000 7f45c61bd740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55b9854c7ae0 con 0x55b9850f8270 2024-04-25T19:23:47.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.364+0000 7f45c61bd740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55b9854c7640 con 0x55b9850d7590 2024-04-25T19:23:47.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.364+0000 7f45c61bd740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x55b9854db360 con 0x55b9850cf3b0 2024-04-25T19:23:47.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.364+0000 7f45c61bd740 10 client.0 _ll_register_callbacks cb 0x7f45b0009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T19:23:47.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.364+0000 7f45bd200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850f8270 0x55b9854c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:47.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.365+0000 7f45bd200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850f8270 0x55b9854c64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51876/0 (socket says 172.21.15.131:51876) 2024-04-25T19:23:47.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.365+0000 7f45bd200640 1 -- 172.21.15.131:0/1650196590 learned_addr learned my addr 172.21.15.131:0/1650196590 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:47.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.365+0000 7f45afe00640 1 --2- 172.21.15.131:0/1650196590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9850d7590 0x55b9854c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:47.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.365+0000 7f45b7e00640 1 --2- 172.21.15.131:0/1650196590 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55b9850cf3b0 0x55b98555aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:47.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.365+0000 7f45bd200640 1 -- 172.21.15.131:0/1650196590 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55b9850cf3b0 msgr2=0x55b98555aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:47.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.365+0000 7f45bd200640 1 --2- 172.21.15.131:0/1650196590 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55b9850cf3b0 0x55b98555aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.365+0000 7f45bd200640 1 -- 172.21.15.131:0/1650196590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9850d7590 msgr2=0x55b9854c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:47.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.365+0000 7f45bd200640 1 --2- 172.21.15.131:0/1650196590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9850d7590 0x55b9854c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.365+0000 7f45bd200640 1 -- 172.21.15.131:0/1650196590 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9854dbb80 con 0x55b9850f8270 2024-04-25T19:23:47.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.365+0000 7f45afe00640 1 --2- 172.21.15.131:0/1650196590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9850d7590 0x55b9854c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:47.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.365+0000 7f45bd200640 1 --2- 172.21.15.131:0/1650196590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850f8270 0x55b9854c64a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f45b002ace0 tx=0x7f45b0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fccae4dee5db569 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:47.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.365+0000 7f45a5600640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-04-25T19:23:47.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.365+0000 7f45a5600640 1 -- 172.21.15.131:0/1650196590 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b0036070 con 0x55b9850f8270 2024-04-25T19:23:47.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.366+0000 7f45a5600640 1 -- 172.21.15.131:0/1650196590 <== mon.0 v2:172.21.15.131:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f45b0059aa0 con 0x55b9850f8270 2024-04-25T19:23:47.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.366+0000 7f45c61bd740 1 -- 172.21.15.131:0/1650196590 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45b0049070 con 0x55b9850f8270 2024-04-25T19:23:47.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.366+0000 7f45a5600640 1 -- 172.21.15.131:0/1650196590 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f45b0003d80 con 0x55b9850f8270 2024-04-25T19:23:47.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.366+0000 7f45c61bd740 10 client.5286 fetch_fsmap learned FSMap version 16 2024-04-25T19:23:47.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.366+0000 7f45c61bd740 1 -- 172.21.15.131:0/1650196590 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55b9854f0ee0 con 0x55b9850f8270 2024-04-25T19:23:47.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.366+0000 7f45a5600640 1 -- 172.21.15.131:0/1650196590 <== mon.0 v2:172.21.15.131:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45b0049070 con 0x55b9850f8270 2024-04-25T19:23:47.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.366+0000 7f45a5600640 1 -- 172.21.15.131:0/1650196590 <== mon.0 v2:172.21.15.131:3300/0 5 ==== fsmap(e 16) ==== 3494+0+0 (secure 0 0 0) 0x7f45b0057040 con 0x55b9850f8270 2024-04-25T19:23:47.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.366+0000 7f45c61bd740 10 client.5286 fetch_fsmap finished waiting for FSMap version 16 2024-04-25T19:23:47.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.366+0000 7f45c61bd740 10 client.5286 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T19:23:47.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.366+0000 7f45c61bd740 20 client.5286 populate_metadata read hostname 'smithi131' 2024-04-25T19:23:47.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.366+0000 7f45c61bd740 1 --2- 172.21.15.131:0/1650196590 >> [v2:172.21.15.195:6836/2364484867,v1:172.21.15.195:6837/2364484867] conn(0x55b98549ac30 0x55b98549b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.366+0000 7f45c61bd740 4 client.5286 mds_command: new command op to 4729 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T19:23:47.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.366+0000 7f45c61bd740 1 -- 172.21.15.131:0/1650196590 --> [v2:172.21.15.195:6836/2364484867,v1:172.21.15.195:6837/2364484867] -- command(tid 0: {"prefix": "status"}) -- 0x55b985406080 con 0x55b98549ac30 2024-04-25T19:23:47.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.367+0000 7f45b7e00640 1 --2- 172.21.15.131:0/1650196590 >> [v2:172.21.15.195:6836/2364484867,v1:172.21.15.195:6837/2364484867] conn(0x55b98549ac30 0x55b98549b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:47.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.368+0000 7f45b7e00640 1 --2- 172.21.15.131:0/1650196590 >> [v2:172.21.15.195:6836/2364484867,v1:172.21.15.195:6837/2364484867] conn(0x55b98549ac30 0x55b98549b040 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d69ab962359a6a98 server_cookie=99f05233f98ac87a in_seq=0 out_seq=0 2024-04-25T19:23:47.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.368+0000 7f45a5600640 10 client.5286 ms_handle_connect on v2:172.21.15.195:6836/2364484867 2024-04-25T19:23:47.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.369+0000 7f45a5600640 1 -- 172.21.15.131:0/1650196590 <== mds.0 v2:172.21.15.195:6836/2364484867 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55b985406080 con 0x55b98549ac30 2024-04-25T19:23:47.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.369+0000 7f45a5600640 10 client.5286 handle_command_reply: tid=0 2024-04-25T19:23:47.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.369+0000 7f45c61bd740 1 client.5286 shutdown 2024-04-25T19:23:47.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.369+0000 7f45c61bd740 1 -- 172.21.15.131:0/1650196590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850f8270 msgr2=0x55b9854c64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:47.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.369+0000 7f45c61bd740 1 --2- 172.21.15.131:0/1650196590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850f8270 0x55b9854c64a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f45b002ace0 tx=0x7f45b0004ab0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.369+0000 7f45c61bd740 1 -- 172.21.15.131:0/1650196590 shutdown_connections 2024-04-25T19:23:47.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.369+0000 7f45c61bd740 1 --2- 172.21.15.131:0/1650196590 >> [v2:172.21.15.195:6836/2364484867,v1:172.21.15.195:6837/2364484867] conn(0x55b98549ac30 0x55b98549b040 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.369+0000 7f45c61bd740 1 --2- 172.21.15.131:0/1650196590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9850f8270 0x55b9854c64a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.369+0000 7f45c61bd740 1 --2- 172.21.15.131:0/1650196590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9850d7590 0x55b9854c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.369+0000 7f45c61bd740 1 --2- 172.21.15.131:0/1650196590 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55b9850cf3b0 0x55b98555aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.369+0000 7f45c61bd740 1 -- 172.21.15.131:0/1650196590 >> 172.21.15.131:0/1650196590 conn(0x55b9850ec3c0 msgr2=0x55b98549b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:47.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.369+0000 7f45a5600640 0 client.5286 ms_handle_reset on v2:172.21.15.195:6836/2364484867 2024-04-25T19:23:47.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.369+0000 7f45c61bd740 1 -- 172.21.15.131:0/1650196590 shutdown_connections 2024-04-25T19:23:47.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.369+0000 7f45c61bd740 1 -- 172.21.15.131:0/1650196590 wait complete. 2024-04-25T19:23:47.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.369+0000 7f45c61bd740 20 client.5286 trim_cache size 0 max 16384 2024-04-25T19:23:47.373 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-25T19:23:47.373 INFO:teuthology.orchestra.run.smithi131.stdout: "cluster_fsid": "4ba607f8-c2c3-4d8d-85a8-7800763c470f", 2024-04-25T19:23:47.373 INFO:teuthology.orchestra.run.smithi131.stdout: "whoami": 0, 2024-04-25T19:23:47.373 INFO:teuthology.orchestra.run.smithi131.stdout: "id": 4729, 2024-04-25T19:23:47.373 INFO:teuthology.orchestra.run.smithi131.stdout: "want_state": "up:active", 2024-04-25T19:23:47.374 INFO:teuthology.orchestra.run.smithi131.stdout: "state": "up:active", 2024-04-25T19:23:47.374 INFO:teuthology.orchestra.run.smithi131.stdout: "fs_name": "cephfs", 2024-04-25T19:23:47.374 INFO:teuthology.orchestra.run.smithi131.stdout: "rank_uptime": 12.504709030000001, 2024-04-25T19:23:47.374 INFO:teuthology.orchestra.run.smithi131.stdout: "mdsmap_epoch": 16, 2024-04-25T19:23:47.374 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_epoch": 33, 2024-04-25T19:23:47.374 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_epoch_barrier": 33, 2024-04-25T19:23:47.374 INFO:teuthology.orchestra.run.smithi131.stdout: "uptime": 21.47368187 2024-04-25T19:23:47.374 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-25T19:23:47.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.370+0000 7f45bdc00640 1 -- 172.21.15.131:0/2938937777 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f45940744b0 msgr2=0x7f45940769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:47.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.370+0000 7f45bdc00640 1 --2- 172.21.15.131:0/2938937777 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f45940744b0 0x7f45940769c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f45b8147d40 tx=0x7f45a8008040 comp rx=0 tx=0).stop 2024-04-25T19:23:47.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.370+0000 7f45bdc00640 1 -- 172.21.15.131:0/2938937777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45b8144350 msgr2=0x7f45b8142b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:47.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.370+0000 7f45bdc00640 1 --2- 172.21.15.131:0/2938937777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45b8144350 0x7f45b8142b90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f45a000b440 tx=0x7f45a000b900 comp rx=0 tx=0).stop 2024-04-25T19:23:47.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.370+0000 7f45bdc00640 1 -- 172.21.15.131:0/2938937777 shutdown_connections 2024-04-25T19:23:47.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.370+0000 7f45bdc00640 1 --2- 172.21.15.131:0/2938937777 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f45940744b0 0x7f45940769c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.370+0000 7f45bdc00640 1 --2- 172.21.15.131:0/2938937777 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45b8144e60 0x7f45b815c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.370+0000 7f45bdc00640 1 --2- 172.21.15.131:0/2938937777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45b8144350 0x7f45b8142b90 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.370+0000 7f45bdc00640 1 --2- 172.21.15.131:0/2938937777 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45b80d1070 0x7f45b815f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.370+0000 7f45bdc00640 1 -- 172.21.15.131:0/2938937777 >> 172.21.15.131:0/2938937777 conn(0x7f45b80d1720 msgr2=0x7f45b80b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:47.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.370+0000 7f45bdc00640 1 -- 172.21.15.131:0/2938937777 shutdown_connections 2024-04-25T19:23:47.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.370+0000 7f45bdc00640 1 -- 172.21.15.131:0/2938937777 wait complete. 2024-04-25T19:23:47.398 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T19:23:47.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.657+0000 7fe757200640 1 Processor -- start 2024-04-25T19:23:47.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.657+0000 7fe757200640 1 -- start start 2024-04-25T19:23:47.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.659+0000 7fe757200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe7580afe40 0x7fe758163630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.659+0000 7fe757200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe758073d90 0x7fe75806c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.659+0000 7fe757200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe75806fc10 con 0x7fe758164630 2024-04-25T19:23:47.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.659+0000 7fe757200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fe7580cc560 con 0x7fe758073d90 2024-04-25T19:23:47.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.659+0000 7fe757200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe75806f650 con 0x7fe7580afe40 2024-04-25T19:23:47.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.659+0000 7fe756800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe758073d90 0x7fe75806c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:47.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.659+0000 7fe756800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe758073d90 0x7fe75806c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51886/0 (socket says 172.21.15.131:51886) 2024-04-25T19:23:47.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.659+0000 7fe756800640 1 -- 172.21.15.131:0/1480455248 learned_addr learned my addr 172.21.15.131:0/1480455248 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:47.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.659+0000 7fe755e00640 1 --2- 172.21.15.131:0/1480455248 >> v2:172.21.15.195:3300/0 conn(0x7fe7580afe40 0x7fe758163630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:47.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.659+0000 7fe756800640 1 -- 172.21.15.131:0/1480455248 >> v2:172.21.15.195:3300/0 conn(0x7fe7580afe40 msgr2=0x7fe758163630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:47.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.659+0000 7fe756800640 1 --2- 172.21.15.131:0/1480455248 >> v2:172.21.15.195:3300/0 conn(0x7fe7580afe40 0x7fe758163630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.659+0000 7fe756800640 1 -- 172.21.15.131:0/1480455248 >> v1:172.21.15.195:6789/0 conn(0x7fe758164630 legacy=0x7fe758073680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:47.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.659+0000 7fe756800640 1 -- 172.21.15.131:0/1480455248 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe75806f930 con 0x7fe758073d90 2024-04-25T19:23:47.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.660+0000 7fe756800640 1 --2- 172.21.15.131:0/1480455248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe758073d90 0x7fe75806c5c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe7580cfa20 tx=0x7fe75002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2e3dfba319b5b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:47.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.661+0000 7fe755400640 1 -- 172.21.15.131:0/1480455248 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe750036070 con 0x7fe758073d90 2024-04-25T19:23:47.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.661+0000 7fe755400640 1 -- 172.21.15.131:0/1480455248 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe750031600 con 0x7fe758073d90 2024-04-25T19:23:47.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.661+0000 7fe755400640 1 -- 172.21.15.131:0/1480455248 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7500319d0 con 0x7fe758073d90 2024-04-25T19:23:47.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.661+0000 7fe757200640 1 -- 172.21.15.131:0/1480455248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe758073d90 msgr2=0x7fe75806c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:47.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.661+0000 7fe757200640 1 --2- 172.21.15.131:0/1480455248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe758073d90 0x7fe75806c5c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe7580cfa20 tx=0x7fe75002a6f0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.662+0000 7fe757200640 1 -- 172.21.15.131:0/1480455248 shutdown_connections 2024-04-25T19:23:47.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.662+0000 7fe757200640 1 --2- 172.21.15.131:0/1480455248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe758073d90 0x7fe75806c5c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.662+0000 7fe757200640 1 --2- 172.21.15.131:0/1480455248 >> v2:172.21.15.195:3300/0 conn(0x7fe7580afe40 0x7fe758163630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.662+0000 7fe757200640 1 -- 172.21.15.131:0/1480455248 >> 172.21.15.131:0/1480455248 conn(0x7fe7580d1f10 msgr2=0x7fe7580d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:47.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.662+0000 7fe757200640 1 -- 172.21.15.131:0/1480455248 shutdown_connections 2024-04-25T19:23:47.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.662+0000 7fe757200640 1 -- 172.21.15.131:0/1480455248 wait complete. 2024-04-25T19:23:47.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.664+0000 7fe757200640 1 Processor -- start 2024-04-25T19:23:47.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.664+0000 7fe757200640 1 -- start start 2024-04-25T19:23:47.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.667+0000 7fe757200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7580afe40 0x7fe7581f5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.667+0000 7fe757200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe758164630 0x7fe758157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.667+0000 7fe757200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe758157fc0 0x7fe7580b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.667+0000 7fe757200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe758164a40 con 0x7fe758164630 2024-04-25T19:23:47.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.667+0000 7fe757200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe7580b0370 con 0x7fe758157fc0 2024-04-25T19:23:47.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.667+0000 7fe757200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe75806cb00 con 0x7fe7580afe40 2024-04-25T19:23:47.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.667+0000 7fe74fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe758164630 0x7fe758157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:47.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.667+0000 7fe74fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe758164630 0x7fe758157a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51896/0 (socket says 172.21.15.131:51896) 2024-04-25T19:23:47.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.667+0000 7fe74fe00640 1 -- 172.21.15.131:0/272163256 learned_addr learned my addr 172.21.15.131:0/272163256 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:47.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.667+0000 7fe755e00640 1 --2- 172.21.15.131:0/272163256 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7580afe40 0x7fe7581f5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:47.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.667+0000 7fe74fe00640 1 -- 172.21.15.131:0/272163256 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7580afe40 msgr2=0x7fe7581f5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:47.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.667+0000 7fe74fe00640 1 --2- 172.21.15.131:0/272163256 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7580afe40 0x7fe7581f5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.667+0000 7fe74fe00640 1 -- 172.21.15.131:0/272163256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe758157fc0 msgr2=0x7fe7580b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:47.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.667+0000 7fe756800640 1 --2- 172.21.15.131:0/272163256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe758157fc0 0x7fe7580b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:47.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.667+0000 7fe74fe00640 1 --2- 172.21.15.131:0/272163256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe758157fc0 0x7fe7580b4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.667+0000 7fe74fe00640 1 -- 172.21.15.131:0/272163256 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe758159250 con 0x7fe758164630 2024-04-25T19:23:47.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.667+0000 7fe74fe00640 1 --2- 172.21.15.131:0/272163256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe758164630 0x7fe758157a80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe74000b3f0 tx=0x7fe74000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:47.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.667+0000 7fe74e000640 1 -- 172.21.15.131:0/272163256 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe740015020 con 0x7fe758164630 2024-04-25T19:23:47.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.667+0000 7fe74e000640 1 -- 172.21.15.131:0/272163256 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe740011830 con 0x7fe758164630 2024-04-25T19:23:47.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.667+0000 7fe757200640 1 -- 172.21.15.131:0/272163256 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe758158640 con 0x7fe758164630 2024-04-25T19:23:47.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.667+0000 7fe74e000640 1 -- 172.21.15.131:0/272163256 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe740011c20 con 0x7fe758164630 2024-04-25T19:23:47.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.667+0000 7fe757200640 1 -- 172.21.15.131:0/272163256 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe758158c00 con 0x7fe758164630 2024-04-25T19:23:47.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.669+0000 7fe757200640 1 -- 172.21.15.131:0/272163256 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7580b4b30 con 0x7fe758164630 2024-04-25T19:23:47.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.670+0000 7fe74e000640 1 -- 172.21.15.131:0/272163256 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe740018020 con 0x7fe758164630 2024-04-25T19:23:47.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.671+0000 7fe74e000640 1 --2- 172.21.15.131:0/272163256 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe7340744e0 0x7fe7340769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:47.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.671+0000 7fe74e000640 1 -- 172.21.15.131:0/272163256 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe740094e20 con 0x7fe758164630 2024-04-25T19:23:47.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.671+0000 7fe755e00640 1 --2- 172.21.15.131:0/272163256 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe7340744e0 0x7fe7340769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:47.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.673+0000 7fe755e00640 1 --2- 172.21.15.131:0/272163256 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe7340744e0 0x7fe7340769f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe748006fd0 tx=0x7fe748008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:47.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.676+0000 7fe74e000640 1 -- 172.21.15.131:0/272163256 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe74001f030 con 0x7fe758164630 2024-04-25T19:23:47.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.913+0000 7fe757200640 1 -- 172.21.15.131:0/272163256 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe7581583d0 con 0x7fe758164630 2024-04-25T19:23:47.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.914+0000 7fe74e000640 1 -- 172.21.15.131:0/272163256 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7fe74005f640 con 0x7fe758164630 2024-04-25T19:23:47.916 INFO:teuthology.orchestra.run.smithi131.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T19:23:47.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.917+0000 7fe757200640 1 -- 172.21.15.131:0/272163256 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe7340744e0 msgr2=0x7fe7340769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:47.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.917+0000 7fe757200640 1 --2- 172.21.15.131:0/272163256 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe7340744e0 0x7fe7340769f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe748006fd0 tx=0x7fe748008040 comp rx=0 tx=0).stop 2024-04-25T19:23:47.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.917+0000 7fe757200640 1 -- 172.21.15.131:0/272163256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe758164630 msgr2=0x7fe758157a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:47.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.917+0000 7fe757200640 1 --2- 172.21.15.131:0/272163256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe758164630 0x7fe758157a80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe74000b3f0 tx=0x7fe74000b8b0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.917+0000 7fe757200640 1 -- 172.21.15.131:0/272163256 shutdown_connections 2024-04-25T19:23:47.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.917+0000 7fe757200640 1 --2- 172.21.15.131:0/272163256 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe7340744e0 0x7fe7340769f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.917+0000 7fe757200640 1 --2- 172.21.15.131:0/272163256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe758157fc0 0x7fe7580b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.917+0000 7fe757200640 1 --2- 172.21.15.131:0/272163256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe758164630 0x7fe758157a80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.917+0000 7fe757200640 1 --2- 172.21.15.131:0/272163256 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7580afe40 0x7fe7581f5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:47.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.917+0000 7fe757200640 1 -- 172.21.15.131:0/272163256 >> 172.21.15.131:0/272163256 conn(0x7fe7580d1f10 msgr2=0x7fe7580cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:47.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.917+0000 7fe757200640 1 -- 172.21.15.131:0/272163256 shutdown_connections 2024-04-25T19:23:47.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:47.917+0000 7fe757200640 1 -- 172.21.15.131:0/272163256 wait complete. 2024-04-25T19:23:47.947 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T19:23:47.947 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T19:23:47.947 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2024-04-25T19:23:47.947 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T19:23:47.947 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T19:23:47.948 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T19:23:47.948 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T19:23:47.948 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T19:23:47.948 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T19:23:47.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:23:47.948 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2024-04-25T19:23:48.001 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T19:23:48.002 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T19:23:48.002 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T19:23:48.002 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:23:48.002 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2024-04-25T19:23:48.002 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:23:48.002 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T19:23:48.002 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:23:48.003 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2024-04-25T19:23:48.003 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T19:23:48.003 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:23:48.003 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2024-04-25T19:23:48.003 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T19:23:48.003 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:23:48.003 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T19:23:48.003 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:23:48.003 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T19:23:48.004 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42581sec preferred_lft 42581sec 2024-04-25T19:23:48.004 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2024-04-25T19:23:48.004 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:23:48.004 INFO:teuthology.orchestra.run.smithi131.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T19:23:48.004 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 06:e0:b4:1f:52:82 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:23:48.004 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T19:23:48.004 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:23:48.004 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::d448:c8ff:fe91:466b/64 scope link 2024-04-25T19:23:48.005 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:23:48.005 INFO:teuthology.orchestra.run.smithi131.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T19:23:48.005 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 06:e0:b4:1f:52:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T19:23:48.005 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::4e0:b4ff:fe1f:5282/64 scope link 2024-04-25T19:23:48.005 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:23:48.005 INFO:teuthology.orchestra.run.smithi131.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T19:23:48.005 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 8e:5f:bd:1f:12:67 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T19:23:48.005 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::8c5f:bdff:fe1f:1267/64 scope link 2024-04-25T19:23:48.006 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:23:48.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:23:48.006 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T19:23:48.082 INFO:teuthology.orchestra.run.smithi131.stdout:1 2024-04-25T19:23:48.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:23:48.086 DEBUG:teuthology.orchestra.run.smithi131:> route 2024-04-25T19:23:48.138 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2024-04-25T19:23:48.138 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T19:23:48.138 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T19:23:48.138 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T19:23:48.138 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T19:23:48.139 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T19:23:48.140 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-04-25T19:23:48.140 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T19:23:48.140 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T19:23:48.140 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T19:23:48.140 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-04-25T19:23:48.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T19:23:48.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:23:48.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:23:48.351 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-04-25T19:23:48.402 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T19:23:48.402 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T19:23:48.402 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T19:23:48.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:23:48.403 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.0 up 2024-04-25T19:23:48.484 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T19:23:48.485 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T19:23:48.539 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T19:23:48.539 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T19:23:48.539 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T19:23:48.588 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T19:23:48.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:23:48.589 DEBUG:teuthology.orchestra.run.smithi131:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T19:23:48.785 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T19:23:48.785 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T19:23:48.785 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2024-04-25T19:23:48.808 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T19:23:48.808 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T19:23:48.808 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2024-04-25T19:23:48.808 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.131:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T19:23:48.808 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T19:23:48.846 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T19:23:48.846 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T19:23:48.846 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2024-04-25T19:23:48.846 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.131:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T19:23:48.847 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T19:23:48.847 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.131:6789,172.21.15.195:6789,172.21.15.195:6790" 2024-04-25T19:23:48.847 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.131:6789,172.21.15.195:6789,172.21.15.195:6790:/ 2024-04-25T19:23:48.847 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=4ba607f8-c2c3-4d8d-85a8-7800763c470f" will pass to kernel 2024-04-25T19:23:48.848 INFO:teuthology.orchestra.run.smithi131.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T19:23:48.848 INFO:teuthology.orchestra.run.smithi131.stdout: You just mounted a file system that supports labels which does not 2024-04-25T19:23:48.848 INFO:teuthology.orchestra.run.smithi131.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T19:23:48.848 INFO:teuthology.orchestra.run.smithi131.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T19:23:48.848 INFO:teuthology.orchestra.run.smithi131.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T19:23:48.853 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T19:23:48.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:23:48.853 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T19:23:48.924 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T19:23:49.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T19:23:49.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:23:49.063 INFO:teuthology.orchestra.run.smithi131.stdout:client4825 2024-04-25T19:23:49.064 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:23:49.064 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:23:49.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:23:49.114 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent) 2024-04-25T19:23:49.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:23:49.231 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/child) 2024-04-25T19:23:49.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:23:49.291 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent/child/file) 2024-04-25T19:23:49.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:23:49.352 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/child/grandchild) 2024-04-25T19:23:49.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:23:49.408 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent/child/grandchild/file) 2024-04-25T19:23:49.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:23:49.469 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T19:23:49.539 INFO:teuthology.orchestra.run.smithi131.stdout:./ 2024-04-25T19:23:49.539 INFO:teuthology.orchestra.run.smithi131.stdout:./parent 2024-04-25T19:23:49.539 INFO:teuthology.orchestra.run.smithi131.stdout:./parent/child 2024-04-25T19:23:49.539 INFO:teuthology.orchestra.run.smithi131.stdout:./parent/child/grandchild 2024-04-25T19:23:49.539 INFO:teuthology.orchestra.run.smithi131.stdout:./parent/child/grandchild/file 2024-04-25T19:23:49.540 INFO:teuthology.orchestra.run.smithi131.stdout:./parent/child/file 2024-04-25T19:23:49.541 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:23:49.541 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:23:49.541 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:23:49.541 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:23:49.541 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T19:23:49.541 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:23:49.680 INFO:teuthology.orchestra.run.smithi131.stdout:1 2024-04-25T19:23:49.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:23:49.692 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:23:49.692 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:23:49.692 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:23:49.693 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:23:49.693 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-25T19:23:49.693 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:23:49.881 INFO:teuthology.orchestra.run.smithi131.stdout:1099511627776 2024-04-25T19:23:49.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:23:49.894 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:23:49.895 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:23:49.895 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:23:49.895 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:23:49.895 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./parent/child").st_ino) 2024-04-25T19:23:49.895 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:23:50.079 INFO:teuthology.orchestra.run.smithi131.stdout:1099511627777 2024-04-25T19:23:50.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:23:50.090 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:23:50.090 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:23:50.091 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:23:50.091 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:23:50.091 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./parent/child/grandchild").st_ino) 2024-04-25T19:23:50.091 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:23:50.276 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628279 2024-04-25T19:23:50.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:23:50.289 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:23:50.289 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:23:50.289 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:23:50.289 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:23:50.289 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./parent/child/grandchild/file").st_ino) 2024-04-25T19:23:50.289 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:23:50.473 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628280 2024-04-25T19:23:50.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:23:50.490 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:23:50.490 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:23:50.490 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:23:50.490 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:23:50.490 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./parent/child/file").st_ino) 2024-04-25T19:23:50.490 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:23:50.668 INFO:teuthology.orchestra.run.smithi131.stdout:1099511627778 2024-04-25T19:23:50.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:23:50.681 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:23:51.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.005+0000 7f6202000640 1 Processor -- start 2024-04-25T19:23:51.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.005+0000 7f6202000640 1 -- start start 2024-04-25T19:23:51.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.007+0000 7f6202000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f61fc0b75f0 0x7f61fc0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:51.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.007+0000 7f6202000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61fc0cfb40 con 0x7f61fc1605c0 2024-04-25T19:23:51.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.007+0000 7f6202000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61fc0764e0 con 0x7f61fc168000 2024-04-25T19:23:51.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.007+0000 7f6202000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f61fc06c6f0 con 0x7f61fc0b75f0 2024-04-25T19:23:51.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.007+0000 7f6200c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f61fc0b75f0 0x7f61fc0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:51.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.007+0000 7f6200c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f61fc0b75f0 0x7f61fc0ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:50134/0 (socket says 172.21.15.131:50134) 2024-04-25T19:23:51.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.007+0000 7f6200c00640 1 -- 172.21.15.131:0/2888733817 learned_addr learned my addr 172.21.15.131:0/2888733817 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:51.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.008+0000 7f6200c00640 1 -- 172.21.15.131:0/2888733817 >> v1:172.21.15.195:6789/0 conn(0x7f61fc168000 legacy=0x7f61fc16a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:51.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.008+0000 7f6200c00640 1 -- 172.21.15.131:0/2888733817 >> v1:172.21.15.131:6789/0 conn(0x7f61fc1605c0 legacy=0x7f61fc0ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:51.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.008+0000 7f6200c00640 1 -- 172.21.15.131:0/2888733817 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61fc0b7b60 con 0x7f61fc0b75f0 2024-04-25T19:23:51.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.009+0000 7f6200c00640 1 --2- 172.21.15.131:0/2888733817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61fc0b75f0 0x7f61fc0ce7f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009870 tx=0x7f61f402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282c1ee23091d06 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:51.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.009+0000 7f61fb400640 1 -- 172.21.15.131:0/2888733817 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f4037070 con 0x7f61fc0b75f0 2024-04-25T19:23:51.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.009+0000 7f61fb400640 1 -- 172.21.15.131:0/2888733817 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f4032440 con 0x7f61fc0b75f0 2024-04-25T19:23:51.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.009+0000 7f61fb400640 1 -- 172.21.15.131:0/2888733817 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f4032810 con 0x7f61fc0b75f0 2024-04-25T19:23:51.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.010+0000 7f6202000640 1 -- 172.21.15.131:0/2888733817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61fc0b75f0 msgr2=0x7f61fc0ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:51.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.010+0000 7f6202000640 1 --2- 172.21.15.131:0/2888733817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61fc0b75f0 0x7f61fc0ce7f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009870 tx=0x7f61f402a2a0 comp rx=0 tx=0).stop 2024-04-25T19:23:51.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.010+0000 7f6202000640 1 -- 172.21.15.131:0/2888733817 shutdown_connections 2024-04-25T19:23:51.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.010+0000 7f6202000640 1 --2- 172.21.15.131:0/2888733817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61fc0b75f0 0x7f61fc0ce7f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:51.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.010+0000 7f6202000640 1 -- 172.21.15.131:0/2888733817 >> 172.21.15.131:0/2888733817 conn(0x7f61fc09b7d0 msgr2=0x7f61fc0b6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:51.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.010+0000 7f6202000640 1 -- 172.21.15.131:0/2888733817 shutdown_connections 2024-04-25T19:23:51.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.010+0000 7f6202000640 1 -- 172.21.15.131:0/2888733817 wait complete. 2024-04-25T19:23:51.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.013+0000 7f6202000640 1 Processor -- start 2024-04-25T19:23:51.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.013+0000 7f6202000640 1 -- start start 2024-04-25T19:23:51.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.014+0000 7f6202000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61fc0b75f0 0x7f61fc14e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:51.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.014+0000 7f6202000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61fc1605c0 0x7f61fc14b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:51.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.014+0000 7f6202000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61fc168000 0x7f61fc1fa170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:51.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.014+0000 7f6202000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc06cb80 con 0x7f61fc0b75f0 2024-04-25T19:23:51.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.014+0000 7f6202000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc076200 con 0x7f61fc1605c0 2024-04-25T19:23:51.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.014+0000 7f6202000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f61fc06cd00 con 0x7f61fc168000 2024-04-25T19:23:51.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.015+0000 7f6200c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61fc0b75f0 0x7f61fc14e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:51.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.015+0000 7f6200c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61fc0b75f0 0x7f61fc14e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:50144/0 (socket says 172.21.15.131:50144) 2024-04-25T19:23:51.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.015+0000 7f6200c00640 1 -- 172.21.15.131:0/2139626487 learned_addr learned my addr 172.21.15.131:0/2139626487 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:51.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.015+0000 7f6200c00640 1 -- 172.21.15.131:0/2139626487 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61fc168000 msgr2=0x7f61fc1fa170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:51.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.015+0000 7f6200c00640 1 --2- 172.21.15.131:0/2139626487 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61fc168000 0x7f61fc1fa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:51.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.015+0000 7f6200c00640 1 -- 172.21.15.131:0/2139626487 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61fc1605c0 msgr2=0x7f61fc14b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:51.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.015+0000 7f6200c00640 1 --2- 172.21.15.131:0/2139626487 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61fc1605c0 0x7f61fc14b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:51.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.015+0000 7f6200c00640 1 -- 172.21.15.131:0/2139626487 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61fc14d9f0 con 0x7f61fc0b75f0 2024-04-25T19:23:51.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.015+0000 7f6200c00640 1 --2- 172.21.15.131:0/2139626487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61fc0b75f0 0x7f61fc14e530 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009870 tx=0x7f61f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:51.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.016+0000 7f61f8c00640 1 -- 172.21.15.131:0/2139626487 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f4037040 con 0x7f61fc0b75f0 2024-04-25T19:23:51.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.016+0000 7f61f8c00640 1 -- 172.21.15.131:0/2139626487 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f4042070 con 0x7f61fc0b75f0 2024-04-25T19:23:51.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.016+0000 7f61f8c00640 1 -- 172.21.15.131:0/2139626487 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f4030bb0 con 0x7f61fc0b75f0 2024-04-25T19:23:51.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.016+0000 7f6202000640 1 -- 172.21.15.131:0/2139626487 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61fc14fbb0 con 0x7f61fc0b75f0 2024-04-25T19:23:51.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.016+0000 7f6202000640 1 -- 172.21.15.131:0/2139626487 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61fc150170 con 0x7f61fc0b75f0 2024-04-25T19:23:51.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.017+0000 7f6202000640 1 -- 172.21.15.131:0/2139626487 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61fc050740 con 0x7f61fc0b75f0 2024-04-25T19:23:51.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.018+0000 7f61f8c00640 1 -- 172.21.15.131:0/2139626487 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f61f4047460 con 0x7f61fc0b75f0 2024-04-25T19:23:51.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.019+0000 7f61f8c00640 1 --2- 172.21.15.131:0/2139626487 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f61dc0744b0 0x7f61dc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:51.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.019+0000 7f61f8c00640 1 -- 172.21.15.131:0/2139626487 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f61f40b5f20 con 0x7f61fc0b75f0 2024-04-25T19:23:51.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.020+0000 7f61fbe00640 1 --2- 172.21.15.131:0/2139626487 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f61dc0744b0 0x7f61dc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:51.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.021+0000 7f61fbe00640 1 --2- 172.21.15.131:0/2139626487 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f61dc0744b0 0x7f61dc0769c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f61e80012e0 tx=0x7f61e8007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:51.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.025+0000 7f61f8c00640 1 -- 172.21.15.131:0/2139626487 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f61f407ffc0 con 0x7f61fc0b75f0 2024-04-25T19:23:51.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.269+0000 7f6202000640 1 -- 172.21.15.131:0/2139626487 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61fc0b14c0 con 0x7f61fc0b75f0 2024-04-25T19:23:51.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.271+0000 7f61f8c00640 1 -- 172.21.15.131:0/2139626487 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5193 (secure 0 0 0) 0x7f61f40842c0 con 0x7f61fc0b75f0 2024-04-25T19:23:51.271 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:51.271 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3675320819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3675320819},{"type":"v1","addr":"172.21.15.131:6834","nonce":3675320819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/2332391948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":2332391948},{"type":"v1","addr":"172.21.15.195:6835","nonce":2332391948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4726,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2008890338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2008890338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2008890338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T19:23:34.379246+0000","modified":"2024-04-25T19:23:37.485292+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4729":{"gid":4729,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6837/2364484867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2364484867},{"type":"v1","addr":"172.21.15.195:6837","nonce":2364484867}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4729,"qdb_cluster":[4729]},"id":2}]} 2024-04-25T19:23:51.272 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 16 2024-04-25T19:23:51.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.273+0000 7f6202000640 1 -- 172.21.15.131:0/2139626487 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f61dc0744b0 msgr2=0x7f61dc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:51.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.273+0000 7f6202000640 1 --2- 172.21.15.131:0/2139626487 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f61dc0744b0 0x7f61dc0769c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f61e80012e0 tx=0x7f61e8007d50 comp rx=0 tx=0).stop 2024-04-25T19:23:51.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.273+0000 7f6202000640 1 -- 172.21.15.131:0/2139626487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61fc0b75f0 msgr2=0x7f61fc14e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:51.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.273+0000 7f6202000640 1 --2- 172.21.15.131:0/2139626487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61fc0b75f0 0x7f61fc14e530 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009870 tx=0x7f61f40046c0 comp rx=0 tx=0).stop 2024-04-25T19:23:51.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.274+0000 7f6202000640 1 -- 172.21.15.131:0/2139626487 shutdown_connections 2024-04-25T19:23:51.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.274+0000 7f6202000640 1 --2- 172.21.15.131:0/2139626487 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f61dc0744b0 0x7f61dc0769c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:51.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.274+0000 7f6202000640 1 --2- 172.21.15.131:0/2139626487 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61fc168000 0x7f61fc1fa170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:51.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.274+0000 7f6202000640 1 --2- 172.21.15.131:0/2139626487 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61fc1605c0 0x7f61fc14b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:51.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.274+0000 7f6202000640 1 --2- 172.21.15.131:0/2139626487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61fc0b75f0 0x7f61fc14e530 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:51.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.274+0000 7f6202000640 1 -- 172.21.15.131:0/2139626487 >> 172.21.15.131:0/2139626487 conn(0x7f61fc09b7d0 msgr2=0x7f61fc0af500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:51.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.274+0000 7f6202000640 1 -- 172.21.15.131:0/2139626487 shutdown_connections 2024-04-25T19:23:51.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:51.274+0000 7f6202000640 1 -- 172.21.15.131:0/2139626487 wait complete. 2024-04-25T19:23:51.302 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump tree /parent/child 1 2024-04-25T19:23:51.605 INFO:teuthology.orchestra.run.smithi195.stdout:[{"ino":1099511628279,"rdev":0,"ctime":"2024-04-25T19:23:49.464349+0000","btime":"2024-04-25T19:23:49.403350+0000","mode":16877,"uid":1000,"gid":1316,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-04-25T19:23:49.464349+0000","atime":"2024-04-25T19:23:49.403350+0000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-04-25T19:23:49.464349+0000","num_files":1,"num_subdirs":0,"change_attr":1},"rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":1,"rsnaps":0,"rctime":"2024-04-25T19:23:49.464349+0000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":1,"rsnaps":0,"rctime":"2024-04-25T19:23:49.464349+0000"},"version":6,"file_data_version":0,"xattr_version":1,"backtrace_version":4,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"authpin":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4825,"pending":"pAsLsXsFsx","issued":"pAsLsXsFsx","wanted":"pAsLsXsFsxcral","last_sent":5}],"loner":4825,"want_loner":4825,"mds_caps_wanted":[],"dirfrags":[{"path":"/parent/child/grandchild","dirfrag":"0x100000001f7","snapid_first":2,"projected_version":"3","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"dirty":1,"authpin":0},"nref":2,"dentries":[{"path":"parent/child/grandchild/file","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511628280,"remote_type":"","version":2,"projected_version":2,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}],"is_subvolume":false},{"ino":1099511627778,"rdev":0,"ctime":"2024-04-25T19:23:49.346351+0000","btime":"2024-04-25T19:23:49.346351+0000","mode":33188,"uid":1000,"gid":1316,"nlink":1,"dir_layout":{"dir_hash":0,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":4194304,"stripe_count":1,"object_size":4194304,"pool_id":5,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-04-25T19:23:49.346351+0000","atime":"2024-04-25T19:23:49.346351+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[{"client":4825,"byte range":{"first":0,"last":4194304},"follows":1}],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"caps":1,"dirtyparent":1,"dirty":1},"nref":3,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","type":"iauth","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","type":"ixattr","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4825,"pending":"pAsxLsXsxFsxcrwb","issued":"pAsxLsXsxFsxcrwb","wanted":"pAsxXsxFxwb","last_sent":3}],"loner":4825,"want_loner":4825,"mds_caps_wanted":[],"dirfrags":[],"is_subvolume":false},{"ino":1099511627777,"rdev":0,"ctime":"2024-04-25T19:23:49.403350+0000","btime":"2024-04-25T19:23:49.286352+0000","mode":16877,"uid":1000,"gid":1316,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-04-25T19:23:49.403350+0000","atime":"2024-04-25T19:23:49.286352+0000","time_warp_seq":0,"change_attr":2,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-04-25T19:23:49.403350+0000","num_files":1,"num_subdirs":1,"change_attr":2},"rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":2,"rsnaps":0,"rctime":"2024-04-25T19:23:49.403350+0000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":2,"rsnaps":0,"rctime":"2024-04-25T19:23:49.403350+0000"},"version":6,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dirtyscattered":1,"request":0,"lock":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"waiter":0,"authpin":0},"nref":5,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4825,"pending":"pAsLsXsFsx","issued":"pAsLsXsFsx","wanted":"pAsLsXsFsxcral","last_sent":6}],"loner":4825,"want_loner":4825,"mds_caps_wanted":[],"dirfrags":[{"path":"/parent/child","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"7","version":"7","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"dirty":1,"authpin":0},"nref":2,"dentries":[{"path":"parent/child/grandchild","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511628279,"remote_type":"","version":6,"projected_version":6,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]},{"path":"parent/child/file","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511627778,"remote_type":"","version":2,"projected_version":2,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}],"is_subvolume":false}] 2024-04-25T19:23:51.607 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "accounted_rstat": { "rbytes": 0, "rctime": "2024-04-25T19:23:49.464349+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-04-25T19:23:49.403350+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 4, "btime": "2024-04-25T19:23:49.403350+0000", "change_attr": 1, "client_caps": [ { "client_id": 4825, "issued": "pAsLsXsFsx", "last_sent": 5, "pending": "pAsLsXsFsx", "wanted": "pAsLsXsFsxcral" } ], "client_ranges": [], "ctime": "2024-04-25T19:23:49.464349+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dentries": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511628280, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "parent/child/grandchild/file", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 2, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x100000001f7", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/parent/child/grandchild", "pins": { "authpin": 0, "child": 1, "dirty": 1 }, "projected_version": "3", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "3" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 1, "mtime": "2024-04-25T19:23:49.464349+0000", "num_files": 1, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1316, "ino": 1099511628279, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 4825, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-04-25T19:23:49.464349+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "lock": 0, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "2024-04-25T19:23:49.464349+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 6, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 4825, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] }, { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "atime": "2024-04-25T19:23:49.346351+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "iauth", "xlock_by": {} }, "backtrace_version": 2, "btime": "2024-04-25T19:23:49.346351+0000", "change_attr": 0, "client_caps": [ { "client_id": 4825, "issued": "pAsxLsXsxFsxcrwb", "last_sent": 3, "pending": "pAsxLsXsxFsxcrwb", "wanted": "pAsxXsxFxwb" } ], "client_ranges": [ { "byte range": { "first": 0, "last": 4194304 }, "client": 4825, "follows": 1 } ], "ctime": "2024-04-25T19:23:49.346351+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1316, "ino": 1099511627778, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 4194304, "pool_id": 5, "pool_ns": "", "stripe_count": 1, "stripe_unit": 4194304 }, "linklock": {}, "loner": 4825, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 33188, "mtime": "2024-04-25T19:23:49.346351+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "caps": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 4825, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ixattr", "xlock_by": {} }, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] }, { "accounted_rstat": { "rbytes": 0, "rctime": "2024-04-25T19:23:49.403350+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 2, "version": 0 }, "atime": "2024-04-25T19:23:49.286352+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-04-25T19:23:49.286352+0000", "change_attr": 2, "client_caps": [ { "client_id": 4825, "issued": "pAsLsXsFsx", "last_sent": 6, "pending": "pAsLsXsFsx", "wanted": "pAsLsXsFsxcral" } ], "client_ranges": [], "ctime": "2024-04-25T19:23:49.403350+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dentries": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511628279, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "parent/child/grandchild", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 6, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 6, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } }, { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511627778, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "parent/child/file", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 2, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/parent/child", "pins": { "authpin": 0, "child": 1, "dirty": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 2, "mtime": "2024-04-25T19:23:49.403350+0000", "num_files": 1, "num_subdirs": 1, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1316, "ino": 1099511627777, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 4825, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-04-25T19:23:49.403350+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 5, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "dirtyscattered": 1, "lock": 0, "request": 0, "waiter": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "2024-04-25T19:23:49.403350+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 2, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 6, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 4825, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } ] 2024-04-25T19:23:51.607 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T19:23:51.607 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T19:23:51.715 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T19:23:51.817 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T19:23:51.817 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T19:23:51.817 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:23:51.817 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:23:51.874 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:23:51.874 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:23:51.929 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:23:52.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.208+0000 7f0d7b000640 1 Processor -- start 2024-04-25T19:23:52.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.208+0000 7f0d7b000640 1 -- start start 2024-04-25T19:23:52.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.210+0000 7f0d7b000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d740b4ea0 0x7f0d740cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:52.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.210+0000 7f0d7b000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0d74144370 0x7f0d7415e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:52.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.210+0000 7f0d7b000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d740d1230 con 0x7f0d7406c5c0 2024-04-25T19:23:52.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.211+0000 7f0d7b000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f0d740d06b0 con 0x7f0d74144370 2024-04-25T19:23:52.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.211+0000 7f0d7b000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0d740d0990 con 0x7f0d740b4ea0 2024-04-25T19:23:52.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.211+0000 7f0d79c00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f0d7406c5c0 0x7f0d740b4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:45880/0 (socket says 172.21.15.131:45880) 2024-04-25T19:23:52.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.211+0000 7f0d79c00640 1 -- 172.21.15.131:0/2363210231 learned_addr learned my addr 172.21.15.131:0/2363210231 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:52.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.211+0000 7f0d73e00640 1 -- 172.21.15.131:0/2363210231 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3095542364 0 0) 0x7f0d740d1230 con 0x7f0d7406c5c0 2024-04-25T19:23:52.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.211+0000 7f0d73e00640 1 -- 172.21.15.131:0/2363210231 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d5c003520 con 0x7f0d7406c5c0 2024-04-25T19:23:52.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.211+0000 7f0d79200640 1 --2- 172.21.15.131:0/2363210231 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d740b4ea0 0x7f0d740cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:52.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.212+0000 7f0d7a600640 1 --2- 172.21.15.131:0/2363210231 >> v2:172.21.15.195:3300/0 conn(0x7f0d74144370 0x7f0d7415e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:52.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.212+0000 7f0d73e00640 1 -- 172.21.15.131:0/2363210231 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1090565499 0 0) 0x7f0d5c003520 con 0x7f0d7406c5c0 2024-04-25T19:23:52.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.212+0000 7f0d73e00640 1 -- 172.21.15.131:0/2363210231 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d740b4ea0 msgr2=0x7f0d740cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:52.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.212+0000 7f0d73e00640 1 --2- 172.21.15.131:0/2363210231 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d740b4ea0 0x7f0d740cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:52.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.212+0000 7f0d73e00640 1 -- 172.21.15.131:0/2363210231 >> v2:172.21.15.195:3300/0 conn(0x7f0d74144370 msgr2=0x7f0d7415e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:52.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.212+0000 7f0d73e00640 1 --2- 172.21.15.131:0/2363210231 >> v2:172.21.15.195:3300/0 conn(0x7f0d74144370 0x7f0d7415e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:52.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.212+0000 7f0d73e00640 1 -- 172.21.15.131:0/2363210231 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d740d0c70 con 0x7f0d7406c5c0 2024-04-25T19:23:52.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.212+0000 7f0d73e00640 1 -- 172.21.15.131:0/2363210231 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f0d68001670 con 0x7f0d7406c5c0 2024-04-25T19:23:52.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.212+0000 7f0d73e00640 1 -- 172.21.15.131:0/2363210231 >> v1:172.21.15.131:6789/0 conn(0x7f0d7406c5c0 legacy=0x7f0d740b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:52.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.212+0000 7f0d73e00640 1 --2- 172.21.15.131:0/2363210231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d5c0039b0 0x7f0d5c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:52.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.212+0000 7f0d73e00640 1 --2- 172.21.15.131:0/2363210231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d5c004800 0x7f0d5c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:52.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.212+0000 7f0d73e00640 1 --2- 172.21.15.131:0/2363210231 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d5c005270 0x7f0d5c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:52.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.212+0000 7f0d73e00640 1 -- 172.21.15.131:0/2363210231 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0d740d06b0 con 0x7f0d5c0039b0 2024-04-25T19:23:52.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.212+0000 7f0d73e00640 1 -- 172.21.15.131:0/2363210231 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0d740d0990 con 0x7f0d5c004800 2024-04-25T19:23:52.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.212+0000 7f0d73e00640 1 -- 172.21.15.131:0/2363210231 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0d5c00c000 con 0x7f0d5c005270 2024-04-25T19:23:52.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.212+0000 7f0d79c00640 1 --2- 172.21.15.131:0/2363210231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d5c0039b0 0x7f0d5c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:52.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.212+0000 7f0d7a600640 1 --2- 172.21.15.131:0/2363210231 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d5c005270 0x7f0d5c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:52.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.212+0000 7f0d79200640 1 --2- 172.21.15.131:0/2363210231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d5c004800 0x7f0d5c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:52.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.212+0000 7f0d79c00640 1 -- 172.21.15.131:0/2363210231 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d5c005270 msgr2=0x7f0d5c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:52.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.213+0000 7f0d79c00640 1 --2- 172.21.15.131:0/2363210231 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d5c005270 0x7f0d5c00b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:52.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.213+0000 7f0d79c00640 1 -- 172.21.15.131:0/2363210231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d5c004800 msgr2=0x7f0d5c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:52.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.213+0000 7f0d79c00640 1 --2- 172.21.15.131:0/2363210231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d5c004800 0x7f0d5c004c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:52.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.213+0000 7f0d79c00640 1 -- 172.21.15.131:0/2363210231 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5c003520 con 0x7f0d5c0039b0 2024-04-25T19:23:52.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.214+0000 7f0d79c00640 1 --2- 172.21.15.131:0/2363210231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d5c0039b0 0x7f0d5c003e20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800c2c0 tx=0x7f0d5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b75cd0677f857ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:52.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.214+0000 7f0d73e00640 1 -- 172.21.15.131:0/2363210231 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d68007d50 con 0x7f0d5c0039b0 2024-04-25T19:23:52.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.214+0000 7f0d73e00640 1 -- 172.21.15.131:0/2363210231 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d6802e070 con 0x7f0d5c0039b0 2024-04-25T19:23:52.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.214+0000 7f0d73e00640 1 -- 172.21.15.131:0/2363210231 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d68005d30 con 0x7f0d5c0039b0 2024-04-25T19:23:52.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.215+0000 7f0d7b000640 1 -- 172.21.15.131:0/2363210231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d5c0039b0 msgr2=0x7f0d5c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:52.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.215+0000 7f0d7b000640 1 --2- 172.21.15.131:0/2363210231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d5c0039b0 0x7f0d5c003e20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800c2c0 tx=0x7f0d5c005830 comp rx=0 tx=0).stop 2024-04-25T19:23:52.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.215+0000 7f0d7a600640 1 -- 172.21.15.131:0/2363210231 reap_dead start 2024-04-25T19:23:52.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.215+0000 7f0d7b000640 1 -- 172.21.15.131:0/2363210231 shutdown_connections 2024-04-25T19:23:52.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.215+0000 7f0d7b000640 1 -- 172.21.15.131:0/2363210231 >> 172.21.15.131:0/2363210231 conn(0x7f0d740d1720 msgr2=0x7f0d740d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:52.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.215+0000 7f0d7b000640 1 -- 172.21.15.131:0/2363210231 shutdown_connections 2024-04-25T19:23:52.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.215+0000 7f0d7b000640 1 -- 172.21.15.131:0/2363210231 wait complete. 2024-04-25T19:23:52.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.218+0000 7f0d7b000640 1 Processor -- start 2024-04-25T19:23:52.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.218+0000 7f0d7b000640 1 -- start start 2024-04-25T19:23:52.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.220+0000 7f0d7b000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d5c0039b0 0x7f0d7415b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:52.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.220+0000 7f0d7b000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d740ccc90 0x7f0d740cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:52.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.220+0000 7f0d7b000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d7415e670 0x7f0d7415ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:52.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.220+0000 7f0d7b000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0d740d0450 con 0x7f0d7415e670 2024-04-25T19:23:52.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.220+0000 7f0d7b000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0d740d02d0 con 0x7f0d5c0039b0 2024-04-25T19:23:52.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.220+0000 7f0d7b000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0d74147760 con 0x7f0d740ccc90 2024-04-25T19:23:52.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.221+0000 7f0d7a600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d7415e670 0x7f0d7415ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:52.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.221+0000 7f0d7a600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d7415e670 0x7f0d7415ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:50154/0 (socket says 172.21.15.131:50154) 2024-04-25T19:23:52.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.221+0000 7f0d7a600640 1 -- 172.21.15.131:0/1594588084 learned_addr learned my addr 172.21.15.131:0/1594588084 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:52.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.221+0000 7f0d79200640 1 --2- 172.21.15.131:0/1594588084 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d740ccc90 0x7f0d740cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:52.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.221+0000 7f0d79c00640 1 --2- 172.21.15.131:0/1594588084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d5c0039b0 0x7f0d7415b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:52.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.221+0000 7f0d7a600640 1 -- 172.21.15.131:0/1594588084 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d740ccc90 msgr2=0x7f0d740cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.221+0000 7f0d7a600640 1 --2- 172.21.15.131:0/1594588084 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d740ccc90 0x7f0d740cd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.221+0000 7f0d7a600640 1 -- 172.21.15.131:0/1594588084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d5c0039b0 msgr2=0x7f0d7415b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.221+0000 7f0d7a600640 1 --2- 172.21.15.131:0/1594588084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d5c0039b0 0x7f0d7415b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.221+0000 7f0d7a600640 1 -- 172.21.15.131:0/1594588084 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d7415efc0 con 0x7f0d7415e670 2024-04-25T19:23:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.222+0000 7f0d7a600640 1 --2- 172.21.15.131:0/1594588084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d7415e670 0x7f0d7415ea80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0d740b6ca0 tx=0x7f0d6c00de30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.222+0000 7f0d71600640 1 -- 172.21.15.131:0/1594588084 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c01b070 con 0x7f0d7415e670 2024-04-25T19:23:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.222+0000 7f0d71600640 1 -- 172.21.15.131:0/1594588084 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d6c00bcc0 con 0x7f0d7415e670 2024-04-25T19:23:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.222+0000 7f0d71600640 1 -- 172.21.15.131:0/1594588084 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c016680 con 0x7f0d7415e670 2024-04-25T19:23:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.222+0000 7f0d7b000640 1 -- 172.21.15.131:0/1594588084 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d741f91e0 con 0x7f0d7415e670 2024-04-25T19:23:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.222+0000 7f0d7b000640 1 -- 172.21.15.131:0/1594588084 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d741f97a0 con 0x7f0d7415e670 2024-04-25T19:23:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.223+0000 7f0d7b000640 1 -- 172.21.15.131:0/1594588084 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d74050740 con 0x7f0d7415e670 2024-04-25T19:23:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.225+0000 7f0d71600640 1 -- 172.21.15.131:0/1594588084 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0d6c01e070 con 0x7f0d7415e670 2024-04-25T19:23:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.226+0000 7f0d71600640 1 --2- 172.21.15.131:0/1594588084 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0d540744b0 0x7f0d540769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:52.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.226+0000 7f0d71600640 1 -- 172.21.15.131:0/1594588084 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f0d6c095320 con 0x7f0d7415e670 2024-04-25T19:23:52.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.226+0000 7f0d79c00640 1 --2- 172.21.15.131:0/1594588084 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0d540744b0 0x7f0d540769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:52.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.228+0000 7f0d79c00640 1 --2- 172.21.15.131:0/1594588084 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0d540744b0 0x7f0d540769c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0d68033000 tx=0x7f0d68009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:52.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.230+0000 7f0d71600640 1 -- 172.21.15.131:0/1594588084 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0d7415efc0 con 0x7f0d7415e670 2024-04-25T19:23:52.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.430+0000 7f0d7b000640 1 -- 172.21.15.131:0/1594588084 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d740cdba0 con 0x7f0d7415e670 2024-04-25T19:23:52.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.433+0000 7f0d71600640 1 -- 172.21.15.131:0/1594588084 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16693 (secure 0 0 0) 0x7f0d6c05fb40 con 0x7f0d7415e670 2024-04-25T19:23:52.435 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:52.435 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":33,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:23:35.859003+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:23:32.719018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T19:23:33.342898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:23:52.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.436+0000 7f0d7b000640 1 -- 172.21.15.131:0/1594588084 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0d540744b0 msgr2=0x7f0d540769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:52.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.436+0000 7f0d7b000640 1 --2- 172.21.15.131:0/1594588084 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0d540744b0 0x7f0d540769c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0d68033000 tx=0x7f0d68009030 comp rx=0 tx=0).stop 2024-04-25T19:23:52.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.436+0000 7f0d7b000640 1 -- 172.21.15.131:0/1594588084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d7415e670 msgr2=0x7f0d7415ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:52.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.436+0000 7f0d7b000640 1 --2- 172.21.15.131:0/1594588084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d7415e670 0x7f0d7415ea80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0d740b6ca0 tx=0x7f0d6c00de30 comp rx=0 tx=0).stop 2024-04-25T19:23:52.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.436+0000 7f0d7b000640 1 -- 172.21.15.131:0/1594588084 shutdown_connections 2024-04-25T19:23:52.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.436+0000 7f0d7b000640 1 --2- 172.21.15.131:0/1594588084 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0d540744b0 0x7f0d540769c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:52.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.436+0000 7f0d7b000640 1 --2- 172.21.15.131:0/1594588084 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d740ccc90 0x7f0d740cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:52.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.436+0000 7f0d7b000640 1 --2- 172.21.15.131:0/1594588084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d7415e670 0x7f0d7415ea80 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:52.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.436+0000 7f0d7b000640 1 --2- 172.21.15.131:0/1594588084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d5c0039b0 0x7f0d7415b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:52.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.436+0000 7f0d7b000640 1 -- 172.21.15.131:0/1594588084 >> 172.21.15.131:0/1594588084 conn(0x7f0d740d1720 msgr2=0x7f0d740b4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:52.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.437+0000 7f0d7b000640 1 -- 172.21.15.131:0/1594588084 shutdown_connections 2024-04-25T19:23:52.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.437+0000 7f0d7b000640 1 -- 172.21.15.131:0/1594588084 wait complete. 2024-04-25T19:23:52.467 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T19:22:04.178847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T19:23:32.719018+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T19:23:33.342898+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T19:23:52.467 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T19:23:52.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.743+0000 7fab7b200640 1 Processor -- start 2024-04-25T19:23:52.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.743+0000 7fab7b200640 1 -- start start 2024-04-25T19:23:52.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.746+0000 7fab7b200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fab7c06dce0 0x7fab7c1606a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:52.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.746+0000 7fab7b200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab7c0b0090 con 0x7fab7c15de90 2024-04-25T19:23:52.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.746+0000 7fab7b200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab7c160c80 con 0x7fab7c163c90 2024-04-25T19:23:52.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.746+0000 7fab7b200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fab7c160f60 con 0x7fab7c06dce0 2024-04-25T19:23:52.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.746+0000 7fab79e00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fab7c15de90 0x7fab7c06f0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:45888/0 (socket says 172.21.15.131:45888) 2024-04-25T19:23:52.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.746+0000 7fab79e00640 1 -- 172.21.15.131:0/3054407340 learned_addr learned my addr 172.21.15.131:0/3054407340 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:52.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.746+0000 7fab7a800640 1 --2- 172.21.15.131:0/3054407340 >> v2:172.21.15.131:3300/0 conn(0x7fab7c06dce0 0x7fab7c1606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:52.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.747+0000 7fab7a800640 1 -- 172.21.15.131:0/3054407340 >> v1:172.21.15.195:6789/0 conn(0x7fab7c163c90 legacy=0x7fab7c06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:52.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.747+0000 7fab7a800640 1 -- 172.21.15.131:0/3054407340 >> v1:172.21.15.131:6789/0 conn(0x7fab7c15de90 legacy=0x7fab7c06f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:52.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.747+0000 7fab7a800640 1 -- 172.21.15.131:0/3054407340 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7c161240 con 0x7fab7c06dce0 2024-04-25T19:23:52.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.748+0000 7fab7a800640 1 --2- 172.21.15.131:0/3054407340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab7c06dce0 0x7fab7c1606a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fab74009d90 tx=0x7fab7402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce663853f888193 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:52.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.748+0000 7fab79400640 1 -- 172.21.15.131:0/3054407340 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74007740 con 0x7fab7c06dce0 2024-04-25T19:23:52.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.748+0000 7fab79400640 1 -- 172.21.15.131:0/3054407340 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab740078e0 con 0x7fab7c06dce0 2024-04-25T19:23:52.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.748+0000 7fab79400640 1 -- 172.21.15.131:0/3054407340 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74007cb0 con 0x7fab7c06dce0 2024-04-25T19:23:52.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.749+0000 7fab7b200640 1 -- 172.21.15.131:0/3054407340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab7c06dce0 msgr2=0x7fab7c1606a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:52.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.749+0000 7fab7b200640 1 --2- 172.21.15.131:0/3054407340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab7c06dce0 0x7fab7c1606a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fab74009d90 tx=0x7fab7402a660 comp rx=0 tx=0).stop 2024-04-25T19:23:52.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.749+0000 7fab7b200640 1 -- 172.21.15.131:0/3054407340 shutdown_connections 2024-04-25T19:23:52.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.749+0000 7fab7b200640 1 --2- 172.21.15.131:0/3054407340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab7c06dce0 0x7fab7c1606a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:52.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.749+0000 7fab7b200640 1 -- 172.21.15.131:0/3054407340 >> 172.21.15.131:0/3054407340 conn(0x7fab7c072f40 msgr2=0x7fab7c073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:52.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.749+0000 7fab7b200640 1 -- 172.21.15.131:0/3054407340 shutdown_connections 2024-04-25T19:23:52.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.749+0000 7fab7b200640 1 -- 172.21.15.131:0/3054407340 wait complete. 2024-04-25T19:23:52.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.752+0000 7fab7b200640 1 Processor -- start 2024-04-25T19:23:52.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.752+0000 7fab7b200640 1 -- start start 2024-04-25T19:23:52.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.753+0000 7fab7b200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab7c15de90 0x7fab7c14e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:52.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.753+0000 7fab7b200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab7c163c90 0x7fab7c0c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:52.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.753+0000 7fab7b200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab7c0c6d20 0x7fab7c0af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:52.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.753+0000 7fab7b200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c070eb0 con 0x7fab7c15de90 2024-04-25T19:23:52.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.753+0000 7fab7b200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c070d30 con 0x7fab7c0c6d20 2024-04-25T19:23:52.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.753+0000 7fab7b200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fab7c0b0570 con 0x7fab7c163c90 2024-04-25T19:23:52.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.754+0000 7fab79e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab7c15de90 0x7fab7c14e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:52.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.754+0000 7fab79e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab7c15de90 0x7fab7c14e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:50176/0 (socket says 172.21.15.131:50176) 2024-04-25T19:23:52.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.754+0000 7fab79e00640 1 -- 172.21.15.131:0/3697843294 learned_addr learned my addr 172.21.15.131:0/3697843294 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:52.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.754+0000 7fab71400640 1 --2- 172.21.15.131:0/3697843294 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab7c163c90 0x7fab7c0c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:52.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.754+0000 7fab79e00640 1 -- 172.21.15.131:0/3697843294 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab7c163c90 msgr2=0x7fab7c0c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:52.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.754+0000 7fab7a800640 1 --2- 172.21.15.131:0/3697843294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab7c0c6d20 0x7fab7c0af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:52.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.754+0000 7fab79e00640 1 --2- 172.21.15.131:0/3697843294 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab7c163c90 0x7fab7c0c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:52.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.754+0000 7fab79e00640 1 -- 172.21.15.131:0/3697843294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab7c0c6d20 msgr2=0x7fab7c0af310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:52.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.754+0000 7fab79e00640 1 --2- 172.21.15.131:0/3697843294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab7c0c6d20 0x7fab7c0af310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:52.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.754+0000 7fab79e00640 1 -- 172.21.15.131:0/3697843294 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7c14b920 con 0x7fab7c15de90 2024-04-25T19:23:52.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.754+0000 7fab71400640 1 --2- 172.21.15.131:0/3697843294 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab7c163c90 0x7fab7c0c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:52.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.754+0000 7fab79e00640 1 --2- 172.21.15.131:0/3697843294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab7c15de90 0x7fab7c14e250 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00c470 tx=0x7fab6c00c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:52.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.755+0000 7fab72a00640 1 -- 172.21.15.131:0/3697843294 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6c017070 con 0x7fab7c15de90 2024-04-25T19:23:52.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.755+0000 7fab72a00640 1 -- 172.21.15.131:0/3697843294 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6c005d00 con 0x7fab7c15de90 2024-04-25T19:23:52.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.755+0000 7fab72a00640 1 -- 172.21.15.131:0/3697843294 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6c007310 con 0x7fab7c15de90 2024-04-25T19:23:52.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.755+0000 7fab7b200640 1 -- 172.21.15.131:0/3697843294 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab7c14e790 con 0x7fab7c15de90 2024-04-25T19:23:52.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.755+0000 7fab7b200640 1 -- 172.21.15.131:0/3697843294 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab7c14ae40 con 0x7fab7c15de90 2024-04-25T19:23:52.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.756+0000 7fab7b200640 1 -- 172.21.15.131:0/3697843294 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab7c076c60 con 0x7fab7c15de90 2024-04-25T19:23:52.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.757+0000 7fab72a00640 1 -- 172.21.15.131:0/3697843294 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fab6c01a070 con 0x7fab7c15de90 2024-04-25T19:23:52.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.758+0000 7fab72a00640 1 --2- 172.21.15.131:0/3697843294 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fab580744e0 0x7fab580769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:52.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.758+0000 7fab72a00640 1 -- 172.21.15.131:0/3697843294 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fab6c094580 con 0x7fab7c15de90 2024-04-25T19:23:52.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.759+0000 7fab71400640 1 --2- 172.21.15.131:0/3697843294 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fab580744e0 0x7fab580769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:52.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.760+0000 7fab71400640 1 --2- 172.21.15.131:0/3697843294 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fab580744e0 0x7fab580769f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fab7c1589b0 tx=0x7fab64009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:52.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.763+0000 7fab72a00640 1 -- 172.21.15.131:0/3697843294 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fab6c05ed10 con 0x7fab7c15de90 2024-04-25T19:23:52.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.965+0000 7fab7b200640 1 -- 172.21.15.131:0/3697843294 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fab7c06f930 con 0x7fab7c15de90 2024-04-25T19:23:52.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.966+0000 7fab72a00640 1 -- 172.21.15.131:0/3697843294 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) ==== 93+0+10 (secure 0 0 0) 0x7fab6c05e610 con 0x7fab7c15de90 2024-04-25T19:23:52.967 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-25T19:23:52.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.969+0000 7fab7b200640 1 -- 172.21.15.131:0/3697843294 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fab580744e0 msgr2=0x7fab580769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:52.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.969+0000 7fab7b200640 1 --2- 172.21.15.131:0/3697843294 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fab580744e0 0x7fab580769f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fab7c1589b0 tx=0x7fab64009040 comp rx=0 tx=0).stop 2024-04-25T19:23:52.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.969+0000 7fab7b200640 1 -- 172.21.15.131:0/3697843294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab7c15de90 msgr2=0x7fab7c14e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:52.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.969+0000 7fab7b200640 1 --2- 172.21.15.131:0/3697843294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab7c15de90 0x7fab7c14e250 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00c470 tx=0x7fab6c00c930 comp rx=0 tx=0).stop 2024-04-25T19:23:52.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.969+0000 7fab7b200640 1 -- 172.21.15.131:0/3697843294 shutdown_connections 2024-04-25T19:23:52.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.969+0000 7fab7b200640 1 --2- 172.21.15.131:0/3697843294 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fab580744e0 0x7fab580769f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:52.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.969+0000 7fab7b200640 1 --2- 172.21.15.131:0/3697843294 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab7c163c90 0x7fab7c0c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:52.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.969+0000 7fab7b200640 1 --2- 172.21.15.131:0/3697843294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab7c0c6d20 0x7fab7c0af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:52.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.969+0000 7fab7b200640 1 --2- 172.21.15.131:0/3697843294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab7c15de90 0x7fab7c14e250 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:52.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.969+0000 7fab7b200640 1 -- 172.21.15.131:0/3697843294 >> 172.21.15.131:0/3697843294 conn(0x7fab7c072f40 msgr2=0x7fab7c06cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:52.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.969+0000 7fab7b200640 1 -- 172.21.15.131:0/3697843294 shutdown_connections 2024-04-25T19:23:52.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:52.969+0000 7fab7b200640 1 -- 172.21.15.131:0/3697843294 wait complete. 2024-04-25T19:23:52.999 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T19:23:53.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.272+0000 7fb981800640 1 Processor -- start 2024-04-25T19:23:53.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.273+0000 7fb981800640 1 -- start start 2024-04-25T19:23:53.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.275+0000 7fb981800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb97c144340 0x7fb97c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:53.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.275+0000 7fb981800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb97c06df20 con 0x7fb97c06db10 2024-04-25T19:23:53.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.275+0000 7fb981800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb97c070000 con 0x7fb97c15ee60 2024-04-25T19:23:53.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.275+0000 7fb981800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb97c15f270 con 0x7fb97c144340 2024-04-25T19:23:53.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.275+0000 7fb97b400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fb97c06db10 0x7fb97c15e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:45894/0 (socket says 172.21.15.131:45894) 2024-04-25T19:23:53.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.275+0000 7fb97b400640 1 -- 172.21.15.131:0/2124574002 learned_addr learned my addr 172.21.15.131:0/2124574002 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:53.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.276+0000 7fb97be00640 1 --2- 172.21.15.131:0/2124574002 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb97c144340 0x7fb97c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:53.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.276+0000 7fb97aa00640 1 -- 172.21.15.131:0/2124574002 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 303161114 0 0) 0x7fb964001110 con 0x7fb97c06db10 2024-04-25T19:23:53.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.276+0000 7fb97aa00640 1 -- 172.21.15.131:0/2124574002 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb960003520 con 0x7fb97c06db10 2024-04-25T19:23:53.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.276+0000 7fb97aa00640 1 -- 172.21.15.131:0/2124574002 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3411025723 0 0) 0x7fb960003520 con 0x7fb97c06db10 2024-04-25T19:23:53.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.276+0000 7fb97aa00640 1 -- 172.21.15.131:0/2124574002 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb97c144340 msgr2=0x7fb97c06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:53.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.276+0000 7fb97aa00640 1 --2- 172.21.15.131:0/2124574002 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb97c144340 0x7fb97c06d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:53.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.276+0000 7fb97aa00640 1 -- 172.21.15.131:0/2124574002 >> v1:172.21.15.195:6789/0 conn(0x7fb97c15ee60 legacy=0x7fb97c15f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:53.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.276+0000 7fb97aa00640 1 -- 172.21.15.131:0/2124574002 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb97c06f240 con 0x7fb97c06db10 2024-04-25T19:23:53.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.276+0000 7fb97aa00640 1 -- 172.21.15.131:0/2124574002 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7fb964001840 con 0x7fb97c06db10 2024-04-25T19:23:53.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.276+0000 7fb97aa00640 1 -- 172.21.15.131:0/2124574002 >> v1:172.21.15.131:6789/0 conn(0x7fb97c06db10 legacy=0x7fb97c15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:53.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.277+0000 7fb97aa00640 1 --2- 172.21.15.131:0/2124574002 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb97c144340 0x7fb9600039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:53.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.277+0000 7fb97aa00640 1 --2- 172.21.15.131:0/2124574002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb960003f60 0x7fb960004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:53.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.277+0000 7fb97aa00640 1 --2- 172.21.15.131:0/2124574002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb960004d40 0x7fb960005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:53.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.277+0000 7fb97aa00640 1 -- 172.21.15.131:0/2124574002 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb96000bb50 con 0x7fb960004d40 2024-04-25T19:23:53.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.277+0000 7fb97aa00640 1 -- 172.21.15.131:0/2124574002 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb96000bcd0 con 0x7fb960003f60 2024-04-25T19:23:53.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.277+0000 7fb97aa00640 1 -- 172.21.15.131:0/2124574002 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb96000bed0 con 0x7fb97c144340 2024-04-25T19:23:53.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.277+0000 7fb980e00640 1 --2- 172.21.15.131:0/2124574002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb960004d40 0x7fb960005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:53.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.277+0000 7fb97be00640 1 --2- 172.21.15.131:0/2124574002 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb97c144340 0x7fb9600039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:53.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.277+0000 7fb97b400640 1 --2- 172.21.15.131:0/2124574002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb960003f60 0x7fb960004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:53.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.277+0000 7fb980e00640 1 -- 172.21.15.131:0/2124574002 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb97c144340 msgr2=0x7fb9600039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:53.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.277+0000 7fb980e00640 1 --2- 172.21.15.131:0/2124574002 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb97c144340 0x7fb9600039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:53.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.277+0000 7fb980e00640 1 -- 172.21.15.131:0/2124574002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb960003f60 msgr2=0x7fb960004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:53.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.277+0000 7fb980e00640 1 --2- 172.21.15.131:0/2124574002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb960003f60 0x7fb960004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:53.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.277+0000 7fb980e00640 1 -- 172.21.15.131:0/2124574002 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb960003520 con 0x7fb960004d40 2024-04-25T19:23:53.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.278+0000 7fb980e00640 1 --2- 172.21.15.131:0/2124574002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb960004d40 0x7fb960005150 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb974001e50 tx=0x7fb960005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80f9994501c7e7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:53.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.279+0000 7fb97aa00640 1 -- 172.21.15.131:0/2124574002 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb974001a70 con 0x7fb960004d40 2024-04-25T19:23:53.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.279+0000 7fb97aa00640 1 -- 172.21.15.131:0/2124574002 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb974003970 con 0x7fb960004d40 2024-04-25T19:23:53.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.279+0000 7fb97aa00640 1 -- 172.21.15.131:0/2124574002 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb974003d60 con 0x7fb960004d40 2024-04-25T19:23:53.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.279+0000 7fb981800640 1 -- 172.21.15.131:0/2124574002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb960004d40 msgr2=0x7fb960005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:53.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.279+0000 7fb981800640 1 --2- 172.21.15.131:0/2124574002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb960004d40 0x7fb960005150 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb974001e50 tx=0x7fb960005830 comp rx=0 tx=0).stop 2024-04-25T19:23:53.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.279+0000 7fb980e00640 1 -- 172.21.15.131:0/2124574002 reap_dead start 2024-04-25T19:23:53.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.280+0000 7fb981800640 1 -- 172.21.15.131:0/2124574002 shutdown_connections 2024-04-25T19:23:53.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.280+0000 7fb981800640 1 -- 172.21.15.131:0/2124574002 >> 172.21.15.131:0/2124574002 conn(0x7fb97c072f40 msgr2=0x7fb97c073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:53.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.280+0000 7fb981800640 1 -- 172.21.15.131:0/2124574002 shutdown_connections 2024-04-25T19:23:53.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.280+0000 7fb981800640 1 -- 172.21.15.131:0/2124574002 wait complete. 2024-04-25T19:23:53.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.282+0000 7fb981800640 1 Processor -- start 2024-04-25T19:23:53.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.282+0000 7fb981800640 1 -- start start 2024-04-25T19:23:53.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.284+0000 7fb981800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb97c13f1f0 0x7fb97c0b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:53.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.284+0000 7fb981800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb97c13f600 0x7fb97c0b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:53.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.284+0000 7fb981800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb97c1e96b0 0x7fb97c1e9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:53.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.284+0000 7fb981800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb97c06f800 con 0x7fb97c13f600 2024-04-25T19:23:53.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.284+0000 7fb981800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb97c144750 con 0x7fb97c13f1f0 2024-04-25T19:23:53.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.284+0000 7fb981800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb97c06fae0 con 0x7fb97c1e96b0 2024-04-25T19:23:53.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.284+0000 7fb97b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb97c13f600 0x7fb97c0b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:53.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.284+0000 7fb97b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb97c13f600 0x7fb97c0b26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:50190/0 (socket says 172.21.15.131:50190) 2024-04-25T19:23:53.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.284+0000 7fb97b400640 1 -- 172.21.15.131:0/4047448885 learned_addr learned my addr 172.21.15.131:0/4047448885 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:53.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.284+0000 7fb97b400640 1 -- 172.21.15.131:0/4047448885 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb97c1e96b0 msgr2=0x7fb97c1e9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:53.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.284+0000 7fb97b400640 1 --2- 172.21.15.131:0/4047448885 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb97c1e96b0 0x7fb97c1e9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:53.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.284+0000 7fb97b400640 1 -- 172.21.15.131:0/4047448885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb97c13f1f0 msgr2=0x7fb97c0b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:53.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.284+0000 7fb97be00640 1 --2- 172.21.15.131:0/4047448885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb97c13f1f0 0x7fb97c0b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:53.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.284+0000 7fb97b400640 1 --2- 172.21.15.131:0/4047448885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb97c13f1f0 0x7fb97c0b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:53.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.285+0000 7fb97b400640 1 -- 172.21.15.131:0/4047448885 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb97c1ea420 con 0x7fb97c13f600 2024-04-25T19:23:53.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.285+0000 7fb97b400640 1 --2- 172.21.15.131:0/4047448885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb97c13f600 0x7fb97c0b26f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb9640072b0 tx=0x7fb964005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:53.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.285+0000 7fb973e00640 1 -- 172.21.15.131:0/4047448885 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96400e740 con 0x7fb97c13f600 2024-04-25T19:23:53.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.285+0000 7fb973e00640 1 -- 172.21.15.131:0/4047448885 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb964018070 con 0x7fb97c13f600 2024-04-25T19:23:53.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.285+0000 7fb973e00640 1 -- 172.21.15.131:0/4047448885 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96400eb00 con 0x7fb97c13f600 2024-04-25T19:23:53.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.285+0000 7fb981800640 1 -- 172.21.15.131:0/4047448885 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb97c1ea700 con 0x7fb97c13f600 2024-04-25T19:23:53.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.285+0000 7fb981800640 1 -- 172.21.15.131:0/4047448885 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb97c1eacc0 con 0x7fb97c13f600 2024-04-25T19:23:53.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.287+0000 7fb981800640 1 -- 172.21.15.131:0/4047448885 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb97c076c60 con 0x7fb97c13f600 2024-04-25T19:23:53.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.288+0000 7fb973e00640 1 -- 172.21.15.131:0/4047448885 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb96400eca0 con 0x7fb97c13f600 2024-04-25T19:23:53.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.289+0000 7fb973e00640 1 --2- 172.21.15.131:0/4047448885 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb9580744b0 0x7fb9580769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:53.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.289+0000 7fb973e00640 1 -- 172.21.15.131:0/4047448885 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fb9640951f0 con 0x7fb97c13f600 2024-04-25T19:23:53.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.289+0000 7fb97be00640 1 --2- 172.21.15.131:0/4047448885 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb9580744b0 0x7fb9580769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:53.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.291+0000 7fb97be00640 1 --2- 172.21.15.131:0/4047448885 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb9580744b0 0x7fb9580769c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb97c14ee00 tx=0x7fb96c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:53.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.294+0000 7fb973e00640 1 -- 172.21.15.131:0/4047448885 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb97c06df20 con 0x7fb97c13f600 2024-04-25T19:23:53.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.493+0000 7fb981800640 1 -- 172.21.15.131:0/4047448885 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb97c0b7920 con 0x7fb97c13f600 2024-04-25T19:23:53.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.494+0000 7fb973e00640 1 -- 172.21.15.131:0/4047448885 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) ==== 104+0+11 (secure 0 0 0) 0x7fb96405fa10 con 0x7fb97c13f600 2024-04-25T19:23:53.495 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-25T19:23:53.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.497+0000 7fb981800640 1 -- 172.21.15.131:0/4047448885 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb9580744b0 msgr2=0x7fb9580769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:53.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.497+0000 7fb981800640 1 --2- 172.21.15.131:0/4047448885 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb9580744b0 0x7fb9580769c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb97c14ee00 tx=0x7fb96c008040 comp rx=0 tx=0).stop 2024-04-25T19:23:53.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.497+0000 7fb981800640 1 -- 172.21.15.131:0/4047448885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb97c13f600 msgr2=0x7fb97c0b26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:53.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.497+0000 7fb981800640 1 --2- 172.21.15.131:0/4047448885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb97c13f600 0x7fb97c0b26f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb9640072b0 tx=0x7fb964005f90 comp rx=0 tx=0).stop 2024-04-25T19:23:53.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.497+0000 7fb981800640 1 -- 172.21.15.131:0/4047448885 shutdown_connections 2024-04-25T19:23:53.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.497+0000 7fb981800640 1 --2- 172.21.15.131:0/4047448885 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb9580744b0 0x7fb9580769c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:53.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.497+0000 7fb981800640 1 --2- 172.21.15.131:0/4047448885 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb97c1e96b0 0x7fb97c1e9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:53.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.497+0000 7fb981800640 1 --2- 172.21.15.131:0/4047448885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb97c13f600 0x7fb97c0b26f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:53.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.497+0000 7fb981800640 1 --2- 172.21.15.131:0/4047448885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb97c13f1f0 0x7fb97c0b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:53.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.497+0000 7fb981800640 1 -- 172.21.15.131:0/4047448885 >> 172.21.15.131:0/4047448885 conn(0x7fb97c072f40 msgr2=0x7fb97c0b14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:53.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.497+0000 7fb981800640 1 -- 172.21.15.131:0/4047448885 shutdown_connections 2024-04-25T19:23:53.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.497+0000 7fb981800640 1 -- 172.21.15.131:0/4047448885 wait complete. 2024-04-25T19:23:53.524 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T19:23:53.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.803+0000 7f1e24c00640 1 Processor -- start 2024-04-25T19:23:53.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.804+0000 7f1e24c00640 1 -- start start 2024-04-25T19:23:53.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.806+0000 7f1e24c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1e20070d20 0x7f1e20161b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:53.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.806+0000 7f1e24c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e2006f930 0x7f1e2006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:53.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.806+0000 7f1e24c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1e2006fd40 0x7f1e2006db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:53.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.806+0000 7f1e24c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f1e201623f0 con 0x7f1e2006fd40 2024-04-25T19:23:53.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.806+0000 7f1e24c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f1e201626d0 con 0x7f1e20070d20 2024-04-25T19:23:53.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.806+0000 7f1e24c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1e2006f130 con 0x7f1e2006f930 2024-04-25T19:23:53.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.806+0000 7f1e1fe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1e2006fd40 0x7f1e2006db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:53.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.807+0000 7f1e1fe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1e2006fd40 0x7f1e2006db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:50192/0 (socket says 172.21.15.131:50192) 2024-04-25T19:23:53.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.807+0000 7f1e1fe00640 1 -- 172.21.15.131:0/3966387276 learned_addr learned my addr 172.21.15.131:0/3966387276 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:53.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.807+0000 7f1e16a00640 1 --2- 172.21.15.131:0/3966387276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e2006f930 0x7f1e2006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:53.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.807+0000 7f1e1f400640 1 --2- 172.21.15.131:0/3966387276 >> v2:172.21.15.195:3300/0 conn(0x7f1e20070d20 0x7f1e20161b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:53.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.807+0000 7f1e1fe00640 1 -- 172.21.15.131:0/3966387276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e2006f930 msgr2=0x7f1e2006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:53.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.807+0000 7f1e1fe00640 1 --2- 172.21.15.131:0/3966387276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e2006f930 0x7f1e2006d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:53.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.807+0000 7f1e1fe00640 1 -- 172.21.15.131:0/3966387276 >> v2:172.21.15.195:3300/0 conn(0x7f1e20070d20 msgr2=0x7f1e20161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:53.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.807+0000 7f1e1fe00640 1 --2- 172.21.15.131:0/3966387276 >> v2:172.21.15.195:3300/0 conn(0x7f1e20070d20 0x7f1e20161b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:53.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.807+0000 7f1e1fe00640 1 -- 172.21.15.131:0/3966387276 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e2006f410 con 0x7f1e2006fd40 2024-04-25T19:23:53.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.808+0000 7f1e1fe00640 1 --2- 172.21.15.131:0/3966387276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e2006fd40 0x7f1e2006db10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1e2006e520 tx=0x7f1e1802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ed28ff748a4613 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:53.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.808+0000 7f1e1ea00640 1 -- 172.21.15.131:0/3966387276 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18037070 con 0x7f1e2006fd40 2024-04-25T19:23:53.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.809+0000 7f1e1ea00640 1 -- 172.21.15.131:0/3966387276 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e18032440 con 0x7f1e2006fd40 2024-04-25T19:23:53.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.809+0000 7f1e1ea00640 1 -- 172.21.15.131:0/3966387276 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18032810 con 0x7f1e2006fd40 2024-04-25T19:23:53.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.809+0000 7f1e24c00640 1 -- 172.21.15.131:0/3966387276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e2006fd40 msgr2=0x7f1e2006db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:53.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.809+0000 7f1e24c00640 1 --2- 172.21.15.131:0/3966387276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e2006fd40 0x7f1e2006db10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1e2006e520 tx=0x7f1e1802a140 comp rx=0 tx=0).stop 2024-04-25T19:23:53.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.810+0000 7f1e24c00640 1 -- 172.21.15.131:0/3966387276 shutdown_connections 2024-04-25T19:23:53.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.810+0000 7f1e24c00640 1 --2- 172.21.15.131:0/3966387276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e2006fd40 0x7f1e2006db10 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:53.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.810+0000 7f1e24c00640 1 --2- 172.21.15.131:0/3966387276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e2006f930 0x7f1e2006d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:53.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.810+0000 7f1e24c00640 1 --2- 172.21.15.131:0/3966387276 >> v2:172.21.15.195:3300/0 conn(0x7f1e20070d20 0x7f1e20161b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:53.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.810+0000 7f1e24c00640 1 -- 172.21.15.131:0/3966387276 >> 172.21.15.131:0/3966387276 conn(0x7f1e20073160 msgr2=0x7f1e20073570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:53.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.810+0000 7f1e24c00640 1 -- 172.21.15.131:0/3966387276 shutdown_connections 2024-04-25T19:23:53.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.810+0000 7f1e24c00640 1 -- 172.21.15.131:0/3966387276 wait complete. 2024-04-25T19:23:53.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.812+0000 7f1e24c00640 1 Processor -- start 2024-04-25T19:23:53.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.812+0000 7f1e24c00640 1 -- start start 2024-04-25T19:23:53.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.814+0000 7f1e24c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e2006f930 0x7f1e20145320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:53.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.814+0000 7f1e24c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e2006fd40 0x7f1e20155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:53.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.814+0000 7f1e24c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e20070d20 0x7f1e20155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:53.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.814+0000 7f1e24c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2015e2f0 con 0x7f1e20070d20 2024-04-25T19:23:53.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.814+0000 7f1e24c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1e20162070 con 0x7f1e2006f930 2024-04-25T19:23:53.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.814+0000 7f1e24c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1e2015e470 con 0x7f1e2006fd40 2024-04-25T19:23:53.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.814+0000 7f1e1fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e20070d20 0x7f1e20155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:53.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.814+0000 7f1e1fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e20070d20 0x7f1e20155f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:50194/0 (socket says 172.21.15.131:50194) 2024-04-25T19:23:53.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.814+0000 7f1e1fe00640 1 -- 172.21.15.131:0/784785481 learned_addr learned my addr 172.21.15.131:0/784785481 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:53.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.814+0000 7f1e1f400640 1 --2- 172.21.15.131:0/784785481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e2006f930 0x7f1e20145320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:53.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.814+0000 7f1e16a00640 1 --2- 172.21.15.131:0/784785481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e2006fd40 0x7f1e20155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:53.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.815+0000 7f1e1fe00640 1 -- 172.21.15.131:0/784785481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e2006fd40 msgr2=0x7f1e20155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:53.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.815+0000 7f1e1fe00640 1 --2- 172.21.15.131:0/784785481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e2006fd40 0x7f1e20155a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:53.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.815+0000 7f1e1fe00640 1 -- 172.21.15.131:0/784785481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e2006f930 msgr2=0x7f1e20145320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:53.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.815+0000 7f1e1fe00640 1 --2- 172.21.15.131:0/784785481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e2006f930 0x7f1e20145320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:53.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.815+0000 7f1e1fe00640 1 -- 172.21.15.131:0/784785481 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e201567c0 con 0x7f1e20070d20 2024-04-25T19:23:53.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.815+0000 7f1e1fe00640 1 --2- 172.21.15.131:0/784785481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e20070d20 0x7f1e20155f40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1e1802a180 tx=0x7f1e180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:53.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.815+0000 7f1e17e00640 1 -- 172.21.15.131:0/784785481 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18037040 con 0x7f1e20070d20 2024-04-25T19:23:53.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.815+0000 7f1e17e00640 1 -- 172.21.15.131:0/784785481 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e18042070 con 0x7f1e20070d20 2024-04-25T19:23:53.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.815+0000 7f1e17e00640 1 -- 172.21.15.131:0/784785481 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18030920 con 0x7f1e20070d20 2024-04-25T19:23:53.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.815+0000 7f1e24c00640 1 -- 172.21.15.131:0/784785481 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e20156aa0 con 0x7f1e20070d20 2024-04-25T19:23:53.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.815+0000 7f1e24c00640 1 -- 172.21.15.131:0/784785481 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e20157060 con 0x7f1e20070d20 2024-04-25T19:23:53.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.817+0000 7f1e24c00640 1 -- 172.21.15.131:0/784785481 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e20156530 con 0x7f1e20070d20 2024-04-25T19:23:53.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.818+0000 7f1e17e00640 1 -- 172.21.15.131:0/784785481 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1e18030ac0 con 0x7f1e20070d20 2024-04-25T19:23:53.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.819+0000 7f1e17e00640 1 --2- 172.21.15.131:0/784785481 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1dfc0744b0 0x7f1dfc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:53.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.819+0000 7f1e17e00640 1 -- 172.21.15.131:0/784785481 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f1e180b5c00 con 0x7f1e20070d20 2024-04-25T19:23:53.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.820+0000 7f1e1f400640 1 --2- 172.21.15.131:0/784785481 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1dfc0744b0 0x7f1dfc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:53.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.821+0000 7f1e1f400640 1 --2- 172.21.15.131:0/784785481 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1dfc0744b0 0x7f1dfc0769c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1e200b1350 tx=0x7f1e10003990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:53.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:53.824+0000 7f1e17e00640 1 -- 172.21.15.131:0/784785481 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1e180bc080 con 0x7f1e20070d20 2024-04-25T19:23:54.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.030+0000 7f1e24c00640 1 -- 172.21.15.131:0/784785481 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1e2015ec60 con 0x7f1e20070d20 2024-04-25T19:23:54.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.031+0000 7f1e17e00640 1 -- 172.21.15.131:0/784785481 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) ==== 100+0+11 (secure 0 0 0) 0x7f1e1807fd40 con 0x7f1e20070d20 2024-04-25T19:23:54.032 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 64 2024-04-25T19:23:54.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.033+0000 7f1e24c00640 1 -- 172.21.15.131:0/784785481 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1dfc0744b0 msgr2=0x7f1dfc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:54.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.033+0000 7f1e24c00640 1 --2- 172.21.15.131:0/784785481 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1dfc0744b0 0x7f1dfc0769c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1e200b1350 tx=0x7f1e10003990 comp rx=0 tx=0).stop 2024-04-25T19:23:54.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.034+0000 7f1e24c00640 1 -- 172.21.15.131:0/784785481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e20070d20 msgr2=0x7f1e20155f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:54.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.034+0000 7f1e24c00640 1 --2- 172.21.15.131:0/784785481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e20070d20 0x7f1e20155f40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1e1802a180 tx=0x7f1e180046c0 comp rx=0 tx=0).stop 2024-04-25T19:23:54.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.034+0000 7f1e24c00640 1 -- 172.21.15.131:0/784785481 shutdown_connections 2024-04-25T19:23:54.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.034+0000 7f1e24c00640 1 --2- 172.21.15.131:0/784785481 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f1dfc0744b0 0x7f1dfc0769c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:54.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.034+0000 7f1e24c00640 1 --2- 172.21.15.131:0/784785481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e2006fd40 0x7f1e20155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:54.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.034+0000 7f1e24c00640 1 --2- 172.21.15.131:0/784785481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e20070d20 0x7f1e20155f40 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:54.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.034+0000 7f1e24c00640 1 --2- 172.21.15.131:0/784785481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e2006f930 0x7f1e20145320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:54.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.034+0000 7f1e24c00640 1 -- 172.21.15.131:0/784785481 >> 172.21.15.131:0/784785481 conn(0x7f1e20073160 msgr2=0x7f1e2015d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:54.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.034+0000 7f1e24c00640 1 -- 172.21.15.131:0/784785481 shutdown_connections 2024-04-25T19:23:54.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.034+0000 7f1e24c00640 1 -- 172.21.15.131:0/784785481 wait complete. 2024-04-25T19:23:54.060 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T19:23:54.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.332+0000 7f3b3e600640 1 Processor -- start 2024-04-25T19:23:54.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.332+0000 7f3b3e600640 1 -- start start 2024-04-25T19:23:54.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.334+0000 7f3b3e600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3b38144500 0x7f3b38070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:54.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.334+0000 7f3b3e600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3b38162310 0x7f3b380ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:54.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.334+0000 7f3b3e600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b3806f5f0 con 0x7f3b380cdb90 2024-04-25T19:23:54.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.334+0000 7f3b3e600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f3b38070200 con 0x7f3b38144500 2024-04-25T19:23:54.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.334+0000 7f3b3e600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3b3806f8d0 con 0x7f3b38162310 2024-04-25T19:23:54.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.335+0000 7f3b37400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3b38144500 0x7f3b38070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:54.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.335+0000 7f3b37400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3b38144500 0x7f3b38070690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:50202/0 (socket says 172.21.15.131:50202) 2024-04-25T19:23:54.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.335+0000 7f3b37400640 1 -- 172.21.15.131:0/2836688962 learned_addr learned my addr 172.21.15.131:0/2836688962 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:54.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.335+0000 7f3b37400640 1 -- 172.21.15.131:0/2836688962 >> v2:172.21.15.195:3300/0 conn(0x7f3b38162310 msgr2=0x7f3b380ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:54.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.335+0000 7f3b37400640 1 --2- 172.21.15.131:0/2836688962 >> v2:172.21.15.195:3300/0 conn(0x7f3b38162310 0x7f3b380ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:54.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.335+0000 7f3b37400640 1 -- 172.21.15.131:0/2836688962 >> v1:172.21.15.195:6789/0 conn(0x7f3b380cdb90 legacy=0x7f3b38161c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:54.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.335+0000 7f3b37400640 1 -- 172.21.15.131:0/2836688962 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3806fbb0 con 0x7f3b38144500 2024-04-25T19:23:54.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.336+0000 7f3b37400640 1 --2- 172.21.15.131:0/2836688962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b38144500 0x7f3b38070690 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3b380ce840 tx=0x7f3b2802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194e10a54315dbf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:54.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.337+0000 7f3b36a00640 1 -- 172.21.15.131:0/2836688962 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b28036070 con 0x7f3b38144500 2024-04-25T19:23:54.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.337+0000 7f3b36a00640 1 -- 172.21.15.131:0/2836688962 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b28031600 con 0x7f3b38144500 2024-04-25T19:23:54.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.337+0000 7f3b36a00640 1 -- 172.21.15.131:0/2836688962 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2802ae60 con 0x7f3b38144500 2024-04-25T19:23:54.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.338+0000 7f3b3e600640 1 -- 172.21.15.131:0/2836688962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b38144500 msgr2=0x7f3b38070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:54.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.338+0000 7f3b3e600640 1 --2- 172.21.15.131:0/2836688962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b38144500 0x7f3b38070690 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3b380ce840 tx=0x7f3b2802a680 comp rx=0 tx=0).stop 2024-04-25T19:23:54.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.338+0000 7f3b3e600640 1 -- 172.21.15.131:0/2836688962 shutdown_connections 2024-04-25T19:23:54.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.338+0000 7f3b3e600640 1 --2- 172.21.15.131:0/2836688962 >> v2:172.21.15.195:3300/0 conn(0x7f3b38162310 0x7f3b380ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:54.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.338+0000 7f3b3e600640 1 --2- 172.21.15.131:0/2836688962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b38144500 0x7f3b38070690 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:54.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.338+0000 7f3b3e600640 1 -- 172.21.15.131:0/2836688962 >> 172.21.15.131:0/2836688962 conn(0x7f3b38073050 msgr2=0x7f3b38073460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:54.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.338+0000 7f3b3e600640 1 -- 172.21.15.131:0/2836688962 shutdown_connections 2024-04-25T19:23:54.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.338+0000 7f3b3e600640 1 -- 172.21.15.131:0/2836688962 wait complete. 2024-04-25T19:23:54.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.341+0000 7f3b3e600640 1 Processor -- start 2024-04-25T19:23:54.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.341+0000 7f3b3e600640 1 -- start start 2024-04-25T19:23:54.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.342+0000 7f3b3e600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b380cdb90 0x7f3b380cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:54.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.342+0000 7f3b3e600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b38144500 0x7f3b381338f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:54.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.342+0000 7f3b3e600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3b38133e30 0x7f3b381e7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:54.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.342+0000 7f3b3e600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3806f2e0 con 0x7f3b380cdb90 2024-04-25T19:23:54.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.342+0000 7f3b3e600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3806f160 con 0x7f3b38144500 2024-04-25T19:23:54.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.342+0000 7f3b3e600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3b380cdfa0 con 0x7f3b38133e30 2024-04-25T19:23:54.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.343+0000 7f3b37400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b380cdb90 0x7f3b380cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:54.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.343+0000 7f3b37400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b380cdb90 0x7f3b380cc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:50218/0 (socket says 172.21.15.131:50218) 2024-04-25T19:23:54.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.343+0000 7f3b37400640 1 -- 172.21.15.131:0/3361826454 learned_addr learned my addr 172.21.15.131:0/3361826454 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:54.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.343+0000 7f3b37400640 1 -- 172.21.15.131:0/3361826454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3b38133e30 msgr2=0x7f3b381e7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:54.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.343+0000 7f3b37400640 1 --2- 172.21.15.131:0/3361826454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3b38133e30 0x7f3b381e7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:54.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.343+0000 7f3b37400640 1 -- 172.21.15.131:0/3361826454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b38144500 msgr2=0x7f3b381338f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:54.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.343+0000 7f3b2ea00640 1 --2- 172.21.15.131:0/3361826454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b38144500 0x7f3b381338f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:54.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.343+0000 7f3b37400640 1 --2- 172.21.15.131:0/3361826454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b38144500 0x7f3b381338f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:54.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.343+0000 7f3b37400640 1 -- 172.21.15.131:0/3361826454 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b381f65f0 con 0x7f3b380cdb90 2024-04-25T19:23:54.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.343+0000 7f3b37400640 1 --2- 172.21.15.131:0/3361826454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b380cdb90 0x7f3b380cc2b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3b28000f80 tx=0x7f3b28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:54.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.344+0000 7f3b2fe00640 1 -- 172.21.15.131:0/3361826454 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b28041020 con 0x7f3b380cdb90 2024-04-25T19:23:54.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.344+0000 7f3b2fe00640 1 -- 172.21.15.131:0/3361826454 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b2802ae60 con 0x7f3b380cdb90 2024-04-25T19:23:54.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.344+0000 7f3b2fe00640 1 -- 172.21.15.131:0/3361826454 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b28036040 con 0x7f3b380cdb90 2024-04-25T19:23:54.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.344+0000 7f3b3e600640 1 -- 172.21.15.131:0/3361826454 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b38134660 con 0x7f3b380cdb90 2024-04-25T19:23:54.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.344+0000 7f3b3e600640 1 -- 172.21.15.131:0/3361826454 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b381f6b90 con 0x7f3b380cdb90 2024-04-25T19:23:54.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.345+0000 7f3b3e600640 1 -- 172.21.15.131:0/3361826454 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b38050740 con 0x7f3b380cdb90 2024-04-25T19:23:54.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.346+0000 7f3b2fe00640 1 -- 172.21.15.131:0/3361826454 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3b28044020 con 0x7f3b380cdb90 2024-04-25T19:23:54.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.347+0000 7f3b2fe00640 1 --2- 172.21.15.131:0/3361826454 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3b140744b0 0x7f3b140769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:54.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.347+0000 7f3b2fe00640 1 -- 172.21.15.131:0/3361826454 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f3b280b6060 con 0x7f3b380cdb90 2024-04-25T19:23:54.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.348+0000 7f3b2ea00640 1 --2- 172.21.15.131:0/3361826454 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3b140744b0 0x7f3b140769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:54.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.349+0000 7f3b2ea00640 1 --2- 172.21.15.131:0/3361826454 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3b140744b0 0x7f3b140769c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3b3815a2c0 tx=0x7f3b20008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:54.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.352+0000 7f3b2fe00640 1 -- 172.21.15.131:0/3361826454 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3b2804b030 con 0x7f3b380cdb90 2024-04-25T19:23:54.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.563+0000 7f3b3e600640 1 -- 172.21.15.131:0/3361826454 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3b3806dae0 con 0x7f3b380cdb90 2024-04-25T19:23:54.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.564+0000 7f3b2fe00640 1 -- 172.21.15.131:0/3361826454 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) ==== 80+0+0 (secure 0 0 0) 0x7f3b28080750 con 0x7f3b380cdb90 2024-04-25T19:23:54.565 INFO:teuthology.orchestra.run.smithi131.stderr:listed 0 entries 2024-04-25T19:23:54.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.567+0000 7f3b3e600640 1 -- 172.21.15.131:0/3361826454 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3b140744b0 msgr2=0x7f3b140769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:54.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.567+0000 7f3b3e600640 1 --2- 172.21.15.131:0/3361826454 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3b140744b0 0x7f3b140769c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3b3815a2c0 tx=0x7f3b20008040 comp rx=0 tx=0).stop 2024-04-25T19:23:54.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.567+0000 7f3b3e600640 1 -- 172.21.15.131:0/3361826454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b380cdb90 msgr2=0x7f3b380cc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:54.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.567+0000 7f3b3e600640 1 --2- 172.21.15.131:0/3361826454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b380cdb90 0x7f3b380cc2b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3b28000f80 tx=0x7f3b28004a40 comp rx=0 tx=0).stop 2024-04-25T19:23:54.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.567+0000 7f3b3e600640 1 -- 172.21.15.131:0/3361826454 shutdown_connections 2024-04-25T19:23:54.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.567+0000 7f3b3e600640 1 --2- 172.21.15.131:0/3361826454 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3b140744b0 0x7f3b140769c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:54.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.567+0000 7f3b3e600640 1 --2- 172.21.15.131:0/3361826454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3b38133e30 0x7f3b381e7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:54.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.567+0000 7f3b3e600640 1 --2- 172.21.15.131:0/3361826454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b38144500 0x7f3b381338f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:54.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.567+0000 7f3b3e600640 1 --2- 172.21.15.131:0/3361826454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b380cdb90 0x7f3b380cc2b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:54.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.567+0000 7f3b3e600640 1 -- 172.21.15.131:0/3361826454 >> 172.21.15.131:0/3361826454 conn(0x7f3b38073050 msgr2=0x7f3b38160ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:54.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.567+0000 7f3b3e600640 1 -- 172.21.15.131:0/3361826454 shutdown_connections 2024-04-25T19:23:54.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:54.567+0000 7f3b3e600640 1 -- 172.21.15.131:0/3361826454 wait complete. 2024-04-25T19:23:54.595 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T19:23:54.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:23:54.595 DEBUG:teuthology.orchestra.run.smithi131:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T19:23:54.734 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2024-04-25T19:23:54.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:23:54.735 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T19:23:54.783 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T19:23:54.783 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:23:54.783 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:23:54.822 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T19:23:54.822 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T19:23:54.823 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:23:54.823 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:23:54.862 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T19:23:54.862 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T19:23:54.862 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:23:54.862 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:23:54.905 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T19:23:54.905 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:23:55.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.167+0000 7f67d9c00640 1 Processor -- start 2024-04-25T19:23:55.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.168+0000 7f67d9c00640 1 -- start start 2024-04-25T19:23:55.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.170+0000 7f67d9c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f67d40d0ed0 0x7f67d40d12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:55.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.170+0000 7f67d9c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67d4160be0 0x7f67d4160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:55.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.170+0000 7f67d9c00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67d4161530 con 0x7f67d41434d0 2024-04-25T19:23:55.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.170+0000 7f67d9c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f67d41438e0 con 0x7f67d40d0ed0 2024-04-25T19:23:55.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.170+0000 7f67d9c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f67d406f3e0 con 0x7f67d4160be0 2024-04-25T19:23:55.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.170+0000 7f67ca000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f67d40d0ed0 0x7f67d40d12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:55.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.170+0000 7f67d2a00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f67d41434d0 0x7f67d4070480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:45902/0 (socket says 172.21.15.131:45902) 2024-04-25T19:23:55.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.170+0000 7f67d2a00640 1 -- 172.21.15.131:0/1469094198 learned_addr learned my addr 172.21.15.131:0/1469094198 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:55.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.171+0000 7f67d3400640 1 --2- 172.21.15.131:0/1469094198 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67d4160be0 0x7f67d4160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:55.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.171+0000 7f67ca000640 1 -- 172.21.15.131:0/1469094198 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67d4160be0 msgr2=0x7f67d4160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:55.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.171+0000 7f67ca000640 1 --2- 172.21.15.131:0/1469094198 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67d4160be0 0x7f67d4160ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:55.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.171+0000 7f67ca000640 1 -- 172.21.15.131:0/1469094198 >> v1:172.21.15.131:6789/0 conn(0x7f67d41434d0 legacy=0x7f67d4070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:55.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.171+0000 7f67ca000640 1 -- 172.21.15.131:0/1469094198 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d406f6c0 con 0x7f67d40d0ed0 2024-04-25T19:23:55.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.171+0000 7f67d3400640 1 --2- 172.21.15.131:0/1469094198 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67d4160be0 0x7f67d4160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:55.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.171+0000 7f67d2000640 1 -- 172.21.15.131:0/1469094198 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 872535731 0 0) 0x7f67c4001110 con 0x7f67d41434d0 2024-04-25T19:23:55.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.172+0000 7f67ca000640 1 --2- 172.21.15.131:0/1469094198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67d40d0ed0 0x7f67d40d12e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f67bc0097a0 tx=0x7f67bc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5689b1af7b47be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:55.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.172+0000 7f67d2000640 1 -- 172.21.15.131:0/1469094198 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67bc037070 con 0x7f67d40d0ed0 2024-04-25T19:23:55.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.172+0000 7f67d2000640 1 -- 172.21.15.131:0/1469094198 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67bc032440 con 0x7f67d40d0ed0 2024-04-25T19:23:55.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.172+0000 7f67d2000640 1 -- 172.21.15.131:0/1469094198 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67bc032810 con 0x7f67d40d0ed0 2024-04-25T19:23:55.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.173+0000 7f67d9c00640 1 -- 172.21.15.131:0/1469094198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67d40d0ed0 msgr2=0x7f67d40d12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:55.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.173+0000 7f67d9c00640 1 --2- 172.21.15.131:0/1469094198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67d40d0ed0 0x7f67d40d12e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f67bc0097a0 tx=0x7f67bc02a180 comp rx=0 tx=0).stop 2024-04-25T19:23:55.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.173+0000 7f67d9c00640 1 -- 172.21.15.131:0/1469094198 shutdown_connections 2024-04-25T19:23:55.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.173+0000 7f67d9c00640 1 --2- 172.21.15.131:0/1469094198 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67d4160be0 0x7f67d4160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:55.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.173+0000 7f67d9c00640 1 --2- 172.21.15.131:0/1469094198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67d40d0ed0 0x7f67d40d12e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:55.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.173+0000 7f67d9c00640 1 -- 172.21.15.131:0/1469094198 >> 172.21.15.131:0/1469094198 conn(0x7f67d40d1ae0 msgr2=0x7f67d40d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:55.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.173+0000 7f67d9c00640 1 -- 172.21.15.131:0/1469094198 shutdown_connections 2024-04-25T19:23:55.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.173+0000 7f67d9c00640 1 -- 172.21.15.131:0/1469094198 wait complete. 2024-04-25T19:23:55.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.175+0000 7f67d9c00640 1 Processor -- start 2024-04-25T19:23:55.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.175+0000 7f67d9c00640 1 -- start start 2024-04-25T19:23:55.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.177+0000 7f67d9c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67d40d0ed0 0x7f67d413f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:55.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.177+0000 7f67d9c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67d41434d0 0x7f67d40b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:55.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.177+0000 7f67d9c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67d4160be0 0x7f67d40b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:55.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.177+0000 7f67d9c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f67d406f090 con 0x7f67d41434d0 2024-04-25T19:23:55.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.177+0000 7f67d9c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f67d406fc80 con 0x7f67d4160be0 2024-04-25T19:23:55.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.177+0000 7f67d9c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f67d40b51a0 con 0x7f67d40d0ed0 2024-04-25T19:23:55.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.177+0000 7f67ca000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67d41434d0 0x7f67d40b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:55.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.177+0000 7f67ca000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67d41434d0 0x7f67d40b1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:50236/0 (socket says 172.21.15.131:50236) 2024-04-25T19:23:55.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.177+0000 7f67ca000640 1 -- 172.21.15.131:0/555319341 learned_addr learned my addr 172.21.15.131:0/555319341 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:55.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.178+0000 7f67d2a00640 1 --2- 172.21.15.131:0/555319341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67d40d0ed0 0x7f67d413f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:55.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.178+0000 7f67ca000640 1 -- 172.21.15.131:0/555319341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67d40d0ed0 msgr2=0x7f67d413f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:55.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.178+0000 7f67ca000640 1 --2- 172.21.15.131:0/555319341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67d40d0ed0 0x7f67d413f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:55.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.178+0000 7f67ca000640 1 -- 172.21.15.131:0/555319341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67d4160be0 msgr2=0x7f67d40b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:55.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.178+0000 7f67ca000640 1 --2- 172.21.15.131:0/555319341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67d4160be0 0x7f67d40b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:55.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.178+0000 7f67ca000640 1 -- 172.21.15.131:0/555319341 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d40b2d40 con 0x7f67d41434d0 2024-04-25T19:23:55.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.178+0000 7f67ca000640 1 --2- 172.21.15.131:0/555319341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67d41434d0 0x7f67d40b1f80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f67bc02a770 tx=0x7f67bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:55.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.178+0000 7f67cb400640 1 -- 172.21.15.131:0/555319341 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67bc037040 con 0x7f67d41434d0 2024-04-25T19:23:55.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.178+0000 7f67cb400640 1 -- 172.21.15.131:0/555319341 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67bc030770 con 0x7f67d41434d0 2024-04-25T19:23:55.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.178+0000 7f67cb400640 1 -- 172.21.15.131:0/555319341 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67bc030b40 con 0x7f67d41434d0 2024-04-25T19:23:55.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.178+0000 7f67d9c00640 1 -- 172.21.15.131:0/555319341 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67d4144680 con 0x7f67d41434d0 2024-04-25T19:23:55.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.179+0000 7f67d9c00640 1 -- 172.21.15.131:0/555319341 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67d4144c40 con 0x7f67d41434d0 2024-04-25T19:23:55.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.180+0000 7f67d9c00640 1 -- 172.21.15.131:0/555319341 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67d406ff60 con 0x7f67d41434d0 2024-04-25T19:23:55.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.181+0000 7f67cb400640 1 -- 172.21.15.131:0/555319341 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f67bc044020 con 0x7f67d41434d0 2024-04-25T19:23:55.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.182+0000 7f67cb400640 1 --2- 172.21.15.131:0/555319341 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f67b00744e0 0x7f67b00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:55.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.182+0000 7f67cb400640 1 -- 172.21.15.131:0/555319341 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f67bc0b57f0 con 0x7f67d41434d0 2024-04-25T19:23:55.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.183+0000 7f67d2a00640 1 --2- 172.21.15.131:0/555319341 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f67b00744e0 0x7f67b00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:55.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.184+0000 7f67d2a00640 1 --2- 172.21.15.131:0/555319341 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f67b00744e0 0x7f67b00769f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f67c4000f60 tx=0x7f67c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:55.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.187+0000 7f67cb400640 1 -- 172.21.15.131:0/555319341 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f67d406ff60 con 0x7f67d41434d0 2024-04-25T19:23:55.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.409+0000 7f67d9c00640 1 -- 172.21.15.131:0/555319341 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67d4050740 con 0x7f67d41434d0 2024-04-25T19:23:55.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.410+0000 7f67cb400640 1 -- 172.21.15.131:0/555319341 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5193 (secure 0 0 0) 0x7f67bc032e20 con 0x7f67d41434d0 2024-04-25T19:23:55.411 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:55.411 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3675320819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3675320819},{"type":"v1","addr":"172.21.15.131:6834","nonce":3675320819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/2332391948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":2332391948},{"type":"v1","addr":"172.21.15.195:6835","nonce":2332391948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4726,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2008890338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2008890338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2008890338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T19:23:34.379246+0000","modified":"2024-04-25T19:23:37.485292+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4729":{"gid":4729,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6837/2364484867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2364484867},{"type":"v1","addr":"172.21.15.195:6837","nonce":2364484867}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4729,"qdb_cluster":[4729]},"id":2}]} 2024-04-25T19:23:55.411 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 16 2024-04-25T19:23:55.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.413+0000 7f67d9c00640 1 -- 172.21.15.131:0/555319341 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f67b00744e0 msgr2=0x7f67b00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:55.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.413+0000 7f67d9c00640 1 --2- 172.21.15.131:0/555319341 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f67b00744e0 0x7f67b00769f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f67c4000f60 tx=0x7f67c4009040 comp rx=0 tx=0).stop 2024-04-25T19:23:55.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.413+0000 7f67d9c00640 1 -- 172.21.15.131:0/555319341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67d41434d0 msgr2=0x7f67d40b1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:55.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.413+0000 7f67d9c00640 1 --2- 172.21.15.131:0/555319341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67d41434d0 0x7f67d40b1f80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f67bc02a770 tx=0x7f67bc0046c0 comp rx=0 tx=0).stop 2024-04-25T19:23:55.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.413+0000 7f67d9c00640 1 -- 172.21.15.131:0/555319341 shutdown_connections 2024-04-25T19:23:55.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.413+0000 7f67d9c00640 1 --2- 172.21.15.131:0/555319341 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f67b00744e0 0x7f67b00769f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:55.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.413+0000 7f67d9c00640 1 --2- 172.21.15.131:0/555319341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67d4160be0 0x7f67d40b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:55.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.413+0000 7f67d9c00640 1 --2- 172.21.15.131:0/555319341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67d41434d0 0x7f67d40b1f80 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:55.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.413+0000 7f67d9c00640 1 --2- 172.21.15.131:0/555319341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67d40d0ed0 0x7f67d413f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:55.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.413+0000 7f67d9c00640 1 -- 172.21.15.131:0/555319341 >> 172.21.15.131:0/555319341 conn(0x7f67d40d1ae0 msgr2=0x7f67d406cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:55.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.413+0000 7f67d9c00640 1 -- 172.21.15.131:0/555319341 shutdown_connections 2024-04-25T19:23:55.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.413+0000 7f67d9c00640 1 -- 172.21.15.131:0/555319341 wait complete. 2024-04-25T19:23:55.442 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:23:55.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.704+0000 7fc5ffe00640 1 Processor -- start 2024-04-25T19:23:55.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.704+0000 7fc5ffe00640 1 -- start start 2024-04-25T19:23:55.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.706+0000 7fc5ffe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc6000cf2f0 0x7fc6000cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:55.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.707+0000 7fc5ffe00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc600071180 con 0x7fc600168010 2024-04-25T19:23:55.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.707+0000 7fc5ffe00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6000700e0 con 0x7fc60006c5c0 2024-04-25T19:23:55.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.707+0000 7fc5ffe00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fc600070cf0 con 0x7fc6000cf2f0 2024-04-25T19:23:55.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.707+0000 7fc5fea00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc6000cf2f0 0x7fc6000cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:55.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.707+0000 7fc5f6000640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fc600168010 0x7fc600168420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:45914/0 (socket says 172.21.15.131:45914) 2024-04-25T19:23:55.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.707+0000 7fc5f6000640 1 -- 172.21.15.131:0/1728773070 learned_addr learned my addr 172.21.15.131:0/1728773070 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:55.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.707+0000 7fc5fea00640 1 -- 172.21.15.131:0/1728773070 >> v1:172.21.15.195:6789/0 conn(0x7fc60006c5c0 legacy=0x7fc60006c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:55.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.707+0000 7fc5fea00640 1 -- 172.21.15.131:0/1728773070 >> v1:172.21.15.131:6789/0 conn(0x7fc600168010 legacy=0x7fc600168420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:55.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.707+0000 7fc5fe000640 1 -- 172.21.15.131:0/1728773070 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1682697819 0 0) 0x7fc600071180 con 0x7fc600168010 2024-04-25T19:23:55.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.707+0000 7fc5fea00640 1 -- 172.21.15.131:0/1728773070 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6000703c0 con 0x7fc6000cf2f0 2024-04-25T19:23:55.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.708+0000 7fc5fea00640 1 --2- 172.21.15.131:0/1728773070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6000cf2f0 0x7fc6000cf700 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00097a0 tx=0x7fc5f002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399275a5168a2f0c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:55.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.709+0000 7fc5fe000640 1 -- 172.21.15.131:0/1728773070 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0037070 con 0x7fc6000cf2f0 2024-04-25T19:23:55.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.709+0000 7fc5fe000640 1 -- 172.21.15.131:0/1728773070 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f0032440 con 0x7fc6000cf2f0 2024-04-25T19:23:55.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.709+0000 7fc5fe000640 1 -- 172.21.15.131:0/1728773070 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0032810 con 0x7fc6000cf2f0 2024-04-25T19:23:55.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.709+0000 7fc5ffe00640 1 -- 172.21.15.131:0/1728773070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6000cf2f0 msgr2=0x7fc6000cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:55.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.709+0000 7fc5ffe00640 1 --2- 172.21.15.131:0/1728773070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6000cf2f0 0x7fc6000cf700 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00097a0 tx=0x7fc5f002a1e0 comp rx=0 tx=0).stop 2024-04-25T19:23:55.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.709+0000 7fc5ffe00640 1 -- 172.21.15.131:0/1728773070 shutdown_connections 2024-04-25T19:23:55.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.709+0000 7fc5ffe00640 1 --2- 172.21.15.131:0/1728773070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6000cf2f0 0x7fc6000cf700 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:55.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.709+0000 7fc5ffe00640 1 -- 172.21.15.131:0/1728773070 >> 172.21.15.131:0/1728773070 conn(0x7fc6000d1720 msgr2=0x7fc6000d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:55.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.710+0000 7fc5ffe00640 1 -- 172.21.15.131:0/1728773070 shutdown_connections 2024-04-25T19:23:55.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.710+0000 7fc5ffe00640 1 -- 172.21.15.131:0/1728773070 wait complete. 2024-04-25T19:23:55.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.712+0000 7fc5ffe00640 1 Processor -- start 2024-04-25T19:23:55.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.712+0000 7fc5ffe00640 1 -- start start 2024-04-25T19:23:55.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.713+0000 7fc5ffe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc60006c5c0 0x7fc600140670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:55.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.713+0000 7fc5ffe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6000cf2f0 0x7fc60015f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:55.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.713+0000 7fc5ffe00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc600168010 0x7fc6001efa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:55.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.713+0000 7fc5ffe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc600168d00 con 0x7fc6000cf2f0 2024-04-25T19:23:55.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.713+0000 7fc5ffe00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc600070980 con 0x7fc600168010 2024-04-25T19:23:55.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.713+0000 7fc5ffe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc600168e80 con 0x7fc60006c5c0 2024-04-25T19:23:55.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.714+0000 7fc5f6000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6000cf2f0 0x7fc60015f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:55.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.714+0000 7fc5f6000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6000cf2f0 0x7fc60015f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:50250/0 (socket says 172.21.15.131:50250) 2024-04-25T19:23:55.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.714+0000 7fc5f6000640 1 -- 172.21.15.131:0/4254105463 learned_addr learned my addr 172.21.15.131:0/4254105463 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:55.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.714+0000 7fc5f6000640 1 -- 172.21.15.131:0/4254105463 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc60006c5c0 msgr2=0x7fc600140670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:55.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.714+0000 7fc5f6000640 1 --2- 172.21.15.131:0/4254105463 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc60006c5c0 0x7fc600140670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:55.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.714+0000 7fc5f6000640 1 -- 172.21.15.131:0/4254105463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc600168010 msgr2=0x7fc6001efa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:55.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.714+0000 7fc5f6000640 1 --2- 172.21.15.131:0/4254105463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc600168010 0x7fc6001efa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:55.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.714+0000 7fc5f6000640 1 -- 172.21.15.131:0/4254105463 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc600160340 con 0x7fc6000cf2f0 2024-04-25T19:23:55.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.714+0000 7fc5f6000640 1 --2- 172.21.15.131:0/4254105463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6000cf2f0 0x7fc60015f760 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc5e800c460 tx=0x7fc5e800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:55.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.715+0000 7fc5f7400640 1 -- 172.21.15.131:0/4254105463 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8018070 con 0x7fc6000cf2f0 2024-04-25T19:23:55.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.715+0000 7fc5f7400640 1 -- 172.21.15.131:0/4254105463 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e8007500 con 0x7fc6000cf2f0 2024-04-25T19:23:55.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.715+0000 7fc5f7400640 1 -- 172.21.15.131:0/4254105463 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8004a20 con 0x7fc6000cf2f0 2024-04-25T19:23:55.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.715+0000 7fc5ffe00640 1 -- 172.21.15.131:0/4254105463 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc600160620 con 0x7fc6000cf2f0 2024-04-25T19:23:55.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.715+0000 7fc5ffe00640 1 -- 172.21.15.131:0/4254105463 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6001fc0a0 con 0x7fc6000cf2f0 2024-04-25T19:23:55.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.716+0000 7fc5ffe00640 1 -- 172.21.15.131:0/4254105463 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6001fa650 con 0x7fc6000cf2f0 2024-04-25T19:23:55.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.717+0000 7fc5f7400640 1 -- 172.21.15.131:0/4254105463 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc5e8004bc0 con 0x7fc6000cf2f0 2024-04-25T19:23:55.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.718+0000 7fc5f7400640 1 --2- 172.21.15.131:0/4254105463 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc5dc0744e0 0x7fc5dc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:55.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.718+0000 7fc5f7400640 1 -- 172.21.15.131:0/4254105463 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fc5e80945c0 con 0x7fc6000cf2f0 2024-04-25T19:23:55.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.719+0000 7fc5fea00640 1 --2- 172.21.15.131:0/4254105463 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc5dc0744e0 0x7fc5dc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:55.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.720+0000 7fc5fea00640 1 --2- 172.21.15.131:0/4254105463 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc5dc0744e0 0x7fc5dc0769f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0034000 tx=0x7fc5f002c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:55.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.723+0000 7fc5f7400640 1 -- 172.21.15.131:0/4254105463 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc5e805ecb0 con 0x7fc6000cf2f0 2024-04-25T19:23:55.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.929+0000 7fc5ffe00640 1 -- 172.21.15.131:0/4254105463 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc600050740 con 0x7fc6000cf2f0 2024-04-25T19:23:55.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.932+0000 7fc5f7400640 1 -- 172.21.15.131:0/4254105463 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16693 (secure 0 0 0) 0x7fc5e805e5b0 con 0x7fc6000cf2f0 2024-04-25T19:23:55.933 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:55.933 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":33,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:23:35.859003+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:23:32.719018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T19:23:33.342898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:23:55.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.935+0000 7fc5ffe00640 1 -- 172.21.15.131:0/4254105463 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc5dc0744e0 msgr2=0x7fc5dc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:55.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.935+0000 7fc5ffe00640 1 --2- 172.21.15.131:0/4254105463 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc5dc0744e0 0x7fc5dc0769f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0034000 tx=0x7fc5f002c000 comp rx=0 tx=0).stop 2024-04-25T19:23:55.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.935+0000 7fc5ffe00640 1 -- 172.21.15.131:0/4254105463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6000cf2f0 msgr2=0x7fc60015f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:55.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.935+0000 7fc5ffe00640 1 --2- 172.21.15.131:0/4254105463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6000cf2f0 0x7fc60015f760 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc5e800c460 tx=0x7fc5e800c920 comp rx=0 tx=0).stop 2024-04-25T19:23:55.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.935+0000 7fc5ffe00640 1 -- 172.21.15.131:0/4254105463 shutdown_connections 2024-04-25T19:23:55.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.935+0000 7fc5ffe00640 1 --2- 172.21.15.131:0/4254105463 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc5dc0744e0 0x7fc5dc0769f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:55.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.935+0000 7fc5ffe00640 1 --2- 172.21.15.131:0/4254105463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc600168010 0x7fc6001efa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:55.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.935+0000 7fc5ffe00640 1 --2- 172.21.15.131:0/4254105463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6000cf2f0 0x7fc60015f760 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:55.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.935+0000 7fc5ffe00640 1 --2- 172.21.15.131:0/4254105463 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc60006c5c0 0x7fc600140670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:55.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.935+0000 7fc5ffe00640 1 -- 172.21.15.131:0/4254105463 >> 172.21.15.131:0/4254105463 conn(0x7fc6000d1720 msgr2=0x7fc6000b5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:55.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.936+0000 7fc5ffe00640 1 -- 172.21.15.131:0/4254105463 shutdown_connections 2024-04-25T19:23:55.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:55.936+0000 7fc5ffe00640 1 -- 172.21.15.131:0/4254105463 wait complete. 2024-04-25T19:23:55.962 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T19:22:04.178847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T19:23:32.719018+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T19:23:33.342898+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T19:23:55.963 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T19:23:56.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.229+0000 7f524ce00640 1 Processor -- start 2024-04-25T19:23:56.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.229+0000 7f524ce00640 1 -- start start 2024-04-25T19:23:56.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.231+0000 7f524ce00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f52480ce250 0x7f524815cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:56.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.232+0000 7f524ce00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f524806d5d0 0x7f524806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:56.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.232+0000 7f524ce00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f524806df20 con 0x7f52481458c0 2024-04-25T19:23:56.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.232+0000 7f524ce00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f52480b4ec0 con 0x7f52480ce250 2024-04-25T19:23:56.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.232+0000 7f524ce00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5248145cd0 con 0x7f524806d5d0 2024-04-25T19:23:56.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.232+0000 7f5245e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f52480ce250 0x7f524815cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:56.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.232+0000 7f5246800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f524806d5d0 0x7f524806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:56.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.232+0000 7f5246800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f524806d5d0 0x7f524806d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.131:38750/0 (socket says 172.21.15.131:38750) 2024-04-25T19:23:56.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.232+0000 7f5246800640 1 -- 172.21.15.131:0/771149843 learned_addr learned my addr 172.21.15.131:0/771149843 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:56.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.232+0000 7f523d400640 1 --1- 172.21.15.131:0/771149843 >> v1:172.21.15.195:6789/0 conn(0x7f52481458c0 0x7f52480b47b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.131:48278/0 (socket says 172.21.15.131:48278) 2024-04-25T19:23:56.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.233+0000 7f5245e00640 1 -- 172.21.15.131:0/771149843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f524806d5d0 msgr2=0x7f524806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:56.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.233+0000 7f5245e00640 1 --2- 172.21.15.131:0/771149843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f524806d5d0 0x7f524806d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:56.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.233+0000 7f5245e00640 1 -- 172.21.15.131:0/771149843 >> v1:172.21.15.195:6789/0 conn(0x7f52481458c0 legacy=0x7f52480b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:56.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.233+0000 7f5245e00640 1 -- 172.21.15.131:0/771149843 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f524815d5c0 con 0x7f52480ce250 2024-04-25T19:23:56.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.233+0000 7f5246800640 1 --2- 172.21.15.131:0/771149843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f524806d5d0 0x7f524806d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T19:23:56.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.235+0000 7f5245e00640 1 --2- 172.21.15.131:0/771149843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52480ce250 0x7f524815cfa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5238009d90 tx=0x7f523802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48b499f66efef5ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:56.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.235+0000 7f5245400640 1 -- 172.21.15.131:0/771149843 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5238031600 con 0x7f52480ce250 2024-04-25T19:23:56.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.235+0000 7f5245400640 1 -- 172.21.15.131:0/771149843 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52380317a0 con 0x7f52480ce250 2024-04-25T19:23:56.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.235+0000 7f5245400640 1 -- 172.21.15.131:0/771149843 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5238031b70 con 0x7f52480ce250 2024-04-25T19:23:56.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.236+0000 7f524ce00640 1 -- 172.21.15.131:0/771149843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52480ce250 msgr2=0x7f524815cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:56.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.236+0000 7f524ce00640 1 --2- 172.21.15.131:0/771149843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52480ce250 0x7f524815cfa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5238009d90 tx=0x7f523802a5d0 comp rx=0 tx=0).stop 2024-04-25T19:23:56.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.236+0000 7f524ce00640 1 -- 172.21.15.131:0/771149843 shutdown_connections 2024-04-25T19:23:56.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.236+0000 7f524ce00640 1 --2- 172.21.15.131:0/771149843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f524806d5d0 0x7f524806d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:56.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.236+0000 7f524ce00640 1 --2- 172.21.15.131:0/771149843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52480ce250 0x7f524815cfa0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:56.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.236+0000 7f524ce00640 1 -- 172.21.15.131:0/771149843 >> 172.21.15.131:0/771149843 conn(0x7f5248073090 msgr2=0x7f52480734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:56.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.236+0000 7f524ce00640 1 -- 172.21.15.131:0/771149843 shutdown_connections 2024-04-25T19:23:56.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.236+0000 7f524ce00640 1 -- 172.21.15.131:0/771149843 wait complete. 2024-04-25T19:23:56.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.239+0000 7f524ce00640 1 Processor -- start 2024-04-25T19:23:56.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.240+0000 7f524ce00640 1 -- start start 2024-04-25T19:23:56.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.242+0000 7f524ce00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f524806d5d0 0x7f524813d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:56.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.242+0000 7f524ce00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52480ce250 0x7f52480b2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:56.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.242+0000 7f524ce00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52481458c0 0x7f5248140920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:56.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.242+0000 7f524ce00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f524806f640 con 0x7f52481458c0 2024-04-25T19:23:56.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.242+0000 7f524ce00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f524815db80 con 0x7f524806d5d0 2024-04-25T19:23:56.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.242+0000 7f524ce00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f524815de60 con 0x7f52480ce250 2024-04-25T19:23:56.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.242+0000 7f5246800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52481458c0 0x7f5248140920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:56.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.242+0000 7f5246800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52481458c0 0x7f5248140920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:50262/0 (socket says 172.21.15.131:50262) 2024-04-25T19:23:56.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.242+0000 7f5246800640 1 -- 172.21.15.131:0/2821467801 learned_addr learned my addr 172.21.15.131:0/2821467801 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:56.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.242+0000 7f5245e00640 1 --2- 172.21.15.131:0/2821467801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f524806d5d0 0x7f524813d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:56.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.242+0000 7f523d400640 1 --2- 172.21.15.131:0/2821467801 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52480ce250 0x7f52480b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:56.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.243+0000 7f5246800640 1 -- 172.21.15.131:0/2821467801 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52480ce250 msgr2=0x7f52480b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:56.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.243+0000 7f5246800640 1 --2- 172.21.15.131:0/2821467801 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52480ce250 0x7f52480b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:56.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.243+0000 7f5246800640 1 -- 172.21.15.131:0/2821467801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f524806d5d0 msgr2=0x7f524813d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:56.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.243+0000 7f5246800640 1 --2- 172.21.15.131:0/2821467801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f524806d5d0 0x7f524813d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:56.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.243+0000 7f5246800640 1 -- 172.21.15.131:0/2821467801 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f524813dbf0 con 0x7f52481458c0 2024-04-25T19:23:56.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.243+0000 7f5246800640 1 --2- 172.21.15.131:0/2821467801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52481458c0 0x7f5248140920 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f524000dcd0 tx=0x7f5240010490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:56.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.243+0000 7f523ea00640 1 -- 172.21.15.131:0/2821467801 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240004030 con 0x7f52481458c0 2024-04-25T19:23:56.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.243+0000 7f523ea00640 1 -- 172.21.15.131:0/2821467801 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52400041d0 con 0x7f52481458c0 2024-04-25T19:23:56.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.243+0000 7f524ce00640 1 -- 172.21.15.131:0/2821467801 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f524813ded0 con 0x7f52481458c0 2024-04-25T19:23:56.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.243+0000 7f523ea00640 1 -- 172.21.15.131:0/2821467801 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240003610 con 0x7f52481458c0 2024-04-25T19:23:56.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.244+0000 7f524ce00640 1 -- 172.21.15.131:0/2821467801 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f524813e490 con 0x7f52481458c0 2024-04-25T19:23:56.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.245+0000 7f524ce00640 1 -- 172.21.15.131:0/2821467801 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f524813d960 con 0x7f52481458c0 2024-04-25T19:23:56.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.246+0000 7f523ea00640 1 -- 172.21.15.131:0/2821467801 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f52400037b0 con 0x7f52481458c0 2024-04-25T19:23:56.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.247+0000 7f523ea00640 1 --2- 172.21.15.131:0/2821467801 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f52240744b0 0x7f52240769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:56.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.248+0000 7f523ea00640 1 -- 172.21.15.131:0/2821467801 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f5240097920 con 0x7f52481458c0 2024-04-25T19:23:56.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.248+0000 7f5245e00640 1 --2- 172.21.15.131:0/2821467801 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f52240744b0 0x7f52240769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:56.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.249+0000 7f5245e00640 1 --2- 172.21.15.131:0/2821467801 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f52240744b0 0x7f52240769c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5238034000 tx=0x7f5238033040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:56.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.253+0000 7f523ea00640 1 -- 172.21.15.131:0/2821467801 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5240062130 con 0x7f52481458c0 2024-04-25T19:23:56.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.450+0000 7f524ce00640 1 -- 172.21.15.131:0/2821467801 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5248050740 con 0x7f52481458c0 2024-04-25T19:23:56.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.452+0000 7f523ea00640 1 -- 172.21.15.131:0/2821467801 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) ==== 93+0+10 (secure 0 0 0) 0x7f524006a120 con 0x7f52481458c0 2024-04-25T19:23:56.452 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-25T19:23:56.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.454+0000 7f524ce00640 1 -- 172.21.15.131:0/2821467801 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f52240744b0 msgr2=0x7f52240769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:56.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.454+0000 7f524ce00640 1 --2- 172.21.15.131:0/2821467801 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f52240744b0 0x7f52240769c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5238034000 tx=0x7f5238033040 comp rx=0 tx=0).stop 2024-04-25T19:23:56.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.454+0000 7f524ce00640 1 -- 172.21.15.131:0/2821467801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52481458c0 msgr2=0x7f5248140920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:56.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.454+0000 7f524ce00640 1 --2- 172.21.15.131:0/2821467801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52481458c0 0x7f5248140920 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f524000dcd0 tx=0x7f5240010490 comp rx=0 tx=0).stop 2024-04-25T19:23:56.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.454+0000 7f524ce00640 1 -- 172.21.15.131:0/2821467801 shutdown_connections 2024-04-25T19:23:56.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.454+0000 7f524ce00640 1 --2- 172.21.15.131:0/2821467801 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f52240744b0 0x7f52240769c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:56.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.454+0000 7f524ce00640 1 --2- 172.21.15.131:0/2821467801 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52480ce250 0x7f52480b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:56.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.454+0000 7f524ce00640 1 --2- 172.21.15.131:0/2821467801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52481458c0 0x7f5248140920 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:56.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.454+0000 7f524ce00640 1 --2- 172.21.15.131:0/2821467801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f524806d5d0 0x7f524813d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:56.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.454+0000 7f524ce00640 1 -- 172.21.15.131:0/2821467801 >> 172.21.15.131:0/2821467801 conn(0x7f5248073090 msgr2=0x7f5248141da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:56.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.454+0000 7f524ce00640 1 -- 172.21.15.131:0/2821467801 shutdown_connections 2024-04-25T19:23:56.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.454+0000 7f524ce00640 1 -- 172.21.15.131:0/2821467801 wait complete. 2024-04-25T19:23:56.481 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T19:23:56.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.758+0000 7f78a7200640 1 Processor -- start 2024-04-25T19:23:56.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.758+0000 7f78a7200640 1 -- start start 2024-04-25T19:23:56.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.760+0000 7f78a7200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f78a806dce0 0x7f78a815e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:56.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.760+0000 7f78a7200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f78a815ec90 0x7f78a815f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:56.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.760+0000 7f78a7200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a8070000 con 0x7f78a8144340 2024-04-25T19:23:56.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.760+0000 7f78a7200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f78a8144750 con 0x7f78a815ec90 2024-04-25T19:23:56.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.760+0000 7f78a7200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f78a806f240 con 0x7f78a806dce0 2024-04-25T19:23:56.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.760+0000 7f78a6800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f78a815ec90 0x7f78a815f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:56.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.760+0000 7f78a6800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f78a815ec90 0x7f78a815f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:50270/0 (socket says 172.21.15.131:50270) 2024-04-25T19:23:56.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.760+0000 7f78a6800640 1 -- 172.21.15.131:0/723465832 learned_addr learned my addr 172.21.15.131:0/723465832 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:56.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.761+0000 7f789d400640 1 --2- 172.21.15.131:0/723465832 >> v2:172.21.15.195:3300/0 conn(0x7f78a806dce0 0x7f78a815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:56.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.761+0000 7f78a6800640 1 -- 172.21.15.131:0/723465832 >> v2:172.21.15.195:3300/0 conn(0x7f78a806dce0 msgr2=0x7f78a815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:56.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.761+0000 7f78a6800640 1 --2- 172.21.15.131:0/723465832 >> v2:172.21.15.195:3300/0 conn(0x7f78a806dce0 0x7f78a815e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:56.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.761+0000 7f78a6800640 1 -- 172.21.15.131:0/723465832 >> v1:172.21.15.195:6789/0 conn(0x7f78a8144340 legacy=0x7f78a806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:56.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.761+0000 7f78a6800640 1 -- 172.21.15.131:0/723465832 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a806f520 con 0x7f78a815ec90 2024-04-25T19:23:56.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.762+0000 7f78a6800640 1 --2- 172.21.15.131:0/723465832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78a815ec90 0x7f78a815f4a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f78a8073ef0 tx=0x7f78a002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d9311432e6bd1a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:56.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.762+0000 7f78a5400640 1 -- 172.21.15.131:0/723465832 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0036070 con 0x7f78a815ec90 2024-04-25T19:23:56.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.762+0000 7f78a5400640 1 -- 172.21.15.131:0/723465832 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78a0031600 con 0x7f78a815ec90 2024-04-25T19:23:56.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.762+0000 7f78a5400640 1 -- 172.21.15.131:0/723465832 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a00319d0 con 0x7f78a815ec90 2024-04-25T19:23:56.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.763+0000 7f78a7200640 1 -- 172.21.15.131:0/723465832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78a815ec90 msgr2=0x7f78a815f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:56.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.763+0000 7f78a7200640 1 --2- 172.21.15.131:0/723465832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78a815ec90 0x7f78a815f4a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f78a8073ef0 tx=0x7f78a002a6f0 comp rx=0 tx=0).stop 2024-04-25T19:23:56.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.763+0000 7f78a7200640 1 -- 172.21.15.131:0/723465832 shutdown_connections 2024-04-25T19:23:56.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.763+0000 7f78a7200640 1 --2- 172.21.15.131:0/723465832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78a815ec90 0x7f78a815f4a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:56.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.763+0000 7f78a7200640 1 --2- 172.21.15.131:0/723465832 >> v2:172.21.15.195:3300/0 conn(0x7f78a806dce0 0x7f78a815e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:56.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.763+0000 7f78a7200640 1 -- 172.21.15.131:0/723465832 >> 172.21.15.131:0/723465832 conn(0x7f78a8072f40 msgr2=0x7f78a8073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:56.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.763+0000 7f78a7200640 1 -- 172.21.15.131:0/723465832 shutdown_connections 2024-04-25T19:23:56.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.763+0000 7f78a7200640 1 -- 172.21.15.131:0/723465832 wait complete. 2024-04-25T19:23:56.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.766+0000 7f78a7200640 1 Processor -- start 2024-04-25T19:23:56.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.766+0000 7f78a7200640 1 -- start start 2024-04-25T19:23:56.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.767+0000 7f78a7200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78a8144340 0x7f78a81307b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:56.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.767+0000 7f78a7200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78a815ec90 0x7f78a8130cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:56.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.767+0000 7f78a7200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78a8136880 0x7f78a8136c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:56.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.767+0000 7f78a7200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f78a815f0a0 con 0x7f78a815ec90 2024-04-25T19:23:56.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.767+0000 7f78a7200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f78a806fae0 con 0x7f78a8136880 2024-04-25T19:23:56.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.767+0000 7f78a7200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f78a815f220 con 0x7f78a8144340 2024-04-25T19:23:56.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.768+0000 7f789d400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78a815ec90 0x7f78a8130cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:56.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.768+0000 7f789d400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78a815ec90 0x7f78a8130cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:50272/0 (socket says 172.21.15.131:50272) 2024-04-25T19:23:56.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.768+0000 7f789d400640 1 -- 172.21.15.131:0/2019252537 learned_addr learned my addr 172.21.15.131:0/2019252537 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:56.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.768+0000 7f78a6800640 1 --2- 172.21.15.131:0/2019252537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78a8136880 0x7f78a8136c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:56.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.768+0000 7f78a5e00640 1 --2- 172.21.15.131:0/2019252537 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78a8144340 0x7f78a81307b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:56.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.768+0000 7f789d400640 1 -- 172.21.15.131:0/2019252537 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78a8144340 msgr2=0x7f78a81307b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:56.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.768+0000 7f789d400640 1 --2- 172.21.15.131:0/2019252537 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78a8144340 0x7f78a81307b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:56.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.768+0000 7f789d400640 1 -- 172.21.15.131:0/2019252537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78a8136880 msgr2=0x7f78a8136c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:56.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.768+0000 7f789d400640 1 --2- 172.21.15.131:0/2019252537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78a8136880 0x7f78a8136c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:56.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.768+0000 7f789d400640 1 -- 172.21.15.131:0/2019252537 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a815fd90 con 0x7f78a815ec90 2024-04-25T19:23:56.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.768+0000 7f789d400640 1 --2- 172.21.15.131:0/2019252537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78a815ec90 0x7f78a8130cf0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f789000d5f0 tx=0x7f789000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:56.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.769+0000 7f789ea00640 1 -- 172.21.15.131:0/2019252537 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78900125f0 con 0x7f78a815ec90 2024-04-25T19:23:56.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.769+0000 7f789ea00640 1 -- 172.21.15.131:0/2019252537 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7890019070 con 0x7f78a815ec90 2024-04-25T19:23:56.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.769+0000 7f789ea00640 1 -- 172.21.15.131:0/2019252537 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78900129d0 con 0x7f78a815ec90 2024-04-25T19:23:56.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.769+0000 7f78a7200640 1 -- 172.21.15.131:0/2019252537 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78a81371d0 con 0x7f78a815ec90 2024-04-25T19:23:56.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.769+0000 7f78a7200640 1 -- 172.21.15.131:0/2019252537 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78a8161c80 con 0x7f78a815ec90 2024-04-25T19:23:56.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.770+0000 7f78a7200640 1 -- 172.21.15.131:0/2019252537 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78a8161710 con 0x7f78a815ec90 2024-04-25T19:23:56.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.771+0000 7f789ea00640 1 -- 172.21.15.131:0/2019252537 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7890012b70 con 0x7f78a815ec90 2024-04-25T19:23:56.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.772+0000 7f789ea00640 1 --2- 172.21.15.131:0/2019252537 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f78840744b0 0x7f78840769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:56.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.772+0000 7f789ea00640 1 -- 172.21.15.131:0/2019252537 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f78900955d0 con 0x7f78a815ec90 2024-04-25T19:23:56.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.773+0000 7f78a5e00640 1 --2- 172.21.15.131:0/2019252537 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f78840744b0 0x7f78840769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:56.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.774+0000 7f78a5e00640 1 --2- 172.21.15.131:0/2019252537 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f78840744b0 0x7f78840769c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f789800a750 tx=0x7f7898008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:56.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.777+0000 7f789ea00640 1 -- 172.21.15.131:0/2019252537 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f789005fdf0 con 0x7f78a815ec90 2024-04-25T19:23:56.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.973+0000 7f78a7200640 1 -- 172.21.15.131:0/2019252537 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f78a8076c60 con 0x7f78a815ec90 2024-04-25T19:23:56.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.974+0000 7f789ea00640 1 -- 172.21.15.131:0/2019252537 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) ==== 104+0+11 (secure 0 0 0) 0x7f789005f6f0 con 0x7f78a815ec90 2024-04-25T19:23:56.974 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-25T19:23:56.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.976+0000 7f78a7200640 1 -- 172.21.15.131:0/2019252537 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f78840744b0 msgr2=0x7f78840769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:56.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.976+0000 7f78a7200640 1 --2- 172.21.15.131:0/2019252537 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f78840744b0 0x7f78840769c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f789800a750 tx=0x7f7898008040 comp rx=0 tx=0).stop 2024-04-25T19:23:56.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.976+0000 7f78a7200640 1 -- 172.21.15.131:0/2019252537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78a815ec90 msgr2=0x7f78a8130cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:56.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.976+0000 7f78a7200640 1 --2- 172.21.15.131:0/2019252537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78a815ec90 0x7f78a8130cf0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f789000d5f0 tx=0x7f789000dab0 comp rx=0 tx=0).stop 2024-04-25T19:23:56.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.976+0000 7f78a7200640 1 -- 172.21.15.131:0/2019252537 shutdown_connections 2024-04-25T19:23:56.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.976+0000 7f78a7200640 1 --2- 172.21.15.131:0/2019252537 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f78840744b0 0x7f78840769c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:56.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.976+0000 7f78a7200640 1 --2- 172.21.15.131:0/2019252537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78a8136880 0x7f78a8136c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:56.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.976+0000 7f78a7200640 1 --2- 172.21.15.131:0/2019252537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78a815ec90 0x7f78a8130cf0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:56.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.976+0000 7f78a7200640 1 --2- 172.21.15.131:0/2019252537 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78a8144340 0x7f78a81307b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:56.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.976+0000 7f78a7200640 1 -- 172.21.15.131:0/2019252537 >> 172.21.15.131:0/2019252537 conn(0x7f78a8072f40 msgr2=0x7f78a8141230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:56.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.977+0000 7f78a7200640 1 -- 172.21.15.131:0/2019252537 shutdown_connections 2024-04-25T19:23:56.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:56.977+0000 7f78a7200640 1 -- 172.21.15.131:0/2019252537 wait complete. 2024-04-25T19:23:57.002 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T19:23:57.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.278+0000 7f7c19800640 1 Processor -- start 2024-04-25T19:23:57.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.278+0000 7f7c19800640 1 -- start start 2024-04-25T19:23:57.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.281+0000 7f7c19800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c1415bb20 0x7f7c1406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:57.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.281+0000 7f7c19800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c1406df20 con 0x7f7c1406db10 2024-04-25T19:23:57.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.281+0000 7f7c19800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c140d1630 con 0x7f7c1415b710 2024-04-25T19:23:57.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.281+0000 7f7c19800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7c14169280 con 0x7f7c1415bb20 2024-04-25T19:23:57.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.281+0000 7f7c13400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f7c1406db10 0x7f7c14165100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:45924/0 (socket says 172.21.15.131:45924) 2024-04-25T19:23:57.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.281+0000 7f7c13400640 1 -- 172.21.15.131:0/1506166367 learned_addr learned my addr 172.21.15.131:0/1506166367 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:23:57.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.281+0000 7f7c0be00640 1 --2- 172.21.15.131:0/1506166367 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c1415bb20 0x7f7c1406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:57.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.282+0000 7f7c12000640 1 -- 172.21.15.131:0/1506166367 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3716826224 0 0) 0x7f7c0c001490 con 0x7f7c1406db10 2024-04-25T19:23:57.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.282+0000 7f7c12000640 1 -- 172.21.15.131:0/1506166367 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bf8003520 con 0x7f7c1406db10 2024-04-25T19:23:57.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.282+0000 7f7c12000640 1 -- 172.21.15.131:0/1506166367 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3361811423 0 0) 0x7f7bf8003520 con 0x7f7c1406db10 2024-04-25T19:23:57.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.282+0000 7f7c12000640 1 -- 172.21.15.131:0/1506166367 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c1415bb20 msgr2=0x7f7c1406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:57.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.282+0000 7f7c12000640 1 --2- 172.21.15.131:0/1506166367 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c1415bb20 0x7f7c1406d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:57.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.282+0000 7f7c12000640 1 -- 172.21.15.131:0/1506166367 >> v1:172.21.15.195:6789/0 conn(0x7f7c1415b710 legacy=0x7f7c140d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:57.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.282+0000 7f7c12000640 1 -- 172.21.15.131:0/1506166367 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c14168670 con 0x7f7c1406db10 2024-04-25T19:23:57.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.282+0000 7f7c12000640 1 -- 172.21.15.131:0/1506166367 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f7c0c001bc0 con 0x7f7c1406db10 2024-04-25T19:23:57.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.282+0000 7f7c12000640 1 -- 172.21.15.131:0/1506166367 >> v1:172.21.15.131:6789/0 conn(0x7f7c1406db10 legacy=0x7f7c14165100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:57.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.282+0000 7f7c12000640 1 --2- 172.21.15.131:0/1506166367 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c1415bb20 0x7f7bf80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:57.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.282+0000 7f7c12000640 1 --2- 172.21.15.131:0/1506166367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf8003f60 0x7f7bf8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:57.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.282+0000 7f7c12000640 1 --2- 172.21.15.131:0/1506166367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bf8004d40 0x7f7bf8005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:57.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.282+0000 7f7c12000640 1 -- 172.21.15.131:0/1506166367 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf800bb50 con 0x7f7bf8003f60 2024-04-25T19:23:57.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.282+0000 7f7c12000640 1 -- 172.21.15.131:0/1506166367 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf800bcd0 con 0x7f7bf8004d40 2024-04-25T19:23:57.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.282+0000 7f7c12000640 1 -- 172.21.15.131:0/1506166367 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7bf800bed0 con 0x7f7c1415bb20 2024-04-25T19:23:57.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.283+0000 7f7c0be00640 1 --2- 172.21.15.131:0/1506166367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf8003f60 0x7f7bf8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:57.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.283+0000 7f7c12a00640 1 --2- 172.21.15.131:0/1506166367 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c1415bb20 0x7f7bf80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:57.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.283+0000 7f7c0be00640 1 -- 172.21.15.131:0/1506166367 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c1415bb20 msgr2=0x7f7bf80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:57.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.283+0000 7f7c13400640 1 --2- 172.21.15.131:0/1506166367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bf8004d40 0x7f7bf8005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:57.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.283+0000 7f7c0be00640 1 --2- 172.21.15.131:0/1506166367 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c1415bb20 0x7f7bf80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:57.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.283+0000 7f7c0be00640 1 -- 172.21.15.131:0/1506166367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bf8004d40 msgr2=0x7f7bf8005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:57.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.283+0000 7f7c0be00640 1 --2- 172.21.15.131:0/1506166367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bf8004d40 0x7f7bf8005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:57.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.283+0000 7f7c0be00640 1 -- 172.21.15.131:0/1506166367 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf8003520 con 0x7f7bf8003f60 2024-04-25T19:23:57.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.283+0000 7f7c13400640 1 --2- 172.21.15.131:0/1506166367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bf8004d40 0x7f7bf8005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:57.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.283+0000 7f7c12a00640 1 --2- 172.21.15.131:0/1506166367 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c1415bb20 0x7f7bf80039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:57.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.284+0000 7f7c0be00640 1 --2- 172.21.15.131:0/1506166367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf8003f60 0x7f7bf8004800 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009ac0 tx=0x7f7bf8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbacfc1c65167bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:57.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.285+0000 7f7c12000640 1 -- 172.21.15.131:0/1506166367 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc036070 con 0x7f7bf8003f60 2024-04-25T19:23:57.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.285+0000 7f7c12000640 1 -- 172.21.15.131:0/1506166367 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bfc031400 con 0x7f7bf8003f60 2024-04-25T19:23:57.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.285+0000 7f7c12000640 1 -- 172.21.15.131:0/1506166367 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc009690 con 0x7f7bf8003f60 2024-04-25T19:23:57.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.285+0000 7f7c19800640 1 -- 172.21.15.131:0/1506166367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf8003f60 msgr2=0x7f7bf8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:57.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.285+0000 7f7c19800640 1 --2- 172.21.15.131:0/1506166367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf8003f60 0x7f7bf8004800 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009ac0 tx=0x7f7bf8005830 comp rx=0 tx=0).stop 2024-04-25T19:23:57.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.285+0000 7f7c13400640 1 -- 172.21.15.131:0/1506166367 reap_dead start 2024-04-25T19:23:57.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.285+0000 7f7c19800640 1 -- 172.21.15.131:0/1506166367 shutdown_connections 2024-04-25T19:23:57.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.285+0000 7f7c19800640 1 -- 172.21.15.131:0/1506166367 >> 172.21.15.131:0/1506166367 conn(0x7f7c14073090 msgr2=0x7f7c140734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:57.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.285+0000 7f7c19800640 1 -- 172.21.15.131:0/1506166367 shutdown_connections 2024-04-25T19:23:57.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.286+0000 7f7c19800640 1 -- 172.21.15.131:0/1506166367 wait complete. 2024-04-25T19:23:57.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.288+0000 7f7c19800640 1 Processor -- start 2024-04-25T19:23:57.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.288+0000 7f7c19800640 1 -- start start 2024-04-25T19:23:57.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.290+0000 7f7c19800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf8003f60 0x7f7c141466e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:57.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.290+0000 7f7c19800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c14143360 0x7f7c14167040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:57.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.290+0000 7f7c19800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c14167580 0x7f7c140b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:57.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.290+0000 7f7c19800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7c14168f10 con 0x7f7bf8003f60 2024-04-25T19:23:57.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.290+0000 7f7c19800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7c14168c30 con 0x7f7c14143360 2024-04-25T19:23:57.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.290+0000 7f7c19800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7c140b6180 con 0x7f7c14167580 2024-04-25T19:23:57.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.290+0000 7f7c12a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf8003f60 0x7f7c141466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:57.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.290+0000 7f7c12a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf8003f60 0x7f7c141466e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:50286/0 (socket says 172.21.15.131:50286) 2024-04-25T19:23:57.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.290+0000 7f7c12a00640 1 -- 172.21.15.131:0/1222506157 learned_addr learned my addr 172.21.15.131:0/1222506157 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:57.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.290+0000 7f7c13400640 1 --2- 172.21.15.131:0/1222506157 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c14167580 0x7f7c140b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:57.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.290+0000 7f7c0be00640 1 --2- 172.21.15.131:0/1222506157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c14143360 0x7f7c14167040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:57.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.291+0000 7f7c12a00640 1 -- 172.21.15.131:0/1222506157 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c14167580 msgr2=0x7f7c140b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:57.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.291+0000 7f7c12a00640 1 --2- 172.21.15.131:0/1222506157 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c14167580 0x7f7c140b24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:57.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.291+0000 7f7c12a00640 1 -- 172.21.15.131:0/1222506157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c14143360 msgr2=0x7f7c14167040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:57.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.291+0000 7f7c12a00640 1 --2- 172.21.15.131:0/1222506157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c14143360 0x7f7c14167040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:57.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.291+0000 7f7c12a00640 1 -- 172.21.15.131:0/1222506157 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c14146c20 con 0x7f7bf8003f60 2024-04-25T19:23:57.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.291+0000 7f7c13400640 1 --2- 172.21.15.131:0/1222506157 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c14167580 0x7f7c140b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:57.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.291+0000 7f7c0be00640 1 --2- 172.21.15.131:0/1222506157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c14143360 0x7f7c14167040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:57.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.291+0000 7f7c12a00640 1 --2- 172.21.15.131:0/1222506157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf8003f60 0x7f7c141466e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400d7a0 tx=0x7f7c0400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:57.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.291+0000 7f7c0aa00640 1 -- 172.21.15.131:0/1222506157 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c04005270 con 0x7f7bf8003f60 2024-04-25T19:23:57.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.291+0000 7f7c0aa00640 1 -- 172.21.15.131:0/1222506157 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c04017070 con 0x7f7bf8003f60 2024-04-25T19:23:57.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.291+0000 7f7c0aa00640 1 -- 172.21.15.131:0/1222506157 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0400b6b0 con 0x7f7bf8003f60 2024-04-25T19:23:57.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.291+0000 7f7c19800640 1 -- 172.21.15.131:0/1222506157 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c14167990 con 0x7f7bf8003f60 2024-04-25T19:23:57.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.291+0000 7f7c19800640 1 -- 172.21.15.131:0/1222506157 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c14143d50 con 0x7f7bf8003f60 2024-04-25T19:23:57.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.292+0000 7f7c19800640 1 -- 172.21.15.131:0/1222506157 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c14050740 con 0x7f7bf8003f60 2024-04-25T19:23:57.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.294+0000 7f7c0aa00640 1 -- 172.21.15.131:0/1222506157 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7c0400b850 con 0x7f7bf8003f60 2024-04-25T19:23:57.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.295+0000 7f7c0aa00640 1 --2- 172.21.15.131:0/1222506157 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f7bf00744e0 0x7f7bf00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:57.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.295+0000 7f7c0aa00640 1 -- 172.21.15.131:0/1222506157 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f7c04095050 con 0x7f7bf8003f60 2024-04-25T19:23:57.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.295+0000 7f7c0be00640 1 --2- 172.21.15.131:0/1222506157 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f7bf00744e0 0x7f7bf00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:57.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.297+0000 7f7c0be00640 1 --2- 172.21.15.131:0/1222506157 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f7bf00744e0 0x7f7bf00769f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009ac0 tx=0x7f7bfc008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:57.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.299+0000 7f7c0aa00640 1 -- 172.21.15.131:0/1222506157 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7c14167990 con 0x7f7bf8003f60 2024-04-25T19:23:57.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.499+0000 7f7c19800640 1 -- 172.21.15.131:0/1222506157 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7c140b5d40 con 0x7f7bf8003f60 2024-04-25T19:23:57.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.500+0000 7f7c0aa00640 1 -- 172.21.15.131:0/1222506157 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) ==== 100+0+11 (secure 0 0 0) 0x7f7c14146c20 con 0x7f7bf8003f60 2024-04-25T19:23:57.500 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 64 2024-04-25T19:23:57.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.502+0000 7f7c19800640 1 -- 172.21.15.131:0/1222506157 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f7bf00744e0 msgr2=0x7f7bf00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:57.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.502+0000 7f7c19800640 1 --2- 172.21.15.131:0/1222506157 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f7bf00744e0 0x7f7bf00769f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009ac0 tx=0x7f7bfc008030 comp rx=0 tx=0).stop 2024-04-25T19:23:57.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.502+0000 7f7c19800640 1 -- 172.21.15.131:0/1222506157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf8003f60 msgr2=0x7f7c141466e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:57.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.502+0000 7f7c19800640 1 --2- 172.21.15.131:0/1222506157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf8003f60 0x7f7c141466e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400d7a0 tx=0x7f7c0400dc60 comp rx=0 tx=0).stop 2024-04-25T19:23:57.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.502+0000 7f7c19800640 1 -- 172.21.15.131:0/1222506157 shutdown_connections 2024-04-25T19:23:57.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.502+0000 7f7c19800640 1 --2- 172.21.15.131:0/1222506157 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f7bf00744e0 0x7f7bf00769f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:57.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.502+0000 7f7c19800640 1 --2- 172.21.15.131:0/1222506157 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c14167580 0x7f7c140b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:57.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.502+0000 7f7c19800640 1 --2- 172.21.15.131:0/1222506157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c14143360 0x7f7c14167040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:57.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.502+0000 7f7c19800640 1 --2- 172.21.15.131:0/1222506157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf8003f60 0x7f7c141466e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:57.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.502+0000 7f7c19800640 1 -- 172.21.15.131:0/1222506157 >> 172.21.15.131:0/1222506157 conn(0x7f7c14073090 msgr2=0x7f7c140734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:57.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.502+0000 7f7c19800640 1 -- 172.21.15.131:0/1222506157 shutdown_connections 2024-04-25T19:23:57.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.502+0000 7f7c19800640 1 -- 172.21.15.131:0/1222506157 wait complete. 2024-04-25T19:23:57.532 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:23:57.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.794+0000 7f3a32600640 1 Processor -- start 2024-04-25T19:23:57.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.794+0000 7f3a32600640 1 -- start start 2024-04-25T19:23:57.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.796+0000 7f3a32600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a2c0cf9e0 0x7f3a2c161090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:57.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.797+0000 7f3a32600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3a2c0709a0 0x7f3a2c1569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:57.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.797+0000 7f3a32600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a2c1615d0 con 0x7f3a2c0b0800 2024-04-25T19:23:57.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.797+0000 7f3a32600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3a2c0cffc0 con 0x7f3a2c0709a0 2024-04-25T19:23:57.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.797+0000 7f3a32600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3a2c0d02a0 con 0x7f3a2c0cf9e0 2024-04-25T19:23:57.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.797+0000 7f3a31200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a2c0cf9e0 0x7f3a2c161090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:57.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.797+0000 7f3a31c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3a2c0709a0 0x7f3a2c1569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:57.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.797+0000 7f3a31200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a2c0cf9e0 0x7f3a2c161090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.131:38800/0 (socket says 172.21.15.131:38800) 2024-04-25T19:23:57.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.797+0000 7f3a31200640 1 -- 172.21.15.131:0/1317156716 learned_addr learned my addr 172.21.15.131:0/1317156716 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:57.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.798+0000 7f3a31200640 1 -- 172.21.15.131:0/1317156716 >> v2:172.21.15.195:3300/0 conn(0x7f3a2c0709a0 msgr2=0x7f3a2c1569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:57.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.798+0000 7f3a31200640 1 --2- 172.21.15.131:0/1317156716 >> v2:172.21.15.195:3300/0 conn(0x7f3a2c0709a0 0x7f3a2c1569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:57.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.798+0000 7f3a31200640 1 -- 172.21.15.131:0/1317156716 >> v1:172.21.15.195:6789/0 conn(0x7f3a2c0b0800 legacy=0x7f3a2c070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:57.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.798+0000 7f3a31200640 1 -- 172.21.15.131:0/1317156716 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2c0d0580 con 0x7f3a2c0cf9e0 2024-04-25T19:23:57.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.799+0000 7f3a31200640 1 --2- 172.21.15.131:0/1317156716 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a2c0cf9e0 0x7f3a2c161090 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009e50 tx=0x7f3a1c02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22611d67221edb56 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:57.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.800+0000 7f3a2be00640 1 -- 172.21.15.131:0/1317156716 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c036070 con 0x7f3a2c0cf9e0 2024-04-25T19:23:57.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.800+0000 7f3a2be00640 1 -- 172.21.15.131:0/1317156716 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a1c031600 con 0x7f3a2c0cf9e0 2024-04-25T19:23:57.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.800+0000 7f3a2be00640 1 -- 172.21.15.131:0/1317156716 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c0319d0 con 0x7f3a2c0cf9e0 2024-04-25T19:23:57.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.801+0000 7f3a32600640 1 -- 172.21.15.131:0/1317156716 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a2c0cf9e0 msgr2=0x7f3a2c161090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:57.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.801+0000 7f3a32600640 1 --2- 172.21.15.131:0/1317156716 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a2c0cf9e0 0x7f3a2c161090 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009e50 tx=0x7f3a1c02a680 comp rx=0 tx=0).stop 2024-04-25T19:23:57.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.801+0000 7f3a32600640 1 -- 172.21.15.131:0/1317156716 shutdown_connections 2024-04-25T19:23:57.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.801+0000 7f3a32600640 1 --2- 172.21.15.131:0/1317156716 >> v2:172.21.15.195:3300/0 conn(0x7f3a2c0709a0 0x7f3a2c1569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:57.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.801+0000 7f3a32600640 1 --2- 172.21.15.131:0/1317156716 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a2c0cf9e0 0x7f3a2c161090 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:57.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.801+0000 7f3a32600640 1 -- 172.21.15.131:0/1317156716 >> 172.21.15.131:0/1317156716 conn(0x7f3a2c0d1720 msgr2=0x7f3a2c0d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:57.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.801+0000 7f3a32600640 1 -- 172.21.15.131:0/1317156716 shutdown_connections 2024-04-25T19:23:57.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.801+0000 7f3a32600640 1 -- 172.21.15.131:0/1317156716 wait complete. 2024-04-25T19:23:57.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.803+0000 7f3a32600640 1 Processor -- start 2024-04-25T19:23:57.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.803+0000 7f3a32600640 1 -- start start 2024-04-25T19:23:57.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.805+0000 7f3a32600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a2c0b0800 0x7f3a2c15f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:57.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.805+0000 7f3a32600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a2c0cf9e0 0x7f3a2c0b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:57.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.805+0000 7f3a32600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a2c0b7210 0x7f3a2c15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:57.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.805+0000 7f3a32600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2c0b0d90 con 0x7f3a2c0b7210 2024-04-25T19:23:57.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.805+0000 7f3a32600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2c0b0c10 con 0x7f3a2c0b0800 2024-04-25T19:23:57.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.805+0000 7f3a32600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3a2c156ef0 con 0x7f3a2c0cf9e0 2024-04-25T19:23:57.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.805+0000 7f3a31c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a2c0b7210 0x7f3a2c15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:57.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.805+0000 7f3a31c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a2c0b7210 0x7f3a2c15acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:50292/0 (socket says 172.21.15.131:50292) 2024-04-25T19:23:57.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.805+0000 7f3a31c00640 1 -- 172.21.15.131:0/2568513642 learned_addr learned my addr 172.21.15.131:0/2568513642 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:57.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.805+0000 7f3a31200640 1 --2- 172.21.15.131:0/2568513642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a2c0b0800 0x7f3a2c15f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:57.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.806+0000 7f3a23e00640 1 --2- 172.21.15.131:0/2568513642 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a2c0cf9e0 0x7f3a2c0b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:57.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.806+0000 7f3a31c00640 1 -- 172.21.15.131:0/2568513642 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a2c0cf9e0 msgr2=0x7f3a2c0b6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:57.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.806+0000 7f3a31c00640 1 --2- 172.21.15.131:0/2568513642 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a2c0cf9e0 0x7f3a2c0b6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:57.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.806+0000 7f3a31c00640 1 -- 172.21.15.131:0/2568513642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a2c0b0800 msgr2=0x7f3a2c15f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:57.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.806+0000 7f3a31c00640 1 --2- 172.21.15.131:0/2568513642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a2c0b0800 0x7f3a2c15f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:57.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.806+0000 7f3a31c00640 1 -- 172.21.15.131:0/2568513642 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2c1461a0 con 0x7f3a2c0b7210 2024-04-25T19:23:57.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.806+0000 7f3a31200640 1 --2- 172.21.15.131:0/2568513642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a2c0b0800 0x7f3a2c15f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T19:23:57.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.806+0000 7f3a31c00640 1 --2- 172.21.15.131:0/2568513642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a2c0b7210 0x7f3a2c15acd0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400e7f0 tx=0x7f3a2400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:57.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.807+0000 7f3a29600640 1 -- 172.21.15.131:0/2568513642 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24017070 con 0x7f3a2c0b7210 2024-04-25T19:23:57.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.807+0000 7f3a29600640 1 -- 172.21.15.131:0/2568513642 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a2400ee40 con 0x7f3a2c0b7210 2024-04-25T19:23:57.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.807+0000 7f3a29600640 1 -- 172.21.15.131:0/2568513642 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2400cb80 con 0x7f3a2c0b7210 2024-04-25T19:23:57.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.807+0000 7f3a32600640 1 -- 172.21.15.131:0/2568513642 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a2c146480 con 0x7f3a2c0b7210 2024-04-25T19:23:57.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.807+0000 7f3a32600640 1 -- 172.21.15.131:0/2568513642 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a2c158310 con 0x7f3a2c0b7210 2024-04-25T19:23:57.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.808+0000 7f3a32600640 1 -- 172.21.15.131:0/2568513642 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a2c158570 con 0x7f3a2c0b7210 2024-04-25T19:23:57.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.809+0000 7f3a29600640 1 -- 172.21.15.131:0/2568513642 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3a2401a070 con 0x7f3a2c0b7210 2024-04-25T19:23:57.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.810+0000 7f3a29600640 1 --2- 172.21.15.131:0/2568513642 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3a080744b0 0x7f3a080769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:57.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.811+0000 7f3a29600640 1 -- 172.21.15.131:0/2568513642 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f3a24095400 con 0x7f3a2c0b7210 2024-04-25T19:23:57.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.811+0000 7f3a31200640 1 --2- 172.21.15.131:0/2568513642 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3a080744b0 0x7f3a080769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:57.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.812+0000 7f3a31200640 1 --2- 172.21.15.131:0/2568513642 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3a080744b0 0x7f3a080769c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c033000 tx=0x7f3a1c009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:57.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:57.815+0000 7f3a29600640 1 -- 172.21.15.131:0/2568513642 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3a2405fc10 con 0x7f3a2c0b7210 2024-04-25T19:23:58.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.056+0000 7f3a32600640 1 -- 172.21.15.131:0/2568513642 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a2c0b7790 con 0x7f3a2c0b7210 2024-04-25T19:23:58.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.056+0000 7f3a29600640 1 -- 172.21.15.131:0/2568513642 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5193 (secure 0 0 0) 0x7f3a2405f510 con 0x7f3a2c0b7210 2024-04-25T19:23:58.057 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:58.057 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3675320819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3675320819},{"type":"v1","addr":"172.21.15.131:6834","nonce":3675320819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/2332391948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":2332391948},{"type":"v1","addr":"172.21.15.195:6835","nonce":2332391948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4726,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2008890338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2008890338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2008890338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T19:23:34.379246+0000","modified":"2024-04-25T19:23:37.485292+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4729":{"gid":4729,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6837/2364484867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2364484867},{"type":"v1","addr":"172.21.15.195:6837","nonce":2364484867}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4729,"qdb_cluster":[4729]},"id":2}]} 2024-04-25T19:23:58.058 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 16 2024-04-25T19:23:58.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.059+0000 7f3a32600640 1 -- 172.21.15.131:0/2568513642 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3a080744b0 msgr2=0x7f3a080769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:58.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.059+0000 7f3a32600640 1 --2- 172.21.15.131:0/2568513642 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3a080744b0 0x7f3a080769c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c033000 tx=0x7f3a1c009000 comp rx=0 tx=0).stop 2024-04-25T19:23:58.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.059+0000 7f3a32600640 1 -- 172.21.15.131:0/2568513642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a2c0b7210 msgr2=0x7f3a2c15acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:58.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.059+0000 7f3a32600640 1 --2- 172.21.15.131:0/2568513642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a2c0b7210 0x7f3a2c15acd0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400e7f0 tx=0x7f3a2400ebf0 comp rx=0 tx=0).stop 2024-04-25T19:23:58.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.059+0000 7f3a32600640 1 -- 172.21.15.131:0/2568513642 shutdown_connections 2024-04-25T19:23:58.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.059+0000 7f3a32600640 1 --2- 172.21.15.131:0/2568513642 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3a080744b0 0x7f3a080769c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:58.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.059+0000 7f3a32600640 1 --2- 172.21.15.131:0/2568513642 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a2c0cf9e0 0x7f3a2c0b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:58.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.059+0000 7f3a32600640 1 --2- 172.21.15.131:0/2568513642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a2c0b7210 0x7f3a2c15acd0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:58.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.059+0000 7f3a32600640 1 --2- 172.21.15.131:0/2568513642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a2c0b0800 0x7f3a2c15f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:58.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.060+0000 7f3a32600640 1 -- 172.21.15.131:0/2568513642 >> 172.21.15.131:0/2568513642 conn(0x7f3a2c0d1720 msgr2=0x7f3a2c162ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:58.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.060+0000 7f3a32600640 1 -- 172.21.15.131:0/2568513642 shutdown_connections 2024-04-25T19:23:58.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.060+0000 7f3a32600640 1 -- 172.21.15.131:0/2568513642 wait complete. 2024-04-25T19:23:58.087 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:23:58.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.344+0000 7f191b200640 1 Processor -- start 2024-04-25T19:23:58.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.344+0000 7f191b200640 1 -- start start 2024-04-25T19:23:58.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.346+0000 7f191b200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f191c06c5c0 0x7f191c0cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:58.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.346+0000 7f191b200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f191c0b4ea0 0x7f191c15e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:58.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.346+0000 7f191b200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f191c0d1230 con 0x7f191c144370 2024-04-25T19:23:58.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.346+0000 7f191b200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f191c0d06b0 con 0x7f191c06c5c0 2024-04-25T19:23:58.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.346+0000 7f191b200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f191c0d0990 con 0x7f191c0b4ea0 2024-04-25T19:23:58.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.346+0000 7f1919e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f191c06c5c0 0x7f191c0cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:58.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.346+0000 7f1919e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f191c06c5c0 0x7f191c0cfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:37982/0 (socket says 172.21.15.131:37982) 2024-04-25T19:23:58.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.346+0000 7f1919e00640 1 -- 172.21.15.131:0/2921389414 learned_addr learned my addr 172.21.15.131:0/2921389414 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:58.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.347+0000 7f1919e00640 1 -- 172.21.15.131:0/2921389414 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f191c0b4ea0 msgr2=0x7f191c15e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:58.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.347+0000 7f1919e00640 1 --2- 172.21.15.131:0/2921389414 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f191c0b4ea0 0x7f191c15e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:58.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.347+0000 7f1919e00640 1 -- 172.21.15.131:0/2921389414 >> v1:172.21.15.195:6789/0 conn(0x7f191c144370 legacy=0x7f191c0b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:58.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.347+0000 7f1919e00640 1 -- 172.21.15.131:0/2921389414 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191c0d0c70 con 0x7f191c06c5c0 2024-04-25T19:23:58.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.348+0000 7f1919e00640 1 --2- 172.21.15.131:0/2921389414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f191c06c5c0 0x7f191c0cfa70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f190c009870 tx=0x7f190c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d19ce2b5df69d0c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:58.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.348+0000 7f1918a00640 1 -- 172.21.15.131:0/2921389414 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c037070 con 0x7f191c06c5c0 2024-04-25T19:23:58.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.348+0000 7f1918a00640 1 -- 172.21.15.131:0/2921389414 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f190c032440 con 0x7f191c06c5c0 2024-04-25T19:23:58.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.348+0000 7f1918a00640 1 -- 172.21.15.131:0/2921389414 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c032810 con 0x7f191c06c5c0 2024-04-25T19:23:58.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.349+0000 7f191b200640 1 -- 172.21.15.131:0/2921389414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f191c06c5c0 msgr2=0x7f191c0cfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:58.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.349+0000 7f191b200640 1 --2- 172.21.15.131:0/2921389414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f191c06c5c0 0x7f191c0cfa70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f190c009870 tx=0x7f190c02a210 comp rx=0 tx=0).stop 2024-04-25T19:23:58.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.349+0000 7f191b200640 1 -- 172.21.15.131:0/2921389414 shutdown_connections 2024-04-25T19:23:58.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.349+0000 7f191b200640 1 --2- 172.21.15.131:0/2921389414 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f191c0b4ea0 0x7f191c15e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:58.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.349+0000 7f191b200640 1 --2- 172.21.15.131:0/2921389414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f191c06c5c0 0x7f191c0cfa70 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:58.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.349+0000 7f191b200640 1 -- 172.21.15.131:0/2921389414 >> 172.21.15.131:0/2921389414 conn(0x7f191c0d1720 msgr2=0x7f191c0d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:58.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.349+0000 7f191b200640 1 -- 172.21.15.131:0/2921389414 shutdown_connections 2024-04-25T19:23:58.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.349+0000 7f191b200640 1 -- 172.21.15.131:0/2921389414 wait complete. 2024-04-25T19:23:58.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.352+0000 7f191b200640 1 Processor -- start 2024-04-25T19:23:58.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.352+0000 7f191b200640 1 -- start start 2024-04-25T19:23:58.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.353+0000 7f191b200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f191c06c5c0 0x7f191c141140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:58.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.353+0000 7f191b200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f191c144370 0x7f191c161b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:58.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.353+0000 7f191b200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f191c162070 0x7f191c1449c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:58.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.353+0000 7f191b200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f191c0d0450 con 0x7f191c162070 2024-04-25T19:23:58.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.353+0000 7f191b200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f191c0d02d0 con 0x7f191c06c5c0 2024-04-25T19:23:58.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.353+0000 7f191b200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f191c147760 con 0x7f191c144370 2024-04-25T19:23:58.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.354+0000 7f191a800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f191c162070 0x7f191c1449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:58.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.354+0000 7f191a800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f191c162070 0x7f191c1449c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:37994/0 (socket says 172.21.15.131:37994) 2024-04-25T19:23:58.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.354+0000 7f191a800640 1 -- 172.21.15.131:0/1377602837 learned_addr learned my addr 172.21.15.131:0/1377602837 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:58.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.354+0000 7f1919e00640 1 --2- 172.21.15.131:0/1377602837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f191c06c5c0 0x7f191c141140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:58.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.354+0000 7f1919400640 1 --2- 172.21.15.131:0/1377602837 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f191c144370 0x7f191c161b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:58.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.354+0000 7f191a800640 1 -- 172.21.15.131:0/1377602837 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f191c144370 msgr2=0x7f191c161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:58.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.354+0000 7f191a800640 1 --2- 172.21.15.131:0/1377602837 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f191c144370 0x7f191c161b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:58.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.354+0000 7f191a800640 1 -- 172.21.15.131:0/1377602837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f191c06c5c0 msgr2=0x7f191c141140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:58.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.354+0000 7f191a800640 1 --2- 172.21.15.131:0/1377602837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f191c06c5c0 0x7f191c141140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:58.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.354+0000 7f191a800640 1 -- 172.21.15.131:0/1377602837 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191c162480 con 0x7f191c162070 2024-04-25T19:23:58.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.354+0000 7f1919e00640 1 --2- 172.21.15.131:0/1377602837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f191c06c5c0 0x7f191c141140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:23:58.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.354+0000 7f191a800640 1 --2- 172.21.15.131:0/1377602837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f191c162070 0x7f191c1449c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f191400b970 tx=0x7f191400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:58.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.355+0000 7f1912000640 1 -- 172.21.15.131:0/1377602837 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1914019070 con 0x7f191c162070 2024-04-25T19:23:58.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.355+0000 7f1912000640 1 -- 172.21.15.131:0/1377602837 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f191400cb00 con 0x7f191c162070 2024-04-25T19:23:58.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.355+0000 7f1912000640 1 -- 172.21.15.131:0/1377602837 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1914014440 con 0x7f191c162070 2024-04-25T19:23:58.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.355+0000 7f191b200640 1 -- 172.21.15.131:0/1377602837 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f191c155240 con 0x7f191c162070 2024-04-25T19:23:58.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.355+0000 7f191b200640 1 -- 172.21.15.131:0/1377602837 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f191c155800 con 0x7f191c162070 2024-04-25T19:23:58.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.356+0000 7f191b200640 1 -- 172.21.15.131:0/1377602837 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f191c050740 con 0x7f191c162070 2024-04-25T19:23:58.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.358+0000 7f1912000640 1 -- 172.21.15.131:0/1377602837 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f191401c070 con 0x7f191c162070 2024-04-25T19:23:58.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.359+0000 7f1912000640 1 --2- 172.21.15.131:0/1377602837 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f18f80744b0 0x7f18f80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:58.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.359+0000 7f1912000640 1 -- 172.21.15.131:0/1377602837 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f1914094fe0 con 0x7f191c162070 2024-04-25T19:23:58.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.359+0000 7f1919e00640 1 --2- 172.21.15.131:0/1377602837 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f18f80744b0 0x7f18f80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:58.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.361+0000 7f1919e00640 1 --2- 172.21.15.131:0/1377602837 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f18f80744b0 0x7f18f80769c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f190c034000 tx=0x7f190c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:58.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.363+0000 7f1912000640 1 -- 172.21.15.131:0/1377602837 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f191c162480 con 0x7f191c162070 2024-04-25T19:23:58.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.550+0000 7f191b200640 1 -- 172.21.15.131:0/1377602837 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f191c15dce0 con 0x7f191c162070 2024-04-25T19:23:58.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.551+0000 7f1912000640 1 -- 172.21.15.131:0/1377602837 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16693 (secure 0 0 0) 0x7f191405f6d0 con 0x7f191c162070 2024-04-25T19:23:58.553 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:58.553 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":33,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:23:35.859003+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:23:32.719018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T19:23:33.342898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:23:58.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.554+0000 7f191b200640 1 -- 172.21.15.131:0/1377602837 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f18f80744b0 msgr2=0x7f18f80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:58.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.554+0000 7f191b200640 1 --2- 172.21.15.131:0/1377602837 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f18f80744b0 0x7f18f80769c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f190c034000 tx=0x7f190c02e000 comp rx=0 tx=0).stop 2024-04-25T19:23:58.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.554+0000 7f191b200640 1 -- 172.21.15.131:0/1377602837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f191c162070 msgr2=0x7f191c1449c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:58.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.554+0000 7f191b200640 1 --2- 172.21.15.131:0/1377602837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f191c162070 0x7f191c1449c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f191400b970 tx=0x7f191400be30 comp rx=0 tx=0).stop 2024-04-25T19:23:58.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.554+0000 7f191b200640 1 -- 172.21.15.131:0/1377602837 shutdown_connections 2024-04-25T19:23:58.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.554+0000 7f191b200640 1 --2- 172.21.15.131:0/1377602837 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f18f80744b0 0x7f18f80769c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:58.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.554+0000 7f191b200640 1 --2- 172.21.15.131:0/1377602837 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f191c144370 0x7f191c161b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:58.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.554+0000 7f191b200640 1 --2- 172.21.15.131:0/1377602837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f191c162070 0x7f191c1449c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:58.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.554+0000 7f191b200640 1 --2- 172.21.15.131:0/1377602837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f191c06c5c0 0x7f191c141140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:58.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.554+0000 7f191b200640 1 -- 172.21.15.131:0/1377602837 >> 172.21.15.131:0/1377602837 conn(0x7f191c0d1720 msgr2=0x7f191c15c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:58.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.555+0000 7f191b200640 1 -- 172.21.15.131:0/1377602837 shutdown_connections 2024-04-25T19:23:58.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.555+0000 7f191b200640 1 -- 172.21.15.131:0/1377602837 wait complete. 2024-04-25T19:23:58.581 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T19:23:58.581 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:23:58.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.834+0000 7f1849800640 1 Processor -- start 2024-04-25T19:23:58.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.834+0000 7f1849800640 1 -- start start 2024-04-25T19:23:58.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.836+0000 7f1849800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f184406c5c0 0x7f18440cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:58.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.836+0000 7f1849800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18440b4ea0 0x7f184415e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:58.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.836+0000 7f1849800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18440d1230 con 0x7f1844144370 2024-04-25T19:23:58.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.836+0000 7f1849800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f18440d06b0 con 0x7f184406c5c0 2024-04-25T19:23:58.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.836+0000 7f1849800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f18440d0990 con 0x7f18440b4ea0 2024-04-25T19:23:58.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.837+0000 7f1843e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f184406c5c0 0x7f18440cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:58.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.837+0000 7f1843e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f184406c5c0 0x7f18440cfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.131:59600/0 (socket says 172.21.15.131:59600) 2024-04-25T19:23:58.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.837+0000 7f1843e00640 1 -- 172.21.15.131:0/3265532471 learned_addr learned my addr 172.21.15.131:0/3265532471 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:58.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.837+0000 7f1848e00640 1 --2- 172.21.15.131:0/3265532471 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18440b4ea0 0x7f184415e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:58.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.838+0000 7f1843e00640 1 -- 172.21.15.131:0/3265532471 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18440b4ea0 msgr2=0x7f184415e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:58.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.838+0000 7f1843e00640 1 --2- 172.21.15.131:0/3265532471 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18440b4ea0 0x7f184415e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:58.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.838+0000 7f1843e00640 1 -- 172.21.15.131:0/3265532471 >> v1:172.21.15.195:6789/0 conn(0x7f1844144370 legacy=0x7f18440b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:58.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.838+0000 7f1843e00640 1 -- 172.21.15.131:0/3265532471 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18440d0c70 con 0x7f184406c5c0 2024-04-25T19:23:58.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.839+0000 7f1843e00640 1 --2- 172.21.15.131:0/3265532471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f184406c5c0 0x7f18440cfa70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1834009870 tx=0x7f183402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db095b861a8db98c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:58.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.840+0000 7f1843400640 1 -- 172.21.15.131:0/3265532471 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1834037070 con 0x7f184406c5c0 2024-04-25T19:23:58.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.840+0000 7f1843400640 1 -- 172.21.15.131:0/3265532471 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1834032440 con 0x7f184406c5c0 2024-04-25T19:23:58.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.840+0000 7f1843400640 1 -- 172.21.15.131:0/3265532471 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1834032810 con 0x7f184406c5c0 2024-04-25T19:23:58.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.840+0000 7f1849800640 1 -- 172.21.15.131:0/3265532471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f184406c5c0 msgr2=0x7f18440cfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:58.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.840+0000 7f1849800640 1 --2- 172.21.15.131:0/3265532471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f184406c5c0 0x7f18440cfa70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1834009870 tx=0x7f183402a270 comp rx=0 tx=0).stop 2024-04-25T19:23:58.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.840+0000 7f1849800640 1 -- 172.21.15.131:0/3265532471 shutdown_connections 2024-04-25T19:23:58.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.840+0000 7f1849800640 1 --2- 172.21.15.131:0/3265532471 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18440b4ea0 0x7f184415e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:58.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.840+0000 7f1849800640 1 --2- 172.21.15.131:0/3265532471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f184406c5c0 0x7f18440cfa70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:58.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.840+0000 7f1849800640 1 -- 172.21.15.131:0/3265532471 >> 172.21.15.131:0/3265532471 conn(0x7f18440d1720 msgr2=0x7f18440d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:58.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.840+0000 7f1849800640 1 -- 172.21.15.131:0/3265532471 shutdown_connections 2024-04-25T19:23:58.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.841+0000 7f1849800640 1 -- 172.21.15.131:0/3265532471 wait complete. 2024-04-25T19:23:58.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.843+0000 7f1849800640 1 Processor -- start 2024-04-25T19:23:58.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.843+0000 7f1849800640 1 -- start start 2024-04-25T19:23:58.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.845+0000 7f1849800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f184406c5c0 0x7f18441f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:58.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.845+0000 7f1849800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1844144370 0x7f184406f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:58.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.845+0000 7f1849800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18441620b0 0x7f184406f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:58.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.845+0000 7f1849800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f18440d0450 con 0x7f18441620b0 2024-04-25T19:23:58.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.845+0000 7f1849800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f18440d02d0 con 0x7f184406c5c0 2024-04-25T19:23:58.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.845+0000 7f1849800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1844147760 con 0x7f1844144370 2024-04-25T19:23:58.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.845+0000 7f1848e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18441620b0 0x7f184406f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:58.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.845+0000 7f1848e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18441620b0 0x7f184406f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38010/0 (socket says 172.21.15.131:38010) 2024-04-25T19:23:58.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.845+0000 7f1848e00640 1 -- 172.21.15.131:0/3433956802 learned_addr learned my addr 172.21.15.131:0/3433956802 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:58.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.845+0000 7f1843e00640 1 --2- 172.21.15.131:0/3433956802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f184406c5c0 0x7f18441f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:58.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.846+0000 7f183b400640 1 --2- 172.21.15.131:0/3433956802 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1844144370 0x7f184406f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:58.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.846+0000 7f1848e00640 1 -- 172.21.15.131:0/3433956802 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1844144370 msgr2=0x7f184406f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:58.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.846+0000 7f1848e00640 1 --2- 172.21.15.131:0/3433956802 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1844144370 0x7f184406f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:58.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.846+0000 7f1848e00640 1 -- 172.21.15.131:0/3433956802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f184406c5c0 msgr2=0x7f18441f5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:58.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.846+0000 7f1848e00640 1 --2- 172.21.15.131:0/3433956802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f184406c5c0 0x7f18441f5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:58.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.846+0000 7f1848e00640 1 -- 172.21.15.131:0/3433956802 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18441429b0 con 0x7f18441620b0 2024-04-25T19:23:58.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.846+0000 7f1848e00640 1 --2- 172.21.15.131:0/3433956802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18441620b0 0x7f184406f6c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f183c007e90 tx=0x7f183c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:58.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.846+0000 7f1840c00640 1 -- 172.21.15.131:0/3433956802 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c014420 con 0x7f18441620b0 2024-04-25T19:23:58.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.846+0000 7f1840c00640 1 -- 172.21.15.131:0/3433956802 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f183c019070 con 0x7f18441620b0 2024-04-25T19:23:58.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.846+0000 7f1840c00640 1 -- 172.21.15.131:0/3433956802 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c014800 con 0x7f18441620b0 2024-04-25T19:23:58.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.846+0000 7f1849800640 1 -- 172.21.15.131:0/3433956802 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1844142c90 con 0x7f18441620b0 2024-04-25T19:23:58.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.846+0000 7f1849800640 1 -- 172.21.15.131:0/3433956802 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18440700f0 con 0x7f18441620b0 2024-04-25T19:23:58.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.848+0000 7f1849800640 1 -- 172.21.15.131:0/3433956802 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1844050740 con 0x7f18441620b0 2024-04-25T19:23:58.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.849+0000 7f1840c00640 1 -- 172.21.15.131:0/3433956802 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f183c0149a0 con 0x7f18441620b0 2024-04-25T19:23:58.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.849+0000 7f1840c00640 1 --2- 172.21.15.131:0/3433956802 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f18200744e0 0x7f18200769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:58.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.850+0000 7f1840c00640 1 -- 172.21.15.131:0/3433956802 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f183c095990 con 0x7f18441620b0 2024-04-25T19:23:58.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.850+0000 7f1843e00640 1 --2- 172.21.15.131:0/3433956802 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f18200744e0 0x7f18200769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:58.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.851+0000 7f1843e00640 1 --2- 172.21.15.131:0/3433956802 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f18200744e0 0x7f18200769f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1834034000 tx=0x7f183402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:58.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:58.854+0000 7f1840c00640 1 -- 172.21.15.131:0/3433956802 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f183c05fb40 con 0x7f18441620b0 2024-04-25T19:23:59.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.105+0000 7f1849800640 1 -- 172.21.15.131:0/3433956802 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1844161bd0 con 0x7f18441620b0 2024-04-25T19:23:59.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.106+0000 7f1840c00640 1 -- 172.21.15.131:0/3433956802 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5193 (secure 0 0 0) 0x7f183c063e40 con 0x7f18441620b0 2024-04-25T19:23:59.107 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:59.107 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3675320819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3675320819},{"type":"v1","addr":"172.21.15.131:6834","nonce":3675320819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/2332391948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":2332391948},{"type":"v1","addr":"172.21.15.195:6835","nonce":2332391948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4726,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2008890338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2008890338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2008890338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T19:23:34.379246+0000","modified":"2024-04-25T19:23:37.485292+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4729":{"gid":4729,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6837/2364484867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2364484867},{"type":"v1","addr":"172.21.15.195:6837","nonce":2364484867}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4729,"qdb_cluster":[4729]},"id":2}]} 2024-04-25T19:23:59.107 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 16 2024-04-25T19:23:59.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.109+0000 7f1849800640 1 -- 172.21.15.131:0/3433956802 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f18200744e0 msgr2=0x7f18200769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:59.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.109+0000 7f1849800640 1 --2- 172.21.15.131:0/3433956802 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f18200744e0 0x7f18200769f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1834034000 tx=0x7f183402e000 comp rx=0 tx=0).stop 2024-04-25T19:23:59.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.109+0000 7f1849800640 1 -- 172.21.15.131:0/3433956802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18441620b0 msgr2=0x7f184406f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:59.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.109+0000 7f1849800640 1 --2- 172.21.15.131:0/3433956802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18441620b0 0x7f184406f6c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f183c007e90 tx=0x7f183c00e4b0 comp rx=0 tx=0).stop 2024-04-25T19:23:59.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.110+0000 7f1849800640 1 -- 172.21.15.131:0/3433956802 shutdown_connections 2024-04-25T19:23:59.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.110+0000 7f1849800640 1 --2- 172.21.15.131:0/3433956802 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f18200744e0 0x7f18200769f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:59.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.110+0000 7f1849800640 1 --2- 172.21.15.131:0/3433956802 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1844144370 0x7f184406f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:59.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.110+0000 7f1849800640 1 --2- 172.21.15.131:0/3433956802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18441620b0 0x7f184406f6c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:59.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.110+0000 7f1849800640 1 --2- 172.21.15.131:0/3433956802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f184406c5c0 0x7f18441f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:59.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.110+0000 7f1849800640 1 -- 172.21.15.131:0/3433956802 >> 172.21.15.131:0/3433956802 conn(0x7f18440d1720 msgr2=0x7f184415d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:59.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.110+0000 7f1849800640 1 -- 172.21.15.131:0/3433956802 shutdown_connections 2024-04-25T19:23:59.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.110+0000 7f1849800640 1 -- 172.21.15.131:0/3433956802 wait complete. 2024-04-25T19:23:59.138 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:23:59.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.408+0000 7ff126800640 1 Processor -- start 2024-04-25T19:23:59.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.408+0000 7ff126800640 1 -- start start 2024-04-25T19:23:59.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.410+0000 7ff126800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff12006c5c0 0x7ff1200cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:59.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.410+0000 7ff126800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff1200b4ea0 0x7ff12015e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:59.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.410+0000 7ff126800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1200d1230 con 0x7ff120144370 2024-04-25T19:23:59.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.410+0000 7ff126800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ff1200d06b0 con 0x7ff12006c5c0 2024-04-25T19:23:59.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.410+0000 7ff126800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7ff1200d0990 con 0x7ff1200b4ea0 2024-04-25T19:23:59.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.411+0000 7ff125400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff12006c5c0 0x7ff1200cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:59.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.411+0000 7ff125400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff12006c5c0 0x7ff1200cfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38012/0 (socket says 172.21.15.131:38012) 2024-04-25T19:23:59.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.411+0000 7ff124a00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7ff120144370 0x7ff1200b4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53644/0 (socket says 172.21.15.131:53644) 2024-04-25T19:23:59.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.411+0000 7ff125400640 1 -- 172.21.15.131:0/2615518673 learned_addr learned my addr 172.21.15.131:0/2615518673 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:59.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.411+0000 7ff125400640 1 -- 172.21.15.131:0/2615518673 >> v2:172.21.15.195:3300/0 conn(0x7ff1200b4ea0 msgr2=0x7ff12015e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:59.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.411+0000 7ff125400640 1 --2- 172.21.15.131:0/2615518673 >> v2:172.21.15.195:3300/0 conn(0x7ff1200b4ea0 0x7ff12015e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:59.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.411+0000 7ff125400640 1 -- 172.21.15.131:0/2615518673 >> v1:172.21.15.131:6789/0 conn(0x7ff120144370 legacy=0x7ff1200b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:59.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.411+0000 7ff11fe00640 1 -- 172.21.15.131:0/2615518673 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 625398350 0 0) 0x7ff1200d1230 con 0x7ff120144370 2024-04-25T19:23:59.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.411+0000 7ff125400640 1 -- 172.21.15.131:0/2615518673 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1200d0c70 con 0x7ff12006c5c0 2024-04-25T19:23:59.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.412+0000 7ff125400640 1 --2- 172.21.15.131:0/2615518673 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff12006c5c0 0x7ff1200cfa70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff1200d26c0 tx=0x7ff11402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a48a21ca3fbb11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:59.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.412+0000 7ff11fe00640 1 -- 172.21.15.131:0/2615518673 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff114037070 con 0x7ff12006c5c0 2024-04-25T19:23:59.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.412+0000 7ff11fe00640 1 -- 172.21.15.131:0/2615518673 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff114032440 con 0x7ff12006c5c0 2024-04-25T19:23:59.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.413+0000 7ff11fe00640 1 -- 172.21.15.131:0/2615518673 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff114032810 con 0x7ff12006c5c0 2024-04-25T19:23:59.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.413+0000 7ff126800640 1 -- 172.21.15.131:0/2615518673 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff12006c5c0 msgr2=0x7ff1200cfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:59.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.413+0000 7ff126800640 1 --2- 172.21.15.131:0/2615518673 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff12006c5c0 0x7ff1200cfa70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff1200d26c0 tx=0x7ff11402a270 comp rx=0 tx=0).stop 2024-04-25T19:23:59.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.413+0000 7ff126800640 1 -- 172.21.15.131:0/2615518673 shutdown_connections 2024-04-25T19:23:59.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.413+0000 7ff126800640 1 --2- 172.21.15.131:0/2615518673 >> v2:172.21.15.195:3300/0 conn(0x7ff1200b4ea0 0x7ff12015e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:59.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.413+0000 7ff126800640 1 --2- 172.21.15.131:0/2615518673 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff12006c5c0 0x7ff1200cfa70 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:59.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.413+0000 7ff126800640 1 -- 172.21.15.131:0/2615518673 >> 172.21.15.131:0/2615518673 conn(0x7ff1200d1720 msgr2=0x7ff1200d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:59.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.413+0000 7ff126800640 1 -- 172.21.15.131:0/2615518673 shutdown_connections 2024-04-25T19:23:59.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.413+0000 7ff126800640 1 -- 172.21.15.131:0/2615518673 wait complete. 2024-04-25T19:23:59.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.416+0000 7ff126800640 1 Processor -- start 2024-04-25T19:23:59.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.416+0000 7ff126800640 1 -- start start 2024-04-25T19:23:59.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.417+0000 7ff126800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff12006c5c0 0x7ff12015f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:59.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.417+0000 7ff126800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff120144370 0x7ff120141100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:59.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.417+0000 7ff126800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1201457d0 0x7ff120145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:59.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.417+0000 7ff126800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff1200d0450 con 0x7ff12006c5c0 2024-04-25T19:23:59.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.417+0000 7ff126800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff1200d02d0 con 0x7ff1201457d0 2024-04-25T19:23:59.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.417+0000 7ff126800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff120147760 con 0x7ff120144370 2024-04-25T19:23:59.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.418+0000 7ff125400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff12006c5c0 0x7ff12015f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:59.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.418+0000 7ff125400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff12006c5c0 0x7ff12015f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38016/0 (socket says 172.21.15.131:38016) 2024-04-25T19:23:59.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.418+0000 7ff125400640 1 -- 172.21.15.131:0/3959519021 learned_addr learned my addr 172.21.15.131:0/3959519021 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:59.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.418+0000 7ff125400640 1 -- 172.21.15.131:0/3959519021 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff120144370 msgr2=0x7ff120141100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:59.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.418+0000 7ff124a00640 1 --2- 172.21.15.131:0/3959519021 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff120144370 0x7ff120141100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:59.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.418+0000 7ff125e00640 1 --2- 172.21.15.131:0/3959519021 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1201457d0 0x7ff120145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:59.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.418+0000 7ff125400640 1 --2- 172.21.15.131:0/3959519021 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff120144370 0x7ff120141100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:59.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.418+0000 7ff125400640 1 -- 172.21.15.131:0/3959519021 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1201457d0 msgr2=0x7ff120145be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:59.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.418+0000 7ff125400640 1 --2- 172.21.15.131:0/3959519021 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1201457d0 0x7ff120145be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:59.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.418+0000 7ff125400640 1 -- 172.21.15.131:0/3959519021 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff12015fe50 con 0x7ff12006c5c0 2024-04-25T19:23:59.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.418+0000 7ff125400640 1 --2- 172.21.15.131:0/3959519021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff12006c5c0 0x7ff12015f910 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff114035040 tx=0x7ff1140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:59.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.419+0000 7ff11d600640 1 -- 172.21.15.131:0/3959519021 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff114037040 con 0x7ff12006c5c0 2024-04-25T19:23:59.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.419+0000 7ff11d600640 1 -- 172.21.15.131:0/3959519021 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff114004030 con 0x7ff12006c5c0 2024-04-25T19:23:59.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.419+0000 7ff11d600640 1 -- 172.21.15.131:0/3959519021 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff114004420 con 0x7ff12006c5c0 2024-04-25T19:23:59.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.419+0000 7ff126800640 1 -- 172.21.15.131:0/3959519021 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff120146120 con 0x7ff12006c5c0 2024-04-25T19:23:59.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.419+0000 7ff126800640 1 -- 172.21.15.131:0/3959519021 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1201605b0 con 0x7ff12006c5c0 2024-04-25T19:23:59.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.420+0000 7ff126800640 1 -- 172.21.15.131:0/3959519021 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff120050740 con 0x7ff12006c5c0 2024-04-25T19:23:59.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.421+0000 7ff11d600640 1 -- 172.21.15.131:0/3959519021 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff11403a040 con 0x7ff12006c5c0 2024-04-25T19:23:59.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.423+0000 7ff11d600640 1 --2- 172.21.15.131:0/3959519021 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff1000744b0 0x7ff1000769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:59.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.423+0000 7ff11d600640 1 -- 172.21.15.131:0/3959519021 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7ff1140b5970 con 0x7ff12006c5c0 2024-04-25T19:23:59.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.423+0000 7ff124a00640 1 --2- 172.21.15.131:0/3959519021 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff1000744b0 0x7ff1000769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.424+0000 7ff124a00640 1 --2- 172.21.15.131:0/3959519021 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff1000744b0 0x7ff1000769c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff120143d00 tx=0x7ff10c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.428+0000 7ff11d600640 1 -- 172.21.15.131:0/3959519021 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff114042020 con 0x7ff12006c5c0 2024-04-25T19:23:59.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.651+0000 7ff126800640 1 -- 172.21.15.131:0/3959519021 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff12015c190 con 0x7ff12006c5c0 2024-04-25T19:23:59.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.653+0000 7ff11d600640 1 -- 172.21.15.131:0/3959519021 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5193 (secure 0 0 0) 0x7ff114080110 con 0x7ff12006c5c0 2024-04-25T19:23:59.653 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:23:59.654 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3675320819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3675320819},{"type":"v1","addr":"172.21.15.131:6834","nonce":3675320819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/2332391948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":2332391948},{"type":"v1","addr":"172.21.15.195:6835","nonce":2332391948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4726,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2008890338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2008890338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2008890338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T19:23:34.379246+0000","modified":"2024-04-25T19:23:37.485292+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4729":{"gid":4729,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6837/2364484867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2364484867},{"type":"v1","addr":"172.21.15.195:6837","nonce":2364484867}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4729,"qdb_cluster":[4729]},"id":2}]} 2024-04-25T19:23:59.654 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 16 2024-04-25T19:23:59.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.655+0000 7ff126800640 1 -- 172.21.15.131:0/3959519021 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff1000744b0 msgr2=0x7ff1000769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:59.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.655+0000 7ff126800640 1 --2- 172.21.15.131:0/3959519021 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff1000744b0 0x7ff1000769c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff120143d00 tx=0x7ff10c009040 comp rx=0 tx=0).stop 2024-04-25T19:23:59.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.655+0000 7ff126800640 1 -- 172.21.15.131:0/3959519021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff12006c5c0 msgr2=0x7ff12015f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:59.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.655+0000 7ff126800640 1 --2- 172.21.15.131:0/3959519021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff12006c5c0 0x7ff12015f910 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff114035040 tx=0x7ff1140046c0 comp rx=0 tx=0).stop 2024-04-25T19:23:59.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.655+0000 7ff126800640 1 -- 172.21.15.131:0/3959519021 shutdown_connections 2024-04-25T19:23:59.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.655+0000 7ff126800640 1 --2- 172.21.15.131:0/3959519021 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff1000744b0 0x7ff1000769c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:59.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.655+0000 7ff126800640 1 --2- 172.21.15.131:0/3959519021 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff120144370 0x7ff120141100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:59.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.655+0000 7ff126800640 1 --2- 172.21.15.131:0/3959519021 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1201457d0 0x7ff120145be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:59.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.655+0000 7ff126800640 1 --2- 172.21.15.131:0/3959519021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff12006c5c0 0x7ff12015f910 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:59.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.655+0000 7ff126800640 1 -- 172.21.15.131:0/3959519021 >> 172.21.15.131:0/3959519021 conn(0x7ff1200d1720 msgr2=0x7ff120073550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:59.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.656+0000 7ff126800640 1 -- 172.21.15.131:0/3959519021 shutdown_connections 2024-04-25T19:23:59.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.656+0000 7ff126800640 1 -- 172.21.15.131:0/3959519021 wait complete. 2024-04-25T19:23:59.683 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:23:59.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.948+0000 7fd520200640 1 Processor -- start 2024-04-25T19:23:59.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.948+0000 7fd520200640 1 -- start start 2024-04-25T19:23:59.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.951+0000 7fd520200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd518144500 0x7fd518070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:59.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.951+0000 7fd520200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd518162310 0x7fd5180ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:59.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.951+0000 7fd520200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd51806f5f0 con 0x7fd5180cdb90 2024-04-25T19:23:59.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.951+0000 7fd520200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd518070200 con 0x7fd518144500 2024-04-25T19:23:59.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.951+0000 7fd520200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd51806f8d0 con 0x7fd518162310 2024-04-25T19:23:59.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.951+0000 7fd51d800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd518144500 0x7fd518070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:59.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.952+0000 7fd51d800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd518144500 0x7fd518070690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.131:59654/0 (socket says 172.21.15.131:59654) 2024-04-25T19:23:59.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.952+0000 7fd51d800640 1 -- 172.21.15.131:0/1748289476 learned_addr learned my addr 172.21.15.131:0/1748289476 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:59.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.952+0000 7fd51e200640 1 --2- 172.21.15.131:0/1748289476 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd518162310 0x7fd5180ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:59.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.952+0000 7fd51d800640 1 -- 172.21.15.131:0/1748289476 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd518162310 msgr2=0x7fd5180ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:23:59.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.952+0000 7fd51d800640 1 --2- 172.21.15.131:0/1748289476 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd518162310 0x7fd5180ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:59.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.952+0000 7fd51d800640 1 -- 172.21.15.131:0/1748289476 >> v1:172.21.15.195:6789/0 conn(0x7fd5180cdb90 legacy=0x7fd518161c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:59.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.952+0000 7fd51d800640 1 -- 172.21.15.131:0/1748289476 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd51806fbb0 con 0x7fd518144500 2024-04-25T19:23:59.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.954+0000 7fd51d800640 1 --2- 172.21.15.131:0/1748289476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd518144500 0x7fd518070690 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009870 tx=0x7fd50c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1137dba40f8abcb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:59.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.955+0000 7fd517e00640 1 -- 172.21.15.131:0/1748289476 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c037070 con 0x7fd518144500 2024-04-25T19:23:59.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.955+0000 7fd517e00640 1 -- 172.21.15.131:0/1748289476 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd50c032440 con 0x7fd518144500 2024-04-25T19:23:59.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.955+0000 7fd517e00640 1 -- 172.21.15.131:0/1748289476 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c032810 con 0x7fd518144500 2024-04-25T19:23:59.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.955+0000 7fd520200640 1 -- 172.21.15.131:0/1748289476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd518144500 msgr2=0x7fd518070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:59.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.955+0000 7fd520200640 1 --2- 172.21.15.131:0/1748289476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd518144500 0x7fd518070690 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009870 tx=0x7fd50c02a270 comp rx=0 tx=0).stop 2024-04-25T19:23:59.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.956+0000 7fd520200640 1 -- 172.21.15.131:0/1748289476 shutdown_connections 2024-04-25T19:23:59.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.956+0000 7fd520200640 1 --2- 172.21.15.131:0/1748289476 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd518162310 0x7fd5180ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:59.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.956+0000 7fd520200640 1 --2- 172.21.15.131:0/1748289476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd518144500 0x7fd518070690 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:59.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.956+0000 7fd520200640 1 -- 172.21.15.131:0/1748289476 >> 172.21.15.131:0/1748289476 conn(0x7fd518073050 msgr2=0x7fd518073460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:23:59.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.956+0000 7fd520200640 1 -- 172.21.15.131:0/1748289476 shutdown_connections 2024-04-25T19:23:59.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.956+0000 7fd520200640 1 -- 172.21.15.131:0/1748289476 wait complete. 2024-04-25T19:23:59.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.958+0000 7fd520200640 1 Processor -- start 2024-04-25T19:23:59.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.958+0000 7fd520200640 1 -- start start 2024-04-25T19:23:59.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.960+0000 7fd520200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5180cdb90 0x7fd5180cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:59.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.960+0000 7fd520200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd518144500 0x7fd5180b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:59.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.960+0000 7fd520200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd518143720 0x7fd518154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:59.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.960+0000 7fd520200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd51806f2e0 con 0x7fd518143720 2024-04-25T19:23:59.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.960+0000 7fd520200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd51806f160 con 0x7fd5180cdb90 2024-04-25T19:23:59.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.960+0000 7fd520200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd5180cdfa0 con 0x7fd518144500 2024-04-25T19:23:59.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.960+0000 7fd51e200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd518143720 0x7fd518154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:59.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.960+0000 7fd51e200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd518143720 0x7fd518154d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38030/0 (socket says 172.21.15.131:38030) 2024-04-25T19:23:59.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.960+0000 7fd51e200640 1 -- 172.21.15.131:0/3299286182 learned_addr learned my addr 172.21.15.131:0/3299286182 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:23:59.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.961+0000 7fd51d800640 1 --2- 172.21.15.131:0/3299286182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5180cdb90 0x7fd5180cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:59.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.961+0000 7fd51ce00640 1 --2- 172.21.15.131:0/3299286182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd518144500 0x7fd5180b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:59.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.961+0000 7fd51e200640 1 -- 172.21.15.131:0/3299286182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd518144500 msgr2=0x7fd5180b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:59.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.961+0000 7fd51e200640 1 --2- 172.21.15.131:0/3299286182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd518144500 0x7fd5180b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:59.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.961+0000 7fd51e200640 1 -- 172.21.15.131:0/3299286182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5180cdb90 msgr2=0x7fd5180cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:23:59.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.961+0000 7fd51e200640 1 --2- 172.21.15.131:0/3299286182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5180cdb90 0x7fd5180cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:23:59.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.961+0000 7fd51e200640 1 -- 172.21.15.131:0/3299286182 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5180cbde0 con 0x7fd518143720 2024-04-25T19:23:59.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.961+0000 7fd51e200640 1 --2- 172.21.15.131:0/3299286182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd518143720 0x7fd518154d00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd510009cb0 tx=0x7fd51000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:59.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.961+0000 7fd515600640 1 -- 172.21.15.131:0/3299286182 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd510018020 con 0x7fd518143720 2024-04-25T19:23:59.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.961+0000 7fd515600640 1 -- 172.21.15.131:0/3299286182 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd510014480 con 0x7fd518143720 2024-04-25T19:23:59.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.961+0000 7fd520200640 1 -- 172.21.15.131:0/3299286182 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5180b57d0 con 0x7fd518143720 2024-04-25T19:23:59.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.961+0000 7fd515600640 1 -- 172.21.15.131:0/3299286182 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd510014870 con 0x7fd518143720 2024-04-25T19:23:59.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.962+0000 7fd520200640 1 -- 172.21.15.131:0/3299286182 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5180cadc0 con 0x7fd518143720 2024-04-25T19:23:59.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.963+0000 7fd520200640 1 -- 172.21.15.131:0/3299286182 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5180b5540 con 0x7fd518143720 2024-04-25T19:23:59.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.964+0000 7fd515600640 1 -- 172.21.15.131:0/3299286182 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd510005d10 con 0x7fd518143720 2024-04-25T19:23:59.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.965+0000 7fd515600640 1 --2- 172.21.15.131:0/3299286182 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd4fc0744b0 0x7fd4fc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:23:59.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.966+0000 7fd515600640 1 -- 172.21.15.131:0/3299286182 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fd510095ed0 con 0x7fd518143720 2024-04-25T19:23:59.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.966+0000 7fd51d800640 1 --2- 172.21.15.131:0/3299286182 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd4fc0744b0 0x7fd4fc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:23:59.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.967+0000 7fd51d800640 1 --2- 172.21.15.131:0/3299286182 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd4fc0744b0 0x7fd4fc0769c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd50c034000 tx=0x7fd50c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:23:59.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:23:59.970+0000 7fd515600640 1 -- 172.21.15.131:0/3299286182 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd510022030 con 0x7fd518143720 2024-04-25T19:24:00.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.155+0000 7fd520200640 1 -- 172.21.15.131:0/3299286182 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5180cca00 con 0x7fd518143720 2024-04-25T19:24:00.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.158+0000 7fd515600640 1 -- 172.21.15.131:0/3299286182 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16693 (secure 0 0 0) 0x7fd510010040 con 0x7fd518143720 2024-04-25T19:24:00.159 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:24:00.160 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":33,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:23:35.859003+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:23:32.719018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T19:23:33.342898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:24:00.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.161+0000 7fd520200640 1 -- 172.21.15.131:0/3299286182 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd4fc0744b0 msgr2=0x7fd4fc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:00.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.161+0000 7fd520200640 1 --2- 172.21.15.131:0/3299286182 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd4fc0744b0 0x7fd4fc0769c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd50c034000 tx=0x7fd50c02e000 comp rx=0 tx=0).stop 2024-04-25T19:24:00.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.161+0000 7fd520200640 1 -- 172.21.15.131:0/3299286182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd518143720 msgr2=0x7fd518154d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:00.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.161+0000 7fd520200640 1 --2- 172.21.15.131:0/3299286182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd518143720 0x7fd518154d00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd510009cb0 tx=0x7fd51000c490 comp rx=0 tx=0).stop 2024-04-25T19:24:00.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.161+0000 7fd520200640 1 -- 172.21.15.131:0/3299286182 shutdown_connections 2024-04-25T19:24:00.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.161+0000 7fd520200640 1 --2- 172.21.15.131:0/3299286182 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd4fc0744b0 0x7fd4fc0769c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:00.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.161+0000 7fd520200640 1 --2- 172.21.15.131:0/3299286182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd518144500 0x7fd5180b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:00.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.161+0000 7fd520200640 1 --2- 172.21.15.131:0/3299286182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd518143720 0x7fd518154d00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:00.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.161+0000 7fd520200640 1 --2- 172.21.15.131:0/3299286182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5180cdb90 0x7fd5180cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:00.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.161+0000 7fd520200640 1 -- 172.21.15.131:0/3299286182 >> 172.21.15.131:0/3299286182 conn(0x7fd518073050 msgr2=0x7fd51815ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:00.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.161+0000 7fd520200640 1 -- 172.21.15.131:0/3299286182 shutdown_connections 2024-04-25T19:24:00.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.161+0000 7fd520200640 1 -- 172.21.15.131:0/3299286182 wait complete. 2024-04-25T19:24:00.189 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T19:24:00.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.448+0000 7fa67e400640 1 Processor -- start 2024-04-25T19:24:00.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.449+0000 7fa67e400640 1 -- start start 2024-04-25T19:24:00.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.451+0000 7fa67e400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa678145e70 0x7fa678168e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:00.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.451+0000 7fa67e400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67806fc70 con 0x7fa6780d1070 2024-04-25T19:24:00.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.451+0000 7fa67e400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67806ff50 con 0x7fa678144350 2024-04-25T19:24:00.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.451+0000 7fa67e400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa678070230 con 0x7fa678145e70 2024-04-25T19:24:00.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.451+0000 7fa66fe00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fa6780d1070 0x7fa678162200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53658/0 (socket says 172.21.15.131:53658) 2024-04-25T19:24:00.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.451+0000 7fa66fe00640 1 -- 172.21.15.131:0/3521179662 learned_addr learned my addr 172.21.15.131:0/3521179662 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:24:00.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.451+0000 7fa677e00640 1 -- 172.21.15.131:0/3521179662 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3127129719 0 0) 0x7fa67806fc70 con 0x7fa6780d1070 2024-04-25T19:24:00.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.452+0000 7fa677e00640 1 -- 172.21.15.131:0/3521179662 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa65c003520 con 0x7fa6780d1070 2024-04-25T19:24:00.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.452+0000 7fa67da00640 1 --2- 172.21.15.131:0/3521179662 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa678145e70 0x7fa678168e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:00.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.452+0000 7fa677e00640 1 -- 172.21.15.131:0/3521179662 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3685901918 0 0) 0x7fa65c003520 con 0x7fa6780d1070 2024-04-25T19:24:00.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.452+0000 7fa677e00640 1 -- 172.21.15.131:0/3521179662 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa678145e70 msgr2=0x7fa678168e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:00.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.452+0000 7fa677e00640 1 --2- 172.21.15.131:0/3521179662 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa678145e70 0x7fa678168e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:00.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.452+0000 7fa677e00640 1 -- 172.21.15.131:0/3521179662 >> v1:172.21.15.195:6789/0 conn(0x7fa678144350 legacy=0x7fa678161af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:00.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.452+0000 7fa677e00640 1 -- 172.21.15.131:0/3521179662 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa678070510 con 0x7fa6780d1070 2024-04-25T19:24:00.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.452+0000 7fa677e00640 1 -- 172.21.15.131:0/3521179662 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7fa660001690 con 0x7fa6780d1070 2024-04-25T19:24:00.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.452+0000 7fa677e00640 1 -- 172.21.15.131:0/3521179662 >> v1:172.21.15.131:6789/0 conn(0x7fa6780d1070 legacy=0x7fa678162200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:00.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.452+0000 7fa677e00640 1 --2- 172.21.15.131:0/3521179662 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa678145e70 0x7fa65c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:00.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.452+0000 7fa677e00640 1 --2- 172.21.15.131:0/3521179662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa65c003fb0 0x7fa65c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:00.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.452+0000 7fa677e00640 1 --2- 172.21.15.131:0/3521179662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa65c004d40 0x7fa65c0051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:00.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.452+0000 7fa677e00640 1 -- 172.21.15.131:0/3521179662 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa678070230 con 0x7fa65c004d40 2024-04-25T19:24:00.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.452+0000 7fa677e00640 1 -- 172.21.15.131:0/3521179662 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa65c00bbb0 con 0x7fa65c003fb0 2024-04-25T19:24:00.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.452+0000 7fa677e00640 1 -- 172.21.15.131:0/3521179662 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa65c00bdb0 con 0x7fa678145e70 2024-04-25T19:24:00.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.453+0000 7fa67da00640 1 --2- 172.21.15.131:0/3521179662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa65c004d40 0x7fa65c0051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:00.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.453+0000 7fa66fe00640 1 --2- 172.21.15.131:0/3521179662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa65c003fb0 0x7fa65c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:00.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.453+0000 7fa67d000640 1 --2- 172.21.15.131:0/3521179662 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa678145e70 0x7fa65c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:00.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.453+0000 7fa67da00640 1 -- 172.21.15.131:0/3521179662 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa678145e70 msgr2=0x7fa65c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:00.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.453+0000 7fa67da00640 1 --2- 172.21.15.131:0/3521179662 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa678145e70 0x7fa65c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:00.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.453+0000 7fa67da00640 1 -- 172.21.15.131:0/3521179662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa65c003fb0 msgr2=0x7fa65c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:00.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.453+0000 7fa67da00640 1 --2- 172.21.15.131:0/3521179662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa65c003fb0 0x7fa65c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:00.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.453+0000 7fa67da00640 1 -- 172.21.15.131:0/3521179662 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa65c003520 con 0x7fa65c004d40 2024-04-25T19:24:00.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.453+0000 7fa67d000640 1 --2- 172.21.15.131:0/3521179662 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa678145e70 0x7fa65c0039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:24:00.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.454+0000 7fa67da00640 1 --2- 172.21.15.131:0/3521179662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa65c004d40 0x7fa65c0051b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa678072e90 tx=0x7fa65c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878be9b7470c8a7a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:00.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.454+0000 7fa677e00640 1 -- 172.21.15.131:0/3521179662 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa670037070 con 0x7fa65c004d40 2024-04-25T19:24:00.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.454+0000 7fa677e00640 1 -- 172.21.15.131:0/3521179662 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6700325f0 con 0x7fa65c004d40 2024-04-25T19:24:00.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.454+0000 7fa677e00640 1 -- 172.21.15.131:0/3521179662 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa670009c10 con 0x7fa65c004d40 2024-04-25T19:24:00.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.455+0000 7fa67e400640 1 -- 172.21.15.131:0/3521179662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa65c004d40 msgr2=0x7fa65c0051b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:00.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.455+0000 7fa67e400640 1 --2- 172.21.15.131:0/3521179662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa65c004d40 0x7fa65c0051b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa678072e90 tx=0x7fa65c005830 comp rx=0 tx=0).stop 2024-04-25T19:24:00.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.455+0000 7fa67da00640 1 -- 172.21.15.131:0/3521179662 reap_dead start 2024-04-25T19:24:00.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.455+0000 7fa67e400640 1 -- 172.21.15.131:0/3521179662 shutdown_connections 2024-04-25T19:24:00.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.455+0000 7fa67e400640 1 -- 172.21.15.131:0/3521179662 >> 172.21.15.131:0/3521179662 conn(0x7fa6780d1720 msgr2=0x7fa6780d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:00.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.455+0000 7fa67e400640 1 -- 172.21.15.131:0/3521179662 shutdown_connections 2024-04-25T19:24:00.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.455+0000 7fa67e400640 1 -- 172.21.15.131:0/3521179662 wait complete. 2024-04-25T19:24:00.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.457+0000 7fa67e400640 1 Processor -- start 2024-04-25T19:24:00.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.457+0000 7fa67e400640 1 -- start start 2024-04-25T19:24:00.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.459+0000 7fa67e400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa67814f740 0x7fa67813da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:00.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.459+0000 7fa67e400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa67813df80 0x7fa67815e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:00.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.459+0000 7fa67e400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa67815ea70 0x7fa6781f78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:00.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.459+0000 7fa67e400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa678166e70 con 0x7fa67814f740 2024-04-25T19:24:00.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.459+0000 7fa67e400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa678147910 con 0x7fa67813df80 2024-04-25T19:24:00.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.459+0000 7fa67e400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa678166ff0 con 0x7fa67815ea70 2024-04-25T19:24:00.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.459+0000 7fa67d000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa67814f740 0x7fa67813da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:00.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.459+0000 7fa67d000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa67814f740 0x7fa67813da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38050/0 (socket says 172.21.15.131:38050) 2024-04-25T19:24:00.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.459+0000 7fa67d000640 1 -- 172.21.15.131:0/4176521403 learned_addr learned my addr 172.21.15.131:0/4176521403 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:00.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.460+0000 7fa67d000640 1 -- 172.21.15.131:0/4176521403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa67815ea70 msgr2=0x7fa6781f78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:00.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.460+0000 7fa67da00640 1 --2- 172.21.15.131:0/4176521403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa67815ea70 0x7fa6781f78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:00.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.460+0000 7fa67d000640 1 --2- 172.21.15.131:0/4176521403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa67815ea70 0x7fa6781f78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:00.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.460+0000 7fa67d000640 1 -- 172.21.15.131:0/4176521403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa67813df80 msgr2=0x7fa67815e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:00.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.460+0000 7fa67d000640 1 --2- 172.21.15.131:0/4176521403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa67813df80 0x7fa67815e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:00.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.460+0000 7fa67d000640 1 -- 172.21.15.131:0/4176521403 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67815d8c0 con 0x7fa67814f740 2024-04-25T19:24:00.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.460+0000 7fa67d000640 1 --2- 172.21.15.131:0/4176521403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa67814f740 0x7fa67813da40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa66800d7a0 tx=0x7fa66800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:00.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.460+0000 7fa675600640 1 -- 172.21.15.131:0/4176521403 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa668005070 con 0x7fa67814f740 2024-04-25T19:24:00.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.460+0000 7fa675600640 1 -- 172.21.15.131:0/4176521403 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa668005210 con 0x7fa67814f740 2024-04-25T19:24:00.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.460+0000 7fa675600640 1 -- 172.21.15.131:0/4176521403 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa668007030 con 0x7fa67814f740 2024-04-25T19:24:00.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.460+0000 7fa67e400640 1 -- 172.21.15.131:0/4176521403 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa67813e390 con 0x7fa67814f740 2024-04-25T19:24:00.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.460+0000 7fa67e400640 1 -- 172.21.15.131:0/4176521403 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa67815f110 con 0x7fa67814f740 2024-04-25T19:24:00.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.461+0000 7fa67e400640 1 -- 172.21.15.131:0/4176521403 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa678050740 con 0x7fa67814f740 2024-04-25T19:24:00.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.463+0000 7fa675600640 1 -- 172.21.15.131:0/4176521403 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa66801a020 con 0x7fa67814f740 2024-04-25T19:24:00.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.463+0000 7fa675600640 1 --2- 172.21.15.131:0/4176521403 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa6540744b0 0x7fa6540769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:00.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.464+0000 7fa675600640 1 -- 172.21.15.131:0/4176521403 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fa6680949d0 con 0x7fa67814f740 2024-04-25T19:24:00.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.464+0000 7fa66fe00640 1 --2- 172.21.15.131:0/4176521403 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa6540744b0 0x7fa6540769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:00.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.465+0000 7fa66fe00640 1 --2- 172.21.15.131:0/4176521403 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa6540744b0 0x7fa6540769c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa6780726b0 tx=0x7fa660000ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:00.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.469+0000 7fa675600640 1 -- 172.21.15.131:0/4176521403 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa67813e390 con 0x7fa67814f740 2024-04-25T19:24:00.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.690+0000 7fa67e400640 1 -- 172.21.15.131:0/4176521403 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa6780741f0 con 0x7fa67814f740 2024-04-25T19:24:00.692 INFO:tasks.ceph.mon.a.smithi131.stderr:2024-04-25T19:24:00.691+0000 7f4e1e400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T19:24:00.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.695+0000 7fa675600640 1 -- 172.21.15.131:0/4176521403 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) ==== 161+0+0 (secure 0 0 0) 0x7fa67815d8c0 con 0x7fa67814f740 2024-04-25T19:24:00.696 INFO:teuthology.orchestra.run.smithi131.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T19:24:00.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.698+0000 7fa67e400640 1 -- 172.21.15.131:0/4176521403 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa6540744b0 msgr2=0x7fa6540769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:00.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.698+0000 7fa67e400640 1 --2- 172.21.15.131:0/4176521403 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa6540744b0 0x7fa6540769c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa6780726b0 tx=0x7fa660000ed0 comp rx=0 tx=0).stop 2024-04-25T19:24:00.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.698+0000 7fa67e400640 1 -- 172.21.15.131:0/4176521403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa67814f740 msgr2=0x7fa67813da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:00.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.698+0000 7fa67e400640 1 --2- 172.21.15.131:0/4176521403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa67814f740 0x7fa67813da40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa66800d7a0 tx=0x7fa66800dc60 comp rx=0 tx=0).stop 2024-04-25T19:24:00.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.698+0000 7fa67e400640 1 -- 172.21.15.131:0/4176521403 shutdown_connections 2024-04-25T19:24:00.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.698+0000 7fa67e400640 1 --2- 172.21.15.131:0/4176521403 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa6540744b0 0x7fa6540769c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:00.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.698+0000 7fa67e400640 1 --2- 172.21.15.131:0/4176521403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa67815ea70 0x7fa6781f78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:00.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.698+0000 7fa67e400640 1 --2- 172.21.15.131:0/4176521403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa67813df80 0x7fa67815e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:00.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.698+0000 7fa67e400640 1 --2- 172.21.15.131:0/4176521403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa67814f740 0x7fa67813da40 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:00.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.698+0000 7fa67e400640 1 -- 172.21.15.131:0/4176521403 >> 172.21.15.131:0/4176521403 conn(0x7fa6780d1720 msgr2=0x7fa67813f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:00.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.698+0000 7fa67e400640 1 -- 172.21.15.131:0/4176521403 shutdown_connections 2024-04-25T19:24:00.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.698+0000 7fa67e400640 1 -- 172.21.15.131:0/4176521403 wait complete. 2024-04-25T19:24:00.724 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T19:24:00.736 INFO:tasks.ceph.mds.d.smithi195.stderr: -6143> 2024-04-25T19:23:37.609+0000 7fd3a1c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T19:24:00.910 INFO:tasks.ceph.mds.d.smithi195.stdout:starting mds.d at 2024-04-25T19:24:00.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.987+0000 7fe81d600640 1 Processor -- start 2024-04-25T19:24:00.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.987+0000 7fe81d600640 1 -- start start 2024-04-25T19:24:00.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.989+0000 7fe81d600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8180cc070 0x7fe8180cc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:00.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.989+0000 7fe81d600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe81806d5d0 0x7fe81806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:00.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.989+0000 7fe81d600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe818070180 con 0x7fe81806fd70 2024-04-25T19:24:00.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.989+0000 7fe81d600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fe81815f4c0 con 0x7fe81806d5d0 2024-04-25T19:24:00.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.989+0000 7fe81d600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe81806df20 con 0x7fe8180cc070 2024-04-25T19:24:00.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.989+0000 7fe817400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe81806d5d0 0x7fe81806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:00.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.990+0000 7fe817400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe81806d5d0 0x7fe81806d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38062/0 (socket says 172.21.15.131:38062) 2024-04-25T19:24:00.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.990+0000 7fe817400640 1 -- 172.21.15.131:0/1282229150 learned_addr learned my addr 172.21.15.131:0/1282229150 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:00.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.990+0000 7fe816000640 1 --2- 172.21.15.131:0/1282229150 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8180cc070 0x7fe8180cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:00.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.990+0000 7fe817400640 1 -- 172.21.15.131:0/1282229150 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8180cc070 msgr2=0x7fe8180cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:00.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.990+0000 7fe817400640 1 --2- 172.21.15.131:0/1282229150 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8180cc070 0x7fe8180cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:00.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.990+0000 7fe817400640 1 -- 172.21.15.131:0/1282229150 >> v1:172.21.15.195:6789/0 conn(0x7fe81806fd70 legacy=0x7fe8181624a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:00.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.990+0000 7fe817400640 1 -- 172.21.15.131:0/1282229150 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe81815e8b0 con 0x7fe81806d5d0 2024-04-25T19:24:00.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.991+0000 7fe817400640 1 --2- 172.21.15.131:0/1282229150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe81806d5d0 0x7fe81806d9e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe810009e50 tx=0x7fe81002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e504ab2016ee944d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:00.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.991+0000 7fe815600640 1 -- 172.21.15.131:0/1282229150 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810036070 con 0x7fe81806d5d0 2024-04-25T19:24:00.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.991+0000 7fe815600640 1 -- 172.21.15.131:0/1282229150 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe810031600 con 0x7fe81806d5d0 2024-04-25T19:24:00.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.991+0000 7fe815600640 1 -- 172.21.15.131:0/1282229150 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8100319d0 con 0x7fe81806d5d0 2024-04-25T19:24:00.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.992+0000 7fe81d600640 1 -- 172.21.15.131:0/1282229150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe81806d5d0 msgr2=0x7fe81806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:00.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.992+0000 7fe81d600640 1 --2- 172.21.15.131:0/1282229150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe81806d5d0 0x7fe81806d9e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe810009e50 tx=0x7fe81002a630 comp rx=0 tx=0).stop 2024-04-25T19:24:00.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.992+0000 7fe81d600640 1 -- 172.21.15.131:0/1282229150 shutdown_connections 2024-04-25T19:24:00.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.992+0000 7fe81d600640 1 --2- 172.21.15.131:0/1282229150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe81806d5d0 0x7fe81806d9e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:00.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.992+0000 7fe81d600640 1 --2- 172.21.15.131:0/1282229150 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8180cc070 0x7fe8180cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:00.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.992+0000 7fe81d600640 1 -- 172.21.15.131:0/1282229150 >> 172.21.15.131:0/1282229150 conn(0x7fe8180b3520 msgr2=0x7fe8180b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:00.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.992+0000 7fe81d600640 1 -- 172.21.15.131:0/1282229150 shutdown_connections 2024-04-25T19:24:00.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.992+0000 7fe81d600640 1 -- 172.21.15.131:0/1282229150 wait complete. 2024-04-25T19:24:00.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.995+0000 7fe81d600640 1 Processor -- start 2024-04-25T19:24:00.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.995+0000 7fe81d600640 1 -- start start 2024-04-25T19:24:00.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.996+0000 7fe81d600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe81806d5d0 0x7fe818147090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:00.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.996+0000 7fe81d600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe81806fd70 0x7fe8180c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:00.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.996+0000 7fe81d600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8180cc070 0x7fe8180d0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:00.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.996+0000 7fe81d600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe81815f150 con 0x7fe81806fd70 2024-04-25T19:24:00.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.996+0000 7fe81d600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe81815ee70 con 0x7fe81806d5d0 2024-04-25T19:24:00.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.996+0000 7fe81d600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe81815e550 con 0x7fe8180cc070 2024-04-25T19:24:00.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.997+0000 7fe816000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe81806fd70 0x7fe8180c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:01.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.997+0000 7fe816000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe81806fd70 0x7fe8180c9a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38070/0 (socket says 172.21.15.131:38070) 2024-04-25T19:24:01.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.997+0000 7fe816000640 1 -- 172.21.15.131:0/3226385767 learned_addr learned my addr 172.21.15.131:0/3226385767 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:01.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.997+0000 7fe816a00640 1 --2- 172.21.15.131:0/3226385767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe81806d5d0 0x7fe818147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:01.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.997+0000 7fe816000640 1 -- 172.21.15.131:0/3226385767 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8180cc070 msgr2=0x7fe8180d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:01.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.997+0000 7fe816000640 1 --2- 172.21.15.131:0/3226385767 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8180cc070 0x7fe8180d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:01.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.997+0000 7fe816000640 1 -- 172.21.15.131:0/3226385767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe81806d5d0 msgr2=0x7fe818147090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:01.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.997+0000 7fe816000640 1 --2- 172.21.15.131:0/3226385767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe81806d5d0 0x7fe818147090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:01.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.997+0000 7fe816000640 1 -- 172.21.15.131:0/3226385767 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8180b45f0 con 0x7fe81806fd70 2024-04-25T19:24:01.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.997+0000 7fe816a00640 1 --2- 172.21.15.131:0/3226385767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe81806d5d0 0x7fe818147090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:24:01.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.998+0000 7fe816000640 1 --2- 172.21.15.131:0/3226385767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe81806fd70 0x7fe8180c9a30 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe80000d620 tx=0x7fe80000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:01.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.998+0000 7fe80ea00640 1 -- 172.21.15.131:0/3226385767 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8000125f0 con 0x7fe81806fd70 2024-04-25T19:24:01.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.998+0000 7fe80ea00640 1 -- 172.21.15.131:0/3226385767 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe800019070 con 0x7fe81806fd70 2024-04-25T19:24:01.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.998+0000 7fe81d600640 1 -- 172.21.15.131:0/3226385767 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8181475d0 con 0x7fe81806fd70 2024-04-25T19:24:01.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.998+0000 7fe80ea00640 1 -- 172.21.15.131:0/3226385767 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8000129d0 con 0x7fe81806fd70 2024-04-25T19:24:01.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.998+0000 7fe81d600640 1 -- 172.21.15.131:0/3226385767 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe818149cf0 con 0x7fe81806fd70 2024-04-25T19:24:01.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:00.999+0000 7fe81d600640 1 -- 172.21.15.131:0/3226385767 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe818050740 con 0x7fe81806fd70 2024-04-25T19:24:01.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:01.001+0000 7fe80ea00640 1 -- 172.21.15.131:0/3226385767 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe800012b70 con 0x7fe81806fd70 2024-04-25T19:24:01.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:01.002+0000 7fe80ea00640 1 --2- 172.21.15.131:0/3226385767 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe7f40744e0 0x7fe7f40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:01.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:01.002+0000 7fe80ea00640 1 -- 172.21.15.131:0/3226385767 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5795+0+0 (secure 0 0 0) 0x7fe800095670 con 0x7fe81806fd70 2024-04-25T19:24:01.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:01.002+0000 7fe816a00640 1 --2- 172.21.15.131:0/3226385767 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe7f40744e0 0x7fe7f40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:01.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:01.003+0000 7fe816a00640 1 --2- 172.21.15.131:0/3226385767 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe7f40744e0 0x7fe7f40769f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe8180730d0 tx=0x7fe808008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:01.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:01.007+0000 7fe80ea00640 1 -- 172.21.15.131:0/3226385767 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe80005fd90 con 0x7fe81806fd70 2024-04-25T19:24:01.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:01.249+0000 7fe81d600640 1 -- 172.21.15.131:0/3226385767 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe8180c7450 con 0x7fe81806fd70 2024-04-25T19:24:01.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:01.699+0000 7fe80ea00640 1 -- 172.21.15.131:0/3226385767 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) ==== 104+0+0 (secure 0 0 0) 0x7fe80005f690 con 0x7fe81806fd70 2024-04-25T19:24:01.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:01.703+0000 7fe81d600640 1 -- 172.21.15.131:0/3226385767 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe7f40744e0 msgr2=0x7fe7f40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:01.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:01.703+0000 7fe81d600640 1 --2- 172.21.15.131:0/3226385767 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe7f40744e0 0x7fe7f40769f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe8180730d0 tx=0x7fe808008040 comp rx=0 tx=0).stop 2024-04-25T19:24:01.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:01.703+0000 7fe81d600640 1 -- 172.21.15.131:0/3226385767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe81806fd70 msgr2=0x7fe8180c9a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:01.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:01.703+0000 7fe81d600640 1 --2- 172.21.15.131:0/3226385767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe81806fd70 0x7fe8180c9a30 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe80000d620 tx=0x7fe80000dae0 comp rx=0 tx=0).stop 2024-04-25T19:24:01.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:01.703+0000 7fe81d600640 1 -- 172.21.15.131:0/3226385767 shutdown_connections 2024-04-25T19:24:01.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:01.703+0000 7fe81d600640 1 --2- 172.21.15.131:0/3226385767 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe7f40744e0 0x7fe7f40769f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:01.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:01.703+0000 7fe81d600640 1 --2- 172.21.15.131:0/3226385767 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8180cc070 0x7fe8180d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:01.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:01.703+0000 7fe81d600640 1 --2- 172.21.15.131:0/3226385767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe81806fd70 0x7fe8180c9a30 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:01.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:01.703+0000 7fe81d600640 1 --2- 172.21.15.131:0/3226385767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe81806d5d0 0x7fe818147090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:01.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:01.703+0000 7fe81d600640 1 -- 172.21.15.131:0/3226385767 >> 172.21.15.131:0/3226385767 conn(0x7fe8180b3520 msgr2=0x7fe818160530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:01.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:01.703+0000 7fe81d600640 1 -- 172.21.15.131:0/3226385767 shutdown_connections 2024-04-25T19:24:01.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:01.703+0000 7fe81d600640 1 -- 172.21.15.131:0/3226385767 wait complete. 2024-04-25T19:24:01.735 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T19:24:02.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.005+0000 7f46afe00640 1 Processor -- start 2024-04-25T19:24:02.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.006+0000 7f46afe00640 1 -- start start 2024-04-25T19:24:02.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.008+0000 7f46afe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f46b00cd420 0x7f46b00cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:02.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.008+0000 7f46afe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46b0070b90 0x7f46b0160910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:02.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.008+0000 7f46afe00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46b015d1b0 con 0x7f46b006c5c0 2024-04-25T19:24:02.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.008+0000 7f46afe00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f46b00cbf80 con 0x7f46b00cd420 2024-04-25T19:24:02.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.008+0000 7f46afe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f46b00ce190 con 0x7f46b0070b90 2024-04-25T19:24:02.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.008+0000 7f46ae000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f46b00cd420 0x7f46b00cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:02.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.008+0000 7f46ae000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f46b00cd420 0x7f46b00cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38086/0 (socket says 172.21.15.131:38086) 2024-04-25T19:24:02.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.008+0000 7f46ae000640 1 -- 172.21.15.131:0/520845699 learned_addr learned my addr 172.21.15.131:0/520845699 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:02.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.008+0000 7f46aea00640 1 --1- 172.21.15.131:0/520845699 >> v1:172.21.15.131:6789/0 conn(0x7f46b006c5c0 0x7f46b0070480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53670/0 (socket says 172.21.15.131:53670) 2024-04-25T19:24:02.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.008+0000 7f46ae000640 1 -- 172.21.15.131:0/520845699 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46b0070b90 msgr2=0x7f46b0160910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:02.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.008+0000 7f46af400640 1 --2- 172.21.15.131:0/520845699 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46b0070b90 0x7f46b0160910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:02.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.008+0000 7f46ae000640 1 --2- 172.21.15.131:0/520845699 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46b0070b90 0x7f46b0160910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:02.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.008+0000 7f46ae000640 1 -- 172.21.15.131:0/520845699 >> v1:172.21.15.131:6789/0 conn(0x7f46b006c5c0 legacy=0x7f46b0070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:02.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.009+0000 7f46ae000640 1 -- 172.21.15.131:0/520845699 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b00d05b0 con 0x7f46b00cd420 2024-04-25T19:24:02.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.008+0000 7f46ad600640 1 -- 172.21.15.131:0/520845699 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1544023918 0 0) 0x7f46a0001110 con 0x7f46b006c5c0 2024-04-25T19:24:02.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.010+0000 7f46ae000640 1 --2- 172.21.15.131:0/520845699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46b00cd420 0x7f46b00cfec0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f469c009870 tx=0x7f469c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2ff3e7a5acf913 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:02.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.010+0000 7f46ad600640 1 -- 172.21.15.131:0/520845699 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469c037070 con 0x7f46b00cd420 2024-04-25T19:24:02.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.010+0000 7f46ad600640 1 -- 172.21.15.131:0/520845699 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f469c032440 con 0x7f46b00cd420 2024-04-25T19:24:02.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.010+0000 7f46ad600640 1 -- 172.21.15.131:0/520845699 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469c032810 con 0x7f46b00cd420 2024-04-25T19:24:02.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.011+0000 7f46afe00640 1 -- 172.21.15.131:0/520845699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46b00cd420 msgr2=0x7f46b00cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:02.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.011+0000 7f46afe00640 1 --2- 172.21.15.131:0/520845699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46b00cd420 0x7f46b00cfec0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f469c009870 tx=0x7f469c02a250 comp rx=0 tx=0).stop 2024-04-25T19:24:02.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.011+0000 7f46afe00640 1 -- 172.21.15.131:0/520845699 shutdown_connections 2024-04-25T19:24:02.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.011+0000 7f46afe00640 1 --2- 172.21.15.131:0/520845699 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46b0070b90 0x7f46b0160910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:02.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.011+0000 7f46afe00640 1 --2- 172.21.15.131:0/520845699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46b00cd420 0x7f46b00cfec0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:02.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.011+0000 7f46afe00640 1 -- 172.21.15.131:0/520845699 >> 172.21.15.131:0/520845699 conn(0x7f46b00ce3b0 msgr2=0x7f46b00ce7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:02.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.011+0000 7f46afe00640 1 -- 172.21.15.131:0/520845699 shutdown_connections 2024-04-25T19:24:02.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.011+0000 7f46afe00640 1 -- 172.21.15.131:0/520845699 wait complete. 2024-04-25T19:24:02.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.013+0000 7f46afe00640 1 Processor -- start 2024-04-25T19:24:02.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.013+0000 7f46afe00640 1 -- start start 2024-04-25T19:24:02.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.015+0000 7f46afe00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46b006c5c0 0x7f46b00a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:02.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.015+0000 7f46afe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46b0070b90 0x7f46b01e58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:02.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.015+0000 7f46afe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46b00cd420 0x7f46b01f67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:02.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.015+0000 7f46afe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f46b00d0e50 con 0x7f46b00cd420 2024-04-25T19:24:02.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.015+0000 7f46afe00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f46b00d0b70 con 0x7f46b006c5c0 2024-04-25T19:24:02.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.015+0000 7f46afe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f46b0070fa0 con 0x7f46b0070b90 2024-04-25T19:24:02.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.015+0000 7f46af400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46b00cd420 0x7f46b01f67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:02.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.015+0000 7f46af400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46b00cd420 0x7f46b01f67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38098/0 (socket says 172.21.15.131:38098) 2024-04-25T19:24:02.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.015+0000 7f46af400640 1 -- 172.21.15.131:0/1397451533 learned_addr learned my addr 172.21.15.131:0/1397451533 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:02.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.016+0000 7f46ae000640 1 --2- 172.21.15.131:0/1397451533 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46b0070b90 0x7f46b01e58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:02.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.016+0000 7f46aea00640 1 --2- 172.21.15.131:0/1397451533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46b006c5c0 0x7f46b00a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:02.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.016+0000 7f46af400640 1 -- 172.21.15.131:0/1397451533 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46b0070b90 msgr2=0x7f46b01e58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:02.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.016+0000 7f46af400640 1 --2- 172.21.15.131:0/1397451533 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46b0070b90 0x7f46b01e58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:02.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.016+0000 7f46af400640 1 -- 172.21.15.131:0/1397451533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46b006c5c0 msgr2=0x7f46b00a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:02.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.016+0000 7f46af400640 1 --2- 172.21.15.131:0/1397451533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46b006c5c0 0x7f46b00a0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:02.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.016+0000 7f46af400640 1 -- 172.21.15.131:0/1397451533 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b00a0fd0 con 0x7f46b00cd420 2024-04-25T19:24:02.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.016+0000 7f46af400640 1 --2- 172.21.15.131:0/1397451533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46b00cd420 0x7f46b01f67d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f46a800ccb0 tx=0x7f46a800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:02.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.016+0000 7f46a6a00640 1 -- 172.21.15.131:0/1397451533 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a800ce60 con 0x7f46b00cd420 2024-04-25T19:24:02.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.016+0000 7f46a6a00640 1 -- 172.21.15.131:0/1397451533 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a8003990 con 0x7f46b00cd420 2024-04-25T19:24:02.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.016+0000 7f46a6a00640 1 -- 172.21.15.131:0/1397451533 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a8003d60 con 0x7f46b00cd420 2024-04-25T19:24:02.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.016+0000 7f46afe00640 1 -- 172.21.15.131:0/1397451533 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b00a12b0 con 0x7f46b00cd420 2024-04-25T19:24:02.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.017+0000 7f46afe00640 1 -- 172.21.15.131:0/1397451533 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b00a1870 con 0x7f46b00cd420 2024-04-25T19:24:02.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.018+0000 7f46afe00640 1 -- 172.21.15.131:0/1397451533 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46b00a0d40 con 0x7f46b00cd420 2024-04-25T19:24:02.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.019+0000 7f46a6a00640 1 -- 172.21.15.131:0/1397451533 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f46a8003f00 con 0x7f46b00cd420 2024-04-25T19:24:02.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.020+0000 7f46a6a00640 1 --2- 172.21.15.131:0/1397451533 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f46900744e0 0x7f46900769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:02.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.020+0000 7f46a6a00640 1 -- 172.21.15.131:0/1397451533 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5795+0+0 (secure 0 0 0) 0x7f46a8095700 con 0x7f46b00cd420 2024-04-25T19:24:02.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.021+0000 7f46aea00640 1 --2- 172.21.15.131:0/1397451533 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f46900744e0 0x7f46900769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:02.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.022+0000 7f46aea00640 1 --2- 172.21.15.131:0/1397451533 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f46900744e0 0x7f46900769f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f46a0000f60 tx=0x7f46a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:02.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.025+0000 7f46a6a00640 1 -- 172.21.15.131:0/1397451533 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f46a8014030 con 0x7f46b00cd420 2024-04-25T19:24:02.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:02.211+0000 7f46afe00640 1 -- 172.21.15.131:0/1397451533 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f46b0076c60 con 0x7f46b00cd420 2024-04-25T19:24:03.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.051+0000 7f46a6a00640 1 -- 172.21.15.131:0/1397451533 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) ==== 181+0+0 (secure 0 0 0) 0x7f46a805fd90 con 0x7f46b00cd420 2024-04-25T19:24:03.052 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'cephfs_metadata' removed 2024-04-25T19:24:03.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.055+0000 7f46afe00640 1 -- 172.21.15.131:0/1397451533 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f46900744e0 msgr2=0x7f46900769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:03.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.055+0000 7f46afe00640 1 --2- 172.21.15.131:0/1397451533 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f46900744e0 0x7f46900769f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f46a0000f60 tx=0x7f46a0009040 comp rx=0 tx=0).stop 2024-04-25T19:24:03.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.055+0000 7f46afe00640 1 -- 172.21.15.131:0/1397451533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46b00cd420 msgr2=0x7f46b01f67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:03.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.055+0000 7f46afe00640 1 --2- 172.21.15.131:0/1397451533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46b00cd420 0x7f46b01f67d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f46a800ccb0 tx=0x7f46a800a5c0 comp rx=0 tx=0).stop 2024-04-25T19:24:03.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.055+0000 7f46afe00640 1 -- 172.21.15.131:0/1397451533 shutdown_connections 2024-04-25T19:24:03.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.055+0000 7f46afe00640 1 --2- 172.21.15.131:0/1397451533 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f46900744e0 0x7f46900769f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:03.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.055+0000 7f46afe00640 1 --2- 172.21.15.131:0/1397451533 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46b0070b90 0x7f46b01e58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:03.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.055+0000 7f46afe00640 1 --2- 172.21.15.131:0/1397451533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46b00cd420 0x7f46b01f67d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:03.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.055+0000 7f46afe00640 1 --2- 172.21.15.131:0/1397451533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46b006c5c0 0x7f46b00a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:03.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.055+0000 7f46afe00640 1 -- 172.21.15.131:0/1397451533 >> 172.21.15.131:0/1397451533 conn(0x7f46b00ce3b0 msgr2=0x7f46b01600d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:03.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.055+0000 7f46afe00640 1 -- 172.21.15.131:0/1397451533 shutdown_connections 2024-04-25T19:24:03.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.055+0000 7f46afe00640 1 -- 172.21.15.131:0/1397451533 wait complete. 2024-04-25T19:24:03.096 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T19:24:03.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.367+0000 7f260e800640 1 Processor -- start 2024-04-25T19:24:03.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.367+0000 7f260e800640 1 -- start start 2024-04-25T19:24:03.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.370+0000 7f260e800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2608076190 0x7f26080af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:03.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.370+0000 7f260e800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f260806d6e0 0x7f2608169f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:03.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.370+0000 7f260e800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26080b24d0 con 0x7f26080af8e0 2024-04-25T19:24:03.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.370+0000 7f260e800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f260806dff0 con 0x7f2608076190 2024-04-25T19:24:03.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.370+0000 7f260e800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f260809b970 con 0x7f260806d6e0 2024-04-25T19:24:03.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.370+0000 7f2606a00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f26080af8e0 0x7f260806cfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53678/0 (socket says 172.21.15.131:53678) 2024-04-25T19:24:03.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.370+0000 7f2606a00640 1 -- 172.21.15.131:0/3321276312 learned_addr learned my addr 172.21.15.131:0/3321276312 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:24:03.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.370+0000 7f2607400640 1 --2- 172.21.15.131:0/3321276312 >> v2:172.21.15.195:3300/0 conn(0x7f2608076190 0x7f26080af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:03.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.370+0000 7f2607e00640 1 --2- 172.21.15.131:0/3321276312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f260806d6e0 0x7f2608169f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:03.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.371+0000 7f2606000640 1 -- 172.21.15.131:0/3321276312 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3139853315 0 0) 0x7f26080b24d0 con 0x7f26080af8e0 2024-04-25T19:24:03.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.371+0000 7f2606000640 1 -- 172.21.15.131:0/3321276312 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25ec003520 con 0x7f26080af8e0 2024-04-25T19:24:03.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.371+0000 7f2606000640 1 -- 172.21.15.131:0/3321276312 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2748863635 0 0) 0x7f25ec003520 con 0x7f26080af8e0 2024-04-25T19:24:03.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.371+0000 7f2606000640 1 -- 172.21.15.131:0/3321276312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f260806d6e0 msgr2=0x7f2608169f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:03.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.371+0000 7f2606000640 1 --2- 172.21.15.131:0/3321276312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f260806d6e0 0x7f2608169f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:03.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.371+0000 7f2606000640 1 -- 172.21.15.131:0/3321276312 >> v2:172.21.15.195:3300/0 conn(0x7f2608076190 msgr2=0x7f26080af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:03.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.371+0000 7f2606000640 1 --2- 172.21.15.131:0/3321276312 >> v2:172.21.15.195:3300/0 conn(0x7f2608076190 0x7f26080af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:03.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.371+0000 7f2606000640 1 -- 172.21.15.131:0/3321276312 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26080b2740 con 0x7f26080af8e0 2024-04-25T19:24:03.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.371+0000 7f2606000640 1 -- 172.21.15.131:0/3321276312 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f25f0001670 con 0x7f26080af8e0 2024-04-25T19:24:03.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.371+0000 7f2606000640 1 -- 172.21.15.131:0/3321276312 >> v1:172.21.15.131:6789/0 conn(0x7f26080af8e0 legacy=0x7f260806cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:03.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.371+0000 7f2606000640 1 --2- 172.21.15.131:0/3321276312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f260806d6e0 0x7f25ec0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:03.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.371+0000 7f2606000640 1 --2- 172.21.15.131:0/3321276312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25ec003f30 0x7f25ec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:03.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.371+0000 7f2606000640 1 --2- 172.21.15.131:0/3321276312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25ec004d40 0x7f25ec005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:03.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.371+0000 7f2606000640 1 -- 172.21.15.131:0/3321276312 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f260806dff0 con 0x7f25ec004d40 2024-04-25T19:24:03.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.371+0000 7f2606000640 1 -- 172.21.15.131:0/3321276312 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f260809b970 con 0x7f25ec003f30 2024-04-25T19:24:03.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.371+0000 7f2606000640 1 -- 172.21.15.131:0/3321276312 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f25ec00bac0 con 0x7f260806d6e0 2024-04-25T19:24:03.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.371+0000 7f2607e00640 1 --2- 172.21.15.131:0/3321276312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25ec004d40 0x7f25ec005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:03.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.372+0000 7f2606a00640 1 --2- 172.21.15.131:0/3321276312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25ec003f30 0x7f25ec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:03.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.372+0000 7f2607400640 1 --2- 172.21.15.131:0/3321276312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f260806d6e0 0x7f25ec0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:03.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.372+0000 7f2607e00640 1 -- 172.21.15.131:0/3321276312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f260806d6e0 msgr2=0x7f25ec0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:03.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.372+0000 7f2607e00640 1 --2- 172.21.15.131:0/3321276312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f260806d6e0 0x7f25ec0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:03.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.372+0000 7f2607e00640 1 -- 172.21.15.131:0/3321276312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25ec003f30 msgr2=0x7f25ec004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:03.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.372+0000 7f2607e00640 1 --2- 172.21.15.131:0/3321276312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25ec003f30 0x7f25ec004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:03.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.372+0000 7f2607e00640 1 -- 172.21.15.131:0/3321276312 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25ec003520 con 0x7f25ec004d40 2024-04-25T19:24:03.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.372+0000 7f2607400640 1 --2- 172.21.15.131:0/3321276312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f260806d6e0 0x7f25ec0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:24:03.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.373+0000 7f2607e00640 1 --2- 172.21.15.131:0/3321276312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25ec004d40 0x7f25ec005150 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f25f8009a90 tx=0x7f25ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5af60bac3346e9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:03.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.373+0000 7f2606000640 1 -- 172.21.15.131:0/3321276312 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f8036070 con 0x7f25ec004d40 2024-04-25T19:24:03.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.373+0000 7f2606000640 1 -- 172.21.15.131:0/3321276312 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f8031400 con 0x7f25ec004d40 2024-04-25T19:24:03.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.373+0000 7f2606000640 1 -- 172.21.15.131:0/3321276312 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f8009690 con 0x7f25ec004d40 2024-04-25T19:24:03.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.374+0000 7f260e800640 1 -- 172.21.15.131:0/3321276312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25ec004d40 msgr2=0x7f25ec005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:03.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.374+0000 7f260e800640 1 --2- 172.21.15.131:0/3321276312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25ec004d40 0x7f25ec005150 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f25f8009a90 tx=0x7f25ec005830 comp rx=0 tx=0).stop 2024-04-25T19:24:03.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.374+0000 7f2607e00640 1 -- 172.21.15.131:0/3321276312 reap_dead start 2024-04-25T19:24:03.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.374+0000 7f260e800640 1 -- 172.21.15.131:0/3321276312 shutdown_connections 2024-04-25T19:24:03.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.374+0000 7f260e800640 1 -- 172.21.15.131:0/3321276312 >> 172.21.15.131:0/3321276312 conn(0x7f2608073b50 msgr2=0x7f26080b7670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:03.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.374+0000 7f260e800640 1 -- 172.21.15.131:0/3321276312 shutdown_connections 2024-04-25T19:24:03.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.374+0000 7f260e800640 1 -- 172.21.15.131:0/3321276312 wait complete. 2024-04-25T19:24:03.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.377+0000 7f260e800640 1 Processor -- start 2024-04-25T19:24:03.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.377+0000 7f260e800640 1 -- start start 2024-04-25T19:24:03.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.378+0000 7f260e800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25ec004d40 0x7f260815ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:03.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.378+0000 7f260e800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26081483b0 0x7f26081487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:03.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.378+0000 7f260e800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f260809f7b0 0x7f260809fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:03.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.378+0000 7f260e800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f260806ddb0 con 0x7f26081483b0 2024-04-25T19:24:03.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.378+0000 7f260e800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f260806dc30 con 0x7f260809f7b0 2024-04-25T19:24:03.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.378+0000 7f260e800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f26080b1ee0 con 0x7f25ec004d40 2024-04-25T19:24:03.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.379+0000 7f2606a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26081483b0 0x7f26081487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:03.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.379+0000 7f2606a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26081483b0 0x7f26081487c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38118/0 (socket says 172.21.15.131:38118) 2024-04-25T19:24:03.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.379+0000 7f2606a00640 1 -- 172.21.15.131:0/3351525630 learned_addr learned my addr 172.21.15.131:0/3351525630 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:03.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.379+0000 7f2607e00640 1 --2- 172.21.15.131:0/3351525630 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f260809f7b0 0x7f260809fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:03.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.379+0000 7f2606a00640 1 -- 172.21.15.131:0/3351525630 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25ec004d40 msgr2=0x7f260815ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:03.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.379+0000 7f2606a00640 1 --2- 172.21.15.131:0/3351525630 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25ec004d40 0x7f260815ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:03.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.379+0000 7f2606a00640 1 -- 172.21.15.131:0/3351525630 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f260809f7b0 msgr2=0x7f260809fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:03.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.379+0000 7f2606a00640 1 --2- 172.21.15.131:0/3351525630 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f260809f7b0 0x7f260809fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:03.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.379+0000 7f2606a00640 1 -- 172.21.15.131:0/3351525630 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26080a0100 con 0x7f26081483b0 2024-04-25T19:24:03.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.379+0000 7f2606a00640 1 --2- 172.21.15.131:0/3351525630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26081483b0 0x7f26081487c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f25f000e850 tx=0x7f25f000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:03.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.380+0000 7f25ff400640 1 -- 172.21.15.131:0/3351525630 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f000c870 con 0x7f26081483b0 2024-04-25T19:24:03.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.380+0000 7f25ff400640 1 -- 172.21.15.131:0/3351525630 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f0018070 con 0x7f26081483b0 2024-04-25T19:24:03.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.380+0000 7f260e800640 1 -- 172.21.15.131:0/3351525630 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f260815d510 con 0x7f26081483b0 2024-04-25T19:24:03.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.380+0000 7f25ff400640 1 -- 172.21.15.131:0/3351525630 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f000cc70 con 0x7f26081483b0 2024-04-25T19:24:03.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.380+0000 7f260e800640 1 -- 172.21.15.131:0/3351525630 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f260815dad0 con 0x7f26081483b0 2024-04-25T19:24:03.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.381+0000 7f260e800640 1 -- 172.21.15.131:0/3351525630 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2608050740 con 0x7f26081483b0 2024-04-25T19:24:03.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.382+0000 7f25ff400640 1 -- 172.21.15.131:0/3351525630 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f25f001d460 con 0x7f26081483b0 2024-04-25T19:24:03.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.383+0000 7f25ff400640 1 --2- 172.21.15.131:0/3351525630 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f25e40744b0 0x7f25e40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:03.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.383+0000 7f25ff400640 1 -- 172.21.15.131:0/3351525630 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5357+0+0 (secure 0 0 0) 0x7f25f0094ff0 con 0x7f26081483b0 2024-04-25T19:24:03.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.384+0000 7f2607400640 1 --2- 172.21.15.131:0/3351525630 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f25e40744b0 0x7f25e40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:03.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.385+0000 7f2607400640 1 --2- 172.21.15.131:0/3351525630 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f25e40744b0 0x7f25e40769c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2600007460 tx=0x7f2600009750 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:03.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.388+0000 7f25ff400640 1 -- 172.21.15.131:0/3351525630 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f26080a0100 con 0x7f26081483b0 2024-04-25T19:24:03.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:03.573+0000 7f260e800640 1 -- 172.21.15.131:0/3351525630 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f260815d2a0 con 0x7f26081483b0 2024-04-25T19:24:04.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.054+0000 7f25ff400640 1 -- 172.21.15.131:0/3351525630 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) ==== 169+0+0 (secure 0 0 0) 0x7f25f005f910 con 0x7f26081483b0 2024-04-25T19:24:04.056 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'cephfs_data' removed 2024-04-25T19:24:04.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.058+0000 7f260e800640 1 -- 172.21.15.131:0/3351525630 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f25e40744b0 msgr2=0x7f25e40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:04.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.058+0000 7f260e800640 1 --2- 172.21.15.131:0/3351525630 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f25e40744b0 0x7f25e40769c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2600007460 tx=0x7f2600009750 comp rx=0 tx=0).stop 2024-04-25T19:24:04.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.058+0000 7f260e800640 1 -- 172.21.15.131:0/3351525630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26081483b0 msgr2=0x7f26081487c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:04.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.058+0000 7f260e800640 1 --2- 172.21.15.131:0/3351525630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26081483b0 0x7f26081487c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f25f000e850 tx=0x7f25f000ed10 comp rx=0 tx=0).stop 2024-04-25T19:24:04.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.058+0000 7f260e800640 1 -- 172.21.15.131:0/3351525630 shutdown_connections 2024-04-25T19:24:04.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.058+0000 7f260e800640 1 --2- 172.21.15.131:0/3351525630 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f25e40744b0 0x7f25e40769c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:04.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.058+0000 7f260e800640 1 --2- 172.21.15.131:0/3351525630 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f260809f7b0 0x7f260809fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:04.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.058+0000 7f260e800640 1 --2- 172.21.15.131:0/3351525630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26081483b0 0x7f26081487c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:04.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.058+0000 7f260e800640 1 --2- 172.21.15.131:0/3351525630 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25ec004d40 0x7f260815ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:04.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.058+0000 7f260e800640 1 -- 172.21.15.131:0/3351525630 >> 172.21.15.131:0/3351525630 conn(0x7f2608073b50 msgr2=0x7f2608070b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:04.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.059+0000 7f260e800640 1 -- 172.21.15.131:0/3351525630 shutdown_connections 2024-04-25T19:24:04.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.059+0000 7f260e800640 1 -- 172.21.15.131:0/3351525630 wait complete. 2024-04-25T19:24:04.091 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T19:24:04.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.343+0000 7ff1d7200640 1 Processor -- start 2024-04-25T19:24:04.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.343+0000 7ff1d7200640 1 -- start start 2024-04-25T19:24:04.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.345+0000 7ff1d7200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1d80aedb0 0x7ff1d815ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:04.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.345+0000 7ff1d7200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff1d80cea60 0x7ff1d80af490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.345+0000 7ff1d7200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1d806c810 con 0x7ff1d80ce650 2024-04-25T19:24:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.345+0000 7ff1d7200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ff1d815e330 con 0x7ff1d80cea60 2024-04-25T19:24:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.345+0000 7ff1d7200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d806c5c0 con 0x7ff1d80aedb0 2024-04-25T19:24:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.345+0000 7ff1d6800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff1d80cea60 0x7ff1d80af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.345+0000 7ff1cfe00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7ff1d80ce650 0x7ff1d806d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53684/0 (socket says 172.21.15.131:53684) 2024-04-25T19:24:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.345+0000 7ff1d6800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff1d80cea60 0x7ff1d80af490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38134/0 (socket says 172.21.15.131:38134) 2024-04-25T19:24:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.345+0000 7ff1cfe00640 1 -- 172.21.15.131:0/619184645 learned_addr learned my addr 172.21.15.131:0/619184645 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:24:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.346+0000 7ff1d5e00640 1 --2- 172.21.15.131:0/619184645 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1d80aedb0 0x7ff1d815ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.346+0000 7ff1d6800640 1 -- 172.21.15.131:0/619184645 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1d80aedb0 msgr2=0x7ff1d815ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.346+0000 7ff1d6800640 1 --2- 172.21.15.131:0/619184645 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1d80aedb0 0x7ff1d815ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.346+0000 7ff1d6800640 1 -- 172.21.15.131:0/619184645 >> v1:172.21.15.131:6789/0 conn(0x7ff1d80ce650 legacy=0x7ff1d806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.346+0000 7ff1d6800640 1 -- 172.21.15.131:0/619184645 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d806caf0 con 0x7ff1d80cea60 2024-04-25T19:24:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.346+0000 7ff1d5e00640 1 --2- 172.21.15.131:0/619184645 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1d80aedb0 0x7ff1d815ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:24:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.347+0000 7ff1d6800640 1 --2- 172.21.15.131:0/619184645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1d80cea60 0x7ff1d80af490 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0009d90 tx=0x7ff1d002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c66113cb053f3e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:04.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.347+0000 7ff1d5400640 1 -- 172.21.15.131:0/619184645 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0031600 con 0x7ff1d80cea60 2024-04-25T19:24:04.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.347+0000 7ff1d5400640 1 -- 172.21.15.131:0/619184645 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d00317a0 con 0x7ff1d80cea60 2024-04-25T19:24:04.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.347+0000 7ff1d5400640 1 -- 172.21.15.131:0/619184645 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0031b70 con 0x7ff1d80cea60 2024-04-25T19:24:04.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.348+0000 7ff1d7200640 1 -- 172.21.15.131:0/619184645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1d80cea60 msgr2=0x7ff1d80af490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:04.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.348+0000 7ff1d7200640 1 --2- 172.21.15.131:0/619184645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1d80cea60 0x7ff1d80af490 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0009d90 tx=0x7ff1d002a5d0 comp rx=0 tx=0).stop 2024-04-25T19:24:04.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.348+0000 7ff1d7200640 1 -- 172.21.15.131:0/619184645 shutdown_connections 2024-04-25T19:24:04.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.348+0000 7ff1d7200640 1 --2- 172.21.15.131:0/619184645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1d80cea60 0x7ff1d80af490 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:04.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.348+0000 7ff1d7200640 1 --2- 172.21.15.131:0/619184645 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1d80aedb0 0x7ff1d815ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:04.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.348+0000 7ff1d7200640 1 -- 172.21.15.131:0/619184645 >> 172.21.15.131:0/619184645 conn(0x7ff1d80d1d60 msgr2=0x7ff1d80d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:04.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.348+0000 7ff1d7200640 1 -- 172.21.15.131:0/619184645 shutdown_connections 2024-04-25T19:24:04.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.348+0000 7ff1d7200640 1 -- 172.21.15.131:0/619184645 wait complete. 2024-04-25T19:24:04.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.350+0000 7ff1d7200640 1 Processor -- start 2024-04-25T19:24:04.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.350+0000 7ff1d7200640 1 -- start start 2024-04-25T19:24:04.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.352+0000 7ff1d7200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1d80aedb0 0x7ff1d81592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:04.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.352+0000 7ff1d7200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1d80ce650 0x7ff1d8145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:04.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.352+0000 7ff1d7200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1d80cea60 0x7ff1d815a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:04.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.352+0000 7ff1d7200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d80cee70 con 0x7ff1d80aedb0 2024-04-25T19:24:04.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.352+0000 7ff1d7200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d806d0b0 con 0x7ff1d80ce650 2024-04-25T19:24:04.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.352+0000 7ff1d7200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d806dce0 con 0x7ff1d80cea60 2024-04-25T19:24:04.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.352+0000 7ff1d5e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1d80aedb0 0x7ff1d81592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:04.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.352+0000 7ff1d5e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1d80aedb0 0x7ff1d81592c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38148/0 (socket says 172.21.15.131:38148) 2024-04-25T19:24:04.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.352+0000 7ff1d5e00640 1 -- 172.21.15.131:0/2921808449 learned_addr learned my addr 172.21.15.131:0/2921808449 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:04.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.352+0000 7ff1d5e00640 1 -- 172.21.15.131:0/2921808449 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1d80cea60 msgr2=0x7ff1d815a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:04.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.352+0000 7ff1d5e00640 1 --2- 172.21.15.131:0/2921808449 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1d80cea60 0x7ff1d815a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:04.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.352+0000 7ff1d5e00640 1 -- 172.21.15.131:0/2921808449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1d80ce650 msgr2=0x7ff1d8145bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:04.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.352+0000 7ff1d5e00640 1 --2- 172.21.15.131:0/2921808449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1d80ce650 0x7ff1d8145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:04.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.352+0000 7ff1d5e00640 1 -- 172.21.15.131:0/2921808449 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d8158220 con 0x7ff1d80aedb0 2024-04-25T19:24:04.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.353+0000 7ff1d5e00640 1 --2- 172.21.15.131:0/2921808449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1d80aedb0 0x7ff1d81592c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff1c800c7f0 tx=0x7ff1c800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:04.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.353+0000 7ff1ce000640 1 -- 172.21.15.131:0/2921808449 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8015070 con 0x7ff1d80aedb0 2024-04-25T19:24:04.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.353+0000 7ff1ce000640 1 -- 172.21.15.131:0/2921808449 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1c8007820 con 0x7ff1d80aedb0 2024-04-25T19:24:04.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.353+0000 7ff1d7200640 1 -- 172.21.15.131:0/2921808449 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d8158500 con 0x7ff1d80aedb0 2024-04-25T19:24:04.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.353+0000 7ff1ce000640 1 -- 172.21.15.131:0/2921808449 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8007bd0 con 0x7ff1d80aedb0 2024-04-25T19:24:04.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.353+0000 7ff1d7200640 1 -- 172.21.15.131:0/2921808449 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d8158ac0 con 0x7ff1d80aedb0 2024-04-25T19:24:04.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.354+0000 7ff1d7200640 1 -- 172.21.15.131:0/2921808449 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1d8076c60 con 0x7ff1d80aedb0 2024-04-25T19:24:04.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.356+0000 7ff1ce000640 1 -- 172.21.15.131:0/2921808449 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff1c8018070 con 0x7ff1d80aedb0 2024-04-25T19:24:04.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.357+0000 7ff1ce000640 1 --2- 172.21.15.131:0/2921808449 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff1b40744b0 0x7ff1b40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:04.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.357+0000 7ff1ce000640 1 -- 172.21.15.131:0/2921808449 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7ff1c80950f0 con 0x7ff1d80aedb0 2024-04-25T19:24:04.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.357+0000 7ff1cfe00640 1 --2- 172.21.15.131:0/2921808449 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff1b40744b0 0x7ff1b40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:04.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.358+0000 7ff1cfe00640 1 --2- 172.21.15.131:0/2921808449 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff1b40744b0 0x7ff1b40769c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0000f60 tx=0x7ff1c0007a80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:04.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.361+0000 7ff1ce000640 1 -- 172.21.15.131:0/2921808449 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff1c805fae0 con 0x7ff1d80aedb0 2024-04-25T19:24:04.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.549+0000 7ff1d7200640 1 -- 172.21.15.131:0/2921808449 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7ff1d81617a0 con 0x7ff1d80aedb0 2024-04-25T19:24:04.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.557+0000 7ff1ce000640 1 -- 172.21.15.131:0/2921808449 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7ff1c805f3e0 con 0x7ff1d80aedb0 2024-04-25T19:24:04.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.560+0000 7ff1d7200640 1 -- 172.21.15.131:0/2921808449 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff1b40744b0 msgr2=0x7ff1b40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:04.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.560+0000 7ff1d7200640 1 --2- 172.21.15.131:0/2921808449 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff1b40744b0 0x7ff1b40769c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0000f60 tx=0x7ff1c0007a80 comp rx=0 tx=0).stop 2024-04-25T19:24:04.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.560+0000 7ff1d7200640 1 -- 172.21.15.131:0/2921808449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1d80aedb0 msgr2=0x7ff1d81592c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:04.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.560+0000 7ff1d7200640 1 --2- 172.21.15.131:0/2921808449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1d80aedb0 0x7ff1d81592c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff1c800c7f0 tx=0x7ff1c800ccb0 comp rx=0 tx=0).stop 2024-04-25T19:24:04.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.560+0000 7ff1d7200640 1 -- 172.21.15.131:0/2921808449 shutdown_connections 2024-04-25T19:24:04.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.560+0000 7ff1d7200640 1 --2- 172.21.15.131:0/2921808449 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff1b40744b0 0x7ff1b40769c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:04.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.560+0000 7ff1d7200640 1 --2- 172.21.15.131:0/2921808449 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1d80cea60 0x7ff1d815a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:04.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.560+0000 7ff1d7200640 1 --2- 172.21.15.131:0/2921808449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1d80ce650 0x7ff1d8145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:04.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.560+0000 7ff1d7200640 1 --2- 172.21.15.131:0/2921808449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1d80aedb0 0x7ff1d81592c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:04.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.560+0000 7ff1d7200640 1 -- 172.21.15.131:0/2921808449 >> 172.21.15.131:0/2921808449 conn(0x7ff1d80d1d60 msgr2=0x7ff1d80b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:04.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.560+0000 7ff1d7200640 1 -- 172.21.15.131:0/2921808449 shutdown_connections 2024-04-25T19:24:04.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.560+0000 7ff1d7200640 1 -- 172.21.15.131:0/2921808449 wait complete. 2024-04-25T19:24:04.584 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_dump_tree.TestDumpTree.test_basic' 2024-04-25T19:24:04.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.851+0000 7fb041400640 1 Processor -- start 2024-04-25T19:24:04.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.852+0000 7fb041400640 1 -- start start 2024-04-25T19:24:04.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.854+0000 7fb041400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb03c13fe10 0x7fb03c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:04.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.854+0000 7fb041400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb03c06db10 0x7fb03c142730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:04.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.854+0000 7fb041400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb03c06df20 con 0x7fb03c142c70 2024-04-25T19:24:04.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.854+0000 7fb041400640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fb03c15d5e0 con 0x7fb03c06db10 2024-04-25T19:24:04.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.854+0000 7fb041400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb03c15d8c0 con 0x7fb03c13fe10 2024-04-25T19:24:04.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.854+0000 7fb033400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb03c06db10 0x7fb03c142730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:04.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.854+0000 7fb033400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb03c06db10 0x7fb03c142730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38154/0 (socket says 172.21.15.131:38154) 2024-04-25T19:24:04.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.854+0000 7fb033400640 1 -- 172.21.15.131:0/2320741467 learned_addr learned my addr 172.21.15.131:0/2320741467 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:04.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.855+0000 7fb03be00640 1 --2- 172.21.15.131:0/2320741467 >> v2:172.21.15.195:3300/0 conn(0x7fb03c13fe10 0x7fb03c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:04.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.855+0000 7fb033400640 1 -- 172.21.15.131:0/2320741467 >> v2:172.21.15.195:3300/0 conn(0x7fb03c13fe10 msgr2=0x7fb03c06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:04.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.855+0000 7fb033400640 1 --2- 172.21.15.131:0/2320741467 >> v2:172.21.15.195:3300/0 conn(0x7fb03c13fe10 0x7fb03c06d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:04.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.855+0000 7fb033400640 1 -- 172.21.15.131:0/2320741467 >> v1:172.21.15.195:6789/0 conn(0x7fb03c142c70 legacy=0x7fb03c070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:04.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.855+0000 7fb033400640 1 -- 172.21.15.131:0/2320741467 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb03c15dba0 con 0x7fb03c06db10 2024-04-25T19:24:04.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.855+0000 7fb03be00640 1 --2- 172.21.15.131:0/2320741467 >> v2:172.21.15.195:3300/0 conn(0x7fb03c13fe10 0x7fb03c06d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:24:04.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.856+0000 7fb033400640 1 --2- 172.21.15.131:0/2320741467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb03c06db10 0x7fb03c142730 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb03c073c30 tx=0x7fb02402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f95e1a043c87a4ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:04.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.856+0000 7fb03b400640 1 -- 172.21.15.131:0/2320741467 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb024037070 con 0x7fb03c06db10 2024-04-25T19:24:04.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.856+0000 7fb03b400640 1 -- 172.21.15.131:0/2320741467 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb024032440 con 0x7fb03c06db10 2024-04-25T19:24:04.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.856+0000 7fb03b400640 1 -- 172.21.15.131:0/2320741467 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb024032810 con 0x7fb03c06db10 2024-04-25T19:24:04.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.857+0000 7fb041400640 1 -- 172.21.15.131:0/2320741467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb03c06db10 msgr2=0x7fb03c142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:04.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.857+0000 7fb041400640 1 --2- 172.21.15.131:0/2320741467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb03c06db10 0x7fb03c142730 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb03c073c30 tx=0x7fb02402a1a0 comp rx=0 tx=0).stop 2024-04-25T19:24:04.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.857+0000 7fb041400640 1 -- 172.21.15.131:0/2320741467 shutdown_connections 2024-04-25T19:24:04.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.857+0000 7fb041400640 1 --2- 172.21.15.131:0/2320741467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb03c06db10 0x7fb03c142730 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:04.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.857+0000 7fb041400640 1 --2- 172.21.15.131:0/2320741467 >> v2:172.21.15.195:3300/0 conn(0x7fb03c13fe10 0x7fb03c06d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:04.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.857+0000 7fb041400640 1 -- 172.21.15.131:0/2320741467 >> 172.21.15.131:0/2320741467 conn(0x7fb03c072ee0 msgr2=0x7fb03c0732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:04.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.857+0000 7fb041400640 1 -- 172.21.15.131:0/2320741467 shutdown_connections 2024-04-25T19:24:04.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.857+0000 7fb041400640 1 -- 172.21.15.131:0/2320741467 wait complete. 2024-04-25T19:24:04.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.860+0000 7fb041400640 1 Processor -- start 2024-04-25T19:24:04.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.860+0000 7fb041400640 1 -- start start 2024-04-25T19:24:04.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.861+0000 7fb041400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb03c06db10 0x7fb03c0b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:04.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.861+0000 7fb041400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb03c13fe10 0x7fb03c1442c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:04.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.861+0000 7fb041400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb03c142c70 0x7fb03c144800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:04.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.861+0000 7fb041400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb03c143080 con 0x7fb03c142c70 2024-04-25T19:24:04.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.861+0000 7fb041400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb03c15d2d0 con 0x7fb03c13fe10 2024-04-25T19:24:04.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.861+0000 7fb041400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb03c143200 con 0x7fb03c06db10 2024-04-25T19:24:04.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.861+0000 7fb040a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb03c142c70 0x7fb03c144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:04.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.862+0000 7fb040a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb03c142c70 0x7fb03c144800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38168/0 (socket says 172.21.15.131:38168) 2024-04-25T19:24:04.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.862+0000 7fb040a00640 1 -- 172.21.15.131:0/2990797113 learned_addr learned my addr 172.21.15.131:0/2990797113 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:04.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.862+0000 7fb033400640 1 --2- 172.21.15.131:0/2990797113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb03c13fe10 0x7fb03c1442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:04.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.862+0000 7fb040a00640 1 -- 172.21.15.131:0/2990797113 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb03c06db10 msgr2=0x7fb03c0b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:04.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.862+0000 7fb040a00640 1 --2- 172.21.15.131:0/2990797113 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb03c06db10 0x7fb03c0b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:04.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.862+0000 7fb040a00640 1 -- 172.21.15.131:0/2990797113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb03c13fe10 msgr2=0x7fb03c1442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:04.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.862+0000 7fb040a00640 1 --2- 172.21.15.131:0/2990797113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb03c13fe10 0x7fb03c1442c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:04.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.862+0000 7fb040a00640 1 -- 172.21.15.131:0/2990797113 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb03c0b7080 con 0x7fb03c142c70 2024-04-25T19:24:04.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.862+0000 7fb040a00640 1 --2- 172.21.15.131:0/2990797113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb03c142c70 0x7fb03c144800 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb03400b9f0 tx=0x7fb03400beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:04.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.863+0000 7fb038c00640 1 -- 172.21.15.131:0/2990797113 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb034019070 con 0x7fb03c142c70 2024-04-25T19:24:04.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.863+0000 7fb038c00640 1 -- 172.21.15.131:0/2990797113 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb03400cbd0 con 0x7fb03c142c70 2024-04-25T19:24:04.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.863+0000 7fb041400640 1 -- 172.21.15.131:0/2990797113 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb03c0b7360 con 0x7fb03c142c70 2024-04-25T19:24:04.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.863+0000 7fb038c00640 1 -- 172.21.15.131:0/2990797113 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb034014440 con 0x7fb03c142c70 2024-04-25T19:24:04.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.863+0000 7fb041400640 1 -- 172.21.15.131:0/2990797113 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb03c155df0 con 0x7fb03c142c70 2024-04-25T19:24:04.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.864+0000 7fb041400640 1 -- 172.21.15.131:0/2990797113 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb03c050740 con 0x7fb03c142c70 2024-04-25T19:24:04.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.865+0000 7fb038c00640 1 -- 172.21.15.131:0/2990797113 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb03401c070 con 0x7fb03c142c70 2024-04-25T19:24:04.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.866+0000 7fb038c00640 1 --2- 172.21.15.131:0/2990797113 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb0180744b0 0x7fb0180769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:04.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.866+0000 7fb038c00640 1 -- 172.21.15.131:0/2990797113 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fb034094bc0 con 0x7fb03c142c70 2024-04-25T19:24:04.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.867+0000 7fb03be00640 1 --2- 172.21.15.131:0/2990797113 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb0180744b0 0x7fb0180769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:04.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.868+0000 7fb03be00640 1 --2- 172.21.15.131:0/2990797113 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb0180744b0 0x7fb0180769c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb02c006fd0 tx=0x7fb02c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:04.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:04.871+0000 7fb038c00640 1 -- 172.21.15.131:0/2990797113 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb03405f750 con 0x7fb03c142c70 2024-04-25T19:24:05.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:05.140+0000 7fb041400640 1 -- 172.21.15.131:0/2990797113 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_dump_tree.TestDumpTree.test_basic"]} v 0) -- 0x7fb03c1541f0 con 0x7fb03c142c70 2024-04-25T19:24:06.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.067+0000 7fb038c00640 1 -- 172.21.15.131:0/2990797113 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_dump_tree.TestDumpTree.test_basic"]}]=0 v125) ==== 130+0+0 (secure 0 0 0) 0x7fb03405f050 con 0x7fb03c142c70 2024-04-25T19:24:06.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.072+0000 7fb041400640 1 -- 172.21.15.131:0/2990797113 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb0180744b0 msgr2=0x7fb0180769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:06.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.072+0000 7fb041400640 1 --2- 172.21.15.131:0/2990797113 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb0180744b0 0x7fb0180769c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb02c006fd0 tx=0x7fb02c008040 comp rx=0 tx=0).stop 2024-04-25T19:24:06.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.072+0000 7fb041400640 1 -- 172.21.15.131:0/2990797113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb03c142c70 msgr2=0x7fb03c144800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:06.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.072+0000 7fb041400640 1 --2- 172.21.15.131:0/2990797113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb03c142c70 0x7fb03c144800 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb03400b9f0 tx=0x7fb03400beb0 comp rx=0 tx=0).stop 2024-04-25T19:24:06.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.072+0000 7fb041400640 1 -- 172.21.15.131:0/2990797113 shutdown_connections 2024-04-25T19:24:06.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.072+0000 7fb041400640 1 --2- 172.21.15.131:0/2990797113 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb0180744b0 0x7fb0180769c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:06.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.072+0000 7fb041400640 1 --2- 172.21.15.131:0/2990797113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb03c142c70 0x7fb03c144800 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:06.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.072+0000 7fb041400640 1 --2- 172.21.15.131:0/2990797113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb03c13fe10 0x7fb03c1442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:06.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.072+0000 7fb041400640 1 --2- 172.21.15.131:0/2990797113 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb03c06db10 0x7fb03c0b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:06.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.072+0000 7fb041400640 1 -- 172.21.15.131:0/2990797113 >> 172.21.15.131:0/2990797113 conn(0x7fb03c072ee0 msgr2=0x7fb03c15ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:06.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.072+0000 7fb041400640 1 -- 172.21.15.131:0/2990797113 shutdown_connections 2024-04-25T19:24:06.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.072+0000 7fb041400640 1 -- 172.21.15.131:0/2990797113 wait complete. 2024-04-25T19:24:06.108 INFO:tasks.cephfs_test_runner:test_basic (tasks.cephfs.test_dump_tree.TestDumpTree) ... ok 2024-04-25T19:24:06.109 INFO:tasks.cephfs_test_runner:Starting test: test_random (tasks.cephfs.test_dump_tree.TestDumpTree) 2024-04-25T19:24:06.109 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:24:06.172 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:24:06.177 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:24:06.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.375+0000 7f3ddfe00640 1 Processor -- start 2024-04-25T19:24:06.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.376+0000 7f3ddfe00640 1 -- start start 2024-04-25T19:24:06.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.378+0000 7f3ddfe00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3de0071e90 0x7f3de00b6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:06.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.378+0000 7f3ddfe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3de00d06c0 0x7f3de00d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:06.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.378+0000 7f3ddfe00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de01607c0 con 0x7f3de00b6270 2024-04-25T19:24:06.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.378+0000 7f3ddfe00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f3de00b6ca0 con 0x7f3de00d06c0 2024-04-25T19:24:06.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.378+0000 7f3ddfe00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3de01613b0 con 0x7f3de0071e90 2024-04-25T19:24:06.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.378+0000 7f3ddf400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3de00d06c0 0x7f3de00d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:06.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.378+0000 7f3ddea00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f3de00b6270 0x7f3de0071780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53700/0 (socket says 172.21.15.131:53700) 2024-04-25T19:24:06.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.378+0000 7f3ddea00640 1 -- 172.21.15.131:0/913656825 learned_addr learned my addr 172.21.15.131:0/913656825 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:24:06.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.378+0000 7f3dde000640 1 --2- 172.21.15.131:0/913656825 >> v2:172.21.15.195:3300/0 conn(0x7f3de0071e90 0x7f3de00b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:06.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.378+0000 7f3ddf400640 1 -- 172.21.15.131:0/913656825 >> v2:172.21.15.195:3300/0 conn(0x7f3de0071e90 msgr2=0x7f3de00b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:06.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.378+0000 7f3ddf400640 1 --2- 172.21.15.131:0/913656825 >> v2:172.21.15.195:3300/0 conn(0x7f3de0071e90 0x7f3de00b6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:06.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.378+0000 7f3ddf400640 1 -- 172.21.15.131:0/913656825 >> v1:172.21.15.131:6789/0 conn(0x7f3de00b6270 legacy=0x7f3de0071780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:06.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.378+0000 7f3ddf400640 1 -- 172.21.15.131:0/913656825 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de0160a80 con 0x7f3de00d06c0 2024-04-25T19:24:06.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.378+0000 7f3ddd600640 1 -- 172.21.15.131:0/913656825 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 527704440 0 0) 0x7f3de01607c0 con 0x7f3de00b6270 2024-04-25T19:24:06.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.379+0000 7f3ddf400640 1 --2- 172.21.15.131:0/913656825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3de00d06c0 0x7f3de00d0ad0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3de0161530 tx=0x7f3dd802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3874d3a41a12d69d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:06.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.380+0000 7f3ddd600640 1 -- 172.21.15.131:0/913656825 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8007740 con 0x7f3de00d06c0 2024-04-25T19:24:06.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.380+0000 7f3ddd600640 1 -- 172.21.15.131:0/913656825 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dd80078e0 con 0x7f3de00d06c0 2024-04-25T19:24:06.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.380+0000 7f3ddd600640 1 -- 172.21.15.131:0/913656825 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8007cb0 con 0x7f3de00d06c0 2024-04-25T19:24:06.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.380+0000 7f3ddfe00640 1 -- 172.21.15.131:0/913656825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3de00d06c0 msgr2=0x7f3de00d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:06.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.380+0000 7f3ddfe00640 1 --2- 172.21.15.131:0/913656825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3de00d06c0 0x7f3de00d0ad0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3de0161530 tx=0x7f3dd802a660 comp rx=0 tx=0).stop 2024-04-25T19:24:06.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.381+0000 7f3ddfe00640 1 -- 172.21.15.131:0/913656825 shutdown_connections 2024-04-25T19:24:06.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.381+0000 7f3ddfe00640 1 --2- 172.21.15.131:0/913656825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3de00d06c0 0x7f3de00d0ad0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:06.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.381+0000 7f3ddfe00640 1 --2- 172.21.15.131:0/913656825 >> v2:172.21.15.195:3300/0 conn(0x7f3de0071e90 0x7f3de00b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:06.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.381+0000 7f3ddfe00640 1 -- 172.21.15.131:0/913656825 >> 172.21.15.131:0/913656825 conn(0x7f3de0070270 msgr2=0x7f3de0070680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:06.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.381+0000 7f3ddfe00640 1 -- 172.21.15.131:0/913656825 shutdown_connections 2024-04-25T19:24:06.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.381+0000 7f3ddfe00640 1 -- 172.21.15.131:0/913656825 wait complete. 2024-04-25T19:24:06.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.383+0000 7f3ddfe00640 1 Processor -- start 2024-04-25T19:24:06.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.383+0000 7f3ddfe00640 1 -- start start 2024-04-25T19:24:06.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.385+0000 7f3ddfe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3de00b6270 0x7f3de00cc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:06.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.385+0000 7f3ddfe00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3de00d06c0 0x7f3de0148340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:06.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.385+0000 7f3ddfe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3de014e230 0x7f3de014e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:06.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.385+0000 7f3ddfe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3de00b1c20 con 0x7f3de00b6270 2024-04-25T19:24:06.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.385+0000 7f3ddfe00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3de0161040 con 0x7f3de00d06c0 2024-04-25T19:24:06.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.385+0000 7f3ddfe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3de00b1da0 con 0x7f3de014e230 2024-04-25T19:24:06.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.385+0000 7f3ddea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3de00b6270 0x7f3de00cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:06.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.385+0000 7f3ddea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3de00b6270 0x7f3de00cc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38192/0 (socket says 172.21.15.131:38192) 2024-04-25T19:24:06.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.385+0000 7f3ddea00640 1 -- 172.21.15.131:0/1781054639 learned_addr learned my addr 172.21.15.131:0/1781054639 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:06.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.385+0000 7f3ddea00640 1 -- 172.21.15.131:0/1781054639 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3de014e230 msgr2=0x7f3de014e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:06.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.385+0000 7f3ddea00640 1 --2- 172.21.15.131:0/1781054639 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3de014e230 0x7f3de014e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:06.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.385+0000 7f3ddea00640 1 -- 172.21.15.131:0/1781054639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3de00d06c0 msgr2=0x7f3de0148340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:06.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.385+0000 7f3dde000640 1 --2- 172.21.15.131:0/1781054639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3de00d06c0 0x7f3de0148340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:06.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.385+0000 7f3ddea00640 1 --2- 172.21.15.131:0/1781054639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3de00d06c0 0x7f3de0148340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:06.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.385+0000 7f3ddea00640 1 -- 172.21.15.131:0/1781054639 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de00ccc60 con 0x7f3de00b6270 2024-04-25T19:24:06.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.386+0000 7f3ddea00640 1 --2- 172.21.15.131:0/1781054639 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3de00b6270 0x7f3de00cc460 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000c440 tx=0x7f3dd000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:06.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.386+0000 7f3dd7400640 1 -- 172.21.15.131:0/1781054639 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0018070 con 0x7f3de00b6270 2024-04-25T19:24:06.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.386+0000 7f3dd7400640 1 -- 172.21.15.131:0/1781054639 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dd00074e0 con 0x7f3de00b6270 2024-04-25T19:24:06.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.386+0000 7f3dd7400640 1 -- 172.21.15.131:0/1781054639 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0004a20 con 0x7f3de00b6270 2024-04-25T19:24:06.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.386+0000 7f3ddfe00640 1 -- 172.21.15.131:0/1781054639 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3de014eb80 con 0x7f3de00b6270 2024-04-25T19:24:06.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.386+0000 7f3ddfe00640 1 -- 172.21.15.131:0/1781054639 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3de00ce2e0 con 0x7f3de00b6270 2024-04-25T19:24:06.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.387+0000 7f3ddfe00640 1 -- 172.21.15.131:0/1781054639 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3de0050740 con 0x7f3de00b6270 2024-04-25T19:24:06.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.389+0000 7f3dd7400640 1 -- 172.21.15.131:0/1781054639 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3dd0004bc0 con 0x7f3de00b6270 2024-04-25T19:24:06.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.390+0000 7f3dd7400640 1 --2- 172.21.15.131:0/1781054639 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3dc00744b0 0x7f3dc00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:06.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.390+0000 7f3dd7400640 1 -- 172.21.15.131:0/1781054639 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f3dd00942e0 con 0x7f3de00b6270 2024-04-25T19:24:06.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.390+0000 7f3dde000640 1 --2- 172.21.15.131:0/1781054639 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3dc00744b0 0x7f3dc00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:06.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.392+0000 7f3dde000640 1 --2- 172.21.15.131:0/1781054639 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3dc00744b0 0x7f3dc00769c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3de0159ab0 tx=0x7f3dcc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:06.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.395+0000 7f3dd7400640 1 -- 172.21.15.131:0/1781054639 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3de014eb80 con 0x7f3de00b6270 2024-04-25T19:24:06.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.593+0000 7f3ddfe00640 1 -- 172.21.15.131:0/1781054639 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3de00b1660 con 0x7f3de00b6270 2024-04-25T19:24:06.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.595+0000 7f3dd7400640 1 -- 172.21.15.131:0/1781054639 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+13046 (secure 0 0 0) 0x7f3dd005ecd0 con 0x7f3de00b6270 2024-04-25T19:24:06.597 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:24:06.597 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":36,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:24:04.051237+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.195:6837/2364484867":"2024-04-26T19:24:00.691555+0000","172.21.15.195:6836/2364484867":"2024-04-26T19:24:00.691555+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:24:06.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.597+0000 7f3ddfe00640 1 -- 172.21.15.131:0/1781054639 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3dc00744b0 msgr2=0x7f3dc00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:06.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.597+0000 7f3ddfe00640 1 --2- 172.21.15.131:0/1781054639 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3dc00744b0 0x7f3dc00769c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3de0159ab0 tx=0x7f3dcc008040 comp rx=0 tx=0).stop 2024-04-25T19:24:06.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.597+0000 7f3ddfe00640 1 -- 172.21.15.131:0/1781054639 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3de00b6270 msgr2=0x7f3de00cc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:06.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.597+0000 7f3ddfe00640 1 --2- 172.21.15.131:0/1781054639 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3de00b6270 0x7f3de00cc460 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000c440 tx=0x7f3dd000c900 comp rx=0 tx=0).stop 2024-04-25T19:24:06.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.598+0000 7f3ddfe00640 1 -- 172.21.15.131:0/1781054639 shutdown_connections 2024-04-25T19:24:06.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.598+0000 7f3ddfe00640 1 --2- 172.21.15.131:0/1781054639 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3dc00744b0 0x7f3dc00769c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:06.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.598+0000 7f3ddfe00640 1 --2- 172.21.15.131:0/1781054639 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3de014e230 0x7f3de014e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:06.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.598+0000 7f3ddfe00640 1 --2- 172.21.15.131:0/1781054639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3de00d06c0 0x7f3de0148340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:06.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.598+0000 7f3ddfe00640 1 --2- 172.21.15.131:0/1781054639 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3de00b6270 0x7f3de00cc460 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:06.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.598+0000 7f3ddfe00640 1 -- 172.21.15.131:0/1781054639 >> 172.21.15.131:0/1781054639 conn(0x7f3de0070270 msgr2=0x7f3de00b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:06.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.598+0000 7f3ddfe00640 1 -- 172.21.15.131:0/1781054639 shutdown_connections 2024-04-25T19:24:06.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.598+0000 7f3ddfe00640 1 -- 172.21.15.131:0/1781054639 wait complete. 2024-04-25T19:24:06.627 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T19:22:04.178847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T19:24:06.627 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T19:24:06.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.904+0000 7ff42e200640 1 Processor -- start 2024-04-25T19:24:06.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.904+0000 7ff42e200640 1 -- start start 2024-04-25T19:24:06.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.907+0000 7ff42e200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff42806dce0 0x7ff4280d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:06.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.907+0000 7ff42e200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4280cda60 con 0x7ff4280ce520 2024-04-25T19:24:06.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.907+0000 7ff42e200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff42815dfe0 con 0x7ff4280ce930 2024-04-25T19:24:06.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.907+0000 7ff42e200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7ff42815e2c0 con 0x7ff42806dce0 2024-04-25T19:24:06.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.907+0000 7ff42ce00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7ff4280ce520 0x7ff42815d4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53708/0 (socket says 172.21.15.131:53708) 2024-04-25T19:24:06.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.907+0000 7ff42ce00640 1 -- 172.21.15.131:0/838337431 learned_addr learned my addr 172.21.15.131:0/838337431 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:24:06.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.907+0000 7ff42d800640 1 --2- 172.21.15.131:0/838337431 >> v2:172.21.15.195:3300/0 conn(0x7ff42806dce0 0x7ff4280d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:06.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.907+0000 7ff427400640 1 -- 172.21.15.131:0/838337431 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4080893305 0 0) 0x7ff4280cda60 con 0x7ff4280ce520 2024-04-25T19:24:06.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.907+0000 7ff427400640 1 -- 172.21.15.131:0/838337431 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff410005730 con 0x7ff4280ce520 2024-04-25T19:24:06.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.908+0000 7ff427400640 1 -- 172.21.15.131:0/838337431 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1344325830 0 0) 0x7ff410005730 con 0x7ff4280ce520 2024-04-25T19:24:06.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.908+0000 7ff427400640 1 -- 172.21.15.131:0/838337431 >> v2:172.21.15.195:3300/0 conn(0x7ff42806dce0 msgr2=0x7ff4280d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:06.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.908+0000 7ff427400640 1 --2- 172.21.15.131:0/838337431 >> v2:172.21.15.195:3300/0 conn(0x7ff42806dce0 0x7ff4280d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:06.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.908+0000 7ff427400640 1 -- 172.21.15.131:0/838337431 >> v1:172.21.15.195:6789/0 conn(0x7ff4280ce930 legacy=0x7ff42806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:06.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.908+0000 7ff427400640 1 -- 172.21.15.131:0/838337431 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4280cdd20 con 0x7ff4280ce520 2024-04-25T19:24:06.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.908+0000 7ff427400640 1 -- 172.21.15.131:0/838337431 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7ff41c001670 con 0x7ff4280ce520 2024-04-25T19:24:06.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.908+0000 7ff427400640 1 -- 172.21.15.131:0/838337431 >> v1:172.21.15.131:6789/0 conn(0x7ff4280ce520 legacy=0x7ff42815d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:06.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.908+0000 7ff427400640 1 --2- 172.21.15.131:0/838337431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff410005c10 0x7ff410006080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:06.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.908+0000 7ff427400640 1 --2- 172.21.15.131:0/838337431 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff410006a10 0x7ff410006e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:06.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.908+0000 7ff427400640 1 --2- 172.21.15.131:0/838337431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4100074b0 0x7ff41000dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:06.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.908+0000 7ff427400640 1 -- 172.21.15.131:0/838337431 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff42815e2c0 con 0x7ff4100074b0 2024-04-25T19:24:06.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.908+0000 7ff427400640 1 -- 172.21.15.131:0/838337431 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff41000e440 con 0x7ff410005c10 2024-04-25T19:24:06.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.908+0000 7ff427400640 1 -- 172.21.15.131:0/838337431 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff41000e640 con 0x7ff410006a10 2024-04-25T19:24:06.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.908+0000 7ff42d800640 1 --2- 172.21.15.131:0/838337431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4100074b0 0x7ff41000dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:06.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.909+0000 7ff42ce00640 1 --2- 172.21.15.131:0/838337431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff410005c10 0x7ff410006080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:06.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.909+0000 7ff42d800640 1 -- 172.21.15.131:0/838337431 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff410006a10 msgr2=0x7ff410006e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:06.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.909+0000 7ff42d800640 1 --2- 172.21.15.131:0/838337431 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff410006a10 0x7ff410006e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:06.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.909+0000 7ff42d800640 1 -- 172.21.15.131:0/838337431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff410005c10 msgr2=0x7ff410006080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:06.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.909+0000 7ff42d800640 1 --2- 172.21.15.131:0/838337431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff410005c10 0x7ff410006080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:06.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.909+0000 7ff42d800640 1 -- 172.21.15.131:0/838337431 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff410005730 con 0x7ff4100074b0 2024-04-25T19:24:06.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.909+0000 7ff42ce00640 1 --2- 172.21.15.131:0/838337431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff410005c10 0x7ff410006080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:24:06.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.910+0000 7ff42d800640 1 -- 172.21.15.131:0/838337431 reap_dead start 2024-04-25T19:24:06.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.910+0000 7ff42d800640 1 --2- 172.21.15.131:0/838337431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4100074b0 0x7ff41000dbd0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff420009fc0 tx=0x7ff410007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1013bf31c08c2c99 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:06.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.910+0000 7ff427400640 1 -- 172.21.15.131:0/838337431 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff420035020 con 0x7ff4100074b0 2024-04-25T19:24:06.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.910+0000 7ff427400640 1 -- 172.21.15.131:0/838337431 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff420003bd0 con 0x7ff4100074b0 2024-04-25T19:24:06.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.910+0000 7ff427400640 1 -- 172.21.15.131:0/838337431 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff420009c10 con 0x7ff4100074b0 2024-04-25T19:24:06.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.911+0000 7ff42e200640 1 -- 172.21.15.131:0/838337431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4100074b0 msgr2=0x7ff41000dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:06.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.911+0000 7ff42e200640 1 --2- 172.21.15.131:0/838337431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4100074b0 0x7ff41000dbd0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff420009fc0 tx=0x7ff410007a40 comp rx=0 tx=0).stop 2024-04-25T19:24:06.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.911+0000 7ff42e200640 1 -- 172.21.15.131:0/838337431 shutdown_connections 2024-04-25T19:24:06.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.911+0000 7ff42e200640 1 --2- 172.21.15.131:0/838337431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4100074b0 0x7ff41000dbd0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:06.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.911+0000 7ff42e200640 1 -- 172.21.15.131:0/838337431 >> 172.21.15.131:0/838337431 conn(0x7ff428072f40 msgr2=0x7ff428073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:06.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.911+0000 7ff42e200640 1 -- 172.21.15.131:0/838337431 shutdown_connections 2024-04-25T19:24:06.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.911+0000 7ff42e200640 1 -- 172.21.15.131:0/838337431 wait complete. 2024-04-25T19:24:06.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.913+0000 7ff42e200640 1 Processor -- start 2024-04-25T19:24:06.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.913+0000 7ff42e200640 1 -- start start 2024-04-25T19:24:06.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.915+0000 7ff42e200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4100074b0 0x7ff428153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:06.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.915+0000 7ff42e200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff42813ec50 0x7ff42813f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:06.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.915+0000 7ff42e200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff428144160 0x7ff428144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:06.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.915+0000 7ff42e200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff4280b73d0 con 0x7ff4100074b0 2024-04-25T19:24:06.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.915+0000 7ff42e200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff428160d30 con 0x7ff428144160 2024-04-25T19:24:06.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.915+0000 7ff42e200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff4280b7550 con 0x7ff42813ec50 2024-04-25T19:24:06.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.915+0000 7ff42ce00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4100074b0 0x7ff428153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:06.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.915+0000 7ff42ce00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4100074b0 0x7ff428153ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38206/0 (socket says 172.21.15.131:38206) 2024-04-25T19:24:06.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.915+0000 7ff42ce00640 1 -- 172.21.15.131:0/1939835116 learned_addr learned my addr 172.21.15.131:0/1939835116 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:06.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.916+0000 7ff427e00640 1 --2- 172.21.15.131:0/1939835116 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff42813ec50 0x7ff42813f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:06.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.916+0000 7ff42d800640 1 --2- 172.21.15.131:0/1939835116 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff428144160 0x7ff428144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:06.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.916+0000 7ff42ce00640 1 -- 172.21.15.131:0/1939835116 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff42813ec50 msgr2=0x7ff42813f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:06.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.916+0000 7ff42ce00640 1 --2- 172.21.15.131:0/1939835116 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff42813ec50 0x7ff42813f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:06.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.916+0000 7ff42ce00640 1 -- 172.21.15.131:0/1939835116 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff428144160 msgr2=0x7ff428144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:06.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.916+0000 7ff42ce00640 1 --2- 172.21.15.131:0/1939835116 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff428144160 0x7ff428144570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:06.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.916+0000 7ff42ce00640 1 -- 172.21.15.131:0/1939835116 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff428144ab0 con 0x7ff4100074b0 2024-04-25T19:24:06.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.916+0000 7ff42ce00640 1 --2- 172.21.15.131:0/1939835116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4100074b0 0x7ff428153ef0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff41c00d6f0 tx=0x7ff41c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:06.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.916+0000 7ff424c00640 1 -- 172.21.15.131:0/1939835116 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff41c019070 con 0x7ff4100074b0 2024-04-25T19:24:06.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.916+0000 7ff424c00640 1 -- 172.21.15.131:0/1939835116 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff41c0072e0 con 0x7ff4100074b0 2024-04-25T19:24:06.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.916+0000 7ff424c00640 1 -- 172.21.15.131:0/1939835116 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff41c0047e0 con 0x7ff4100074b0 2024-04-25T19:24:06.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.916+0000 7ff42e200640 1 -- 172.21.15.131:0/1939835116 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff428157b50 con 0x7ff4100074b0 2024-04-25T19:24:06.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.916+0000 7ff42e200640 1 -- 172.21.15.131:0/1939835116 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4281539d0 con 0x7ff4100074b0 2024-04-25T19:24:06.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.918+0000 7ff42e200640 1 -- 172.21.15.131:0/1939835116 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff428076c60 con 0x7ff4100074b0 2024-04-25T19:24:06.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.919+0000 7ff424c00640 1 -- 172.21.15.131:0/1939835116 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff41c004980 con 0x7ff4100074b0 2024-04-25T19:24:06.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.920+0000 7ff424c00640 1 --2- 172.21.15.131:0/1939835116 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff4080744b0 0x7ff4080769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:06.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.921+0000 7ff424c00640 1 -- 172.21.15.131:0/1939835116 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7ff41c094880 con 0x7ff4100074b0 2024-04-25T19:24:06.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.921+0000 7ff427e00640 1 --2- 172.21.15.131:0/1939835116 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff4080744b0 0x7ff4080769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:06.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.922+0000 7ff427e00640 1 --2- 172.21.15.131:0/1939835116 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff4080744b0 0x7ff4080769c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff42806df30 tx=0x7ff414009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:06.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:06.925+0000 7ff424c00640 1 -- 172.21.15.131:0/1939835116 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff41c05f310 con 0x7ff4100074b0 2024-04-25T19:24:07.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.127+0000 7ff42e200640 1 -- 172.21.15.131:0/1939835116 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff4280b5480 con 0x7ff4100074b0 2024-04-25T19:24:07.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.128+0000 7ff424c00640 1 -- 172.21.15.131:0/1939835116 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) ==== 93+0+10 (secure 0 0 0) 0x7ff41c067390 con 0x7ff4100074b0 2024-04-25T19:24:07.130 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-25T19:24:07.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.131+0000 7ff42e200640 1 -- 172.21.15.131:0/1939835116 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff4080744b0 msgr2=0x7ff4080769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:07.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.131+0000 7ff42e200640 1 --2- 172.21.15.131:0/1939835116 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff4080744b0 0x7ff4080769c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff42806df30 tx=0x7ff414009040 comp rx=0 tx=0).stop 2024-04-25T19:24:07.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.131+0000 7ff42e200640 1 -- 172.21.15.131:0/1939835116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4100074b0 msgr2=0x7ff428153ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:07.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.131+0000 7ff42e200640 1 --2- 172.21.15.131:0/1939835116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4100074b0 0x7ff428153ef0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff41c00d6f0 tx=0x7ff41c00dbb0 comp rx=0 tx=0).stop 2024-04-25T19:24:07.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.131+0000 7ff42e200640 1 -- 172.21.15.131:0/1939835116 shutdown_connections 2024-04-25T19:24:07.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.131+0000 7ff42e200640 1 --2- 172.21.15.131:0/1939835116 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff4080744b0 0x7ff4080769c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:07.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.131+0000 7ff42e200640 1 --2- 172.21.15.131:0/1939835116 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff42813ec50 0x7ff42813f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:07.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.131+0000 7ff42e200640 1 --2- 172.21.15.131:0/1939835116 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff428144160 0x7ff428144570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:07.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.131+0000 7ff42e200640 1 --2- 172.21.15.131:0/1939835116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4100074b0 0x7ff428153ef0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:07.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.131+0000 7ff42e200640 1 -- 172.21.15.131:0/1939835116 >> 172.21.15.131:0/1939835116 conn(0x7ff428072f40 msgr2=0x7ff42815b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:07.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.132+0000 7ff42e200640 1 -- 172.21.15.131:0/1939835116 shutdown_connections 2024-04-25T19:24:07.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.132+0000 7ff42e200640 1 -- 172.21.15.131:0/1939835116 wait complete. 2024-04-25T19:24:07.159 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_dump_tree.TestDumpTree.test_random' 2024-04-25T19:24:07.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.422+0000 7f7e19200640 1 Processor -- start 2024-04-25T19:24:07.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.422+0000 7f7e19200640 1 -- start start 2024-04-25T19:24:07.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.424+0000 7f7e19200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e1413fe10 0x7f7e1406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:07.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.424+0000 7f7e19200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7e1406db10 0x7f7e14142730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:07.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.424+0000 7f7e19200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e1406df20 con 0x7f7e14142c70 2024-04-25T19:24:07.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.424+0000 7f7e19200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f7e1415d5e0 con 0x7f7e1406db10 2024-04-25T19:24:07.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.424+0000 7f7e19200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7e1415d8c0 con 0x7f7e1413fe10 2024-04-25T19:24:07.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.424+0000 7f7e0aa00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7e1406db10 0x7f7e14142730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:07.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.425+0000 7f7e0aa00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7e1406db10 0x7f7e14142730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38218/0 (socket says 172.21.15.131:38218) 2024-04-25T19:24:07.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.425+0000 7f7e0aa00640 1 -- 172.21.15.131:0/4043557951 learned_addr learned my addr 172.21.15.131:0/4043557951 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:07.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.425+0000 7f7e13e00640 1 --1- 172.21.15.131:0/4043557951 >> v1:172.21.15.131:6789/0 conn(0x7f7e14142c70 0x7f7e14070240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53710/0 (socket says 172.21.15.131:53710) 2024-04-25T19:24:07.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.425+0000 7f7e13400640 1 --2- 172.21.15.131:0/4043557951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e1413fe10 0x7f7e1406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:07.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.425+0000 7f7e0aa00640 1 -- 172.21.15.131:0/4043557951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e1413fe10 msgr2=0x7f7e1406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:07.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.425+0000 7f7e0aa00640 1 --2- 172.21.15.131:0/4043557951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e1413fe10 0x7f7e1406d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:07.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.425+0000 7f7e0aa00640 1 -- 172.21.15.131:0/4043557951 >> v1:172.21.15.131:6789/0 conn(0x7f7e14142c70 legacy=0x7f7e14070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:07.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.425+0000 7f7e0aa00640 1 -- 172.21.15.131:0/4043557951 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1415dba0 con 0x7f7e1406db10 2024-04-25T19:24:07.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.426+0000 7f7e0aa00640 1 --2- 172.21.15.131:0/4043557951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e1406db10 0x7f7e14142730 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc009870 tx=0x7f7dfc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75af1a509f411f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:07.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.426+0000 7f7e12a00640 1 -- 172.21.15.131:0/4043557951 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc037070 con 0x7f7e1406db10 2024-04-25T19:24:07.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.426+0000 7f7e12a00640 1 -- 172.21.15.131:0/4043557951 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dfc032440 con 0x7f7e1406db10 2024-04-25T19:24:07.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.426+0000 7f7e12a00640 1 -- 172.21.15.131:0/4043557951 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc032810 con 0x7f7e1406db10 2024-04-25T19:24:07.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.427+0000 7f7e19200640 1 -- 172.21.15.131:0/4043557951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e1406db10 msgr2=0x7f7e14142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:07.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.427+0000 7f7e19200640 1 --2- 172.21.15.131:0/4043557951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e1406db10 0x7f7e14142730 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc009870 tx=0x7f7dfc02a1c0 comp rx=0 tx=0).stop 2024-04-25T19:24:07.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.427+0000 7f7e19200640 1 -- 172.21.15.131:0/4043557951 shutdown_connections 2024-04-25T19:24:07.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.427+0000 7f7e19200640 1 --2- 172.21.15.131:0/4043557951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e1406db10 0x7f7e14142730 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:07.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.427+0000 7f7e19200640 1 --2- 172.21.15.131:0/4043557951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e1413fe10 0x7f7e1406d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:07.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.427+0000 7f7e19200640 1 -- 172.21.15.131:0/4043557951 >> 172.21.15.131:0/4043557951 conn(0x7f7e14072ee0 msgr2=0x7f7e140732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:07.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.427+0000 7f7e19200640 1 -- 172.21.15.131:0/4043557951 shutdown_connections 2024-04-25T19:24:07.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.427+0000 7f7e19200640 1 -- 172.21.15.131:0/4043557951 wait complete. 2024-04-25T19:24:07.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.430+0000 7f7e19200640 1 Processor -- start 2024-04-25T19:24:07.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.430+0000 7f7e19200640 1 -- start start 2024-04-25T19:24:07.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.431+0000 7f7e19200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e1406db10 0x7f7e1413f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:07.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.431+0000 7f7e19200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e1413fe10 0x7f7e140b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:07.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.431+0000 7f7e19200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e14142c70 0x7f7e141412c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:07.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.431+0000 7f7e19200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7e14143080 con 0x7f7e1406db10 2024-04-25T19:24:07.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.431+0000 7f7e19200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1415d2d0 con 0x7f7e14142c70 2024-04-25T19:24:07.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.431+0000 7f7e19200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7e14143200 con 0x7f7e1413fe10 2024-04-25T19:24:07.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.432+0000 7f7e13400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e1406db10 0x7f7e1413f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:07.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.432+0000 7f7e13400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e1406db10 0x7f7e1413f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:38224/0 (socket says 172.21.15.131:38224) 2024-04-25T19:24:07.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.432+0000 7f7e13400640 1 -- 172.21.15.131:0/21135331 learned_addr learned my addr 172.21.15.131:0/21135331 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:07.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.432+0000 7f7e13400640 1 -- 172.21.15.131:0/21135331 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e1413fe10 msgr2=0x7f7e140b7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:07.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.432+0000 7f7e13400640 1 --2- 172.21.15.131:0/21135331 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e1413fe10 0x7f7e140b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:07.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.432+0000 7f7e13400640 1 -- 172.21.15.131:0/21135331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e14142c70 msgr2=0x7f7e141412c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:07.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.432+0000 7f7e13400640 1 --2- 172.21.15.131:0/21135331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e14142c70 0x7f7e141412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:07.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.432+0000 7f7e13400640 1 -- 172.21.15.131:0/21135331 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e140af050 con 0x7f7e1406db10 2024-04-25T19:24:07.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.432+0000 7f7e13400640 1 --2- 172.21.15.131:0/21135331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e1406db10 0x7f7e1413f150 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400d5d0 tx=0x7f7e0400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:07.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.433+0000 7f7e0be00640 1 -- 172.21.15.131:0/21135331 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04004240 con 0x7f7e1406db10 2024-04-25T19:24:07.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.433+0000 7f7e0be00640 1 -- 172.21.15.131:0/21135331 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e040043e0 con 0x7f7e1406db10 2024-04-25T19:24:07.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.433+0000 7f7e0be00640 1 -- 172.21.15.131:0/21135331 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04003830 con 0x7f7e1406db10 2024-04-25T19:24:07.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.433+0000 7f7e19200640 1 -- 172.21.15.131:0/21135331 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e140af580 con 0x7f7e1406db10 2024-04-25T19:24:07.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.433+0000 7f7e19200640 1 -- 172.21.15.131:0/21135331 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e140afb40 con 0x7f7e1406db10 2024-04-25T19:24:07.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.434+0000 7f7e19200640 1 -- 172.21.15.131:0/21135331 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e140afd80 con 0x7f7e1406db10 2024-04-25T19:24:07.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.435+0000 7f7e0be00640 1 -- 172.21.15.131:0/21135331 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7e040039d0 con 0x7f7e1406db10 2024-04-25T19:24:07.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.436+0000 7f7e0be00640 1 --2- 172.21.15.131:0/21135331 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f7df0074500 0x7f7df0076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:07.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.436+0000 7f7e0be00640 1 -- 172.21.15.131:0/21135331 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f7e04095180 con 0x7f7e1406db10 2024-04-25T19:24:07.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.437+0000 7f7e0aa00640 1 --2- 172.21.15.131:0/21135331 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f7df0074500 0x7f7df0076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:07.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.438+0000 7f7e0aa00640 1 --2- 172.21.15.131:0/21135331 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f7df0074500 0x7f7df0076a10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc034000 tx=0x7f7dfc02c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:07.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.441+0000 7f7e0be00640 1 -- 172.21.15.131:0/21135331 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7e140afd80 con 0x7f7e1406db10 2024-04-25T19:24:07.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:07.709+0000 7f7e19200640 1 -- 172.21.15.131:0/21135331 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_dump_tree.TestDumpTree.test_random"]} v 0) -- 0x7f7e14050740 con 0x7f7e1406db10 2024-04-25T19:24:08.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.082+0000 7f7e0be00640 1 -- 172.21.15.131:0/21135331 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_dump_tree.TestDumpTree.test_random"]}]=0 v127) ==== 134+0+0 (secure 0 0 0) 0x7f7e0405fc80 con 0x7f7e1406db10 2024-04-25T19:24:08.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.086+0000 7f7e19200640 1 -- 172.21.15.131:0/21135331 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f7df0074500 msgr2=0x7f7df0076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:08.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.086+0000 7f7e19200640 1 --2- 172.21.15.131:0/21135331 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f7df0074500 0x7f7df0076a10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc034000 tx=0x7f7dfc02c000 comp rx=0 tx=0).stop 2024-04-25T19:24:08.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.086+0000 7f7e19200640 1 -- 172.21.15.131:0/21135331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e1406db10 msgr2=0x7f7e1413f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:08.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.086+0000 7f7e19200640 1 --2- 172.21.15.131:0/21135331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e1406db10 0x7f7e1413f150 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400d5d0 tx=0x7f7e0400da90 comp rx=0 tx=0).stop 2024-04-25T19:24:08.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.086+0000 7f7e19200640 1 -- 172.21.15.131:0/21135331 shutdown_connections 2024-04-25T19:24:08.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.086+0000 7f7e19200640 1 --2- 172.21.15.131:0/21135331 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f7df0074500 0x7f7df0076a10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:08.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.086+0000 7f7e19200640 1 --2- 172.21.15.131:0/21135331 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e1413fe10 0x7f7e140b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:08.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.086+0000 7f7e19200640 1 --2- 172.21.15.131:0/21135331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e14142c70 0x7f7e141412c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:08.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.086+0000 7f7e19200640 1 --2- 172.21.15.131:0/21135331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e1406db10 0x7f7e1413f150 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:08.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.086+0000 7f7e19200640 1 -- 172.21.15.131:0/21135331 >> 172.21.15.131:0/21135331 conn(0x7f7e14072ee0 msgr2=0x7f7e1415e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:08.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.086+0000 7f7e19200640 1 -- 172.21.15.131:0/21135331 shutdown_connections 2024-04-25T19:24:08.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.087+0000 7f7e19200640 1 -- 172.21.15.131:0/21135331 wait complete. 2024-04-25T19:24:08.116 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T19:24:08.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.387+0000 7f6a07e00640 1 Processor -- start 2024-04-25T19:24:08.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.388+0000 7f6a07e00640 1 -- start start 2024-04-25T19:24:08.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.390+0000 7f6a07e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6a0815de90 0x7f6a081606a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:08.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.390+0000 7f6a07e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6a0806d5d0 0x7f6a0806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:08.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.390+0000 7f6a07e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a0806df20 con 0x7f6a08163c90 2024-04-25T19:24:08.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.390+0000 7f6a07e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f6a080b0090 con 0x7f6a0806d5d0 2024-04-25T19:24:08.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.390+0000 7f6a07e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6a08160c80 con 0x7f6a0815de90 2024-04-25T19:24:08.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.391+0000 7f6a07400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6a0806d5d0 0x7f6a0806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:08.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.391+0000 7f6a06a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6a0815de90 0x7f6a081606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:08.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.391+0000 7f6a07400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6a0806d5d0 0x7f6a0806d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.131:54838/0 (socket says 172.21.15.131:54838) 2024-04-25T19:24:08.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.391+0000 7f6a07400640 1 -- 172.21.15.131:0/447889342 learned_addr learned my addr 172.21.15.131:0/447889342 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:08.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.391+0000 7f6a07400640 1 -- 172.21.15.131:0/447889342 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6a0815de90 msgr2=0x7f6a081606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:08.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.391+0000 7f6a07400640 1 --2- 172.21.15.131:0/447889342 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6a0815de90 0x7f6a081606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:08.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.391+0000 7f6a07400640 1 -- 172.21.15.131:0/447889342 >> v1:172.21.15.195:6789/0 conn(0x7f6a08163c90 legacy=0x7f6a0806f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:08.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.392+0000 7f6a07400640 1 -- 172.21.15.131:0/447889342 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a08160f60 con 0x7f6a0806d5d0 2024-04-25T19:24:08.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.393+0000 7f6a07400640 1 --2- 172.21.15.131:0/447889342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a0806d5d0 0x7f6a0806d9e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009870 tx=0x7f6a0002a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c6818fa5ae1c37a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:08.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.393+0000 7f6a05600640 1 -- 172.21.15.131:0/447889342 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00037070 con 0x7f6a0806d5d0 2024-04-25T19:24:08.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.393+0000 7f6a05600640 1 -- 172.21.15.131:0/447889342 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a00032440 con 0x7f6a0806d5d0 2024-04-25T19:24:08.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.393+0000 7f6a05600640 1 -- 172.21.15.131:0/447889342 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00032810 con 0x7f6a0806d5d0 2024-04-25T19:24:08.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.394+0000 7f6a07e00640 1 -- 172.21.15.131:0/447889342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a0806d5d0 msgr2=0x7f6a0806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:08.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.394+0000 7f6a07e00640 1 --2- 172.21.15.131:0/447889342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a0806d5d0 0x7f6a0806d9e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009870 tx=0x7f6a0002a250 comp rx=0 tx=0).stop 2024-04-25T19:24:08.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.394+0000 7f6a07e00640 1 -- 172.21.15.131:0/447889342 shutdown_connections 2024-04-25T19:24:08.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.394+0000 7f6a07e00640 1 --2- 172.21.15.131:0/447889342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a0806d5d0 0x7f6a0806d9e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:08.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.394+0000 7f6a07e00640 1 --2- 172.21.15.131:0/447889342 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6a0815de90 0x7f6a081606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:08.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.394+0000 7f6a07e00640 1 -- 172.21.15.131:0/447889342 >> 172.21.15.131:0/447889342 conn(0x7f6a08072f40 msgr2=0x7f6a08073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:08.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.394+0000 7f6a07e00640 1 -- 172.21.15.131:0/447889342 shutdown_connections 2024-04-25T19:24:08.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.394+0000 7f6a07e00640 1 -- 172.21.15.131:0/447889342 wait complete. 2024-04-25T19:24:08.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.396+0000 7f6a07e00640 1 Processor -- start 2024-04-25T19:24:08.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.397+0000 7f6a07e00640 1 -- start start 2024-04-25T19:24:08.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.398+0000 7f6a07e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6a0806d5d0 0x7f6a08157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:08.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.398+0000 7f6a07e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a0815de90 0x7f6a08148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:08.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.398+0000 7f6a07e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a08163c90 0x7f6a08148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:08.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.398+0000 7f6a07e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6a08070d30 con 0x7f6a08163c90 2024-04-25T19:24:08.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.398+0000 7f6a07e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6a08161520 con 0x7f6a0815de90 2024-04-25T19:24:08.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.398+0000 7f6a07e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6a08070eb0 con 0x7f6a0806d5d0 2024-04-25T19:24:08.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.398+0000 7f6a07400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a08163c90 0x7f6a08148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:08.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.398+0000 7f6a07400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a08163c90 0x7f6a08148160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41750/0 (socket says 172.21.15.131:41750) 2024-04-25T19:24:08.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.398+0000 7f6a07400640 1 -- 172.21.15.131:0/505843203 learned_addr learned my addr 172.21.15.131:0/505843203 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:08.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.399+0000 7f6a06000640 1 --2- 172.21.15.131:0/505843203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a0815de90 0x7f6a08148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:08.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.399+0000 7f6a07400640 1 -- 172.21.15.131:0/505843203 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6a0806d5d0 msgr2=0x7f6a08157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:08.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.399+0000 7f6a06a00640 1 --2- 172.21.15.131:0/505843203 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6a0806d5d0 0x7f6a08157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:08.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.399+0000 7f6a07400640 1 --2- 172.21.15.131:0/505843203 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6a0806d5d0 0x7f6a08157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:08.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.399+0000 7f6a07400640 1 -- 172.21.15.131:0/505843203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a0815de90 msgr2=0x7f6a08148b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:08.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.399+0000 7f6a07400640 1 --2- 172.21.15.131:0/505843203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a0815de90 0x7f6a08148b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:08.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.399+0000 7f6a07400640 1 -- 172.21.15.131:0/505843203 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a08158160 con 0x7f6a08163c90 2024-04-25T19:24:08.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.399+0000 7f6a07400640 1 --2- 172.21.15.131:0/505843203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a08163c90 0x7f6a08148160 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009870 tx=0x7f6a000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:08.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.399+0000 7f69fea00640 1 -- 172.21.15.131:0/505843203 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00041020 con 0x7f6a08163c90 2024-04-25T19:24:08.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.400+0000 7f69fea00640 1 -- 172.21.15.131:0/505843203 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a0003d640 con 0x7f6a08163c90 2024-04-25T19:24:08.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.400+0000 7f69fea00640 1 -- 172.21.15.131:0/505843203 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00037040 con 0x7f6a08163c90 2024-04-25T19:24:08.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.400+0000 7f6a07e00640 1 -- 172.21.15.131:0/505843203 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a0815f590 con 0x7f6a08163c90 2024-04-25T19:24:08.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.400+0000 7f6a07e00640 1 -- 172.21.15.131:0/505843203 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a0815fb50 con 0x7f6a08163c90 2024-04-25T19:24:08.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.401+0000 7f6a07e00640 1 -- 172.21.15.131:0/505843203 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a08076c60 con 0x7f6a08163c90 2024-04-25T19:24:08.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.402+0000 7f69fea00640 1 -- 172.21.15.131:0/505843203 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6a00044020 con 0x7f6a08163c90 2024-04-25T19:24:08.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.403+0000 7f69fea00640 1 --2- 172.21.15.131:0/505843203 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f69e40744b0 0x7f69e40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:08.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.403+0000 7f69fea00640 1 -- 172.21.15.131:0/505843203 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f6a000b5750 con 0x7f6a08163c90 2024-04-25T19:24:08.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.404+0000 7f6a06a00640 1 --2- 172.21.15.131:0/505843203 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f69e40744b0 0x7f69e40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:08.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.405+0000 7f6a06a00640 1 --2- 172.21.15.131:0/505843203 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f69e40744b0 0x7f69e40769c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6a080b7880 tx=0x7f69f8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:08.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.407+0000 7f69fea00640 1 -- 172.21.15.131:0/505843203 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6a0004b030 con 0x7f6a08163c90 2024-04-25T19:24:08.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.602+0000 7f6a07e00640 1 -- 172.21.15.131:0/505843203 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f6a08158400 con 0x7f6a08163c90 2024-04-25T19:24:08.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.610+0000 7f69fea00640 1 -- 172.21.15.131:0/505843203 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f6a00080150 con 0x7f6a08163c90 2024-04-25T19:24:08.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.613+0000 7f6a07e00640 1 -- 172.21.15.131:0/505843203 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f69e40744b0 msgr2=0x7f69e40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:08.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.613+0000 7f6a07e00640 1 --2- 172.21.15.131:0/505843203 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f69e40744b0 0x7f69e40769c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6a080b7880 tx=0x7f69f8008040 comp rx=0 tx=0).stop 2024-04-25T19:24:08.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.613+0000 7f6a07e00640 1 -- 172.21.15.131:0/505843203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a08163c90 msgr2=0x7f6a08148160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:08.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.613+0000 7f6a07e00640 1 --2- 172.21.15.131:0/505843203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a08163c90 0x7f6a08148160 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009870 tx=0x7f6a000046c0 comp rx=0 tx=0).stop 2024-04-25T19:24:08.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.613+0000 7f6a07e00640 1 -- 172.21.15.131:0/505843203 shutdown_connections 2024-04-25T19:24:08.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.613+0000 7f6a07e00640 1 --2- 172.21.15.131:0/505843203 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f69e40744b0 0x7f69e40769c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:08.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.613+0000 7f6a07e00640 1 --2- 172.21.15.131:0/505843203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a08163c90 0x7f6a08148160 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:08.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.613+0000 7f6a07e00640 1 --2- 172.21.15.131:0/505843203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a0815de90 0x7f6a08148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:08.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.613+0000 7f6a07e00640 1 --2- 172.21.15.131:0/505843203 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6a0806d5d0 0x7f6a08157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:08.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.613+0000 7f6a07e00640 1 -- 172.21.15.131:0/505843203 >> 172.21.15.131:0/505843203 conn(0x7f6a08072f40 msgr2=0x7f6a0815c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:08.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.614+0000 7f6a07e00640 1 -- 172.21.15.131:0/505843203 shutdown_connections 2024-04-25T19:24:08.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:08.614+0000 7f6a07e00640 1 -- 172.21.15.131:0/505843203 wait complete. 2024-04-25T19:24:08.641 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T19:24:08.641 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T19:24:08.744 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T19:24:08.857 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T19:24:08.857 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:24:08.857 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:24:08.913 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T19:24:08.913 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:24:08.913 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:24:08.971 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T19:24:08.972 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:24:08.972 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:24:09.029 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T19:24:09.029 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:24:09.029 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:24:09.088 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T19:24:09.088 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T19:24:09.088 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:24:09.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.360+0000 7f81d7200640 1 Processor -- start 2024-04-25T19:24:09.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.360+0000 7f81d7200640 1 -- start start 2024-04-25T19:24:09.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.362+0000 7f81d7200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f81d80cfab0 0x7f81d80b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:09.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.362+0000 7f81d7200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81d80b9100 con 0x7f81d80d2220 2024-04-25T19:24:09.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.362+0000 7f81d7200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81d809d150 con 0x7f81d80d0ee0 2024-04-25T19:24:09.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.362+0000 7f81d7200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f81d80d1580 con 0x7f81d80cfab0 2024-04-25T19:24:09.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.363+0000 7f81d6800640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f81d80d2220 0x7f81d80ce730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:33454/0 (socket says 172.21.15.131:33454) 2024-04-25T19:24:09.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.363+0000 7f81d6800640 1 -- 172.21.15.131:0/891579408 learned_addr learned my addr 172.21.15.131:0/891579408 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:24:09.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.363+0000 7f81cd400640 1 --2- 172.21.15.131:0/891579408 >> v2:172.21.15.195:3300/0 conn(0x7f81d80cfab0 0x7f81d80b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:09.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.363+0000 7f81d5400640 1 -- 172.21.15.131:0/891579408 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1333218771 0 0) 0x7f81d80b9100 con 0x7f81d80d2220 2024-04-25T19:24:09.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.363+0000 7f81d5400640 1 -- 172.21.15.131:0/891579408 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81bc003520 con 0x7f81d80d2220 2024-04-25T19:24:09.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.364+0000 7f81d5400640 1 -- 172.21.15.131:0/891579408 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 72586377 0 0) 0x7f81bc003520 con 0x7f81d80d2220 2024-04-25T19:24:09.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.364+0000 7f81d5400640 1 -- 172.21.15.131:0/891579408 >> v2:172.21.15.195:3300/0 conn(0x7f81d80cfab0 msgr2=0x7f81d80b71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:09.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.364+0000 7f81d5400640 1 --2- 172.21.15.131:0/891579408 >> v2:172.21.15.195:3300/0 conn(0x7f81d80cfab0 0x7f81d80b71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:09.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.364+0000 7f81d5400640 1 -- 172.21.15.131:0/891579408 >> v1:172.21.15.195:6789/0 conn(0x7f81d80d0ee0 legacy=0x7f81d809ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:09.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.364+0000 7f81d5400640 1 -- 172.21.15.131:0/891579408 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d80d1c90 con 0x7f81d80d2220 2024-04-25T19:24:09.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.364+0000 7f81d5400640 1 -- 172.21.15.131:0/891579408 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f81d0001670 con 0x7f81d80d2220 2024-04-25T19:24:09.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.364+0000 7f81d5400640 1 -- 172.21.15.131:0/891579408 >> v1:172.21.15.131:6789/0 conn(0x7f81d80d2220 legacy=0x7f81d80ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:09.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.364+0000 7f81d5400640 1 --2- 172.21.15.131:0/891579408 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81bc0039b0 0x7f81bc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:09.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.364+0000 7f81d5400640 1 --2- 172.21.15.131:0/891579408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81bc004800 0x7f81bc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:09.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.364+0000 7f81d5400640 1 --2- 172.21.15.131:0/891579408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81bc005350 0x7f81bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:09.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.364+0000 7f81d5400640 1 -- 172.21.15.131:0/891579408 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f81d80d1580 con 0x7f81bc005350 2024-04-25T19:24:09.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.364+0000 7f81d5400640 1 -- 172.21.15.131:0/891579408 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc00c280 con 0x7f81bc004800 2024-04-25T19:24:09.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.364+0000 7f81d5400640 1 -- 172.21.15.131:0/891579408 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f81bc00c480 con 0x7f81bc0039b0 2024-04-25T19:24:09.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.364+0000 7f81d6800640 1 --2- 172.21.15.131:0/891579408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81bc005350 0x7f81bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:09.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.364+0000 7f81cd400640 1 --2- 172.21.15.131:0/891579408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81bc004800 0x7f81bc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:09.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.364+0000 7f81d5e00640 1 --2- 172.21.15.131:0/891579408 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81bc0039b0 0x7f81bc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:09.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.365+0000 7f81d6800640 1 -- 172.21.15.131:0/891579408 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81bc0039b0 msgr2=0x7f81bc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:09.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.365+0000 7f81d6800640 1 --2- 172.21.15.131:0/891579408 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81bc0039b0 0x7f81bc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:09.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.365+0000 7f81d6800640 1 -- 172.21.15.131:0/891579408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81bc004800 msgr2=0x7f81bc004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:09.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.365+0000 7f81d6800640 1 --2- 172.21.15.131:0/891579408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81bc004800 0x7f81bc004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:09.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.365+0000 7f81d6800640 1 -- 172.21.15.131:0/891579408 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81bc003520 con 0x7f81bc005350 2024-04-25T19:24:09.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.366+0000 7f81d6800640 1 -- 172.21.15.131:0/891579408 reap_dead start 2024-04-25T19:24:09.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.366+0000 7f81d6800640 1 --2- 172.21.15.131:0/891579408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81bc005350 0x7f81bc00b9c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f81d000c240 tx=0x7f81bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47ca80ed60ab59a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:09.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.367+0000 7f81d5400640 1 -- 172.21.15.131:0/891579408 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d0007d10 con 0x7f81bc005350 2024-04-25T19:24:09.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.367+0000 7f81d5400640 1 -- 172.21.15.131:0/891579408 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81d0005ad0 con 0x7f81bc005350 2024-04-25T19:24:09.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.367+0000 7f81d5400640 1 -- 172.21.15.131:0/891579408 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d0007070 con 0x7f81bc005350 2024-04-25T19:24:09.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.367+0000 7f81d7200640 1 -- 172.21.15.131:0/891579408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81bc005350 msgr2=0x7f81bc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:09.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.367+0000 7f81d7200640 1 --2- 172.21.15.131:0/891579408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81bc005350 0x7f81bc00b9c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f81d000c240 tx=0x7f81bc005830 comp rx=0 tx=0).stop 2024-04-25T19:24:09.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.368+0000 7f81d7200640 1 -- 172.21.15.131:0/891579408 shutdown_connections 2024-04-25T19:24:09.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.368+0000 7f81d7200640 1 --2- 172.21.15.131:0/891579408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81bc005350 0x7f81bc00b9c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:09.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.368+0000 7f81d7200640 1 -- 172.21.15.131:0/891579408 >> 172.21.15.131:0/891579408 conn(0x7f81d80d03c0 msgr2=0x7f81d80d07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:09.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.368+0000 7f81d7200640 1 -- 172.21.15.131:0/891579408 shutdown_connections 2024-04-25T19:24:09.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.368+0000 7f81d7200640 1 -- 172.21.15.131:0/891579408 wait complete. 2024-04-25T19:24:09.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.370+0000 7f81d7200640 1 Processor -- start 2024-04-25T19:24:09.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.370+0000 7f81d7200640 1 -- start start 2024-04-25T19:24:09.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.372+0000 7f81d7200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81bc005350 0x7f81d80c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:09.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.372+0000 7f81d7200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81d80c7650 0x7f81d80c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:09.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.372+0000 7f81d7200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81d809dca0 0x7f81d809e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:09.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.372+0000 7f81d7200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f81d80d3590 con 0x7f81d80c7650 2024-04-25T19:24:09.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.372+0000 7f81d7200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f81d80b9450 con 0x7f81bc005350 2024-04-25T19:24:09.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.372+0000 7f81d7200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f81d80d3710 con 0x7f81d809dca0 2024-04-25T19:24:09.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.372+0000 7f81cd400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81d80c7650 0x7f81d80c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:09.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.372+0000 7f81cd400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81d80c7650 0x7f81d80c7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41782/0 (socket says 172.21.15.131:41782) 2024-04-25T19:24:09.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.372+0000 7f81cd400640 1 -- 172.21.15.131:0/667148121 learned_addr learned my addr 172.21.15.131:0/667148121 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:09.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.372+0000 7f81d5e00640 1 --2- 172.21.15.131:0/667148121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81bc005350 0x7f81d80c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:09.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.373+0000 7f81d6800640 1 --2- 172.21.15.131:0/667148121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81d809dca0 0x7f81d809e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:09.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.373+0000 7f81cd400640 1 -- 172.21.15.131:0/667148121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81d809dca0 msgr2=0x7f81d809e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:09.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.373+0000 7f81cd400640 1 --2- 172.21.15.131:0/667148121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81d809dca0 0x7f81d809e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:09.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.373+0000 7f81cd400640 1 -- 172.21.15.131:0/667148121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81bc005350 msgr2=0x7f81d80c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:09.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.373+0000 7f81cd400640 1 --2- 172.21.15.131:0/667148121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81bc005350 0x7f81d80c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:09.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.373+0000 7f81cd400640 1 -- 172.21.15.131:0/667148121 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d80a15e0 con 0x7f81d80c7650 2024-04-25T19:24:09.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.373+0000 7f81d5e00640 1 --2- 172.21.15.131:0/667148121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81bc005350 0x7f81d80c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:24:09.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.373+0000 7f81cd400640 1 --2- 172.21.15.131:0/667148121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81d80c7650 0x7f81d80c7a60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f81c0011990 tx=0x7f81c0011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:09.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.373+0000 7f81cea00640 1 -- 172.21.15.131:0/667148121 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c0019070 con 0x7f81d80c7650 2024-04-25T19:24:09.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.373+0000 7f81cea00640 1 -- 172.21.15.131:0/667148121 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c0004240 con 0x7f81d80c7650 2024-04-25T19:24:09.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.373+0000 7f81cea00640 1 -- 172.21.15.131:0/667148121 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c000f860 con 0x7f81d80c7650 2024-04-25T19:24:09.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.373+0000 7f81d7200640 1 -- 172.21.15.131:0/667148121 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81d80c8b50 con 0x7f81d80c7650 2024-04-25T19:24:09.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.373+0000 7f81d7200640 1 -- 172.21.15.131:0/667148121 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81d80a1020 con 0x7f81d80c7650 2024-04-25T19:24:09.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.375+0000 7f81d7200640 1 -- 172.21.15.131:0/667148121 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81d80a0ab0 con 0x7f81d80c7650 2024-04-25T19:24:09.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.376+0000 7f81cea00640 1 -- 172.21.15.131:0/667148121 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f81c001c070 con 0x7f81d80c7650 2024-04-25T19:24:09.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.377+0000 7f81cea00640 1 --2- 172.21.15.131:0/667148121 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f81b40744b0 0x7f81b40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:09.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.377+0000 7f81cea00640 1 -- 172.21.15.131:0/667148121 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f81c00952d0 con 0x7f81d80c7650 2024-04-25T19:24:09.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.377+0000 7f81d5e00640 1 --2- 172.21.15.131:0/667148121 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f81b40744b0 0x7f81b40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:09.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.378+0000 7f81d5e00640 1 --2- 172.21.15.131:0/667148121 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f81b40744b0 0x7f81b40769c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f81c8000f80 tx=0x7f81c8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:09.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.381+0000 7f81cea00640 1 -- 172.21.15.131:0/667148121 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f81c005fdf0 con 0x7f81d80c7650 2024-04-25T19:24:09.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.620+0000 7f81d7200640 1 -- 172.21.15.131:0/667148121 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81d8050740 con 0x7f81d80c7650 2024-04-25T19:24:09.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.621+0000 7f81cea00640 1 -- 172.21.15.131:0/667148121 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+3881 (secure 0 0 0) 0x7f81c005f6f0 con 0x7f81d80c7650 2024-04-25T19:24:09.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:24:09.623 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3675320819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3675320819},{"type":"v1","addr":"172.21.15.131:6834","nonce":3675320819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/4031276350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":4031276350},{"type":"v1","addr":"172.21.15.195:6837","nonce":4031276350}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/2332391948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":2332391948},{"type":"v1","addr":"172.21.15.195:6835","nonce":2332391948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4726,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2008890338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2008890338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2008890338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[]} 2024-04-25T19:24:09.623 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 18 2024-04-25T19:24:09.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.624+0000 7f81d7200640 1 -- 172.21.15.131:0/667148121 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f81b40744b0 msgr2=0x7f81b40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:09.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.624+0000 7f81d7200640 1 --2- 172.21.15.131:0/667148121 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f81b40744b0 0x7f81b40769c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f81c8000f80 tx=0x7f81c8009040 comp rx=0 tx=0).stop 2024-04-25T19:24:09.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.624+0000 7f81d7200640 1 -- 172.21.15.131:0/667148121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81d80c7650 msgr2=0x7f81d80c7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:09.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.624+0000 7f81d7200640 1 --2- 172.21.15.131:0/667148121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81d80c7650 0x7f81d80c7a60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f81c0011990 tx=0x7f81c0011e50 comp rx=0 tx=0).stop 2024-04-25T19:24:09.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.624+0000 7f81d7200640 1 -- 172.21.15.131:0/667148121 shutdown_connections 2024-04-25T19:24:09.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.624+0000 7f81d7200640 1 --2- 172.21.15.131:0/667148121 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f81b40744b0 0x7f81b40769c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:09.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.624+0000 7f81d7200640 1 --2- 172.21.15.131:0/667148121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81d809dca0 0x7f81d809e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:09.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.624+0000 7f81d7200640 1 --2- 172.21.15.131:0/667148121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81d80c7650 0x7f81d80c7a60 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:09.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.624+0000 7f81d7200640 1 --2- 172.21.15.131:0/667148121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81bc005350 0x7f81d80c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:09.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.624+0000 7f81d7200640 1 -- 172.21.15.131:0/667148121 >> 172.21.15.131:0/667148121 conn(0x7f81d80d03c0 msgr2=0x7f81d809c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:09.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.624+0000 7f81d7200640 1 -- 172.21.15.131:0/667148121 shutdown_connections 2024-04-25T19:24:09.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.624+0000 7f81d7200640 1 -- 172.21.15.131:0/667148121 wait complete. 2024-04-25T19:24:09.655 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T19:24:09.655 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T19:24:09.655 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T19:24:09.655 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T19:24:09.656 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T19:24:09.656 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T19:24:09.656 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T19:24:09.656 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T19:24:09.656 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T19:24:09.656 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T19:24:09.656 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T19:24:09.657 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T19:24:09.657 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T19:24:09.657 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T19:24:09.657 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T19:24:09.657 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T19:24:09.679 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T19:24:09.680 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T19:24:09.687 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T19:24:09.687 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T19:24:09.691 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T19:24:09.691 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T19:24:09.703 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T19:24:09.703 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T19:24:09.734 INFO:tasks.ceph.mds.a:Started 2024-04-25T19:24:09.735 DEBUG:teuthology.parallel:result is None 2024-04-25T19:24:09.741 INFO:tasks.ceph.mds.c:Started 2024-04-25T19:24:09.742 DEBUG:teuthology.parallel:result is None 2024-04-25T19:24:09.750 INFO:tasks.ceph.mds.d:Started 2024-04-25T19:24:09.750 DEBUG:teuthology.parallel:result is None 2024-04-25T19:24:09.756 INFO:tasks.ceph.mds.b:Started 2024-04-25T19:24:09.756 DEBUG:teuthology.parallel:result is None 2024-04-25T19:24:09.756 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T19:24:09.950 INFO:tasks.ceph.mds.a.smithi131.stdout:starting mds.a at 2024-04-25T19:24:09.951 INFO:tasks.ceph.mds.c.smithi131.stdout:starting mds.c at 2024-04-25T19:24:09.978 INFO:tasks.ceph.mds.b.smithi195.stdout:starting mds.b at 2024-04-25T19:24:09.979 INFO:tasks.ceph.mds.d.smithi195.stdout:starting mds.d at 2024-04-25T19:24:09.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.997+0000 7fa957600640 1 Processor -- start 2024-04-25T19:24:09.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.998+0000 7fa957600640 1 -- start start 2024-04-25T19:24:10.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.999+0000 7fa957600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa9500cf5e0 0x7fa9500cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:10.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.999+0000 7fa957600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa95006c5c0 0x7fa95006c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:10.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.999+0000 7fa957600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9500cff30 con 0x7fa9501443c0 2024-04-25T19:24:10.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.999+0000 7fa957600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fa9500708d0 con 0x7fa9500cf5e0 2024-04-25T19:24:10.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:09.999+0000 7fa957600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa95015f160 con 0x7fa95006c5c0 2024-04-25T19:24:10.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.000+0000 7fa954c00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fa9501443c0 0x7fa95006fe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:33464/0 (socket says 172.21.15.131:33464) 2024-04-25T19:24:10.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.000+0000 7fa954c00640 1 -- 172.21.15.131:0/2017995141 learned_addr learned my addr 172.21.15.131:0/2017995141 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:24:10.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.000+0000 7fa955600640 1 --2- 172.21.15.131:0/2017995141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa95006c5c0 0x7fa95006c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:10.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.000+0000 7fa947e00640 1 --2- 172.21.15.131:0/2017995141 >> v2:172.21.15.195:3300/0 conn(0x7fa9500cf5e0 0x7fa9500cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:10.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.000+0000 7fa94fe00640 1 -- 172.21.15.131:0/2017995141 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1370270725 0 0) 0x7fa940001110 con 0x7fa9501443c0 2024-04-25T19:24:10.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.000+0000 7fa94fe00640 1 -- 172.21.15.131:0/2017995141 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa934003520 con 0x7fa9501443c0 2024-04-25T19:24:10.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.000+0000 7fa955600640 1 -- 172.21.15.131:0/2017995141 >> v2:172.21.15.195:3300/0 conn(0x7fa9500cf5e0 msgr2=0x7fa9500cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:10.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.000+0000 7fa955600640 1 --2- 172.21.15.131:0/2017995141 >> v2:172.21.15.195:3300/0 conn(0x7fa9500cf5e0 0x7fa9500cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:10.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.000+0000 7fa955600640 1 -- 172.21.15.131:0/2017995141 >> v1:172.21.15.131:6789/0 conn(0x7fa9501443c0 legacy=0x7fa95006fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:10.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.000+0000 7fa955600640 1 -- 172.21.15.131:0/2017995141 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa95015f5f0 con 0x7fa95006c5c0 2024-04-25T19:24:10.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.001+0000 7fa955600640 1 --2- 172.21.15.131:0/2017995141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa95006c5c0 0x7fa95006c9d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa948009d90 tx=0x7fa94802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebeb4f111b7e520b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:10.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.002+0000 7fa94fe00640 1 -- 172.21.15.131:0/2017995141 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa948007740 con 0x7fa95006c5c0 2024-04-25T19:24:10.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.002+0000 7fa94fe00640 1 -- 172.21.15.131:0/2017995141 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9480078e0 con 0x7fa95006c5c0 2024-04-25T19:24:10.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.002+0000 7fa94fe00640 1 -- 172.21.15.131:0/2017995141 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa948007c90 con 0x7fa95006c5c0 2024-04-25T19:24:10.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.002+0000 7fa957600640 1 -- 172.21.15.131:0/2017995141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa95006c5c0 msgr2=0x7fa95006c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:10.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.002+0000 7fa957600640 1 --2- 172.21.15.131:0/2017995141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa95006c5c0 0x7fa95006c9d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa948009d90 tx=0x7fa94802a660 comp rx=0 tx=0).stop 2024-04-25T19:24:10.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.002+0000 7fa957600640 1 -- 172.21.15.131:0/2017995141 shutdown_connections 2024-04-25T19:24:10.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.002+0000 7fa957600640 1 --2- 172.21.15.131:0/2017995141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa95006c5c0 0x7fa95006c9d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:10.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.002+0000 7fa957600640 1 --2- 172.21.15.131:0/2017995141 >> v2:172.21.15.195:3300/0 conn(0x7fa9500cf5e0 0x7fa9500cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:10.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.002+0000 7fa957600640 1 -- 172.21.15.131:0/2017995141 >> 172.21.15.131:0/2017995141 conn(0x7fa9500d1ae0 msgr2=0x7fa9500d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:10.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.003+0000 7fa957600640 1 -- 172.21.15.131:0/2017995141 shutdown_connections 2024-04-25T19:24:10.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.003+0000 7fa957600640 1 -- 172.21.15.131:0/2017995141 wait complete. 2024-04-25T19:24:10.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.005+0000 7fa957600640 1 Processor -- start 2024-04-25T19:24:10.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.005+0000 7fa957600640 1 -- start start 2024-04-25T19:24:10.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.006+0000 7fa957600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa95006c5c0 0x7fa9500aa230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:10.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.006+0000 7fa957600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9500cf5e0 0x7fa950155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:10.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.006+0000 7fa957600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9501443c0 0x7fa9501f7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:10.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.006+0000 7fa957600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa95015edf0 con 0x7fa9501443c0 2024-04-25T19:24:10.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.006+0000 7fa957600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa95015eb10 con 0x7fa9500cf5e0 2024-04-25T19:24:10.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.006+0000 7fa957600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa9501447d0 con 0x7fa95006c5c0 2024-04-25T19:24:10.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.007+0000 7fa955600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9501443c0 0x7fa9501f7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:10.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.007+0000 7fa955600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9501443c0 0x7fa9501f7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41818/0 (socket says 172.21.15.131:41818) 2024-04-25T19:24:10.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.007+0000 7fa955600640 1 -- 172.21.15.131:0/841079076 learned_addr learned my addr 172.21.15.131:0/841079076 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:10.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.007+0000 7fa947e00640 1 --2- 172.21.15.131:0/841079076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9500cf5e0 0x7fa950155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:10.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.007+0000 7fa954c00640 1 --2- 172.21.15.131:0/841079076 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa95006c5c0 0x7fa9500aa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:10.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.007+0000 7fa955600640 1 -- 172.21.15.131:0/841079076 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa95006c5c0 msgr2=0x7fa9500aa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:10.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.007+0000 7fa955600640 1 --2- 172.21.15.131:0/841079076 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa95006c5c0 0x7fa9500aa230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:10.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.007+0000 7fa955600640 1 -- 172.21.15.131:0/841079076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9500cf5e0 msgr2=0x7fa950155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:10.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.007+0000 7fa955600640 1 --2- 172.21.15.131:0/841079076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9500cf5e0 0x7fa950155ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:10.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.007+0000 7fa955600640 1 -- 172.21.15.131:0/841079076 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa950133c90 con 0x7fa9501443c0 2024-04-25T19:24:10.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.007+0000 7fa954c00640 1 --2- 172.21.15.131:0/841079076 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa95006c5c0 0x7fa9500aa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T19:24:10.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.007+0000 7fa955600640 1 --2- 172.21.15.131:0/841079076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9501443c0 0x7fa9501f7fb0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa94802ac50 tx=0x7fa948004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:10.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.008+0000 7fa94d600640 1 -- 172.21.15.131:0/841079076 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94803f070 con 0x7fa9501443c0 2024-04-25T19:24:10.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.008+0000 7fa94d600640 1 -- 172.21.15.131:0/841079076 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa948031c60 con 0x7fa9501443c0 2024-04-25T19:24:10.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.008+0000 7fa94d600640 1 -- 172.21.15.131:0/841079076 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa948009450 con 0x7fa9501443c0 2024-04-25T19:24:10.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.008+0000 7fa957600640 1 -- 172.21.15.131:0/841079076 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9500aa770 con 0x7fa9501443c0 2024-04-25T19:24:10.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.008+0000 7fa957600640 1 -- 172.21.15.131:0/841079076 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa95015b6c0 con 0x7fa9501443c0 2024-04-25T19:24:10.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.009+0000 7fa957600640 1 -- 172.21.15.131:0/841079076 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa95015ad60 con 0x7fa9501443c0 2024-04-25T19:24:10.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.010+0000 7fa94d600640 1 -- 172.21.15.131:0/841079076 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa94803b410 con 0x7fa9501443c0 2024-04-25T19:24:10.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.011+0000 7fa94d600640 1 --2- 172.21.15.131:0/841079076 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa92c0744e0 0x7fa92c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:10.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.011+0000 7fa94d600640 1 -- 172.21.15.131:0/841079076 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fa9480b6220 con 0x7fa9501443c0 2024-04-25T19:24:10.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.012+0000 7fa954c00640 1 --2- 172.21.15.131:0/841079076 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa92c0744e0 0x7fa92c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:10.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.012+0000 7fa954c00640 1 --2- 172.21.15.131:0/841079076 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa92c0744e0 0x7fa92c0769f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa940007fd0 tx=0x7fa940009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:10.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.016+0000 7fa94d600640 1 -- 172.21.15.131:0/841079076 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa948080c10 con 0x7fa9501443c0 2024-04-25T19:24:10.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:10.220+0000 7fa957600640 1 -- 172.21.15.131:0/841079076 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fa950133e60 con 0x7fa9501443c0 2024-04-25T19:24:11.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.146+0000 7fa94d600640 1 -- 172.21.15.131:0/841079076 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v41) ==== 97+0+0 (secure 0 0 0) 0x7fa948080510 con 0x7fa9501443c0 2024-04-25T19:24:11.148 INFO:teuthology.orchestra.run.smithi131.stderr: removed all blocklist entries 2024-04-25T19:24:11.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.150+0000 7fa957600640 1 -- 172.21.15.131:0/841079076 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa92c0744e0 msgr2=0x7fa92c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:11.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.150+0000 7fa957600640 1 --2- 172.21.15.131:0/841079076 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa92c0744e0 0x7fa92c0769f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa940007fd0 tx=0x7fa940009040 comp rx=0 tx=0).stop 2024-04-25T19:24:11.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.150+0000 7fa957600640 1 -- 172.21.15.131:0/841079076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9501443c0 msgr2=0x7fa9501f7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:11.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.150+0000 7fa957600640 1 --2- 172.21.15.131:0/841079076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9501443c0 0x7fa9501f7fb0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa94802ac50 tx=0x7fa948004a40 comp rx=0 tx=0).stop 2024-04-25T19:24:11.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.150+0000 7fa957600640 1 -- 172.21.15.131:0/841079076 shutdown_connections 2024-04-25T19:24:11.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.150+0000 7fa957600640 1 --2- 172.21.15.131:0/841079076 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa92c0744e0 0x7fa92c0769f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:11.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.150+0000 7fa957600640 1 --2- 172.21.15.131:0/841079076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9501443c0 0x7fa9501f7fb0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:11.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.150+0000 7fa957600640 1 --2- 172.21.15.131:0/841079076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9500cf5e0 0x7fa950155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:11.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.150+0000 7fa957600640 1 --2- 172.21.15.131:0/841079076 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa95006c5c0 0x7fa9500aa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:11.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.150+0000 7fa957600640 1 -- 172.21.15.131:0/841079076 >> 172.21.15.131:0/841079076 conn(0x7fa9500d1ae0 msgr2=0x7fa95006c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:11.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.151+0000 7fa957600640 1 -- 172.21.15.131:0/841079076 shutdown_connections 2024-04-25T19:24:11.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.151+0000 7fa957600640 1 -- 172.21.15.131:0/841079076 wait complete. 2024-04-25T19:24:11.182 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T19:24:11.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.444+0000 7f4d71200640 1 Processor -- start 2024-04-25T19:24:11.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.444+0000 7f4d71200640 1 -- start start 2024-04-25T19:24:11.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.446+0000 7f4d71200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d6c13fe10 0x7f4d6c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:11.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.446+0000 7f4d71200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4d6c06db10 0x7f4d6c142730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:11.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.446+0000 7f4d71200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d6c06df20 con 0x7f4d6c142c70 2024-04-25T19:24:11.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.446+0000 7f4d71200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4d6c15d5e0 con 0x7f4d6c06db10 2024-04-25T19:24:11.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.446+0000 7f4d71200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4d6c15d8c0 con 0x7f4d6c13fe10 2024-04-25T19:24:11.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.446+0000 7f4d6be00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f4d6c142c70 0x7f4d6c070240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:33470/0 (socket says 172.21.15.131:33470) 2024-04-25T19:24:11.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.446+0000 7f4d6be00640 1 -- 172.21.15.131:0/841815594 learned_addr learned my addr 172.21.15.131:0/841815594 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:24:11.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.446+0000 7f4d62a00640 1 --2- 172.21.15.131:0/841815594 >> v2:172.21.15.195:3300/0 conn(0x7f4d6c06db10 0x7f4d6c142730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:11.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.447+0000 7f4d6b400640 1 --2- 172.21.15.131:0/841815594 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d6c13fe10 0x7f4d6c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:11.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.447+0000 7f4d6aa00640 1 -- 172.21.15.131:0/841815594 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 278631658 0 0) 0x7f4d64001490 con 0x7f4d6c142c70 2024-04-25T19:24:11.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.447+0000 7f4d6aa00640 1 -- 172.21.15.131:0/841815594 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d50003520 con 0x7f4d6c142c70 2024-04-25T19:24:11.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.447+0000 7f4d6aa00640 1 -- 172.21.15.131:0/841815594 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 284588265 0 0) 0x7f4d50003520 con 0x7f4d6c142c70 2024-04-25T19:24:11.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.447+0000 7f4d6aa00640 1 -- 172.21.15.131:0/841815594 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d6c13fe10 msgr2=0x7f4d6c06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:11.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.447+0000 7f4d6aa00640 1 --2- 172.21.15.131:0/841815594 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d6c13fe10 0x7f4d6c06d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:11.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.447+0000 7f4d6aa00640 1 -- 172.21.15.131:0/841815594 >> v2:172.21.15.195:3300/0 conn(0x7f4d6c06db10 msgr2=0x7f4d6c142730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:11.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.447+0000 7f4d6aa00640 1 --2- 172.21.15.131:0/841815594 >> v2:172.21.15.195:3300/0 conn(0x7f4d6c06db10 0x7f4d6c142730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:11.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.447+0000 7f4d6aa00640 1 -- 172.21.15.131:0/841815594 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6c15dba0 con 0x7f4d6c142c70 2024-04-25T19:24:11.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.447+0000 7f4d6aa00640 1 -- 172.21.15.131:0/841815594 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f4d64001bc0 con 0x7f4d6c142c70 2024-04-25T19:24:11.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.447+0000 7f4d6aa00640 1 -- 172.21.15.131:0/841815594 >> v1:172.21.15.131:6789/0 conn(0x7f4d6c142c70 legacy=0x7f4d6c070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:11.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.447+0000 7f4d6aa00640 1 --2- 172.21.15.131:0/841815594 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d6c13fe10 0x7f4d500039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:11.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.447+0000 7f4d6aa00640 1 --2- 172.21.15.131:0/841815594 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d50003f80 0x7f4d50004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:11.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.447+0000 7f4d6aa00640 1 --2- 172.21.15.131:0/841815594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d50004d40 0x7f4d50005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:11.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.447+0000 7f4d6aa00640 1 -- 172.21.15.131:0/841815594 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6c15d5e0 con 0x7f4d50004d40 2024-04-25T19:24:11.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.447+0000 7f4d6aa00640 1 -- 172.21.15.131:0/841815594 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6c15d8c0 con 0x7f4d50003f80 2024-04-25T19:24:11.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.447+0000 7f4d6aa00640 1 -- 172.21.15.131:0/841815594 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4d5000bba0 con 0x7f4d6c13fe10 2024-04-25T19:24:11.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.447+0000 7f4d6be00640 1 --2- 172.21.15.131:0/841815594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d50004d40 0x7f4d50005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:11.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.448+0000 7f4d6b400640 1 --2- 172.21.15.131:0/841815594 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d6c13fe10 0x7f4d500039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:11.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.448+0000 7f4d62a00640 1 --2- 172.21.15.131:0/841815594 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d50003f80 0x7f4d50004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:11.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.448+0000 7f4d6be00640 1 -- 172.21.15.131:0/841815594 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d6c13fe10 msgr2=0x7f4d500039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:11.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.448+0000 7f4d6be00640 1 --2- 172.21.15.131:0/841815594 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d6c13fe10 0x7f4d500039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:11.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.448+0000 7f4d6be00640 1 -- 172.21.15.131:0/841815594 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d50003f80 msgr2=0x7f4d50004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:11.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.448+0000 7f4d6be00640 1 --2- 172.21.15.131:0/841815594 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d50003f80 0x7f4d50004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:11.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.448+0000 7f4d6be00640 1 -- 172.21.15.131:0/841815594 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d50003520 con 0x7f4d50004d40 2024-04-25T19:24:11.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.449+0000 7f4d6be00640 1 --2- 172.21.15.131:0/841815594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d50004d40 0x7f4d50005150 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c140240 tx=0x7f4d50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=153beeefce9838cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:11.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.449+0000 7f4d6aa00640 1 -- 172.21.15.131:0/841815594 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6400a5d0 con 0x7f4d50004d40 2024-04-25T19:24:11.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.449+0000 7f4d6aa00640 1 -- 172.21.15.131:0/841815594 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d6402f070 con 0x7f4d50004d40 2024-04-25T19:24:11.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.449+0000 7f4d6aa00640 1 -- 172.21.15.131:0/841815594 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6402bdb0 con 0x7f4d50004d40 2024-04-25T19:24:11.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.450+0000 7f4d71200640 1 -- 172.21.15.131:0/841815594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d50004d40 msgr2=0x7f4d50005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:11.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.450+0000 7f4d71200640 1 --2- 172.21.15.131:0/841815594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d50004d40 0x7f4d50005150 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c140240 tx=0x7f4d50005830 comp rx=0 tx=0).stop 2024-04-25T19:24:11.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.450+0000 7f4d6be00640 1 -- 172.21.15.131:0/841815594 reap_dead start 2024-04-25T19:24:11.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.450+0000 7f4d71200640 1 -- 172.21.15.131:0/841815594 shutdown_connections 2024-04-25T19:24:11.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.450+0000 7f4d71200640 1 -- 172.21.15.131:0/841815594 >> 172.21.15.131:0/841815594 conn(0x7f4d6c072ee0 msgr2=0x7f4d6c0732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:11.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.450+0000 7f4d71200640 1 -- 172.21.15.131:0/841815594 shutdown_connections 2024-04-25T19:24:11.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.450+0000 7f4d71200640 1 -- 172.21.15.131:0/841815594 wait complete. 2024-04-25T19:24:11.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.453+0000 7f4d71200640 1 Processor -- start 2024-04-25T19:24:11.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.453+0000 7f4d71200640 1 -- start start 2024-04-25T19:24:11.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.454+0000 7f4d71200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d50004d40 0x7f4d6c141a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:11.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.454+0000 7f4d71200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d6c141f50 0x7f4d6c145950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:11.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.454+0000 7f4d71200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d6c145e90 0x7f4d6c1f4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:11.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.454+0000 7f4d71200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6c143080 con 0x7f4d50004d40 2024-04-25T19:24:11.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.454+0000 7f4d71200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6c15d2d0 con 0x7f4d6c141f50 2024-04-25T19:24:11.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.454+0000 7f4d71200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4d6c143200 con 0x7f4d6c145e90 2024-04-25T19:24:11.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.454+0000 7f4d6b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d50004d40 0x7f4d6c141a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:11.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.454+0000 7f4d6b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d50004d40 0x7f4d6c141a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41834/0 (socket says 172.21.15.131:41834) 2024-04-25T19:24:11.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.454+0000 7f4d6b400640 1 -- 172.21.15.131:0/762671674 learned_addr learned my addr 172.21.15.131:0/762671674 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:11.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.455+0000 7f4d62a00640 1 --2- 172.21.15.131:0/762671674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d6c141f50 0x7f4d6c145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:11.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.455+0000 7f4d6be00640 1 --2- 172.21.15.131:0/762671674 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d6c145e90 0x7f4d6c1f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:11.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.455+0000 7f4d6b400640 1 -- 172.21.15.131:0/762671674 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d6c145e90 msgr2=0x7f4d6c1f4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:11.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.455+0000 7f4d6b400640 1 --2- 172.21.15.131:0/762671674 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d6c145e90 0x7f4d6c1f4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:11.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.455+0000 7f4d6b400640 1 -- 172.21.15.131:0/762671674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d6c141f50 msgr2=0x7f4d6c145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:11.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.455+0000 7f4d6b400640 1 --2- 172.21.15.131:0/762671674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d6c141f50 0x7f4d6c145950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:11.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.455+0000 7f4d6b400640 1 -- 172.21.15.131:0/762671674 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6c154550 con 0x7f4d50004d40 2024-04-25T19:24:11.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.455+0000 7f4d6b400640 1 --2- 172.21.15.131:0/762671674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d50004d40 0x7f4d6c141a10 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00f550 tx=0x7f4d5c00fa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:11.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.455+0000 7f4d63e00640 1 -- 172.21.15.131:0/762671674 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c019030 con 0x7f4d50004d40 2024-04-25T19:24:11.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.455+0000 7f4d63e00640 1 -- 172.21.15.131:0/762671674 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d5c004020 con 0x7f4d50004d40 2024-04-25T19:24:11.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.455+0000 7f4d71200640 1 -- 172.21.15.131:0/762671674 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d6c154830 con 0x7f4d50004d40 2024-04-25T19:24:11.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.456+0000 7f4d63e00640 1 -- 172.21.15.131:0/762671674 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c0043f0 con 0x7f4d50004d40 2024-04-25T19:24:11.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.456+0000 7f4d71200640 1 -- 172.21.15.131:0/762671674 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d6c154df0 con 0x7f4d50004d40 2024-04-25T19:24:11.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.457+0000 7f4d71200640 1 -- 172.21.15.131:0/762671674 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d6c050740 con 0x7f4d50004d40 2024-04-25T19:24:11.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.458+0000 7f4d63e00640 1 -- 172.21.15.131:0/762671674 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4d5c01c070 con 0x7f4d50004d40 2024-04-25T19:24:11.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.459+0000 7f4d63e00640 1 --2- 172.21.15.131:0/762671674 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f4d48074450 0x7f4d48076960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:11.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.459+0000 7f4d63e00640 1 -- 172.21.15.131:0/762671674 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f4d5c0953e0 con 0x7f4d50004d40 2024-04-25T19:24:11.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.460+0000 7f4d62a00640 1 --2- 172.21.15.131:0/762671674 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f4d48074450 0x7f4d48076960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:11.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.461+0000 7f4d62a00640 1 --2- 172.21.15.131:0/762671674 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f4d48074450 0x7f4d48076960 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c13f8b0 tx=0x7f4d54008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:11.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.464+0000 7f4d63e00640 1 -- 172.21.15.131:0/762671674 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4d5c05fe20 con 0x7f4d50004d40 2024-04-25T19:24:11.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.736+0000 7f4d71200640 1 -- 172.21.15.131:0/762671674 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f4d6c0b5350 con 0x7f4d50004d40 2024-04-25T19:24:11.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.737+0000 7f4d63e00640 1 -- 172.21.15.131:0/762671674 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7f4d5c05f720 con 0x7f4d50004d40 2024-04-25T19:24:11.739 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:24:11.739 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-25T19:24:11.739 INFO:teuthology.orchestra.run.smithi131.stdout: "auth_dump": [ 2024-04-25T19:24:11.739 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:24:11.739 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "mds.a", 2024-04-25T19:24:11.739 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAlrSpmqg5cNxAAWJ0TNKbWYEtA7s5RxJ6Fhg==", 2024-04-25T19:24:11.740 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:24:11.740 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow", 2024-04-25T19:24:11.740 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow *", 2024-04-25T19:24:11.740 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow *", 2024-04-25T19:24:11.740 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:24:11.740 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:24:11.740 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:24:11.740 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:24:11.740 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "mds.b", 2024-04-25T19:24:11.740 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAmrSpmPcS8IxAA0/2QnmpsJxkbZGtvgPzigA==", 2024-04-25T19:24:11.740 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:24:11.740 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow", 2024-04-25T19:24:11.741 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow *", 2024-04-25T19:24:11.741 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow *", 2024-04-25T19:24:11.741 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:24:11.741 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:24:11.741 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:24:11.741 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:24:11.741 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "mds.c", 2024-04-25T19:24:11.741 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAmrSpmYTSdDxAAe05MkvENoxxx/9CEAqVulw==", 2024-04-25T19:24:11.741 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:24:11.741 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow", 2024-04-25T19:24:11.741 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow *", 2024-04-25T19:24:11.741 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow *", 2024-04-25T19:24:11.741 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:24:11.742 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:24:11.742 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:24:11.742 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:24:11.742 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "mds.d", 2024-04-25T19:24:11.742 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAmrSpmlTDINRAANW7Yrhyzj9B9tueRk+OALw==", 2024-04-25T19:24:11.742 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:24:11.742 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow", 2024-04-25T19:24:11.742 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow *", 2024-04-25T19:24:11.742 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow *", 2024-04-25T19:24:11.742 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:24:11.742 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:24:11.742 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:24:11.742 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:24:11.742 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "osd.0", 2024-04-25T19:24:11.743 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQArrSpmDyNSExAAq7QOaxXYhk0uJro2xsAnIQ==", 2024-04-25T19:24:11.743 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:24:11.743 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow profile osd", 2024-04-25T19:24:11.743 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile osd", 2024-04-25T19:24:11.743 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:24:11.743 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:24:11.743 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:24:11.743 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:24:11.743 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "osd.1", 2024-04-25T19:24:11.743 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAurSpm5oMiNRAARATy+zVosunvnnyrj20Vag==", 2024-04-25T19:24:11.743 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:24:11.743 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow profile osd", 2024-04-25T19:24:11.743 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile osd", 2024-04-25T19:24:11.744 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:24:11.744 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:24:11.744 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:24:11.744 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:24:11.744 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "osd.2", 2024-04-25T19:24:11.744 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAyrSpmaiGyGRAA7/TDEA2+LxFGdAssJD67yA==", 2024-04-25T19:24:11.744 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:24:11.745 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow profile osd", 2024-04-25T19:24:11.745 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile osd", 2024-04-25T19:24:11.745 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:24:11.745 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:24:11.745 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:24:11.745 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:24:11.745 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "osd.3", 2024-04-25T19:24:11.745 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQA1rSpmc3idKRAA46Dj8IuduRvkuZzZZcz+Pw==", 2024-04-25T19:24:11.745 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:24:11.745 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow profile osd", 2024-04-25T19:24:11.746 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile osd", 2024-04-25T19:24:11.746 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:24:11.746 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:24:11.746 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:24:11.746 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:24:11.746 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "osd.4", 2024-04-25T19:24:11.746 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQA6rSpmBf1IKxAA0WHniS5uxIAFRlmPXdovZQ==", 2024-04-25T19:24:11.746 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:24:11.746 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow profile osd", 2024-04-25T19:24:11.746 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile osd", 2024-04-25T19:24:11.746 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:24:11.746 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:24:11.746 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:24:11.746 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:24:11.747 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "osd.5", 2024-04-25T19:24:11.747 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQA+rSpmaa1EDRAA4sjV6lnWG2Wks2UMi+mDsg==", 2024-04-25T19:24:11.747 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:24:11.747 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow profile osd", 2024-04-25T19:24:11.747 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile osd", 2024-04-25T19:24:11.747 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:24:11.747 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:24:11.747 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:24:11.747 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:24:11.747 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "osd.6", 2024-04-25T19:24:11.747 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQBBrSpmRAtbHBAAoX0qYn2X8UQvVhD9/8ESpQ==", 2024-04-25T19:24:11.747 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:24:11.747 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow profile osd", 2024-04-25T19:24:11.747 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile osd", 2024-04-25T19:24:11.748 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:24:11.748 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:24:11.748 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:24:11.748 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:24:11.748 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "osd.7", 2024-04-25T19:24:11.748 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQBErSpm/ySRLBAAslPaxYOGkHT9/nOX04fVSA==", 2024-04-25T19:24:11.748 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:24:11.748 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow profile osd", 2024-04-25T19:24:11.748 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile osd", 2024-04-25T19:24:11.748 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:24:11.748 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:24:11.748 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:24:11.748 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:24:11.749 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.0", 2024-04-25T19:24:11.749 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAnrSpmvjE7CxAABw7VdVfflQSjatWfjdHUXQ==", 2024-04-25T19:24:11.749 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:24:11.749 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow", 2024-04-25T19:24:11.749 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow r", 2024-04-25T19:24:11.749 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T19:24:11.749 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:24:11.749 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:24:11.749 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:24:11.750 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.1", 2024-04-25T19:24:11.750 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAnrSpmSP3NJxAAJZ3U1F/vuUzN2tAHqtIreA==", 2024-04-25T19:24:11.750 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:24:11.750 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow", 2024-04-25T19:24:11.750 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow r", 2024-04-25T19:24:11.750 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow rw", 2024-04-25T19:24:11.750 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow rwx" 2024-04-25T19:24:11.750 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:24:11.751 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:24:11.751 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:24:11.751 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.2", 2024-04-25T19:24:11.751 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAnrSpm5+TmGBAA3du3m8geJUah6/gf6KfBww==", 2024-04-25T19:24:11.751 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:24:11.751 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow", 2024-04-25T19:24:11.751 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow r", 2024-04-25T19:24:11.751 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow rw", 2024-04-25T19:24:11.751 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow rwx" 2024-04-25T19:24:11.752 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:24:11.752 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:24:11.752 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:24:11.752 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.3", 2024-04-25T19:24:11.752 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAnrSpm0pcbNRAAnUUEf+YKSh6BjpnN1NpC9w==", 2024-04-25T19:24:11.752 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:24:11.752 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow", 2024-04-25T19:24:11.752 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow r", 2024-04-25T19:24:11.753 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow rw", 2024-04-25T19:24:11.753 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow rwx" 2024-04-25T19:24:11.753 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:24:11.753 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:24:11.753 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:24:11.753 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.admin", 2024-04-25T19:24:11.753 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAkrSpm92F7JhAADCf4e6pojPAzP2pr+RjT/g==", 2024-04-25T19:24:11.753 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:24:11.753 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow *", 2024-04-25T19:24:11.754 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow *", 2024-04-25T19:24:11.754 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow *", 2024-04-25T19:24:11.754 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:24:11.754 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:24:11.754 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:24:11.754 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:24:11.754 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "mgr.x", 2024-04-25T19:24:11.754 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAlrSpmc81JKBAA83A0rfzYE5nUkz0rH1KrSw==", 2024-04-25T19:24:11.755 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:24:11.755 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow *", 2024-04-25T19:24:11.755 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile mgr", 2024-04-25T19:24:11.755 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:24:11.755 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:24:11.755 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-25T19:24:11.755 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:24:11.755 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "mgr.y", 2024-04-25T19:24:11.755 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAlrSpm8cFSGhAAzZX5s8YMuNvdbiCd34TG5Q==", 2024-04-25T19:24:11.756 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-04-25T19:24:11.756 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow *", 2024-04-25T19:24:11.756 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile mgr", 2024-04-25T19:24:11.756 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-04-25T19:24:11.756 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:24:11.756 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:24:11.756 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-25T19:24:11.756 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-25T19:24:11.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.740+0000 7f4d71200640 1 -- 172.21.15.131:0/762671674 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f4d48074450 msgr2=0x7f4d48076960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:11.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.740+0000 7f4d71200640 1 --2- 172.21.15.131:0/762671674 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f4d48074450 0x7f4d48076960 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c13f8b0 tx=0x7f4d54008040 comp rx=0 tx=0).stop 2024-04-25T19:24:11.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.740+0000 7f4d71200640 1 -- 172.21.15.131:0/762671674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d50004d40 msgr2=0x7f4d6c141a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:11.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.740+0000 7f4d71200640 1 --2- 172.21.15.131:0/762671674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d50004d40 0x7f4d6c141a10 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00f550 tx=0x7f4d5c00fa10 comp rx=0 tx=0).stop 2024-04-25T19:24:11.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.740+0000 7f4d71200640 1 -- 172.21.15.131:0/762671674 shutdown_connections 2024-04-25T19:24:11.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.740+0000 7f4d71200640 1 --2- 172.21.15.131:0/762671674 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f4d48074450 0x7f4d48076960 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:11.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.740+0000 7f4d71200640 1 --2- 172.21.15.131:0/762671674 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d6c145e90 0x7f4d6c1f4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:11.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.740+0000 7f4d71200640 1 --2- 172.21.15.131:0/762671674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d6c141f50 0x7f4d6c145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:11.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.740+0000 7f4d71200640 1 --2- 172.21.15.131:0/762671674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d50004d40 0x7f4d6c141a10 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:11.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.740+0000 7f4d71200640 1 -- 172.21.15.131:0/762671674 >> 172.21.15.131:0/762671674 conn(0x7f4d6c072ee0 msgr2=0x7f4d6c06f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:11.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.740+0000 7f4d71200640 1 -- 172.21.15.131:0/762671674 shutdown_connections 2024-04-25T19:24:11.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:11.741+0000 7f4d71200640 1 -- 172.21.15.131:0/762671674 wait complete. 2024-04-25T19:24:11.770 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:24:12.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.038+0000 7f0ca5400640 1 Processor -- start 2024-04-25T19:24:12.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.038+0000 7f0ca5400640 1 -- start start 2024-04-25T19:24:12.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.040+0000 7f0ca5400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0ca0070e20 0x7f0ca015c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:12.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.040+0000 7f0ca5400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ca006d560 0x7f0ca00b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:12.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.040+0000 7f0ca5400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ca0071230 con 0x7f0ca006f180 2024-04-25T19:24:12.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.040+0000 7f0ca5400640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f0ca006f8f0 con 0x7f0ca0070e20 2024-04-25T19:24:12.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.040+0000 7f0ca5400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0ca006fbd0 con 0x7f0ca006d560 2024-04-25T19:24:12.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.040+0000 7f0c9fe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0ca0070e20 0x7f0ca015c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:12.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.040+0000 7f0c9fe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0ca0070e20 0x7f0ca015c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41848/0 (socket says 172.21.15.131:41848) 2024-04-25T19:24:12.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.040+0000 7f0c9fe00640 1 -- 172.21.15.131:0/4097920573 learned_addr learned my addr 172.21.15.131:0/4097920573 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:12.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.041+0000 7f0ca4a00640 1 --2- 172.21.15.131:0/4097920573 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ca006d560 0x7f0ca00b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:12.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.041+0000 7f0c9fe00640 1 -- 172.21.15.131:0/4097920573 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ca006d560 msgr2=0x7f0ca00b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:12.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.041+0000 7f0c9fe00640 1 --2- 172.21.15.131:0/4097920573 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ca006d560 0x7f0ca00b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:12.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.041+0000 7f0c9fe00640 1 -- 172.21.15.131:0/4097920573 >> v1:172.21.15.195:6789/0 conn(0x7f0ca006f180 legacy=0x7f0ca006ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:12.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.041+0000 7f0c9fe00640 1 -- 172.21.15.131:0/4097920573 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca006feb0 con 0x7f0ca0070e20 2024-04-25T19:24:12.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.041+0000 7f0ca4a00640 1 --2- 172.21.15.131:0/4097920573 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ca006d560 0x7f0ca00b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:24:12.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.042+0000 7f0c9fe00640 1 --2- 172.21.15.131:0/4097920573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ca0070e20 0x7f0ca015c800 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0c90009870 tx=0x7f0c9002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad47db41dc127db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:12.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.042+0000 7f0c9f400640 1 -- 172.21.15.131:0/4097920573 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c90037070 con 0x7f0ca0070e20 2024-04-25T19:24:12.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.042+0000 7f0c9f400640 1 -- 172.21.15.131:0/4097920573 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c90032440 con 0x7f0ca0070e20 2024-04-25T19:24:12.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.042+0000 7f0c9f400640 1 -- 172.21.15.131:0/4097920573 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c90032810 con 0x7f0ca0070e20 2024-04-25T19:24:12.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.043+0000 7f0ca5400640 1 -- 172.21.15.131:0/4097920573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ca0070e20 msgr2=0x7f0ca015c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:12.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.043+0000 7f0ca5400640 1 --2- 172.21.15.131:0/4097920573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ca0070e20 0x7f0ca015c800 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0c90009870 tx=0x7f0c9002a210 comp rx=0 tx=0).stop 2024-04-25T19:24:12.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.043+0000 7f0ca5400640 1 -- 172.21.15.131:0/4097920573 shutdown_connections 2024-04-25T19:24:12.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.043+0000 7f0ca5400640 1 --2- 172.21.15.131:0/4097920573 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ca006d560 0x7f0ca00b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:12.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.043+0000 7f0ca5400640 1 --2- 172.21.15.131:0/4097920573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ca0070e20 0x7f0ca015c800 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:12.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.043+0000 7f0ca5400640 1 -- 172.21.15.131:0/4097920573 >> 172.21.15.131:0/4097920573 conn(0x7f0ca00d1720 msgr2=0x7f0ca00d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:12.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.043+0000 7f0ca5400640 1 -- 172.21.15.131:0/4097920573 shutdown_connections 2024-04-25T19:24:12.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.043+0000 7f0ca5400640 1 -- 172.21.15.131:0/4097920573 wait complete. 2024-04-25T19:24:12.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.045+0000 7f0ca5400640 1 Processor -- start 2024-04-25T19:24:12.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.045+0000 7f0ca5400640 1 -- start start 2024-04-25T19:24:12.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.047+0000 7f0ca5400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ca006f180 0x7f0ca0145e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:12.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.047+0000 7f0ca5400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ca0070e20 0x7f0ca0142870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:12.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.047+0000 7f0ca5400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ca0155b10 0x7f0ca00b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:12.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.047+0000 7f0ca5400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca006c5c0 con 0x7f0ca006f180 2024-04-25T19:24:12.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.047+0000 7f0ca5400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca006f590 con 0x7f0ca0155b10 2024-04-25T19:24:12.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.047+0000 7f0ca5400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0ca006c740 con 0x7f0ca0070e20 2024-04-25T19:24:12.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.047+0000 7f0c9fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ca006f180 0x7f0ca0145e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:12.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.047+0000 7f0c9fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ca006f180 0x7f0ca0145e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41854/0 (socket says 172.21.15.131:41854) 2024-04-25T19:24:12.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.047+0000 7f0c9fe00640 1 -- 172.21.15.131:0/1817796818 learned_addr learned my addr 172.21.15.131:0/1817796818 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:12.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.047+0000 7f0ca4a00640 1 --2- 172.21.15.131:0/1817796818 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ca0155b10 0x7f0ca00b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:12.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.047+0000 7f0c9fe00640 1 -- 172.21.15.131:0/1817796818 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ca0070e20 msgr2=0x7f0ca0142870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:12.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.047+0000 7f0c9fe00640 1 --2- 172.21.15.131:0/1817796818 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ca0070e20 0x7f0ca0142870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:12.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.047+0000 7f0c9fe00640 1 -- 172.21.15.131:0/1817796818 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ca0155b10 msgr2=0x7f0ca00b6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:12.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.047+0000 7f0c9fe00640 1 --2- 172.21.15.131:0/1817796818 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ca0155b10 0x7f0ca00b6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:12.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.047+0000 7f0c9fe00640 1 -- 172.21.15.131:0/1817796818 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca01432b0 con 0x7f0ca006f180 2024-04-25T19:24:12.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.048+0000 7f0c9fe00640 1 --2- 172.21.15.131:0/1817796818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ca006f180 0x7f0ca0145e00 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0c90000c00 tx=0x7f0c900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:12.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.048+0000 7f0c9cc00640 1 -- 172.21.15.131:0/1817796818 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c90037040 con 0x7f0ca006f180 2024-04-25T19:24:12.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.048+0000 7f0c9cc00640 1 -- 172.21.15.131:0/1817796818 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c90042070 con 0x7f0ca006f180 2024-04-25T19:24:12.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.048+0000 7f0c9cc00640 1 -- 172.21.15.131:0/1817796818 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c90030bb0 con 0x7f0ca006f180 2024-04-25T19:24:12.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.048+0000 7f0ca5400640 1 -- 172.21.15.131:0/1817796818 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ca0143520 con 0x7f0ca006f180 2024-04-25T19:24:12.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.048+0000 7f0ca5400640 1 -- 172.21.15.131:0/1817796818 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ca0143ae0 con 0x7f0ca006f180 2024-04-25T19:24:12.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.049+0000 7f0ca5400640 1 -- 172.21.15.131:0/1817796818 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ca0050740 con 0x7f0ca006f180 2024-04-25T19:24:12.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.051+0000 7f0c9cc00640 1 -- 172.21.15.131:0/1817796818 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0c90047460 con 0x7f0ca006f180 2024-04-25T19:24:12.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.052+0000 7f0c9cc00640 1 --2- 172.21.15.131:0/1817796818 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0c7c0744b0 0x7f0c7c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:12.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.052+0000 7f0c9cc00640 1 -- 172.21.15.131:0/1817796818 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f0c900b5c10 con 0x7f0ca006f180 2024-04-25T19:24:12.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.052+0000 7f0c97400640 1 --2- 172.21.15.131:0/1817796818 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0c7c0744b0 0x7f0c7c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:12.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.053+0000 7f0c97400640 1 --2- 172.21.15.131:0/1817796818 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0c7c0744b0 0x7f0c7c0769c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0c88006fd0 tx=0x7f0c88006bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:12.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.056+0000 7f0c9cc00640 1 -- 172.21.15.131:0/1817796818 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0c900806e0 con 0x7f0ca006f180 2024-04-25T19:24:12.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.260+0000 7f0ca5400640 1 -- 172.21.15.131:0/1817796818 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ca01598c0 con 0x7f0ca006f180 2024-04-25T19:24:12.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.263+0000 7f0c9cc00640 1 -- 172.21.15.131:0/1817796818 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+12915 (secure 0 0 0) 0x7f0c9007ffe0 con 0x7f0ca006f180 2024-04-25T19:24:12.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:24:12.265 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":41,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:24:11.137275+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:24:12.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.265+0000 7f0ca5400640 1 -- 172.21.15.131:0/1817796818 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0c7c0744b0 msgr2=0x7f0c7c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:12.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.265+0000 7f0ca5400640 1 --2- 172.21.15.131:0/1817796818 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0c7c0744b0 0x7f0c7c0769c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0c88006fd0 tx=0x7f0c88006bc0 comp rx=0 tx=0).stop 2024-04-25T19:24:12.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.265+0000 7f0ca5400640 1 -- 172.21.15.131:0/1817796818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ca006f180 msgr2=0x7f0ca0145e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:12.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.265+0000 7f0ca5400640 1 --2- 172.21.15.131:0/1817796818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ca006f180 0x7f0ca0145e00 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0c90000c00 tx=0x7f0c900046c0 comp rx=0 tx=0).stop 2024-04-25T19:24:12.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.265+0000 7f0ca5400640 1 -- 172.21.15.131:0/1817796818 shutdown_connections 2024-04-25T19:24:12.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.265+0000 7f0ca5400640 1 --2- 172.21.15.131:0/1817796818 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f0c7c0744b0 0x7f0c7c0769c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:12.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.265+0000 7f0ca5400640 1 --2- 172.21.15.131:0/1817796818 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ca0070e20 0x7f0ca0142870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:12.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.265+0000 7f0ca5400640 1 --2- 172.21.15.131:0/1817796818 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ca0155b10 0x7f0ca00b6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:12.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.265+0000 7f0ca5400640 1 --2- 172.21.15.131:0/1817796818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ca006f180 0x7f0ca0145e00 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:12.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.265+0000 7f0ca5400640 1 -- 172.21.15.131:0/1817796818 >> 172.21.15.131:0/1817796818 conn(0x7f0ca00d1720 msgr2=0x7f0ca00b2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:12.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.265+0000 7f0ca5400640 1 -- 172.21.15.131:0/1817796818 shutdown_connections 2024-04-25T19:24:12.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.266+0000 7f0ca5400640 1 -- 172.21.15.131:0/1817796818 wait complete. 2024-04-25T19:24:12.293 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T19:22:04.178847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T19:24:12.294 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T19:24:12.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.571+0000 7ff5d1200640 1 Processor -- start 2024-04-25T19:24:12.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.571+0000 7ff5d1200640 1 -- start start 2024-04-25T19:24:12.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.574+0000 7ff5d1200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff5cc1458c0 0x7ff5cc06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:12.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.574+0000 7ff5d1200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5cc145cd0 con 0x7ff5cc15cfa0 2024-04-25T19:24:12.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.574+0000 7ff5d1200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5cc15d5c0 con 0x7ff5cc0ce250 2024-04-25T19:24:12.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.574+0000 7ff5d1200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff5cc0742c0 con 0x7ff5cc1458c0 2024-04-25T19:24:12.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.574+0000 7ff5c1400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7ff5cc15cfa0 0x7ff5cc0b47b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:33484/0 (socket says 172.21.15.131:33484) 2024-04-25T19:24:12.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.574+0000 7ff5c1400640 1 -- 172.21.15.131:0/1952302252 learned_addr learned my addr 172.21.15.131:0/1952302252 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:24:12.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.574+0000 7ff5ca800640 1 --2- 172.21.15.131:0/1952302252 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff5cc1458c0 0x7ff5cc06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:12.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.574+0000 7ff5c9400640 1 -- 172.21.15.131:0/1952302252 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2496234584 0 0) 0x7ff5cc145cd0 con 0x7ff5cc15cfa0 2024-04-25T19:24:12.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.575+0000 7ff5c9400640 1 -- 172.21.15.131:0/1952302252 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5b0005730 con 0x7ff5cc15cfa0 2024-04-25T19:24:12.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.575+0000 7ff5c9400640 1 -- 172.21.15.131:0/1952302252 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2160058728 0 0) 0x7ff5b0005730 con 0x7ff5cc15cfa0 2024-04-25T19:24:12.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.575+0000 7ff5c9400640 1 -- 172.21.15.131:0/1952302252 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff5cc1458c0 msgr2=0x7ff5cc06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:12.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.575+0000 7ff5c9400640 1 --2- 172.21.15.131:0/1952302252 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff5cc1458c0 0x7ff5cc06d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:12.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.575+0000 7ff5c9400640 1 -- 172.21.15.131:0/1952302252 >> v1:172.21.15.195:6789/0 conn(0x7ff5cc0ce250 legacy=0x7ff5cc073bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:12.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.575+0000 7ff5c9400640 1 -- 172.21.15.131:0/1952302252 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5cc15d8a0 con 0x7ff5cc15cfa0 2024-04-25T19:24:12.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.575+0000 7ff5c9400640 1 -- 172.21.15.131:0/1952302252 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7ff5b4001690 con 0x7ff5cc15cfa0 2024-04-25T19:24:12.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.575+0000 7ff5ca800640 1 --2- 172.21.15.131:0/1952302252 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff5cc1458c0 0x7ff5cc06d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T19:24:12.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.575+0000 7ff5c9400640 1 -- 172.21.15.131:0/1952302252 >> v1:172.21.15.131:6789/0 conn(0x7ff5cc15cfa0 legacy=0x7ff5cc0b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:12.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.575+0000 7ff5c9400640 1 --2- 172.21.15.131:0/1952302252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5b0005bf0 0x7ff5b0006060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:12.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.575+0000 7ff5c9400640 1 --2- 172.21.15.131:0/1952302252 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff5cc1458c0 0x7ff5b0006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:12.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.575+0000 7ff5c9400640 1 --2- 172.21.15.131:0/1952302252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5b0006f50 0x7ff5b00073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:12.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.575+0000 7ff5c9400640 1 -- 172.21.15.131:0/1952302252 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff5cc0742c0 con 0x7ff5b0006f50 2024-04-25T19:24:12.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.575+0000 7ff5c9400640 1 -- 172.21.15.131:0/1952302252 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b000de60 con 0x7ff5b0005bf0 2024-04-25T19:24:12.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.575+0000 7ff5c9400640 1 -- 172.21.15.131:0/1952302252 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff5b000e060 con 0x7ff5cc1458c0 2024-04-25T19:24:12.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.575+0000 7ff5ca800640 1 --2- 172.21.15.131:0/1952302252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5b0006f50 0x7ff5b00073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:12.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.576+0000 7ff5c1400640 1 --2- 172.21.15.131:0/1952302252 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff5cc1458c0 0x7ff5b0006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:12.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.576+0000 7ff5c9e00640 1 --2- 172.21.15.131:0/1952302252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5b0005bf0 0x7ff5b0006060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:12.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.576+0000 7ff5ca800640 1 -- 172.21.15.131:0/1952302252 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff5cc1458c0 msgr2=0x7ff5b0006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:12.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.576+0000 7ff5ca800640 1 --2- 172.21.15.131:0/1952302252 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff5cc1458c0 0x7ff5b0006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:12.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.576+0000 7ff5ca800640 1 -- 172.21.15.131:0/1952302252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5b0005bf0 msgr2=0x7ff5b0006060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:12.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.576+0000 7ff5ca800640 1 --2- 172.21.15.131:0/1952302252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5b0005bf0 0x7ff5b0006060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:12.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.576+0000 7ff5ca800640 1 -- 172.21.15.131:0/1952302252 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b0005730 con 0x7ff5b0006f50 2024-04-25T19:24:12.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.576+0000 7ff5c9e00640 1 --2- 172.21.15.131:0/1952302252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5b0005bf0 0x7ff5b0006060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:24:12.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.577+0000 7ff5ca800640 1 --2- 172.21.15.131:0/1952302252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5b0006f50 0x7ff5b00073e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40073e0 tx=0x7ff5b0007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b087e6ce94f553 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:12.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.577+0000 7ff5c9400640 1 -- 172.21.15.131:0/1952302252 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4009c80 con 0x7ff5b0006f50 2024-04-25T19:24:12.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.577+0000 7ff5c9400640 1 -- 172.21.15.131:0/1952302252 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c402c620 con 0x7ff5b0006f50 2024-04-25T19:24:12.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.577+0000 7ff5c9400640 1 -- 172.21.15.131:0/1952302252 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c402c9d0 con 0x7ff5b0006f50 2024-04-25T19:24:12.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.578+0000 7ff5d1200640 1 -- 172.21.15.131:0/1952302252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5b0006f50 msgr2=0x7ff5b00073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:12.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.578+0000 7ff5d1200640 1 --2- 172.21.15.131:0/1952302252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5b0006f50 0x7ff5b00073e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40073e0 tx=0x7ff5b0007a40 comp rx=0 tx=0).stop 2024-04-25T19:24:12.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.578+0000 7ff5ca800640 1 -- 172.21.15.131:0/1952302252 reap_dead start 2024-04-25T19:24:12.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.578+0000 7ff5d1200640 1 -- 172.21.15.131:0/1952302252 shutdown_connections 2024-04-25T19:24:12.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.578+0000 7ff5d1200640 1 -- 172.21.15.131:0/1952302252 >> 172.21.15.131:0/1952302252 conn(0x7ff5cc073090 msgr2=0x7ff5cc0734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:12.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.578+0000 7ff5d1200640 1 -- 172.21.15.131:0/1952302252 shutdown_connections 2024-04-25T19:24:12.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.578+0000 7ff5d1200640 1 -- 172.21.15.131:0/1952302252 wait complete. 2024-04-25T19:24:12.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.581+0000 7ff5d1200640 1 Processor -- start 2024-04-25T19:24:12.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.581+0000 7ff5d1200640 1 -- start start 2024-04-25T19:24:12.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.582+0000 7ff5d1200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5b0006f50 0x7ff5cc142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:12.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.582+0000 7ff5d1200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff5cc143510 0x7ff5cc1f5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:12.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.582+0000 7ff5d1200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5cc1f5db0 0x7ff5cc1f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:12.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.582+0000 7ff5d1200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff5cc06f640 con 0x7ff5cc1f5db0 2024-04-25T19:24:12.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.582+0000 7ff5d1200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff5cc0b4ec0 con 0x7ff5b0006f50 2024-04-25T19:24:12.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.582+0000 7ff5d1200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff5cc15de60 con 0x7ff5cc143510 2024-04-25T19:24:12.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.583+0000 7ff5ca800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5cc1f5db0 0x7ff5cc1f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:12.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.583+0000 7ff5ca800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5cc1f5db0 0x7ff5cc1f61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41880/0 (socket says 172.21.15.131:41880) 2024-04-25T19:24:12.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.583+0000 7ff5ca800640 1 -- 172.21.15.131:0/1215635616 learned_addr learned my addr 172.21.15.131:0/1215635616 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:12.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.583+0000 7ff5c9e00640 1 --2- 172.21.15.131:0/1215635616 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5b0006f50 0x7ff5cc142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:12.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.583+0000 7ff5ca800640 1 -- 172.21.15.131:0/1215635616 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff5cc143510 msgr2=0x7ff5cc1f5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:12.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.583+0000 7ff5ca800640 1 --2- 172.21.15.131:0/1215635616 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff5cc143510 0x7ff5cc1f5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:12.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.583+0000 7ff5ca800640 1 -- 172.21.15.131:0/1215635616 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5b0006f50 msgr2=0x7ff5cc142fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:12.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.583+0000 7ff5ca800640 1 --2- 172.21.15.131:0/1215635616 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5b0006f50 0x7ff5cc142fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:12.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.583+0000 7ff5ca800640 1 -- 172.21.15.131:0/1215635616 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5cc143d90 con 0x7ff5cc1f5db0 2024-04-25T19:24:12.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.583+0000 7ff5c9e00640 1 --2- 172.21.15.131:0/1215635616 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5b0006f50 0x7ff5cc142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:24:12.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.584+0000 7ff5ca800640 1 --2- 172.21.15.131:0/1215635616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5cc1f5db0 0x7ff5cc1f61c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4007500 tx=0x7ff5c4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:12.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.584+0000 7ff5c2a00640 1 -- 172.21.15.131:0/1215635616 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4009c80 con 0x7ff5cc1f5db0 2024-04-25T19:24:12.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.584+0000 7ff5c2a00640 1 -- 172.21.15.131:0/1215635616 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c402c420 con 0x7ff5cc1f5db0 2024-04-25T19:24:12.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.584+0000 7ff5d1200640 1 -- 172.21.15.131:0/1215635616 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5cc144070 con 0x7ff5cc1f5db0 2024-04-25T19:24:12.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.584+0000 7ff5c2a00640 1 -- 172.21.15.131:0/1215635616 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4037a50 con 0x7ff5cc1f5db0 2024-04-25T19:24:12.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.584+0000 7ff5d1200640 1 -- 172.21.15.131:0/1215635616 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5cc144630 con 0x7ff5cc1f5db0 2024-04-25T19:24:12.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.585+0000 7ff5d1200640 1 -- 172.21.15.131:0/1215635616 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5cc143b00 con 0x7ff5cc1f5db0 2024-04-25T19:24:12.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.587+0000 7ff5c2a00640 1 -- 172.21.15.131:0/1215635616 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff5c4037bf0 con 0x7ff5cc1f5db0 2024-04-25T19:24:12.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.587+0000 7ff5c2a00640 1 --2- 172.21.15.131:0/1215635616 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff5a80744b0 0x7ff5a80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:12.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.588+0000 7ff5c2a00640 1 -- 172.21.15.131:0/1215635616 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7ff5c40b58c0 con 0x7ff5cc1f5db0 2024-04-25T19:24:12.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.588+0000 7ff5c9e00640 1 --2- 172.21.15.131:0/1215635616 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff5a80744b0 0x7ff5a80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:12.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.589+0000 7ff5c9e00640 1 --2- 172.21.15.131:0/1215635616 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff5a80744b0 0x7ff5a80769c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0b6c80 tx=0x7ff5bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:12.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.592+0000 7ff5c2a00640 1 -- 172.21.15.131:0/1215635616 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff5c4047060 con 0x7ff5cc1f5db0 2024-04-25T19:24:12.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.794+0000 7ff5d1200640 1 -- 172.21.15.131:0/1215635616 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff5cc050740 con 0x7ff5cc1f5db0 2024-04-25T19:24:12.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.795+0000 7ff5c2a00640 1 -- 172.21.15.131:0/1215635616 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) ==== 93+0+10 (secure 0 0 0) 0x7ff5c4032030 con 0x7ff5cc1f5db0 2024-04-25T19:24:12.797 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-25T19:24:12.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.797+0000 7ff5d1200640 1 -- 172.21.15.131:0/1215635616 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff5a80744b0 msgr2=0x7ff5a80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:12.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.797+0000 7ff5d1200640 1 --2- 172.21.15.131:0/1215635616 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff5a80744b0 0x7ff5a80769c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0b6c80 tx=0x7ff5bc009040 comp rx=0 tx=0).stop 2024-04-25T19:24:12.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.797+0000 7ff5d1200640 1 -- 172.21.15.131:0/1215635616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5cc1f5db0 msgr2=0x7ff5cc1f61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:12.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.797+0000 7ff5d1200640 1 --2- 172.21.15.131:0/1215635616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5cc1f5db0 0x7ff5cc1f61c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4007500 tx=0x7ff5c4004ab0 comp rx=0 tx=0).stop 2024-04-25T19:24:12.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.797+0000 7ff5d1200640 1 -- 172.21.15.131:0/1215635616 shutdown_connections 2024-04-25T19:24:12.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.797+0000 7ff5d1200640 1 --2- 172.21.15.131:0/1215635616 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff5a80744b0 0x7ff5a80769c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:12.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.797+0000 7ff5d1200640 1 --2- 172.21.15.131:0/1215635616 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff5cc143510 0x7ff5cc1f5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:12.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.798+0000 7ff5d1200640 1 --2- 172.21.15.131:0/1215635616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5cc1f5db0 0x7ff5cc1f61c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:12.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.798+0000 7ff5d1200640 1 --2- 172.21.15.131:0/1215635616 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5b0006f50 0x7ff5cc142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:12.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.798+0000 7ff5d1200640 1 -- 172.21.15.131:0/1215635616 >> 172.21.15.131:0/1215635616 conn(0x7ff5cc073090 msgr2=0x7ff5cc0d03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:12.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.798+0000 7ff5d1200640 1 -- 172.21.15.131:0/1215635616 shutdown_connections 2024-04-25T19:24:12.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:12.798+0000 7ff5d1200640 1 -- 172.21.15.131:0/1215635616 wait complete. 2024-04-25T19:24:12.823 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T19:24:13.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.094+0000 7fc9aa000640 1 Processor -- start 2024-04-25T19:24:13.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.094+0000 7fc9aa000640 1 -- start start 2024-04-25T19:24:13.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.096+0000 7fc9aa000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9a414ad60 0x7fc9a4070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:13.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.096+0000 7fc9aa000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc9a40b5e40 0x7fc9a40b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:13.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.096+0000 7fc9aa000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc9a41681d0 0x7fc9a41685e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:13.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.096+0000 7fc9aa000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fc9a40b6790 con 0x7fc9a40b5e40 2024-04-25T19:24:13.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.096+0000 7fc9aa000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fc9a40b4af0 con 0x7fc9a41681d0 2024-04-25T19:24:13.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.096+0000 7fc9aa000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a40b4dd0 con 0x7fc9a414ad60 2024-04-25T19:24:13.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.097+0000 7fc9a2a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc9a40b5e40 0x7fc9a40b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:13.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.097+0000 7fc9a3400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9a414ad60 0x7fc9a4070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:13.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.097+0000 7fc9a2a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc9a40b5e40 0x7fc9a40b6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41882/0 (socket says 172.21.15.131:41882) 2024-04-25T19:24:13.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.097+0000 7fc9a2a00640 1 -- 172.21.15.131:0/3737501355 learned_addr learned my addr 172.21.15.131:0/3737501355 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:13.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.097+0000 7fc9a3e00640 1 --2- 172.21.15.131:0/3737501355 >> v2:172.21.15.195:3300/0 conn(0x7fc9a41681d0 0x7fc9a41685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:13.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.097+0000 7fc9a2a00640 1 -- 172.21.15.131:0/3737501355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9a414ad60 msgr2=0x7fc9a4070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:13.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.097+0000 7fc9a2a00640 1 --2- 172.21.15.131:0/3737501355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9a414ad60 0x7fc9a4070010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:13.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.097+0000 7fc9a2a00640 1 -- 172.21.15.131:0/3737501355 >> v2:172.21.15.195:3300/0 conn(0x7fc9a41681d0 msgr2=0x7fc9a41685e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:13.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.097+0000 7fc9a2a00640 1 --2- 172.21.15.131:0/3737501355 >> v2:172.21.15.195:3300/0 conn(0x7fc9a41681d0 0x7fc9a41685e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:13.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.097+0000 7fc9a2a00640 1 -- 172.21.15.131:0/3737501355 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a40b50b0 con 0x7fc9a40b5e40 2024-04-25T19:24:13.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.097+0000 7fc9a3400640 1 --2- 172.21.15.131:0/3737501355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9a414ad60 0x7fc9a4070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T19:24:13.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.098+0000 7fc9a2a00640 1 --2- 172.21.15.131:0/3737501355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a40b5e40 0x7fc9a40b6250 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40ce2f0 tx=0x7fc99002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a72d30d9f31265b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:13.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.099+0000 7fc9a2000640 1 -- 172.21.15.131:0/3737501355 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc990037070 con 0x7fc9a40b5e40 2024-04-25T19:24:13.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.099+0000 7fc9a2000640 1 -- 172.21.15.131:0/3737501355 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc990032440 con 0x7fc9a40b5e40 2024-04-25T19:24:13.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.099+0000 7fc9a2000640 1 -- 172.21.15.131:0/3737501355 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc990032810 con 0x7fc9a40b5e40 2024-04-25T19:24:13.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.100+0000 7fc9aa000640 1 -- 172.21.15.131:0/3737501355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a40b5e40 msgr2=0x7fc9a40b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:13.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.100+0000 7fc9aa000640 1 --2- 172.21.15.131:0/3737501355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a40b5e40 0x7fc9a40b6250 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40ce2f0 tx=0x7fc99002a140 comp rx=0 tx=0).stop 2024-04-25T19:24:13.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.100+0000 7fc9aa000640 1 -- 172.21.15.131:0/3737501355 shutdown_connections 2024-04-25T19:24:13.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.100+0000 7fc9aa000640 1 --2- 172.21.15.131:0/3737501355 >> v2:172.21.15.195:3300/0 conn(0x7fc9a41681d0 0x7fc9a41685e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:13.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.100+0000 7fc9aa000640 1 --2- 172.21.15.131:0/3737501355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a40b5e40 0x7fc9a40b6250 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:13.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.100+0000 7fc9aa000640 1 --2- 172.21.15.131:0/3737501355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9a414ad60 0x7fc9a4070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:13.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.100+0000 7fc9aa000640 1 -- 172.21.15.131:0/3737501355 >> 172.21.15.131:0/3737501355 conn(0x7fc9a40d1ae0 msgr2=0x7fc9a40d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:13.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.100+0000 7fc9aa000640 1 -- 172.21.15.131:0/3737501355 shutdown_connections 2024-04-25T19:24:13.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.100+0000 7fc9aa000640 1 -- 172.21.15.131:0/3737501355 wait complete. 2024-04-25T19:24:13.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.102+0000 7fc9aa000640 1 Processor -- start 2024-04-25T19:24:13.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.102+0000 7fc9aa000640 1 -- start start 2024-04-25T19:24:13.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.104+0000 7fc9aa000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a40b5e40 0x7fc9a4165d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:13.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.104+0000 7fc9aa000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9a414ad60 0x7fc9a4149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:13.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.104+0000 7fc9aa000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9a41681d0 0x7fc9a414a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:13.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.104+0000 7fc9aa000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a4070550 con 0x7fc9a40b5e40 2024-04-25T19:24:13.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.104+0000 7fc9aa000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a40b5670 con 0x7fc9a414ad60 2024-04-25T19:24:13.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.104+0000 7fc9aa000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a40706d0 con 0x7fc9a41681d0 2024-04-25T19:24:13.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.104+0000 7fc9a3400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a40b5e40 0x7fc9a4165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:13.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.104+0000 7fc9a3400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a40b5e40 0x7fc9a4165d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41886/0 (socket says 172.21.15.131:41886) 2024-04-25T19:24:13.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.104+0000 7fc9a3400640 1 -- 172.21.15.131:0/461855942 learned_addr learned my addr 172.21.15.131:0/461855942 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:13.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.105+0000 7fc9a2a00640 1 --2- 172.21.15.131:0/461855942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9a414ad60 0x7fc9a4149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:13.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.105+0000 7fc9a3e00640 1 --2- 172.21.15.131:0/461855942 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9a41681d0 0x7fc9a414a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:13.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.105+0000 7fc9a3400640 1 -- 172.21.15.131:0/461855942 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9a41681d0 msgr2=0x7fc9a414a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:13.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.105+0000 7fc9a3400640 1 --2- 172.21.15.131:0/461855942 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9a41681d0 0x7fc9a414a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:13.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.105+0000 7fc9a3400640 1 -- 172.21.15.131:0/461855942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9a414ad60 msgr2=0x7fc9a4149b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:13.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.105+0000 7fc9a3400640 1 --2- 172.21.15.131:0/461855942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9a414ad60 0x7fc9a4149b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:13.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.105+0000 7fc9a3400640 1 -- 172.21.15.131:0/461855942 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a4166680 con 0x7fc9a40b5e40 2024-04-25T19:24:13.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.105+0000 7fc9a2a00640 1 --2- 172.21.15.131:0/461855942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9a414ad60 0x7fc9a4149b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:24:13.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.105+0000 7fc9a3e00640 1 --2- 172.21.15.131:0/461855942 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9a41681d0 0x7fc9a414a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:24:13.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.105+0000 7fc9a3400640 1 --2- 172.21.15.131:0/461855942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a40b5e40 0x7fc9a4165d80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc99400d7d0 tx=0x7fc99400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:13.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.105+0000 7fc99b400640 1 -- 172.21.15.131:0/461855942 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9940096a0 con 0x7fc9a40b5e40 2024-04-25T19:24:13.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.105+0000 7fc99b400640 1 -- 172.21.15.131:0/461855942 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc994019070 con 0x7fc9a40b5e40 2024-04-25T19:24:13.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.105+0000 7fc99b400640 1 -- 172.21.15.131:0/461855942 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc994009a80 con 0x7fc9a40b5e40 2024-04-25T19:24:13.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.105+0000 7fc9aa000640 1 -- 172.21.15.131:0/461855942 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a4166960 con 0x7fc9a40b5e40 2024-04-25T19:24:13.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.105+0000 7fc9aa000640 1 -- 172.21.15.131:0/461855942 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a4166f20 con 0x7fc9a40b5e40 2024-04-25T19:24:13.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.107+0000 7fc9aa000640 1 -- 172.21.15.131:0/461855942 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9a4050740 con 0x7fc9a40b5e40 2024-04-25T19:24:13.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.108+0000 7fc99b400640 1 -- 172.21.15.131:0/461855942 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc994009c20 con 0x7fc9a40b5e40 2024-04-25T19:24:13.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.109+0000 7fc99b400640 1 --2- 172.21.15.131:0/461855942 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc9840744b0 0x7fc9840769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:13.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.109+0000 7fc99b400640 1 -- 172.21.15.131:0/461855942 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7fc994095200 con 0x7fc9a40b5e40 2024-04-25T19:24:13.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.110+0000 7fc9a2a00640 1 --2- 172.21.15.131:0/461855942 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc9840744b0 0x7fc9840769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:13.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.111+0000 7fc9a2a00640 1 --2- 172.21.15.131:0/461855942 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc9840744b0 0x7fc9840769c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc990034000 tx=0x7fc99002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:13.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.115+0000 7fc99b400640 1 -- 172.21.15.131:0/461855942 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc99405fe00 con 0x7fc9a40b5e40 2024-04-25T19:24:13.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.320+0000 7fc9aa000640 1 -- 172.21.15.131:0/461855942 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc9a406f620 con 0x7fc9a40b5e40 2024-04-25T19:24:13.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.321+0000 7fc99b400640 1 -- 172.21.15.131:0/461855942 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v41) ==== 84+0+65 (secure 0 0 0) 0x7fc99405f700 con 0x7fc9a40b5e40 2024-04-25T19:24:13.322 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:24:13.323 INFO:teuthology.orchestra.run.smithi131.stdout:[ 2024-04-25T19:24:13.323 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-25T19:24:13.323 INFO:teuthology.orchestra.run.smithi131.stdout: "poolnum": 1, 2024-04-25T19:24:13.323 INFO:teuthology.orchestra.run.smithi131.stdout: "poolname": ".mgr" 2024-04-25T19:24:13.323 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-25T19:24:13.323 INFO:teuthology.orchestra.run.smithi131.stdout:] 2024-04-25T19:24:13.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.323+0000 7fc9aa000640 1 -- 172.21.15.131:0/461855942 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc9840744b0 msgr2=0x7fc9840769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:13.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.323+0000 7fc9aa000640 1 --2- 172.21.15.131:0/461855942 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc9840744b0 0x7fc9840769c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc990034000 tx=0x7fc99002e000 comp rx=0 tx=0).stop 2024-04-25T19:24:13.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.323+0000 7fc9aa000640 1 -- 172.21.15.131:0/461855942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a40b5e40 msgr2=0x7fc9a4165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:13.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.323+0000 7fc9aa000640 1 --2- 172.21.15.131:0/461855942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a40b5e40 0x7fc9a4165d80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc99400d7d0 tx=0x7fc99400dc90 comp rx=0 tx=0).stop 2024-04-25T19:24:13.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.324+0000 7fc9aa000640 1 -- 172.21.15.131:0/461855942 shutdown_connections 2024-04-25T19:24:13.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.324+0000 7fc9aa000640 1 --2- 172.21.15.131:0/461855942 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc9840744b0 0x7fc9840769c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:13.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.324+0000 7fc9aa000640 1 --2- 172.21.15.131:0/461855942 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9a41681d0 0x7fc9a414a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:13.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.324+0000 7fc9aa000640 1 --2- 172.21.15.131:0/461855942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9a414ad60 0x7fc9a4149b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:13.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.324+0000 7fc9aa000640 1 --2- 172.21.15.131:0/461855942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a40b5e40 0x7fc9a4165d80 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:13.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.324+0000 7fc9aa000640 1 -- 172.21.15.131:0/461855942 >> 172.21.15.131:0/461855942 conn(0x7fc9a40d1ae0 msgr2=0x7fc9a4161bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:13.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.324+0000 7fc9aa000640 1 -- 172.21.15.131:0/461855942 shutdown_connections 2024-04-25T19:24:13.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.324+0000 7fc9aa000640 1 -- 172.21.15.131:0/461855942 wait complete. 2024-04-25T19:24:13.354 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T19:24:13.354 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T19:24:13.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.609+0000 7f43e3e00640 1 Processor -- start 2024-04-25T19:24:13.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.609+0000 7f43e3e00640 1 -- start start 2024-04-25T19:24:13.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.612+0000 7f43e3e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f43e406dce0 0x7f43e415e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:13.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.612+0000 7f43e3e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f43e415ec90 0x7f43e415f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:13.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.612+0000 7f43e3e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43e4070000 con 0x7f43e4144340 2024-04-25T19:24:13.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.612+0000 7f43e3e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f43e4144750 con 0x7f43e406dce0 2024-04-25T19:24:13.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.612+0000 7f43e3e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f43e406f240 con 0x7f43e415ec90 2024-04-25T19:24:13.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.612+0000 7f43dbe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f43e406dce0 0x7f43e415e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:13.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.612+0000 7f43dbe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f43e406dce0 0x7f43e415e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41898/0 (socket says 172.21.15.131:41898) 2024-04-25T19:24:13.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.612+0000 7f43dbe00640 1 -- 172.21.15.131:0/2864141925 learned_addr learned my addr 172.21.15.131:0/2864141925 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:13.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.612+0000 7f43e2a00640 1 --1- 172.21.15.131:0/2864141925 >> v1:172.21.15.131:6789/0 conn(0x7f43e4144340 0x7f43e406d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:33500/0 (socket says 172.21.15.131:33500) 2024-04-25T19:24:13.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.612+0000 7f43e3400640 1 --2- 172.21.15.131:0/2864141925 >> v2:172.21.15.195:3300/0 conn(0x7f43e415ec90 0x7f43e415f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:13.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.612+0000 7f43dbe00640 1 -- 172.21.15.131:0/2864141925 >> v2:172.21.15.195:3300/0 conn(0x7f43e415ec90 msgr2=0x7f43e415f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:13.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.612+0000 7f43dbe00640 1 --2- 172.21.15.131:0/2864141925 >> v2:172.21.15.195:3300/0 conn(0x7f43e415ec90 0x7f43e415f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:13.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.612+0000 7f43dbe00640 1 -- 172.21.15.131:0/2864141925 >> v1:172.21.15.131:6789/0 conn(0x7f43e4144340 legacy=0x7f43e406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:13.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.612+0000 7f43dbe00640 1 -- 172.21.15.131:0/2864141925 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e406f520 con 0x7f43e406dce0 2024-04-25T19:24:13.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.612+0000 7f43e3400640 1 --2- 172.21.15.131:0/2864141925 >> v2:172.21.15.195:3300/0 conn(0x7f43e415ec90 0x7f43e415f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:24:13.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.613+0000 7f43dbe00640 1 --2- 172.21.15.131:0/2864141925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43e406dce0 0x7f43e415e750 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f43e40d1790 tx=0x7f43cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a312d341c80b8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:13.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.614+0000 7f43e2000640 1 -- 172.21.15.131:0/2864141925 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43cc037070 con 0x7f43e406dce0 2024-04-25T19:24:13.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.614+0000 7f43e2000640 1 -- 172.21.15.131:0/2864141925 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43cc032440 con 0x7f43e406dce0 2024-04-25T19:24:13.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.614+0000 7f43e2000640 1 -- 172.21.15.131:0/2864141925 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43cc032810 con 0x7f43e406dce0 2024-04-25T19:24:13.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.614+0000 7f43e3e00640 1 -- 172.21.15.131:0/2864141925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43e406dce0 msgr2=0x7f43e415e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:13.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.614+0000 7f43e3e00640 1 --2- 172.21.15.131:0/2864141925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43e406dce0 0x7f43e415e750 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f43e40d1790 tx=0x7f43cc02a270 comp rx=0 tx=0).stop 2024-04-25T19:24:13.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.615+0000 7f43e3e00640 1 -- 172.21.15.131:0/2864141925 shutdown_connections 2024-04-25T19:24:13.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.615+0000 7f43e3e00640 1 --2- 172.21.15.131:0/2864141925 >> v2:172.21.15.195:3300/0 conn(0x7f43e415ec90 0x7f43e415f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:13.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.615+0000 7f43e3e00640 1 --2- 172.21.15.131:0/2864141925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43e406dce0 0x7f43e415e750 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:13.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.615+0000 7f43e3e00640 1 -- 172.21.15.131:0/2864141925 >> 172.21.15.131:0/2864141925 conn(0x7f43e4072f40 msgr2=0x7f43e4073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:13.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.615+0000 7f43e3e00640 1 -- 172.21.15.131:0/2864141925 shutdown_connections 2024-04-25T19:24:13.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.615+0000 7f43e3e00640 1 -- 172.21.15.131:0/2864141925 wait complete. 2024-04-25T19:24:13.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.617+0000 7f43e3e00640 1 Processor -- start 2024-04-25T19:24:13.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.617+0000 7f43e3e00640 1 -- start start 2024-04-25T19:24:13.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.619+0000 7f43e3e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43e4144340 0x7f43e40b0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:13.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.619+0000 7f43e3e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43e415ec90 0x7f43e4158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:13.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.619+0000 7f43e3e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43e4160620 0x7f43e4160a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:13.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.619+0000 7f43e3e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f43e415f0a0 con 0x7f43e4160620 2024-04-25T19:24:13.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.619+0000 7f43e3e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f43e406fae0 con 0x7f43e4144340 2024-04-25T19:24:13.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.619+0000 7f43e3e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f43e415f220 con 0x7f43e415ec90 2024-04-25T19:24:13.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.619+0000 7f43e3400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43e4160620 0x7f43e4160a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:13.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.619+0000 7f43e3400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43e4160620 0x7f43e4160a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41904/0 (socket says 172.21.15.131:41904) 2024-04-25T19:24:13.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.619+0000 7f43e3400640 1 -- 172.21.15.131:0/1637865253 learned_addr learned my addr 172.21.15.131:0/1637865253 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:13.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.619+0000 7f43e2a00640 1 --2- 172.21.15.131:0/1637865253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43e4144340 0x7f43e40b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:13.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.619+0000 7f43e3400640 1 -- 172.21.15.131:0/1637865253 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43e415ec90 msgr2=0x7f43e4158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:13.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.619+0000 7f43e3400640 1 --2- 172.21.15.131:0/1637865253 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43e415ec90 0x7f43e4158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:13.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.619+0000 7f43e3400640 1 -- 172.21.15.131:0/1637865253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43e4144340 msgr2=0x7f43e40b0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:13.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.619+0000 7f43e3400640 1 --2- 172.21.15.131:0/1637865253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43e4144340 0x7f43e40b0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:13.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.619+0000 7f43e3400640 1 -- 172.21.15.131:0/1637865253 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e4160f70 con 0x7f43e4160620 2024-04-25T19:24:13.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.619+0000 7f43e2a00640 1 --2- 172.21.15.131:0/1637865253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43e4144340 0x7f43e40b0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:24:13.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.620+0000 7f43e3400640 1 --2- 172.21.15.131:0/1637865253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43e4160620 0x7f43e4160a30 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00cd80 tx=0x7f43dc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:13.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.620+0000 7f43daa00640 1 -- 172.21.15.131:0/1637865253 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc00f680 con 0x7f43e4160620 2024-04-25T19:24:13.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.620+0000 7f43daa00640 1 -- 172.21.15.131:0/1637865253 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43dc00f840 con 0x7f43e4160620 2024-04-25T19:24:13.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.620+0000 7f43e3e00640 1 -- 172.21.15.131:0/1637865253 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e40b0f30 con 0x7f43e4160620 2024-04-25T19:24:13.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.620+0000 7f43daa00640 1 -- 172.21.15.131:0/1637865253 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc00fc30 con 0x7f43e4160620 2024-04-25T19:24:13.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.620+0000 7f43e3e00640 1 -- 172.21.15.131:0/1637865253 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e40b4e60 con 0x7f43e4160620 2024-04-25T19:24:13.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.621+0000 7f43e3e00640 1 -- 172.21.15.131:0/1637865253 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43e40b0c80 con 0x7f43e4160620 2024-04-25T19:24:13.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.623+0000 7f43daa00640 1 -- 172.21.15.131:0/1637865253 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f43dc0213f0 con 0x7f43e4160620 2024-04-25T19:24:13.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.623+0000 7f43daa00640 1 --2- 172.21.15.131:0/1637865253 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f43c00744b0 0x7f43c00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:13.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.624+0000 7f43daa00640 1 -- 172.21.15.131:0/1637865253 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f43dc095d30 con 0x7f43e4160620 2024-04-25T19:24:13.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.624+0000 7f43e2a00640 1 --2- 172.21.15.131:0/1637865253 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f43c00744b0 0x7f43c00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:13.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.625+0000 7f43e2a00640 1 --2- 172.21.15.131:0/1637865253 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f43c00744b0 0x7f43c00769c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f43d4000f60 tx=0x7f43d4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:13.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.628+0000 7f43daa00640 1 -- 172.21.15.131:0/1637865253 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f43e4160f70 con 0x7f43e4160620 2024-04-25T19:24:13.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:13.826+0000 7f43e3e00640 1 -- 172.21.15.131:0/1637865253 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f43e40b4970 con 0x7f43e4160620 2024-04-25T19:24:14.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.154+0000 7f43daa00640 1 -- 172.21.15.131:0/1637865253 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v42) ==== 138+0+0 (secure 0 0 0) 0x7f43dc014030 con 0x7f43e4160620 2024-04-25T19:24:14.156 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'cephfs_metadata' created 2024-04-25T19:24:14.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.158+0000 7f43e3e00640 1 -- 172.21.15.131:0/1637865253 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f43c00744b0 msgr2=0x7f43c00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:14.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.158+0000 7f43e3e00640 1 --2- 172.21.15.131:0/1637865253 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f43c00744b0 0x7f43c00769c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f43d4000f60 tx=0x7f43d4009040 comp rx=0 tx=0).stop 2024-04-25T19:24:14.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.158+0000 7f43e3e00640 1 -- 172.21.15.131:0/1637865253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43e4160620 msgr2=0x7f43e4160a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:14.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.158+0000 7f43e3e00640 1 --2- 172.21.15.131:0/1637865253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43e4160620 0x7f43e4160a30 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00cd80 tx=0x7f43dc00a650 comp rx=0 tx=0).stop 2024-04-25T19:24:14.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.158+0000 7f43e3e00640 1 -- 172.21.15.131:0/1637865253 shutdown_connections 2024-04-25T19:24:14.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.158+0000 7f43e3e00640 1 --2- 172.21.15.131:0/1637865253 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f43c00744b0 0x7f43c00769c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:14.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.158+0000 7f43e3e00640 1 --2- 172.21.15.131:0/1637865253 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43e415ec90 0x7f43e4158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:14.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.158+0000 7f43e3e00640 1 --2- 172.21.15.131:0/1637865253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43e4160620 0x7f43e4160a30 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:14.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.158+0000 7f43e3e00640 1 --2- 172.21.15.131:0/1637865253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43e4144340 0x7f43e40b0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:14.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.158+0000 7f43e3e00640 1 -- 172.21.15.131:0/1637865253 >> 172.21.15.131:0/1637865253 conn(0x7f43e4072f40 msgr2=0x7f43e4142f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:14.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.158+0000 7f43e3e00640 1 -- 172.21.15.131:0/1637865253 shutdown_connections 2024-04-25T19:24:14.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.159+0000 7f43e3e00640 1 -- 172.21.15.131:0/1637865253 wait complete. 2024-04-25T19:24:14.195 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T19:24:14.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.459+0000 7f11d3200640 1 Processor -- start 2024-04-25T19:24:14.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.459+0000 7f11d3200640 1 -- start start 2024-04-25T19:24:14.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.461+0000 7f11d3200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f11cc070630 0x7f11cc0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:14.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.461+0000 7f11d3200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11cc15adf0 0x7f11cc06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:14.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.461+0000 7f11d3200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11cc06df20 con 0x7f11cc06db10 2024-04-25T19:24:14.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.461+0000 7f11d3200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f11cc0713f0 con 0x7f11cc070630 2024-04-25T19:24:14.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.461+0000 7f11d3200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f11cc0701a0 con 0x7f11cc15adf0 2024-04-25T19:24:14.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.461+0000 7f11d1200640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f11cc06db10 0x7f11cc0b59c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:33506/0 (socket says 172.21.15.131:33506) 2024-04-25T19:24:14.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.461+0000 7f11d1200640 1 -- 172.21.15.131:0/3612582889 learned_addr learned my addr 172.21.15.131:0/3612582889 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:24:14.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.462+0000 7f11cbe00640 1 --2- 172.21.15.131:0/3612582889 >> v2:172.21.15.195:3300/0 conn(0x7f11cc070630 0x7f11cc0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:14.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.462+0000 7f11c3400640 1 --2- 172.21.15.131:0/3612582889 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11cc15adf0 0x7f11cc06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:14.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.462+0000 7f11cb400640 1 -- 172.21.15.131:0/3612582889 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1281125697 0 0) 0x7f11c4001490 con 0x7f11cc06db10 2024-04-25T19:24:14.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.462+0000 7f11cb400640 1 -- 172.21.15.131:0/3612582889 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11b0005730 con 0x7f11cc06db10 2024-04-25T19:24:14.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.462+0000 7f11cb400640 1 -- 172.21.15.131:0/3612582889 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1987646904 0 0) 0x7f11b0005730 con 0x7f11cc06db10 2024-04-25T19:24:14.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.462+0000 7f11cb400640 1 -- 172.21.15.131:0/3612582889 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11cc15adf0 msgr2=0x7f11cc06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:14.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.462+0000 7f11cb400640 1 --2- 172.21.15.131:0/3612582889 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11cc15adf0 0x7f11cc06d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:14.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.462+0000 7f11cb400640 1 -- 172.21.15.131:0/3612582889 >> v2:172.21.15.195:3300/0 conn(0x7f11cc070630 msgr2=0x7f11cc0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:14.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.462+0000 7f11cb400640 1 --2- 172.21.15.131:0/3612582889 >> v2:172.21.15.195:3300/0 conn(0x7f11cc070630 0x7f11cc0cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:14.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.462+0000 7f11cb400640 1 -- 172.21.15.131:0/3612582889 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11cc071110 con 0x7f11cc06db10 2024-04-25T19:24:14.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.462+0000 7f11cb400640 1 -- 172.21.15.131:0/3612582889 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f11c4001bc0 con 0x7f11cc06db10 2024-04-25T19:24:14.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.462+0000 7f11cb400640 1 -- 172.21.15.131:0/3612582889 >> v1:172.21.15.131:6789/0 conn(0x7f11cc06db10 legacy=0x7f11cc0b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:14.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.462+0000 7f11cb400640 1 --2- 172.21.15.131:0/3612582889 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11cc15adf0 0x7f11b0005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:14.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.462+0000 7f11cb400640 1 --2- 172.21.15.131:0/3612582889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11b0006140 0x7f11b0006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:14.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.462+0000 7f11cb400640 1 --2- 172.21.15.131:0/3612582889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11b0006f50 0x7f11b0007360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:14.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.462+0000 7f11cb400640 1 -- 172.21.15.131:0/3612582889 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f11cc0713f0 con 0x7f11b0006f50 2024-04-25T19:24:14.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.462+0000 7f11cb400640 1 -- 172.21.15.131:0/3612582889 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f11cc0701a0 con 0x7f11b0006140 2024-04-25T19:24:14.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.462+0000 7f11cb400640 1 -- 172.21.15.131:0/3612582889 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f11b000dcd0 con 0x7f11cc15adf0 2024-04-25T19:24:14.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.463+0000 7f11d1200640 1 --2- 172.21.15.131:0/3612582889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11b0006f50 0x7f11b0007360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:14.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.463+0000 7f11cbe00640 1 --2- 172.21.15.131:0/3612582889 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11cc15adf0 0x7f11b0005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:14.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.463+0000 7f11c3400640 1 --2- 172.21.15.131:0/3612582889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11b0006140 0x7f11b0006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:14.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.463+0000 7f11d1200640 1 -- 172.21.15.131:0/3612582889 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11cc15adf0 msgr2=0x7f11b0005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:14.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.463+0000 7f11d1200640 1 --2- 172.21.15.131:0/3612582889 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11cc15adf0 0x7f11b0005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:14.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.463+0000 7f11d1200640 1 -- 172.21.15.131:0/3612582889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11b0006140 msgr2=0x7f11b0006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:14.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.463+0000 7f11d1200640 1 --2- 172.21.15.131:0/3612582889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11b0006140 0x7f11b0006a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:14.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.463+0000 7f11d1200640 1 -- 172.21.15.131:0/3612582889 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b0005730 con 0x7f11b0006f50 2024-04-25T19:24:14.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.464+0000 7f11d1200640 1 --2- 172.21.15.131:0/3612582889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11b0006f50 0x7f11b0007360 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f11c400aa40 tx=0x7f11b0007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f588848c554e041b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:14.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.465+0000 7f11cb400640 1 -- 172.21.15.131:0/3612582889 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c400a690 con 0x7f11b0006f50 2024-04-25T19:24:14.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.465+0000 7f11cb400640 1 -- 172.21.15.131:0/3612582889 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11c402f070 con 0x7f11b0006f50 2024-04-25T19:24:14.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.465+0000 7f11cb400640 1 -- 172.21.15.131:0/3612582889 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c4034470 con 0x7f11b0006f50 2024-04-25T19:24:14.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.465+0000 7f11d3200640 1 -- 172.21.15.131:0/3612582889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11b0006f50 msgr2=0x7f11b0007360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:14.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.465+0000 7f11d3200640 1 --2- 172.21.15.131:0/3612582889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11b0006f50 0x7f11b0007360 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f11c400aa40 tx=0x7f11b0007a40 comp rx=0 tx=0).stop 2024-04-25T19:24:14.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.465+0000 7f11d1200640 1 -- 172.21.15.131:0/3612582889 reap_dead start 2024-04-25T19:24:14.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.465+0000 7f11d3200640 1 -- 172.21.15.131:0/3612582889 shutdown_connections 2024-04-25T19:24:14.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.465+0000 7f11d3200640 1 -- 172.21.15.131:0/3612582889 >> 172.21.15.131:0/3612582889 conn(0x7f11cc073090 msgr2=0x7f11cc0734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:14.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.466+0000 7f11d3200640 1 -- 172.21.15.131:0/3612582889 shutdown_connections 2024-04-25T19:24:14.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.466+0000 7f11d3200640 1 -- 172.21.15.131:0/3612582889 wait complete. 2024-04-25T19:24:14.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.468+0000 7f11d3200640 1 Processor -- start 2024-04-25T19:24:14.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.468+0000 7f11d3200640 1 -- start start 2024-04-25T19:24:14.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.470+0000 7f11d3200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11cc15ec10 0x7f11cc0b5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:14.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.470+0000 7f11d3200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11cc15d9a0 0x7f11cc15ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:14.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.470+0000 7f11d3200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11cc15e2f0 0x7f11cc15ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:14.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.470+0000 7f11d3200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f11cc0b0d00 con 0x7f11cc15ec10 2024-04-25T19:24:14.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.470+0000 7f11d3200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f11cc06fe30 con 0x7f11cc15e2f0 2024-04-25T19:24:14.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.470+0000 7f11d3200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f11cc0b0e80 con 0x7f11cc15d9a0 2024-04-25T19:24:14.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.470+0000 7f11cbe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11cc15ec10 0x7f11cc0b5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:14.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.470+0000 7f11cbe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11cc15ec10 0x7f11cc0b5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41918/0 (socket says 172.21.15.131:41918) 2024-04-25T19:24:14.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.470+0000 7f11cbe00640 1 -- 172.21.15.131:0/1792211597 learned_addr learned my addr 172.21.15.131:0/1792211597 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:14.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.470+0000 7f11c3400640 1 --2- 172.21.15.131:0/1792211597 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11cc15d9a0 0x7f11cc15ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:14.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.470+0000 7f11d1200640 1 --2- 172.21.15.131:0/1792211597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11cc15e2f0 0x7f11cc15ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:14.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.470+0000 7f11cbe00640 1 -- 172.21.15.131:0/1792211597 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11cc15d9a0 msgr2=0x7f11cc15ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:14.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.470+0000 7f11cbe00640 1 --2- 172.21.15.131:0/1792211597 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11cc15d9a0 0x7f11cc15ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:14.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.470+0000 7f11cbe00640 1 -- 172.21.15.131:0/1792211597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11cc15e2f0 msgr2=0x7f11cc15ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:14.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.470+0000 7f11cbe00640 1 --2- 172.21.15.131:0/1792211597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11cc15e2f0 0x7f11cc15ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:14.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.470+0000 7f11cbe00640 1 -- 172.21.15.131:0/1792211597 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11cc15b2a0 con 0x7f11cc15ec10 2024-04-25T19:24:14.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.471+0000 7f11cbe00640 1 --2- 172.21.15.131:0/1792211597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11cc15ec10 0x7f11cc0b5850 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f11bc0115f0 tx=0x7f11bc011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:14.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.471+0000 7f11c8c00640 1 -- 172.21.15.131:0/1792211597 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc00f8f0 con 0x7f11cc15ec10 2024-04-25T19:24:14.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.471+0000 7f11c8c00640 1 -- 172.21.15.131:0/1792211597 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11bc00fa90 con 0x7f11cc15ec10 2024-04-25T19:24:14.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.471+0000 7f11c8c00640 1 -- 172.21.15.131:0/1792211597 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc00fe60 con 0x7f11cc15ec10 2024-04-25T19:24:14.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.471+0000 7f11d3200640 1 -- 172.21.15.131:0/1792211597 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11cc0b5d90 con 0x7f11cc15ec10 2024-04-25T19:24:14.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.471+0000 7f11d3200640 1 -- 172.21.15.131:0/1792211597 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11cc0b6340 con 0x7f11cc15ec10 2024-04-25T19:24:14.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.473+0000 7f11d3200640 1 -- 172.21.15.131:0/1792211597 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11cc050740 con 0x7f11cc15ec10 2024-04-25T19:24:14.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.474+0000 7f11c8c00640 1 -- 172.21.15.131:0/1792211597 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f11bc015460 con 0x7f11cc15ec10 2024-04-25T19:24:14.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.475+0000 7f11c8c00640 1 --2- 172.21.15.131:0/1792211597 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f11a80744e0 0x7f11a80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:14.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.475+0000 7f11c8c00640 1 -- 172.21.15.131:0/1792211597 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5227+0+0 (secure 0 0 0) 0x7f11bc0959d0 con 0x7f11cc15ec10 2024-04-25T19:24:14.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.476+0000 7f11c3400640 1 --2- 172.21.15.131:0/1792211597 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f11a80744e0 0x7f11a80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:14.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.477+0000 7f11c3400640 1 --2- 172.21.15.131:0/1792211597 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f11a80744e0 0x7f11a80769f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f11cc0cf010 tx=0x7f11b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:14.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.480+0000 7f11c8c00640 1 -- 172.21.15.131:0/1792211597 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f11bc019030 con 0x7f11cc15ec10 2024-04-25T19:24:14.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:14.683+0000 7f11d3200640 1 -- 172.21.15.131:0/1792211597 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f11cc155f20 con 0x7f11cc15ec10 2024-04-25T19:24:15.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.171+0000 7f11c8c00640 1 -- 172.21.15.131:0/1792211597 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v43) ==== 170+0+0 (secure 0 0 0) 0x7f11bc0603c0 con 0x7f11cc15ec10 2024-04-25T19:24:15.173 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'cephfs_data' created 2024-04-25T19:24:15.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.174+0000 7f11d3200640 1 -- 172.21.15.131:0/1792211597 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f11a80744e0 msgr2=0x7f11a80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:15.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.174+0000 7f11d3200640 1 --2- 172.21.15.131:0/1792211597 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f11a80744e0 0x7f11a80769f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f11cc0cf010 tx=0x7f11b4008040 comp rx=0 tx=0).stop 2024-04-25T19:24:15.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.174+0000 7f11d3200640 1 -- 172.21.15.131:0/1792211597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11cc15ec10 msgr2=0x7f11cc0b5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:15.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.174+0000 7f11d3200640 1 --2- 172.21.15.131:0/1792211597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11cc15ec10 0x7f11cc0b5850 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f11bc0115f0 tx=0x7f11bc011ab0 comp rx=0 tx=0).stop 2024-04-25T19:24:15.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.174+0000 7f11d3200640 1 -- 172.21.15.131:0/1792211597 shutdown_connections 2024-04-25T19:24:15.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.174+0000 7f11d3200640 1 --2- 172.21.15.131:0/1792211597 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f11a80744e0 0x7f11a80769f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:15.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.175+0000 7f11d3200640 1 --2- 172.21.15.131:0/1792211597 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11cc15d9a0 0x7f11cc15ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:15.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.175+0000 7f11d3200640 1 --2- 172.21.15.131:0/1792211597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11cc15e2f0 0x7f11cc15ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:15.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.175+0000 7f11d3200640 1 --2- 172.21.15.131:0/1792211597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11cc15ec10 0x7f11cc0b5850 secure :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f11bc0115f0 tx=0x7f11bc011ab0 comp rx=0 tx=0).stop 2024-04-25T19:24:15.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.175+0000 7f11d3200640 1 -- 172.21.15.131:0/1792211597 >> 172.21.15.131:0/1792211597 conn(0x7f11cc073090 msgr2=0x7f11cc156440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:15.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.175+0000 7f11d3200640 1 -- 172.21.15.131:0/1792211597 shutdown_connections 2024-04-25T19:24:15.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.175+0000 7f11d3200640 1 -- 172.21.15.131:0/1792211597 wait complete. 2024-04-25T19:24:15.224 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T19:24:15.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.471+0000 7fca55200640 1 Processor -- start 2024-04-25T19:24:15.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.471+0000 7fca55200640 1 -- start start 2024-04-25T19:24:15.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.474+0000 7fca55200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fca500ce520 0x7fca5015d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:15.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.474+0000 7fca55200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca500cda60 con 0x7fca5006dce0 2024-04-25T19:24:15.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.474+0000 7fca55200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca5015dfe0 con 0x7fca500ce930 2024-04-25T19:24:15.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.474+0000 7fca55200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fca5015e2c0 con 0x7fca500ce520 2024-04-25T19:24:15.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.474+0000 7fca4fe00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fca5006dce0 0x7fca500d00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:33520/0 (socket says 172.21.15.131:33520) 2024-04-25T19:24:15.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.474+0000 7fca4fe00640 1 -- 172.21.15.131:0/1840881444 learned_addr learned my addr 172.21.15.131:0/1840881444 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:24:15.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.475+0000 7fca4f400640 1 --2- 172.21.15.131:0/1840881444 >> v2:172.21.15.195:3300/0 conn(0x7fca500ce520 0x7fca5015d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:15.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.475+0000 7fca4ea00640 1 -- 172.21.15.131:0/1840881444 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1371418017 0 0) 0x7fca500cda60 con 0x7fca5006dce0 2024-04-25T19:24:15.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.475+0000 7fca4ea00640 1 -- 172.21.15.131:0/1840881444 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca34003520 con 0x7fca5006dce0 2024-04-25T19:24:15.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.475+0000 7fca4ea00640 1 -- 172.21.15.131:0/1840881444 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3100403511 0 0) 0x7fca34003520 con 0x7fca5006dce0 2024-04-25T19:24:15.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.475+0000 7fca4ea00640 1 -- 172.21.15.131:0/1840881444 >> v2:172.21.15.195:3300/0 conn(0x7fca500ce520 msgr2=0x7fca5015d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:15.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.475+0000 7fca4ea00640 1 --2- 172.21.15.131:0/1840881444 >> v2:172.21.15.195:3300/0 conn(0x7fca500ce520 0x7fca5015d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:15.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.475+0000 7fca4ea00640 1 -- 172.21.15.131:0/1840881444 >> v1:172.21.15.195:6789/0 conn(0x7fca500ce930 legacy=0x7fca5006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:15.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.475+0000 7fca4ea00640 1 -- 172.21.15.131:0/1840881444 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca500cdd20 con 0x7fca5006dce0 2024-04-25T19:24:15.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.475+0000 7fca4ea00640 1 -- 172.21.15.131:0/1840881444 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7fca480019f0 con 0x7fca5006dce0 2024-04-25T19:24:15.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.476+0000 7fca4ea00640 1 -- 172.21.15.131:0/1840881444 >> v1:172.21.15.131:6789/0 conn(0x7fca5006dce0 legacy=0x7fca500d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:15.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.476+0000 7fca4ea00640 1 --2- 172.21.15.131:0/1840881444 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca34003a00 0x7fca34003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:15.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.476+0000 7fca4ea00640 1 --2- 172.21.15.131:0/1840881444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca34004800 0x7fca34004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:15.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.476+0000 7fca4ea00640 1 --2- 172.21.15.131:0/1840881444 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca340052a0 0x7fca3400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:15.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.476+0000 7fca4ea00640 1 -- 172.21.15.131:0/1840881444 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fca5015e2c0 con 0x7fca34004800 2024-04-25T19:24:15.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.476+0000 7fca4ea00640 1 -- 172.21.15.131:0/1840881444 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fca3400e440 con 0x7fca34003a00 2024-04-25T19:24:15.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.476+0000 7fca4ea00640 1 -- 172.21.15.131:0/1840881444 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fca3400e640 con 0x7fca340052a0 2024-04-25T19:24:15.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.476+0000 7fca47e00640 1 --2- 172.21.15.131:0/1840881444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca34004800 0x7fca34004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:15.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.476+0000 7fca4f400640 1 --2- 172.21.15.131:0/1840881444 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca34003a00 0x7fca34003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:15.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.476+0000 7fca4fe00640 1 --2- 172.21.15.131:0/1840881444 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca340052a0 0x7fca3400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:15.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.476+0000 7fca47e00640 1 -- 172.21.15.131:0/1840881444 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca340052a0 msgr2=0x7fca3400dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:15.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.476+0000 7fca47e00640 1 --2- 172.21.15.131:0/1840881444 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca340052a0 0x7fca3400dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:15.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.476+0000 7fca47e00640 1 -- 172.21.15.131:0/1840881444 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca34003a00 msgr2=0x7fca34003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:15.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.476+0000 7fca47e00640 1 --2- 172.21.15.131:0/1840881444 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca34003a00 0x7fca34003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:15.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.477+0000 7fca47e00640 1 -- 172.21.15.131:0/1840881444 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca34003520 con 0x7fca34004800 2024-04-25T19:24:15.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.477+0000 7fca4fe00640 1 -- 172.21.15.131:0/1840881444 reap_dead start 2024-04-25T19:24:15.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.478+0000 7fca47e00640 1 --2- 172.21.15.131:0/1840881444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca34004800 0x7fca34004c10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fca38001750 tx=0x7fca34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85a4f2a00a02a6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:15.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.478+0000 7fca4ea00640 1 -- 172.21.15.131:0/1840881444 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca38001370 con 0x7fca34004800 2024-04-25T19:24:15.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.478+0000 7fca4ea00640 1 -- 172.21.15.131:0/1840881444 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca380052d0 con 0x7fca34004800 2024-04-25T19:24:15.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.478+0000 7fca4ea00640 1 -- 172.21.15.131:0/1840881444 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3802abe0 con 0x7fca34004800 2024-04-25T19:24:15.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.479+0000 7fca55200640 1 -- 172.21.15.131:0/1840881444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca34004800 msgr2=0x7fca34004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:15.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.479+0000 7fca55200640 1 --2- 172.21.15.131:0/1840881444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca34004800 0x7fca34004c10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fca38001750 tx=0x7fca34005830 comp rx=0 tx=0).stop 2024-04-25T19:24:15.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.479+0000 7fca55200640 1 -- 172.21.15.131:0/1840881444 shutdown_connections 2024-04-25T19:24:15.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.479+0000 7fca55200640 1 --2- 172.21.15.131:0/1840881444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca34004800 0x7fca34004c10 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:15.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.479+0000 7fca55200640 1 -- 172.21.15.131:0/1840881444 >> 172.21.15.131:0/1840881444 conn(0x7fca50072f40 msgr2=0x7fca50073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:15.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.479+0000 7fca55200640 1 -- 172.21.15.131:0/1840881444 shutdown_connections 2024-04-25T19:24:15.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.479+0000 7fca55200640 1 -- 172.21.15.131:0/1840881444 wait complete. 2024-04-25T19:24:15.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.481+0000 7fca55200640 1 Processor -- start 2024-04-25T19:24:15.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.481+0000 7fca55200640 1 -- start start 2024-04-25T19:24:15.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.483+0000 7fca55200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca34004800 0x7fca500cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:15.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.483+0000 7fca55200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca5014b2b0 0x7fca500b2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:15.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.483+0000 7fca55200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca500b2ba0 0x7fca501f9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:15.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.483+0000 7fca55200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fca500b73d0 con 0x7fca500b2ba0 2024-04-25T19:24:15.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.483+0000 7fca55200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fca50160d30 con 0x7fca34004800 2024-04-25T19:24:15.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.483+0000 7fca55200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fca500b7550 con 0x7fca5014b2b0 2024-04-25T19:24:15.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.483+0000 7fca4fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca500b2ba0 0x7fca501f9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:15.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.483+0000 7fca4fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca500b2ba0 0x7fca501f9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41938/0 (socket says 172.21.15.131:41938) 2024-04-25T19:24:15.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.483+0000 7fca4fe00640 1 -- 172.21.15.131:0/654594834 learned_addr learned my addr 172.21.15.131:0/654594834 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:15.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.483+0000 7fca47e00640 1 --2- 172.21.15.131:0/654594834 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca5014b2b0 0x7fca500b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:15.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.484+0000 7fca4f400640 1 --2- 172.21.15.131:0/654594834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca34004800 0x7fca500cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:15.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.484+0000 7fca4fe00640 1 -- 172.21.15.131:0/654594834 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca5014b2b0 msgr2=0x7fca500b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:15.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.484+0000 7fca4fe00640 1 --2- 172.21.15.131:0/654594834 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca5014b2b0 0x7fca500b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:15.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.484+0000 7fca4fe00640 1 -- 172.21.15.131:0/654594834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca34004800 msgr2=0x7fca500cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:15.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.484+0000 7fca4fe00640 1 --2- 172.21.15.131:0/654594834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca34004800 0x7fca500cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:15.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.484+0000 7fca4fe00640 1 -- 172.21.15.131:0/654594834 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca500cca60 con 0x7fca500b2ba0 2024-04-25T19:24:15.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.484+0000 7fca4fe00640 1 --2- 172.21.15.131:0/654594834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca500b2ba0 0x7fca501f9e90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fca48001330 tx=0x7fca4800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:15.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.484+0000 7fca47400640 1 -- 172.21.15.131:0/654594834 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca48004d60 con 0x7fca500b2ba0 2024-04-25T19:24:15.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.484+0000 7fca47400640 1 -- 172.21.15.131:0/654594834 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca4800bb20 con 0x7fca500b2ba0 2024-04-25T19:24:15.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.484+0000 7fca55200640 1 -- 172.21.15.131:0/654594834 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca500b2fb0 con 0x7fca500b2ba0 2024-04-25T19:24:15.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.484+0000 7fca47400640 1 -- 172.21.15.131:0/654594834 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca48007070 con 0x7fca500b2ba0 2024-04-25T19:24:15.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.484+0000 7fca55200640 1 -- 172.21.15.131:0/654594834 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca5015ece0 con 0x7fca500b2ba0 2024-04-25T19:24:15.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.486+0000 7fca55200640 1 -- 172.21.15.131:0/654594834 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca50076c60 con 0x7fca500b2ba0 2024-04-25T19:24:15.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.487+0000 7fca47400640 1 -- 172.21.15.131:0/654594834 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fca48007210 con 0x7fca500b2ba0 2024-04-25T19:24:15.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.488+0000 7fca47400640 1 --2- 172.21.15.131:0/654594834 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fca2c0744b0 0x7fca2c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:15.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.488+0000 7fca47400640 1 -- 172.21.15.131:0/654594834 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5609+0+0 (secure 0 0 0) 0x7fca48095160 con 0x7fca500b2ba0 2024-04-25T19:24:15.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.489+0000 7fca4f400640 1 --2- 172.21.15.131:0/654594834 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fca2c0744b0 0x7fca2c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:15.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.490+0000 7fca4f400640 1 --2- 172.21.15.131:0/654594834 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fca2c0744b0 0x7fca2c0769c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fca5006b530 tx=0x7fca40008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:15.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.494+0000 7fca47400640 1 -- 172.21.15.131:0/654594834 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fca500b2fb0 con 0x7fca500b2ba0 2024-04-25T19:24:15.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:15.725+0000 7fca55200640 1 -- 172.21.15.131:0/654594834 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fca500cc740 con 0x7fca500b2ba0 2024-04-25T19:24:16.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.175+0000 7fca47400640 1 -- 172.21.15.131:0/654594834 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v21) ==== 172+0+0 (secure 0 0 0) 0x7fca4805f8b0 con 0x7fca500b2ba0 2024-04-25T19:24:16.177 INFO:teuthology.orchestra.run.smithi131.stderr:new fs with metadata pool 6 and data pool 7 2024-04-25T19:24:16.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.179+0000 7fca55200640 1 -- 172.21.15.131:0/654594834 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fca2c0744b0 msgr2=0x7fca2c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:16.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.179+0000 7fca55200640 1 --2- 172.21.15.131:0/654594834 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fca2c0744b0 0x7fca2c0769c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fca5006b530 tx=0x7fca40008040 comp rx=0 tx=0).stop 2024-04-25T19:24:16.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.179+0000 7fca55200640 1 -- 172.21.15.131:0/654594834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca500b2ba0 msgr2=0x7fca501f9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:16.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.179+0000 7fca55200640 1 --2- 172.21.15.131:0/654594834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca500b2ba0 0x7fca501f9e90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fca48001330 tx=0x7fca4800b4a0 comp rx=0 tx=0).stop 2024-04-25T19:24:16.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.179+0000 7fca55200640 1 -- 172.21.15.131:0/654594834 shutdown_connections 2024-04-25T19:24:16.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.179+0000 7fca55200640 1 --2- 172.21.15.131:0/654594834 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fca2c0744b0 0x7fca2c0769c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:16.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.179+0000 7fca55200640 1 --2- 172.21.15.131:0/654594834 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca5014b2b0 0x7fca500b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:16.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.179+0000 7fca55200640 1 --2- 172.21.15.131:0/654594834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca500b2ba0 0x7fca501f9e90 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:16.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.179+0000 7fca55200640 1 --2- 172.21.15.131:0/654594834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca34004800 0x7fca500cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:16.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.179+0000 7fca55200640 1 -- 172.21.15.131:0/654594834 >> 172.21.15.131:0/654594834 conn(0x7fca50072f40 msgr2=0x7fca500d0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:16.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.179+0000 7fca55200640 1 -- 172.21.15.131:0/654594834 shutdown_connections 2024-04-25T19:24:16.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.179+0000 7fca55200640 1 -- 172.21.15.131:0/654594834 wait complete. 2024-04-25T19:24:16.239 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:24:16.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.480+0000 7f3196e00640 1 Processor -- start 2024-04-25T19:24:16.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.480+0000 7f3196e00640 1 -- start start 2024-04-25T19:24:16.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.482+0000 7f3196e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f31900b4ea0 0x7f31900cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:16.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.482+0000 7f3196e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31900d1230 con 0x7f3190144370 2024-04-25T19:24:16.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.482+0000 7f3196e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31900d06b0 con 0x7f319006c5c0 2024-04-25T19:24:16.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.482+0000 7f3196e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f31900d0990 con 0x7f31900b4ea0 2024-04-25T19:24:16.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.482+0000 7f3196400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f3190144370 0x7f319015e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:33532/0 (socket says 172.21.15.131:33532) 2024-04-25T19:24:16.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.482+0000 7f3196400640 1 -- 172.21.15.131:0/3965442771 learned_addr learned my addr 172.21.15.131:0/3965442771 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:24:16.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.483+0000 7f3195000640 1 --2- 172.21.15.131:0/3965442771 >> v2:172.21.15.195:3300/0 conn(0x7f31900b4ea0 0x7f31900cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:16.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.483+0000 7f318fe00640 1 -- 172.21.15.131:0/3965442771 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3568942807 0 0) 0x7f31900d1230 con 0x7f3190144370 2024-04-25T19:24:16.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.483+0000 7f318fe00640 1 -- 172.21.15.131:0/3965442771 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3178003520 con 0x7f3190144370 2024-04-25T19:24:16.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.483+0000 7f318fe00640 1 -- 172.21.15.131:0/3965442771 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1606071858 0 0) 0x7f3178003520 con 0x7f3190144370 2024-04-25T19:24:16.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.483+0000 7f318fe00640 1 -- 172.21.15.131:0/3965442771 >> v2:172.21.15.195:3300/0 conn(0x7f31900b4ea0 msgr2=0x7f31900cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:16.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.483+0000 7f318fe00640 1 --2- 172.21.15.131:0/3965442771 >> v2:172.21.15.195:3300/0 conn(0x7f31900b4ea0 0x7f31900cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:16.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.483+0000 7f318fe00640 1 -- 172.21.15.131:0/3965442771 >> v1:172.21.15.195:6789/0 conn(0x7f319006c5c0 legacy=0x7f31900b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:16.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.483+0000 7f318fe00640 1 -- 172.21.15.131:0/3965442771 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31900d0c70 con 0x7f3190144370 2024-04-25T19:24:16.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.483+0000 7f318fe00640 1 -- 172.21.15.131:0/3965442771 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f31880019f0 con 0x7f3190144370 2024-04-25T19:24:16.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.483+0000 7f318fe00640 1 -- 172.21.15.131:0/3965442771 >> v1:172.21.15.131:6789/0 conn(0x7f3190144370 legacy=0x7f319015e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:16.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.483+0000 7f318fe00640 1 --2- 172.21.15.131:0/3965442771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3178003a00 0x7f3178003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:16.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.483+0000 7f318fe00640 1 --2- 172.21.15.131:0/3965442771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3178004800 0x7f3178004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:16.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.483+0000 7f318fe00640 1 --2- 172.21.15.131:0/3965442771 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3178005270 0x7f317800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:16.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.483+0000 7f318fe00640 1 -- 172.21.15.131:0/3965442771 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f31900d0990 con 0x7f3178004800 2024-04-25T19:24:16.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.483+0000 7f318fe00640 1 -- 172.21.15.131:0/3965442771 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f317800c190 con 0x7f3178003a00 2024-04-25T19:24:16.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.483+0000 7f318fe00640 1 -- 172.21.15.131:0/3965442771 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f317800c390 con 0x7f3178005270 2024-04-25T19:24:16.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.484+0000 7f3195000640 1 --2- 172.21.15.131:0/3965442771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3178004800 0x7f3178004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:16.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.484+0000 7f3195a00640 1 --2- 172.21.15.131:0/3965442771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3178003a00 0x7f3178003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:16.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.484+0000 7f3196400640 1 --2- 172.21.15.131:0/3965442771 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3178005270 0x7f317800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:16.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.484+0000 7f3195000640 1 -- 172.21.15.131:0/3965442771 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3178005270 msgr2=0x7f317800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:16.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.484+0000 7f3195000640 1 --2- 172.21.15.131:0/3965442771 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3178005270 0x7f317800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:16.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.484+0000 7f3195000640 1 -- 172.21.15.131:0/3965442771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3178003a00 msgr2=0x7f3178003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:16.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.484+0000 7f3195000640 1 --2- 172.21.15.131:0/3965442771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3178003a00 0x7f3178003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:16.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.484+0000 7f3195000640 1 -- 172.21.15.131:0/3965442771 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3178003520 con 0x7f3178004800 2024-04-25T19:24:16.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.484+0000 7f3195a00640 1 --2- 172.21.15.131:0/3965442771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3178003a00 0x7f3178003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:24:16.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.484+0000 7f3196400640 1 --2- 172.21.15.131:0/3965442771 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3178005270 0x7f317800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:24:16.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.484+0000 7f3196400640 1 -- 172.21.15.131:0/3965442771 reap_dead start 2024-04-25T19:24:16.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.485+0000 7f3195000640 1 --2- 172.21.15.131:0/3965442771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3178004800 0x7f3178004c10 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f317c009ac0 tx=0x7f3178005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6457481c2b22db43 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:16.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.485+0000 7f318fe00640 1 -- 172.21.15.131:0/3965442771 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c036070 con 0x7f3178004800 2024-04-25T19:24:16.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.485+0000 7f318fe00640 1 -- 172.21.15.131:0/3965442771 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f317c031400 con 0x7f3178004800 2024-04-25T19:24:16.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.485+0000 7f318fe00640 1 -- 172.21.15.131:0/3965442771 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c009690 con 0x7f3178004800 2024-04-25T19:24:16.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.486+0000 7f3196e00640 1 -- 172.21.15.131:0/3965442771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3178004800 msgr2=0x7f3178004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:16.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.486+0000 7f3196e00640 1 --2- 172.21.15.131:0/3965442771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3178004800 0x7f3178004c10 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f317c009ac0 tx=0x7f3178005830 comp rx=0 tx=0).stop 2024-04-25T19:24:16.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.486+0000 7f3196e00640 1 -- 172.21.15.131:0/3965442771 shutdown_connections 2024-04-25T19:24:16.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.486+0000 7f3196e00640 1 --2- 172.21.15.131:0/3965442771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3178004800 0x7f3178004c10 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:16.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.486+0000 7f3196e00640 1 -- 172.21.15.131:0/3965442771 >> 172.21.15.131:0/3965442771 conn(0x7f31900d1720 msgr2=0x7f31900d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:16.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.486+0000 7f3196e00640 1 -- 172.21.15.131:0/3965442771 shutdown_connections 2024-04-25T19:24:16.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.486+0000 7f3196e00640 1 -- 172.21.15.131:0/3965442771 wait complete. 2024-04-25T19:24:16.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.489+0000 7f3196e00640 1 Processor -- start 2024-04-25T19:24:16.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.489+0000 7f3196e00640 1 -- start start 2024-04-25T19:24:16.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.490+0000 7f3196e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3178004800 0x7f3190070510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:16.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.490+0000 7f3196e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3190161db0 0x7f319013d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:16.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.490+0000 7f3196e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f319006fbd0 0x7f31900cab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:16.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.490+0000 7f3196e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f31900d0450 con 0x7f3190161db0 2024-04-25T19:24:16.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.490+0000 7f3196e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f31900d02d0 con 0x7f319006fbd0 2024-04-25T19:24:16.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.490+0000 7f3196e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3190147760 con 0x7f3178004800 2024-04-25T19:24:16.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.490+0000 7f3195000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3190161db0 0x7f319013d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:16.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.491+0000 7f3195000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3190161db0 0x7f319013d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41956/0 (socket says 172.21.15.131:41956) 2024-04-25T19:24:16.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.491+0000 7f3195000640 1 -- 172.21.15.131:0/2777427648 learned_addr learned my addr 172.21.15.131:0/2777427648 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:16.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.491+0000 7f3196400640 1 --2- 172.21.15.131:0/2777427648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f319006fbd0 0x7f31900cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:16.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.491+0000 7f3195a00640 1 --2- 172.21.15.131:0/2777427648 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3178004800 0x7f3190070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:16.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.491+0000 7f3195000640 1 -- 172.21.15.131:0/2777427648 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3178004800 msgr2=0x7f3190070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:16.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.491+0000 7f3195000640 1 --2- 172.21.15.131:0/2777427648 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3178004800 0x7f3190070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:16.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.491+0000 7f3195000640 1 -- 172.21.15.131:0/2777427648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f319006fbd0 msgr2=0x7f31900cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:16.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.491+0000 7f3195000640 1 --2- 172.21.15.131:0/2777427648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f319006fbd0 0x7f31900cab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:16.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.491+0000 7f3195000640 1 -- 172.21.15.131:0/2777427648 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3190070d60 con 0x7f3190161db0 2024-04-25T19:24:16.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.491+0000 7f3195000640 1 --2- 172.21.15.131:0/2777427648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3190161db0 0x7f319013d390 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f317c034040 tx=0x7f317c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:16.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.492+0000 7f318d600640 1 -- 172.21.15.131:0/2777427648 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c03f020 con 0x7f3190161db0 2024-04-25T19:24:16.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.492+0000 7f318d600640 1 -- 172.21.15.131:0/2777427648 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f317c037040 con 0x7f3190161db0 2024-04-25T19:24:16.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.492+0000 7f318d600640 1 -- 172.21.15.131:0/2777427648 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c036070 con 0x7f3190161db0 2024-04-25T19:24:16.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.492+0000 7f3196e00640 1 -- 172.21.15.131:0/2777427648 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3190071040 con 0x7f3190161db0 2024-04-25T19:24:16.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.492+0000 7f3196e00640 1 -- 172.21.15.131:0/2777427648 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31900cb4d0 con 0x7f3190161db0 2024-04-25T19:24:16.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.493+0000 7f3196e00640 1 -- 172.21.15.131:0/2777427648 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3190070ab0 con 0x7f3190161db0 2024-04-25T19:24:16.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.494+0000 7f318d600640 1 -- 172.21.15.131:0/2777427648 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f317c042020 con 0x7f3190161db0 2024-04-25T19:24:16.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.495+0000 7f318d600640 1 --2- 172.21.15.131:0/2777427648 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f31700744e0 0x7f31700769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:16.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.495+0000 7f318d600640 1 -- 172.21.15.131:0/2777427648 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f317c0b53c0 con 0x7f3190161db0 2024-04-25T19:24:16.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.496+0000 7f3195a00640 1 --2- 172.21.15.131:0/2777427648 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f31700744e0 0x7f31700769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:16.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.497+0000 7f3195a00640 1 --2- 172.21.15.131:0/2777427648 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f31700744e0 0x7f31700769f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3184001630 tx=0x7f3184009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:16.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.500+0000 7f318d600640 1 -- 172.21.15.131:0/2777427648 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f317c049030 con 0x7f3190161db0 2024-04-25T19:24:16.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.687+0000 7f3196e00640 1 -- 172.21.15.131:0/2777427648 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3190050740 con 0x7f3190161db0 2024-04-25T19:24:16.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.690+0000 7f318d600640 1 -- 172.21.15.131:0/2777427648 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16650 (secure 0 0 0) 0x7f317c07fc00 con 0x7f3190161db0 2024-04-25T19:24:16.692 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:24:16.693 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":44,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:24:15.727427+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:24:13.848038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T19:24:14.699910+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:24:16.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.692+0000 7f3196e00640 1 -- 172.21.15.131:0/2777427648 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f31700744e0 msgr2=0x7f31700769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:16.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.692+0000 7f3196e00640 1 --2- 172.21.15.131:0/2777427648 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f31700744e0 0x7f31700769f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3184001630 tx=0x7f3184009040 comp rx=0 tx=0).stop 2024-04-25T19:24:16.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.692+0000 7f3196e00640 1 -- 172.21.15.131:0/2777427648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3190161db0 msgr2=0x7f319013d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:16.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.692+0000 7f3196e00640 1 --2- 172.21.15.131:0/2777427648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3190161db0 0x7f319013d390 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f317c034040 tx=0x7f317c004730 comp rx=0 tx=0).stop 2024-04-25T19:24:16.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.693+0000 7f3196e00640 1 -- 172.21.15.131:0/2777427648 shutdown_connections 2024-04-25T19:24:16.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.693+0000 7f3196e00640 1 --2- 172.21.15.131:0/2777427648 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f31700744e0 0x7f31700769f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:16.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.693+0000 7f3196e00640 1 --2- 172.21.15.131:0/2777427648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f319006fbd0 0x7f31900cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:16.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.693+0000 7f3196e00640 1 --2- 172.21.15.131:0/2777427648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3190161db0 0x7f319013d390 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:16.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.693+0000 7f3196e00640 1 --2- 172.21.15.131:0/2777427648 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3178004800 0x7f3190070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:16.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.693+0000 7f3196e00640 1 -- 172.21.15.131:0/2777427648 >> 172.21.15.131:0/2777427648 conn(0x7f31900d1720 msgr2=0x7f3190072de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:16.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.693+0000 7f3196e00640 1 -- 172.21.15.131:0/2777427648 shutdown_connections 2024-04-25T19:24:16.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.693+0000 7f3196e00640 1 -- 172.21.15.131:0/2777427648 wait complete. 2024-04-25T19:24:16.720 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:24:16.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.978+0000 7fe3f6600640 1 Processor -- start 2024-04-25T19:24:16.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.979+0000 7fe3f6600640 1 -- start start 2024-04-25T19:24:16.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.981+0000 7fe3f6600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3f00b0800 0x7fe3f0070290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:16.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.981+0000 7fe3f6600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe3f00707d0 0x7fe3f01569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:16.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.981+0000 7fe3f6600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3f0070be0 con 0x7fe3f00cf9e0 2024-04-25T19:24:16.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.981+0000 7fe3f6600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe3f00cffc0 con 0x7fe3f00707d0 2024-04-25T19:24:16.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.981+0000 7fe3f6600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe3f00d02a0 con 0x7fe3f00b0800 2024-04-25T19:24:16.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.982+0000 7fe3f5c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe3f00707d0 0x7fe3f01569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:16.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.982+0000 7fe3f5200640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fe3f00cf9e0 0x7fe3f0161090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.131:43330/0 (socket says 172.21.15.131:43330) 2024-04-25T19:24:16.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.982+0000 7fe3f5c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe3f00707d0 0x7fe3f01569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.131:55094/0 (socket says 172.21.15.131:55094) 2024-04-25T19:24:16.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.982+0000 7fe3f5200640 1 -- 172.21.15.131:0/2217786536 learned_addr learned my addr 172.21.15.131:0/2217786536 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:24:16.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.982+0000 7fe3efe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3f00b0800 0x7fe3f0070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:16.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.983+0000 7fe3f5c00640 1 -- 172.21.15.131:0/2217786536 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3f00b0800 msgr2=0x7fe3f0070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:16.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.983+0000 7fe3f5c00640 1 --2- 172.21.15.131:0/2217786536 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3f00b0800 0x7fe3f0070290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:16.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.983+0000 7fe3f5c00640 1 -- 172.21.15.131:0/2217786536 >> v1:172.21.15.195:6789/0 conn(0x7fe3f00cf9e0 legacy=0x7fe3f0161090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:16.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.983+0000 7fe3f5c00640 1 -- 172.21.15.131:0/2217786536 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f00d0580 con 0x7fe3f00707d0 2024-04-25T19:24:16.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.984+0000 7fe3f5c00640 1 --2- 172.21.15.131:0/2217786536 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3f00707d0 0x7fe3f01569b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009d90 tx=0x7fe3e802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7be1cc6b5ae1e0e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:16.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.984+0000 7fe3ef400640 1 -- 172.21.15.131:0/2217786536 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8031600 con 0x7fe3f00707d0 2024-04-25T19:24:16.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.984+0000 7fe3ef400640 1 -- 172.21.15.131:0/2217786536 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e80317a0 con 0x7fe3f00707d0 2024-04-25T19:24:16.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.984+0000 7fe3ef400640 1 -- 172.21.15.131:0/2217786536 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8031b70 con 0x7fe3f00707d0 2024-04-25T19:24:16.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.985+0000 7fe3f6600640 1 -- 172.21.15.131:0/2217786536 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3f00707d0 msgr2=0x7fe3f01569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:16.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.985+0000 7fe3f6600640 1 --2- 172.21.15.131:0/2217786536 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3f00707d0 0x7fe3f01569b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009d90 tx=0x7fe3e802a5d0 comp rx=0 tx=0).stop 2024-04-25T19:24:16.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.985+0000 7fe3f6600640 1 -- 172.21.15.131:0/2217786536 shutdown_connections 2024-04-25T19:24:16.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.985+0000 7fe3f6600640 1 --2- 172.21.15.131:0/2217786536 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3f00707d0 0x7fe3f01569b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:16.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.985+0000 7fe3f6600640 1 --2- 172.21.15.131:0/2217786536 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3f00b0800 0x7fe3f0070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:16.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.985+0000 7fe3f6600640 1 -- 172.21.15.131:0/2217786536 >> 172.21.15.131:0/2217786536 conn(0x7fe3f00d1720 msgr2=0x7fe3f00d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:16.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.986+0000 7fe3f6600640 1 -- 172.21.15.131:0/2217786536 shutdown_connections 2024-04-25T19:24:16.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.986+0000 7fe3f6600640 1 -- 172.21.15.131:0/2217786536 wait complete. 2024-04-25T19:24:16.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.989+0000 7fe3f6600640 1 Processor -- start 2024-04-25T19:24:16.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.989+0000 7fe3f6600640 1 -- start start 2024-04-25T19:24:16.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.991+0000 7fe3f6600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3f00707d0 0x7fe3f0157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:16.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.991+0000 7fe3f6600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3f00b0800 0x7fe3f0158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:16.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.991+0000 7fe3f6600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3f00cf9e0 0x7fe3f0158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:16.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.991+0000 7fe3f6600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f00b0d90 con 0x7fe3f00707d0 2024-04-25T19:24:16.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.991+0000 7fe3f6600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f00b0c10 con 0x7fe3f00b0800 2024-04-25T19:24:16.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.991+0000 7fe3f6600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe3f0156ef0 con 0x7fe3f00cf9e0 2024-04-25T19:24:16.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.991+0000 7fe3f5200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3f00707d0 0x7fe3f0157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:16.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.991+0000 7fe3f5200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3f00707d0 0x7fe3f0157de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41960/0 (socket says 172.21.15.131:41960) 2024-04-25T19:24:16.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.991+0000 7fe3f5200640 1 -- 172.21.15.131:0/1346369181 learned_addr learned my addr 172.21.15.131:0/1346369181 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:16.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.992+0000 7fe3efe00640 1 --2- 172.21.15.131:0/1346369181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3f00b0800 0x7fe3f0158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:16.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.992+0000 7fe3f5200640 1 -- 172.21.15.131:0/1346369181 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3f00cf9e0 msgr2=0x7fe3f0158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:16.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.992+0000 7fe3f5200640 1 --2- 172.21.15.131:0/1346369181 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3f00cf9e0 0x7fe3f0158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:16.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.992+0000 7fe3f5200640 1 -- 172.21.15.131:0/1346369181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3f00b0800 msgr2=0x7fe3f0158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:16.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.992+0000 7fe3f5200640 1 --2- 172.21.15.131:0/1346369181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3f00b0800 0x7fe3f0158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:16.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.992+0000 7fe3f5200640 1 -- 172.21.15.131:0/1346369181 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f00b72a0 con 0x7fe3f00707d0 2024-04-25T19:24:16.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.992+0000 7fe3f5200640 1 --2- 172.21.15.131:0/1346369181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3f00707d0 0x7fe3f0157de0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe3e400c470 tx=0x7fe3e400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:16.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.992+0000 7fe3ecc00640 1 -- 172.21.15.131:0/1346369181 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e4017070 con 0x7fe3f00707d0 2024-04-25T19:24:16.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.992+0000 7fe3f6600640 1 -- 172.21.15.131:0/1346369181 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3f00b7710 con 0x7fe3f00707d0 2024-04-25T19:24:16.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.992+0000 7fe3ecc00640 1 -- 172.21.15.131:0/1346369181 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e4005d00 con 0x7fe3f00707d0 2024-04-25T19:24:16.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.992+0000 7fe3ecc00640 1 -- 172.21.15.131:0/1346369181 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e4007310 con 0x7fe3f00707d0 2024-04-25T19:24:16.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.993+0000 7fe3f6600640 1 -- 172.21.15.131:0/1346369181 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f01575e0 con 0x7fe3f00707d0 2024-04-25T19:24:16.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.994+0000 7fe3f6600640 1 -- 172.21.15.131:0/1346369181 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3f0050740 con 0x7fe3f00707d0 2024-04-25T19:24:16.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.995+0000 7fe3ecc00640 1 -- 172.21.15.131:0/1346369181 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe3e401a070 con 0x7fe3f00707d0 2024-04-25T19:24:16.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.996+0000 7fe3ecc00640 1 --2- 172.21.15.131:0/1346369181 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe3d00744b0 0x7fe3d00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:16.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.996+0000 7fe3ecc00640 1 -- 172.21.15.131:0/1346369181 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fe3e4094650 con 0x7fe3f00707d0 2024-04-25T19:24:16.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.997+0000 7fe3efe00640 1 --2- 172.21.15.131:0/1346369181 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe3d00744b0 0x7fe3d00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:16.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:16.998+0000 7fe3efe00640 1 --2- 172.21.15.131:0/1346369181 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe3d00744b0 0x7fe3d00769c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0070400 tx=0x7fe3dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:17.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.000+0000 7fe3ecc00640 1 -- 172.21.15.131:0/1346369181 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe3f0070be0 con 0x7fe3f00707d0 2024-04-25T19:24:17.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.197+0000 7fe3f6600640 1 -- 172.21.15.131:0/1346369181 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe3f006fb60 con 0x7fe3f00707d0 2024-04-25T19:24:17.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.202+0000 7fe3ecc00640 1 -- 172.21.15.131:0/1346369181 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16650 (secure 0 0 0) 0x7fe3e405ecc0 con 0x7fe3f00707d0 2024-04-25T19:24:17.204 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:24:17.204 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":44,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:24:15.727427+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:24:13.848038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T19:24:14.699910+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:24:17.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.205+0000 7fe3f6600640 1 -- 172.21.15.131:0/1346369181 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe3d00744b0 msgr2=0x7fe3d00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:17.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.205+0000 7fe3f6600640 1 --2- 172.21.15.131:0/1346369181 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe3d00744b0 0x7fe3d00769c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0070400 tx=0x7fe3dc008040 comp rx=0 tx=0).stop 2024-04-25T19:24:17.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.205+0000 7fe3f6600640 1 -- 172.21.15.131:0/1346369181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3f00707d0 msgr2=0x7fe3f0157de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:17.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.205+0000 7fe3f6600640 1 --2- 172.21.15.131:0/1346369181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3f00707d0 0x7fe3f0157de0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe3e400c470 tx=0x7fe3e400c930 comp rx=0 tx=0).stop 2024-04-25T19:24:17.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.205+0000 7fe3f6600640 1 -- 172.21.15.131:0/1346369181 shutdown_connections 2024-04-25T19:24:17.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.205+0000 7fe3f6600640 1 --2- 172.21.15.131:0/1346369181 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe3d00744b0 0x7fe3d00769c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:17.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.205+0000 7fe3f6600640 1 --2- 172.21.15.131:0/1346369181 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3f00cf9e0 0x7fe3f0158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:17.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.205+0000 7fe3f6600640 1 --2- 172.21.15.131:0/1346369181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3f00b0800 0x7fe3f0158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:17.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.205+0000 7fe3f6600640 1 --2- 172.21.15.131:0/1346369181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3f00707d0 0x7fe3f0157de0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:17.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.205+0000 7fe3f6600640 1 -- 172.21.15.131:0/1346369181 >> 172.21.15.131:0/1346369181 conn(0x7fe3f00d1720 msgr2=0x7fe3f00d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:17.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.205+0000 7fe3f6600640 1 -- 172.21.15.131:0/1346369181 shutdown_connections 2024-04-25T19:24:17.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.205+0000 7fe3f6600640 1 -- 172.21.15.131:0/1346369181 wait complete. 2024-04-25T19:24:17.232 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T19:24:17.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.482+0000 7fcfefe00640 1 Processor -- start 2024-04-25T19:24:17.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.483+0000 7fcfefe00640 1 -- start start 2024-04-25T19:24:17.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.485+0000 7fcfefe00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcff006dce0 0x7fcff015e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:17.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.485+0000 7fcfefe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcff015ec90 0x7fcff015f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:17.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.485+0000 7fcfefe00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcff0070000 con 0x7fcff0144340 2024-04-25T19:24:17.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.485+0000 7fcfefe00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fcff0144750 con 0x7fcff006dce0 2024-04-25T19:24:17.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.485+0000 7fcfefe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcff006f240 con 0x7fcff015ec90 2024-04-25T19:24:17.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.486+0000 7fcfef400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcff015ec90 0x7fcff015f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:17.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.486+0000 7fcfee000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcff006dce0 0x7fcff015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:17.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.486+0000 7fcfef400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcff015ec90 0x7fcff015f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.131:49190/0 (socket says 172.21.15.131:49190) 2024-04-25T19:24:17.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.486+0000 7fcfeea00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fcff0144340 0x7fcff006d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.131:43338/0 (socket says 172.21.15.131:43338) 2024-04-25T19:24:17.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.486+0000 7fcfef400640 1 -- 172.21.15.131:0/877126859 learned_addr learned my addr 172.21.15.131:0/877126859 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:17.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.487+0000 7fcfee000640 1 -- 172.21.15.131:0/877126859 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcff015ec90 msgr2=0x7fcff015f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:17.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.487+0000 7fcfee000640 1 --2- 172.21.15.131:0/877126859 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcff015ec90 0x7fcff015f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:17.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.487+0000 7fcfee000640 1 -- 172.21.15.131:0/877126859 >> v1:172.21.15.195:6789/0 conn(0x7fcff0144340 legacy=0x7fcff006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:17.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.487+0000 7fcfee000640 1 -- 172.21.15.131:0/877126859 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff006f520 con 0x7fcff006dce0 2024-04-25T19:24:17.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.487+0000 7fcfef400640 1 --2- 172.21.15.131:0/877126859 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcff015ec90 0x7fcff015f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T19:24:17.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.488+0000 7fcfee000640 1 --2- 172.21.15.131:0/877126859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcff006dce0 0x7fcff015e750 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8009d90 tx=0x7fcfd802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9e6cf9858f5d776 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:17.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.488+0000 7fcfed600640 1 -- 172.21.15.131:0/877126859 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8007740 con 0x7fcff006dce0 2024-04-25T19:24:17.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.488+0000 7fcfed600640 1 -- 172.21.15.131:0/877126859 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfd80078e0 con 0x7fcff006dce0 2024-04-25T19:24:17.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.488+0000 7fcfed600640 1 -- 172.21.15.131:0/877126859 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8007cb0 con 0x7fcff006dce0 2024-04-25T19:24:17.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.489+0000 7fcfefe00640 1 -- 172.21.15.131:0/877126859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcff006dce0 msgr2=0x7fcff015e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:17.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.489+0000 7fcfefe00640 1 --2- 172.21.15.131:0/877126859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcff006dce0 0x7fcff015e750 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8009d90 tx=0x7fcfd802a660 comp rx=0 tx=0).stop 2024-04-25T19:24:17.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.489+0000 7fcfefe00640 1 -- 172.21.15.131:0/877126859 shutdown_connections 2024-04-25T19:24:17.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.489+0000 7fcfefe00640 1 --2- 172.21.15.131:0/877126859 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcff015ec90 0x7fcff015f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:17.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.489+0000 7fcfefe00640 1 --2- 172.21.15.131:0/877126859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcff006dce0 0x7fcff015e750 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:17.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.489+0000 7fcfefe00640 1 -- 172.21.15.131:0/877126859 >> 172.21.15.131:0/877126859 conn(0x7fcff0072f40 msgr2=0x7fcff0073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:17.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.489+0000 7fcfefe00640 1 -- 172.21.15.131:0/877126859 shutdown_connections 2024-04-25T19:24:17.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.489+0000 7fcfefe00640 1 -- 172.21.15.131:0/877126859 wait complete. 2024-04-25T19:24:17.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.492+0000 7fcfefe00640 1 Processor -- start 2024-04-25T19:24:17.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.492+0000 7fcfefe00640 1 -- start start 2024-04-25T19:24:17.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.493+0000 7fcfefe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcff0144340 0x7fcff015a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:17.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.493+0000 7fcfefe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcff015ec90 0x7fcff0161910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:17.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.493+0000 7fcfefe00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcff00b0560 0x7fcff00b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:17.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.493+0000 7fcfefe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcff015f0a0 con 0x7fcff015ec90 2024-04-25T19:24:17.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.493+0000 7fcfefe00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcff006fae0 con 0x7fcff00b0560 2024-04-25T19:24:17.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.493+0000 7fcfefe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcff015f220 con 0x7fcff0144340 2024-04-25T19:24:17.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.493+0000 7fcfee000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcff015ec90 0x7fcff0161910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:17.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.494+0000 7fcfee000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcff015ec90 0x7fcff0161910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41976/0 (socket says 172.21.15.131:41976) 2024-04-25T19:24:17.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.494+0000 7fcfee000640 1 -- 172.21.15.131:0/739935377 learned_addr learned my addr 172.21.15.131:0/739935377 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:17.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.494+0000 7fcfef400640 1 --2- 172.21.15.131:0/739935377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcff00b0560 0x7fcff00b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:17.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.494+0000 7fcfeea00640 1 --2- 172.21.15.131:0/739935377 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcff0144340 0x7fcff015a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:17.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.494+0000 7fcfee000640 1 -- 172.21.15.131:0/739935377 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcff0144340 msgr2=0x7fcff015a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:17.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.494+0000 7fcfee000640 1 --2- 172.21.15.131:0/739935377 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcff0144340 0x7fcff015a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:17.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.494+0000 7fcfee000640 1 -- 172.21.15.131:0/739935377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcff00b0560 msgr2=0x7fcff00b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:17.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.494+0000 7fcfee000640 1 --2- 172.21.15.131:0/739935377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcff00b0560 0x7fcff00b4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:17.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.494+0000 7fcfee000640 1 -- 172.21.15.131:0/739935377 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff0161e50 con 0x7fcff015ec90 2024-04-25T19:24:17.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.494+0000 7fcfeea00640 1 --2- 172.21.15.131:0/739935377 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcff0144340 0x7fcff015a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:24:17.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.494+0000 7fcfee000640 1 --2- 172.21.15.131:0/739935377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcff015ec90 0x7fcff0161910 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8009eb0 tx=0x7fcfd8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:17.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.495+0000 7fcfe6a00640 1 -- 172.21.15.131:0/739935377 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd803f070 con 0x7fcff015ec90 2024-04-25T19:24:17.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.495+0000 7fcfe6a00640 1 -- 172.21.15.131:0/739935377 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfd8031c40 con 0x7fcff015ec90 2024-04-25T19:24:17.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.495+0000 7fcfefe00640 1 -- 172.21.15.131:0/739935377 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcff00b0f20 con 0x7fcff015ec90 2024-04-25T19:24:17.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.495+0000 7fcfe6a00640 1 -- 172.21.15.131:0/739935377 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8009450 con 0x7fcff015ec90 2024-04-25T19:24:17.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.495+0000 7fcfefe00640 1 -- 172.21.15.131:0/739935377 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcff015a020 con 0x7fcff015ec90 2024-04-25T19:24:17.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.496+0000 7fcfefe00640 1 -- 172.21.15.131:0/739935377 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcff0076c60 con 0x7fcff015ec90 2024-04-25T19:24:17.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.497+0000 7fcfe6a00640 1 -- 172.21.15.131:0/739935377 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fcfd8044460 con 0x7fcff015ec90 2024-04-25T19:24:17.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.498+0000 7fcfe6a00640 1 --2- 172.21.15.131:0/739935377 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fcfcc0744b0 0x7fcfcc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:17.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.498+0000 7fcfe6a00640 1 -- 172.21.15.131:0/739935377 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fcfd80b6a10 con 0x7fcff015ec90 2024-04-25T19:24:17.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.499+0000 7fcfeea00640 1 --2- 172.21.15.131:0/739935377 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fcfcc0744b0 0x7fcfcc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:17.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.500+0000 7fcfeea00640 1 --2- 172.21.15.131:0/739935377 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fcfcc0744b0 0x7fcfcc0769c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0000f60 tx=0x7fcfe0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:17.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.502+0000 7fcfe6a00640 1 -- 172.21.15.131:0/739935377 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcfd8080b40 con 0x7fcff015ec90 2024-04-25T19:24:17.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:17.725+0000 7fcfefe00640 1 -- 172.21.15.131:0/739935377 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fcff00b7920 con 0x7fcff015ec90 2024-04-25T19:24:18.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.219+0000 7fcfe6a00640 1 -- 172.21.15.131:0/739935377 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) ==== 118+0+0 (secure 0 0 0) 0x7fcfd8084e40 con 0x7fcff015ec90 2024-04-25T19:24:18.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.222+0000 7fcfefe00640 1 -- 172.21.15.131:0/739935377 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fcfcc0744b0 msgr2=0x7fcfcc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:18.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.222+0000 7fcfefe00640 1 --2- 172.21.15.131:0/739935377 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fcfcc0744b0 0x7fcfcc0769c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0000f60 tx=0x7fcfe0009040 comp rx=0 tx=0).stop 2024-04-25T19:24:18.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.223+0000 7fcfefe00640 1 -- 172.21.15.131:0/739935377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcff015ec90 msgr2=0x7fcff0161910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:18.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.223+0000 7fcfefe00640 1 --2- 172.21.15.131:0/739935377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcff015ec90 0x7fcff0161910 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8009eb0 tx=0x7fcfd8004a40 comp rx=0 tx=0).stop 2024-04-25T19:24:18.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.223+0000 7fcfefe00640 1 -- 172.21.15.131:0/739935377 shutdown_connections 2024-04-25T19:24:18.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.223+0000 7fcfefe00640 1 --2- 172.21.15.131:0/739935377 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fcfcc0744b0 0x7fcfcc0769c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:18.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.223+0000 7fcfefe00640 1 --2- 172.21.15.131:0/739935377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcff00b0560 0x7fcff00b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:18.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.223+0000 7fcfefe00640 1 --2- 172.21.15.131:0/739935377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcff015ec90 0x7fcff0161910 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:18.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.223+0000 7fcfefe00640 1 --2- 172.21.15.131:0/739935377 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcff0144340 0x7fcff015a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:18.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.223+0000 7fcfefe00640 1 -- 172.21.15.131:0/739935377 >> 172.21.15.131:0/739935377 conn(0x7fcff0072f40 msgr2=0x7fcff0142f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:18.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.223+0000 7fcfefe00640 1 -- 172.21.15.131:0/739935377 shutdown_connections 2024-04-25T19:24:18.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.223+0000 7fcfefe00640 1 -- 172.21.15.131:0/739935377 wait complete. 2024-04-25T19:24:18.253 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T19:24:18.254 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T19:24:18.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.525+0000 7fb280c00640 1 Processor -- start 2024-04-25T19:24:18.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.526+0000 7fb280c00640 1 -- start start 2024-04-25T19:24:18.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.528+0000 7fb280c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb27c144340 0x7fb27c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:18.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.528+0000 7fb280c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb27c06db10 0x7fb27c15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:18.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.528+0000 7fb280c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb27c06df20 con 0x7fb27c15ec90 2024-04-25T19:24:18.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.528+0000 7fb280c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fb27c144750 con 0x7fb27c144340 2024-04-25T19:24:18.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.528+0000 7fb280c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb27c070000 con 0x7fb27c06db10 2024-04-25T19:24:18.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.528+0000 7fb27b400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb27c144340 0x7fb27c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:18.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.528+0000 7fb27b400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb27c144340 0x7fb27c06d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:42296/0 (socket says 172.21.15.131:42296) 2024-04-25T19:24:18.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.528+0000 7fb27b400640 1 -- 172.21.15.131:0/2158379843 learned_addr learned my addr 172.21.15.131:0/2158379843 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:18.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.529+0000 7fb27aa00640 1 --2- 172.21.15.131:0/2158379843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb27c06db10 0x7fb27c15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:18.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.529+0000 7fb27b400640 1 -- 172.21.15.131:0/2158379843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb27c06db10 msgr2=0x7fb27c15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:18.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.529+0000 7fb27b400640 1 --2- 172.21.15.131:0/2158379843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb27c06db10 0x7fb27c15e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:18.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.529+0000 7fb27b400640 1 -- 172.21.15.131:0/2158379843 >> v1:172.21.15.195:6789/0 conn(0x7fb27c15ec90 legacy=0x7fb27c161aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:18.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.529+0000 7fb27b400640 1 -- 172.21.15.131:0/2158379843 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27c06f240 con 0x7fb27c144340 2024-04-25T19:24:18.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.529+0000 7fb27aa00640 1 --2- 172.21.15.131:0/2158379843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb27c06db10 0x7fb27c15e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:24:18.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.530+0000 7fb27b400640 1 --2- 172.21.15.131:0/2158379843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb27c144340 0x7fb27c06d5d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb264009870 tx=0x7fb26402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad35b6cb0e13768a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:18.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.531+0000 7fb27a000640 1 -- 172.21.15.131:0/2158379843 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb264037070 con 0x7fb27c144340 2024-04-25T19:24:18.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.531+0000 7fb27a000640 1 -- 172.21.15.131:0/2158379843 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb264032440 con 0x7fb27c144340 2024-04-25T19:24:18.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.531+0000 7fb27a000640 1 -- 172.21.15.131:0/2158379843 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb264032810 con 0x7fb27c144340 2024-04-25T19:24:18.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.531+0000 7fb280c00640 1 -- 172.21.15.131:0/2158379843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb27c144340 msgr2=0x7fb27c06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:18.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.531+0000 7fb280c00640 1 --2- 172.21.15.131:0/2158379843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb27c144340 0x7fb27c06d5d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb264009870 tx=0x7fb26402a210 comp rx=0 tx=0).stop 2024-04-25T19:24:18.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.532+0000 7fb280c00640 1 -- 172.21.15.131:0/2158379843 shutdown_connections 2024-04-25T19:24:18.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.532+0000 7fb280c00640 1 --2- 172.21.15.131:0/2158379843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb27c06db10 0x7fb27c15e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:18.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.532+0000 7fb280c00640 1 --2- 172.21.15.131:0/2158379843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb27c144340 0x7fb27c06d5d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:18.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.532+0000 7fb280c00640 1 -- 172.21.15.131:0/2158379843 >> 172.21.15.131:0/2158379843 conn(0x7fb27c072f40 msgr2=0x7fb27c073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:18.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.532+0000 7fb280c00640 1 -- 172.21.15.131:0/2158379843 shutdown_connections 2024-04-25T19:24:18.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.532+0000 7fb280c00640 1 -- 172.21.15.131:0/2158379843 wait complete. 2024-04-25T19:24:18.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.534+0000 7fb280c00640 1 Processor -- start 2024-04-25T19:24:18.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.535+0000 7fb280c00640 1 -- start start 2024-04-25T19:24:18.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.536+0000 7fb280c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb27c06db10 0x7fb27c15b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:18.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.536+0000 7fb280c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb27c144340 0x7fb27c161690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:18.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.537+0000 7fb280c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb27c15ec90 0x7fb27c161bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:18.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.537+0000 7fb280c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb27c06fae0 con 0x7fb27c06db10 2024-04-25T19:24:18.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.537+0000 7fb280c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb27c06f800 con 0x7fb27c15ec90 2024-04-25T19:24:18.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.537+0000 7fb280c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb27c15f0a0 con 0x7fb27c144340 2024-04-25T19:24:18.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.537+0000 7fb27b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb27c06db10 0x7fb27c15b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:18.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.537+0000 7fb27b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb27c06db10 0x7fb27c15b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:42300/0 (socket says 172.21.15.131:42300) 2024-04-25T19:24:18.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.537+0000 7fb27b400640 1 -- 172.21.15.131:0/907235108 learned_addr learned my addr 172.21.15.131:0/907235108 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:18.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.537+0000 7fb27b400640 1 -- 172.21.15.131:0/907235108 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb27c144340 msgr2=0x7fb27c161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:18.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.537+0000 7fb27b400640 1 --2- 172.21.15.131:0/907235108 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb27c144340 0x7fb27c161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:18.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.537+0000 7fb27b400640 1 -- 172.21.15.131:0/907235108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb27c15ec90 msgr2=0x7fb27c161bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:18.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.537+0000 7fb27b400640 1 --2- 172.21.15.131:0/907235108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb27c15ec90 0x7fb27c161bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:18.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.537+0000 7fb27b400640 1 -- 172.21.15.131:0/907235108 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27c144df0 con 0x7fb27c06db10 2024-04-25T19:24:18.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.538+0000 7fb27b400640 1 --2- 172.21.15.131:0/907235108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb27c06db10 0x7fb27c15b020 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb264009870 tx=0x7fb2640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:18.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.538+0000 7fb273400640 1 -- 172.21.15.131:0/907235108 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb264041020 con 0x7fb27c06db10 2024-04-25T19:24:18.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.538+0000 7fb273400640 1 -- 172.21.15.131:0/907235108 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb264030970 con 0x7fb27c06db10 2024-04-25T19:24:18.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.538+0000 7fb273400640 1 -- 172.21.15.131:0/907235108 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb264037040 con 0x7fb27c06db10 2024-04-25T19:24:18.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.538+0000 7fb280c00640 1 -- 172.21.15.131:0/907235108 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb27c147480 con 0x7fb27c06db10 2024-04-25T19:24:18.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.538+0000 7fb280c00640 1 -- 172.21.15.131:0/907235108 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb27c15a820 con 0x7fb27c06db10 2024-04-25T19:24:18.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.539+0000 7fb280c00640 1 -- 172.21.15.131:0/907235108 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb27c076c60 con 0x7fb27c06db10 2024-04-25T19:24:18.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.540+0000 7fb273400640 1 -- 172.21.15.131:0/907235108 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb264044020 con 0x7fb27c06db10 2024-04-25T19:24:18.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.541+0000 7fb273400640 1 --2- 172.21.15.131:0/907235108 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb2580744b0 0x7fb2580769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:18.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.541+0000 7fb273400640 1 -- 172.21.15.131:0/907235108 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fb2640b5dc0 con 0x7fb27c06db10 2024-04-25T19:24:18.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.542+0000 7fb27aa00640 1 --2- 172.21.15.131:0/907235108 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb2580744b0 0x7fb2580769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:18.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.543+0000 7fb27aa00640 1 --2- 172.21.15.131:0/907235108 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb2580744b0 0x7fb2580769c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb27c140dc0 tx=0x7fb26c008330 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:18.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.546+0000 7fb273400640 1 -- 172.21.15.131:0/907235108 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb26404b030 con 0x7fb27c06db10 2024-04-25T19:24:18.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:18.789+0000 7fb280c00640 1 -- 172.21.15.131:0/907235108 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb27c15c1c0 con 0x7fb27c06db10 2024-04-25T19:24:19.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.223+0000 7fb273400640 1 -- 172.21.15.131:0/907235108 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) ==== 122+0+0 (secure 0 0 0) 0x7fb27c06df20 con 0x7fb27c06db10 2024-04-25T19:24:19.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.226+0000 7fb280c00640 1 -- 172.21.15.131:0/907235108 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb2580744b0 msgr2=0x7fb2580769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:19.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.226+0000 7fb280c00640 1 --2- 172.21.15.131:0/907235108 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb2580744b0 0x7fb2580769c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb27c140dc0 tx=0x7fb26c008330 comp rx=0 tx=0).stop 2024-04-25T19:24:19.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.226+0000 7fb280c00640 1 -- 172.21.15.131:0/907235108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb27c06db10 msgr2=0x7fb27c15b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:19.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.226+0000 7fb280c00640 1 --2- 172.21.15.131:0/907235108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb27c06db10 0x7fb27c15b020 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb264009870 tx=0x7fb2640046c0 comp rx=0 tx=0).stop 2024-04-25T19:24:19.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.226+0000 7fb280c00640 1 -- 172.21.15.131:0/907235108 shutdown_connections 2024-04-25T19:24:19.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.226+0000 7fb280c00640 1 --2- 172.21.15.131:0/907235108 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb2580744b0 0x7fb2580769c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:19.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.226+0000 7fb280c00640 1 --2- 172.21.15.131:0/907235108 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb27c144340 0x7fb27c161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:19.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.226+0000 7fb280c00640 1 --2- 172.21.15.131:0/907235108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb27c15ec90 0x7fb27c161bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:19.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.226+0000 7fb280c00640 1 --2- 172.21.15.131:0/907235108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb27c06db10 0x7fb27c15b020 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:19.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.226+0000 7fb280c00640 1 -- 172.21.15.131:0/907235108 >> 172.21.15.131:0/907235108 conn(0x7fb27c072f40 msgr2=0x7fb27c1438c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:19.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.226+0000 7fb280c00640 1 -- 172.21.15.131:0/907235108 shutdown_connections 2024-04-25T19:24:19.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.227+0000 7fb280c00640 1 -- 172.21.15.131:0/907235108 wait complete. 2024-04-25T19:24:19.260 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T19:24:19.260 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:24:19.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.527+0000 7f3fed200640 1 Processor -- start 2024-04-25T19:24:19.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.527+0000 7f3fed200640 1 -- start start 2024-04-25T19:24:19.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.529+0000 7f3fed200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3fe815c800 0x7f3fe806f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:19.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.529+0000 7f3fed200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fe8071230 con 0x7f3fe806d560 2024-04-25T19:24:19.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.529+0000 7f3fed200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fe806f8f0 con 0x7f3fe8070e20 2024-04-25T19:24:19.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.529+0000 7f3fed200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f3fe806f6c0 con 0x7f3fe815c800 2024-04-25T19:24:19.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.529+0000 7f3fe7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3fe815c800 0x7f3fe806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:19.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.529+0000 7f3fe7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3fe815c800 0x7f3fe806f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:42310/0 (socket says 172.21.15.131:42310) 2024-04-25T19:24:19.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.529+0000 7f3fdea00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f3fe806d560 0x7f3fe80b5e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:40740/0 (socket says 172.21.15.131:40740) 2024-04-25T19:24:19.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.529+0000 7f3fe7e00640 1 -- 172.21.15.131:0/4098372484 learned_addr learned my addr 172.21.15.131:0/4098372484 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:19.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.530+0000 7f3fe7e00640 1 -- 172.21.15.131:0/4098372484 >> v1:172.21.15.195:6789/0 conn(0x7f3fe8070e20 legacy=0x7f3fe806ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:19.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.530+0000 7f3fe7e00640 1 -- 172.21.15.131:0/4098372484 >> v1:172.21.15.131:6789/0 conn(0x7f3fe806d560 legacy=0x7f3fe80b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:19.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.530+0000 7f3fe7e00640 1 -- 172.21.15.131:0/4098372484 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe806fbd0 con 0x7f3fe815c800 2024-04-25T19:24:19.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.530+0000 7f3fe6a00640 1 -- 172.21.15.131:0/4098372484 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3643499053 0 0) 0x7f3fe8071230 con 0x7f3fe806d560 2024-04-25T19:24:19.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.531+0000 7f3fe7e00640 1 --2- 172.21.15.131:0/4098372484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fe815c800 0x7f3fe806f180 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0009e50 tx=0x7f3fe002a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aceb4069ddf99b34 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:19.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.531+0000 7f3fe6a00640 1 -- 172.21.15.131:0/4098372484 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0036070 con 0x7f3fe815c800 2024-04-25T19:24:19.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.531+0000 7f3fe6a00640 1 -- 172.21.15.131:0/4098372484 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe0031600 con 0x7f3fe815c800 2024-04-25T19:24:19.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.531+0000 7f3fe6a00640 1 -- 172.21.15.131:0/4098372484 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe00319d0 con 0x7f3fe815c800 2024-04-25T19:24:19.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.532+0000 7f3fed200640 1 -- 172.21.15.131:0/4098372484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fe815c800 msgr2=0x7f3fe806f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:19.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.532+0000 7f3fed200640 1 --2- 172.21.15.131:0/4098372484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fe815c800 0x7f3fe806f180 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0009e50 tx=0x7f3fe002a760 comp rx=0 tx=0).stop 2024-04-25T19:24:19.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.532+0000 7f3fed200640 1 -- 172.21.15.131:0/4098372484 shutdown_connections 2024-04-25T19:24:19.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.532+0000 7f3fed200640 1 --2- 172.21.15.131:0/4098372484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fe815c800 0x7f3fe806f180 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:19.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.532+0000 7f3fed200640 1 -- 172.21.15.131:0/4098372484 >> 172.21.15.131:0/4098372484 conn(0x7f3fe80d1720 msgr2=0x7f3fe80d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:19.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.532+0000 7f3fed200640 1 -- 172.21.15.131:0/4098372484 shutdown_connections 2024-04-25T19:24:19.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.532+0000 7f3fed200640 1 -- 172.21.15.131:0/4098372484 wait complete. 2024-04-25T19:24:19.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.535+0000 7f3fed200640 1 Processor -- start 2024-04-25T19:24:19.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.535+0000 7f3fed200640 1 -- start start 2024-04-25T19:24:19.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.536+0000 7f3fed200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3fe8070e20 0x7f3fe815f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:19.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.536+0000 7f3fed200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fe815c800 0x7f3fe815d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:19.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.536+0000 7f3fed200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fe81557f0 0x7f3fe814a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:19.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.536+0000 7f3fed200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe815cc10 con 0x7f3fe815c800 2024-04-25T19:24:19.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.536+0000 7f3fed200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe8070190 con 0x7f3fe81557f0 2024-04-25T19:24:19.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.536+0000 7f3fed200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe806c5c0 con 0x7f3fe8070e20 2024-04-25T19:24:19.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.536+0000 7f3fdea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fe815c800 0x7f3fe815d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:19.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.537+0000 7f3fdea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fe815c800 0x7f3fe815d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:42316/0 (socket says 172.21.15.131:42316) 2024-04-25T19:24:19.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.537+0000 7f3fdea00640 1 -- 172.21.15.131:0/484595515 learned_addr learned my addr 172.21.15.131:0/484595515 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:19.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.537+0000 7f3fe7400640 1 --2- 172.21.15.131:0/484595515 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3fe8070e20 0x7f3fe815f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:19.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.537+0000 7f3fe7e00640 1 --2- 172.21.15.131:0/484595515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fe81557f0 0x7f3fe814a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:19.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.537+0000 7f3fdea00640 1 -- 172.21.15.131:0/484595515 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3fe8070e20 msgr2=0x7f3fe815f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:19.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.537+0000 7f3fdea00640 1 --2- 172.21.15.131:0/484595515 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3fe8070e20 0x7f3fe815f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:19.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.537+0000 7f3fdea00640 1 -- 172.21.15.131:0/484595515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fe81557f0 msgr2=0x7f3fe814a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:19.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.537+0000 7f3fdea00640 1 --2- 172.21.15.131:0/484595515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fe81557f0 0x7f3fe814a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:19.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.537+0000 7f3fdea00640 1 -- 172.21.15.131:0/484595515 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe815f5f0 con 0x7f3fe815c800 2024-04-25T19:24:19.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.537+0000 7f3fdea00640 1 --2- 172.21.15.131:0/484595515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fe815c800 0x7f3fe815d2a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3fd000c460 tx=0x7f3fd000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:19.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.538+0000 7f3fdfe00640 1 -- 172.21.15.131:0/484595515 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0018070 con 0x7f3fe815c800 2024-04-25T19:24:19.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.538+0000 7f3fdfe00640 1 -- 172.21.15.131:0/484595515 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd0007500 con 0x7f3fe815c800 2024-04-25T19:24:19.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.538+0000 7f3fdfe00640 1 -- 172.21.15.131:0/484595515 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0004a20 con 0x7f3fe815c800 2024-04-25T19:24:19.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.538+0000 7f3fed200640 1 -- 172.21.15.131:0/484595515 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe814e760 con 0x7f3fe815c800 2024-04-25T19:24:19.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.538+0000 7f3fed200640 1 -- 172.21.15.131:0/484595515 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fe815e5d0 con 0x7f3fe815c800 2024-04-25T19:24:19.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.539+0000 7f3fed200640 1 -- 172.21.15.131:0/484595515 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fe8050740 con 0x7f3fe815c800 2024-04-25T19:24:19.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.540+0000 7f3fdfe00640 1 -- 172.21.15.131:0/484595515 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3fd0004bc0 con 0x7f3fe815c800 2024-04-25T19:24:19.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.541+0000 7f3fdfe00640 1 --2- 172.21.15.131:0/484595515 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3fc40744e0 0x7f3fc40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:19.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.542+0000 7f3fdfe00640 1 -- 172.21.15.131:0/484595515 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f3fd00945a0 con 0x7f3fe815c800 2024-04-25T19:24:19.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.542+0000 7f3fe7400640 1 --2- 172.21.15.131:0/484595515 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3fc40744e0 0x7f3fc40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:19.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.543+0000 7f3fe7400640 1 --2- 172.21.15.131:0/484595515 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3fc40744e0 0x7f3fc40769f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800a750 tx=0x7f3fd8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:19.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.547+0000 7f3fdfe00640 1 -- 172.21.15.131:0/484595515 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3fd005ecb0 con 0x7f3fe815c800 2024-04-25T19:24:19.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.782+0000 7f3fed200640 1 -- 172.21.15.131:0/484595515 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3fe80b1930 con 0x7f3fe815c800 2024-04-25T19:24:19.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.783+0000 7f3fdfe00640 1 -- 172.21.15.131:0/484595515 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5190 (secure 0 0 0) 0x7f3fd005e5b0 con 0x7f3fe815c800 2024-04-25T19:24:19.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:24:19.785 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4706,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3512447940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":3512447940},{"type":"v1","addr":"172.21.15.195:6837","nonce":3512447940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2666088311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":2666088311},{"type":"v1","addr":"172.21.15.195:6836","nonce":2666088311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1450320216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1450320216},{"type":"v1","addr":"172.21.15.131:6834","nonce":1450320216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T19:24:15.727328+0000","modified":"2024-04-25T19:24:18.791952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/274211686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":274211686},{"type":"v1","addr":"172.21.15.131:6835","nonce":274211686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5481,"qdb_cluster":[5481]},"id":3}]} 2024-04-25T19:24:19.785 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 25 2024-04-25T19:24:19.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.785+0000 7f3fed200640 1 -- 172.21.15.131:0/484595515 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3fc40744e0 msgr2=0x7f3fc40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:19.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.785+0000 7f3fed200640 1 --2- 172.21.15.131:0/484595515 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3fc40744e0 0x7f3fc40769f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800a750 tx=0x7f3fd8008040 comp rx=0 tx=0).stop 2024-04-25T19:24:19.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.785+0000 7f3fed200640 1 -- 172.21.15.131:0/484595515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fe815c800 msgr2=0x7f3fe815d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:19.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.785+0000 7f3fed200640 1 --2- 172.21.15.131:0/484595515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fe815c800 0x7f3fe815d2a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3fd000c460 tx=0x7f3fd000c920 comp rx=0 tx=0).stop 2024-04-25T19:24:19.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.785+0000 7f3fed200640 1 -- 172.21.15.131:0/484595515 shutdown_connections 2024-04-25T19:24:19.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.785+0000 7f3fed200640 1 --2- 172.21.15.131:0/484595515 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f3fc40744e0 0x7f3fc40769f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:19.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.785+0000 7f3fed200640 1 --2- 172.21.15.131:0/484595515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fe81557f0 0x7f3fe814a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:19.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.785+0000 7f3fed200640 1 --2- 172.21.15.131:0/484595515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fe815c800 0x7f3fe815d2a0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:19.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.785+0000 7f3fed200640 1 --2- 172.21.15.131:0/484595515 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3fe8070e20 0x7f3fe815f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:19.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.785+0000 7f3fed200640 1 -- 172.21.15.131:0/484595515 >> 172.21.15.131:0/484595515 conn(0x7f3fe80d1720 msgr2=0x7f3fe8151140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:19.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.786+0000 7f3fed200640 1 -- 172.21.15.131:0/484595515 shutdown_connections 2024-04-25T19:24:19.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:19.786+0000 7f3fed200640 1 -- 172.21.15.131:0/484595515 wait complete. 2024-04-25T19:24:19.811 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:24:20.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.070+0000 7f222e600640 1 Processor -- start 2024-04-25T19:24:20.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.071+0000 7f222e600640 1 -- start start 2024-04-25T19:24:20.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.073+0000 7f222e600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2228164860 0x7f22280b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:20.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.073+0000 7f222e600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f22280d44a0 0x7f22280d48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:20.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.073+0000 7f222e600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2228161650 con 0x7f22280b7540 2024-04-25T19:24:20.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.073+0000 7f222e600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f22281643d0 con 0x7f2228164860 2024-04-25T19:24:20.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.073+0000 7f222e600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f22280b5270 con 0x7f22280d44a0 2024-04-25T19:24:20.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.073+0000 7f222d200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2228164860 0x7f22280b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:20.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.073+0000 7f222d200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2228164860 0x7f22280b4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:42328/0 (socket says 172.21.15.131:42328) 2024-04-25T19:24:20.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.073+0000 7f222d200640 1 -- 172.21.15.131:0/3665106455 learned_addr learned my addr 172.21.15.131:0/3665106455 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:20.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.073+0000 7f222d200640 1 -- 172.21.15.131:0/3665106455 >> v2:172.21.15.195:3300/0 conn(0x7f22280d44a0 msgr2=0x7f22280d48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:20.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.073+0000 7f222d200640 1 --2- 172.21.15.131:0/3665106455 >> v2:172.21.15.195:3300/0 conn(0x7f22280d44a0 0x7f22280d48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:20.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.073+0000 7f222d200640 1 -- 172.21.15.131:0/3665106455 >> v1:172.21.15.195:6789/0 conn(0x7f22280b7540 legacy=0x7f22280b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:20.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.073+0000 7f222d200640 1 -- 172.21.15.131:0/3665106455 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2228161370 con 0x7f2228164860 2024-04-25T19:24:20.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.074+0000 7f222d200640 1 --2- 172.21.15.131:0/3665106455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2228164860 0x7f22280b4d30 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2228164340 tx=0x7f221802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e71e91d7738d217 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:20.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.075+0000 7f2227400640 1 -- 172.21.15.131:0/3665106455 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2218037070 con 0x7f2228164860 2024-04-25T19:24:20.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.075+0000 7f2227400640 1 -- 172.21.15.131:0/3665106455 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2218032440 con 0x7f2228164860 2024-04-25T19:24:20.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.075+0000 7f2227400640 1 -- 172.21.15.131:0/3665106455 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2218032810 con 0x7f2228164860 2024-04-25T19:24:20.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.075+0000 7f222e600640 1 -- 172.21.15.131:0/3665106455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2228164860 msgr2=0x7f22280b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:20.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.075+0000 7f222e600640 1 --2- 172.21.15.131:0/3665106455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2228164860 0x7f22280b4d30 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2228164340 tx=0x7f221802a230 comp rx=0 tx=0).stop 2024-04-25T19:24:20.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.075+0000 7f222e600640 1 -- 172.21.15.131:0/3665106455 shutdown_connections 2024-04-25T19:24:20.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.075+0000 7f222e600640 1 --2- 172.21.15.131:0/3665106455 >> v2:172.21.15.195:3300/0 conn(0x7f22280d44a0 0x7f22280d48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:20.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.075+0000 7f222e600640 1 --2- 172.21.15.131:0/3665106455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2228164860 0x7f22280b4d30 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:20.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.075+0000 7f222e600640 1 -- 172.21.15.131:0/3665106455 >> 172.21.15.131:0/3665106455 conn(0x7f22280d2720 msgr2=0x7f22280d2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:20.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.075+0000 7f222e600640 1 -- 172.21.15.131:0/3665106455 shutdown_connections 2024-04-25T19:24:20.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.075+0000 7f222e600640 1 -- 172.21.15.131:0/3665106455 wait complete. 2024-04-25T19:24:20.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.078+0000 7f222e600640 1 Processor -- start 2024-04-25T19:24:20.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.078+0000 7f222e600640 1 -- start start 2024-04-25T19:24:20.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.079+0000 7f222e600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22280b7540 0x7f22281540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:20.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.079+0000 7f222e600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22280d44a0 0x7f22281f60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:20.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.079+0000 7f222e600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2228164860 0x7f2228159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:20.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.079+0000 7f222e600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f22280d4df0 con 0x7f22280d44a0 2024-04-25T19:24:20.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.079+0000 7f222e600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2228164060 con 0x7f2228164860 2024-04-25T19:24:20.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.079+0000 7f222e600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f22280d4f70 con 0x7f22280b7540 2024-04-25T19:24:20.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.080+0000 7f2227e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22280d44a0 0x7f22281f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:20.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.080+0000 7f2227e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22280d44a0 0x7f22281f60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:42344/0 (socket says 172.21.15.131:42344) 2024-04-25T19:24:20.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.080+0000 7f2227e00640 1 -- 172.21.15.131:0/3312611828 learned_addr learned my addr 172.21.15.131:0/3312611828 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:20.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.080+0000 7f222dc00640 1 --2- 172.21.15.131:0/3312611828 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2228164860 0x7f2228159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:20.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.080+0000 7f222d200640 1 --2- 172.21.15.131:0/3312611828 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22280b7540 0x7f22281540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:20.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.080+0000 7f2227e00640 1 -- 172.21.15.131:0/3312611828 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22280b7540 msgr2=0x7f22281540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:20.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.080+0000 7f2227e00640 1 --2- 172.21.15.131:0/3312611828 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22280b7540 0x7f22281540d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:20.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.080+0000 7f2227e00640 1 -- 172.21.15.131:0/3312611828 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2228164860 msgr2=0x7f2228159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:20.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.080+0000 7f2227e00640 1 --2- 172.21.15.131:0/3312611828 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2228164860 0x7f2228159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:20.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.080+0000 7f2227e00640 1 -- 172.21.15.131:0/3312611828 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f222815ba10 con 0x7f22280d44a0 2024-04-25T19:24:20.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.080+0000 7f222dc00640 1 --2- 172.21.15.131:0/3312611828 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2228164860 0x7f2228159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:24:20.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.080+0000 7f2227e00640 1 --2- 172.21.15.131:0/3312611828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22280d44a0 0x7f22281f60e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f221400ba10 tx=0x7f221400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:20.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.081+0000 7f2224c00640 1 -- 172.21.15.131:0/3312611828 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2214019070 con 0x7f22280d44a0 2024-04-25T19:24:20.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.081+0000 7f2224c00640 1 -- 172.21.15.131:0/3312611828 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f221400cbd0 con 0x7f22280d44a0 2024-04-25T19:24:20.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.081+0000 7f2224c00640 1 -- 172.21.15.131:0/3312611828 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2214014440 con 0x7f22280d44a0 2024-04-25T19:24:20.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.081+0000 7f222e600640 1 -- 172.21.15.131:0/3312611828 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f222815bcf0 con 0x7f22280d44a0 2024-04-25T19:24:20.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.081+0000 7f222e600640 1 -- 172.21.15.131:0/3312611828 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f222815c2b0 con 0x7f22280d44a0 2024-04-25T19:24:20.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.082+0000 7f222e600640 1 -- 172.21.15.131:0/3312611828 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22280d4ac0 con 0x7f22280d44a0 2024-04-25T19:24:20.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.083+0000 7f2224c00640 1 -- 172.21.15.131:0/3312611828 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f221401c070 con 0x7f22280d44a0 2024-04-25T19:24:20.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.084+0000 7f2224c00640 1 --2- 172.21.15.131:0/3312611828 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f22080744b0 0x7f22080769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:20.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.084+0000 7f2224c00640 1 -- 172.21.15.131:0/3312611828 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f2214094f20 con 0x7f22280d44a0 2024-04-25T19:24:20.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.085+0000 7f222d200640 1 --2- 172.21.15.131:0/3312611828 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f22080744b0 0x7f22080769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:20.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.086+0000 7f222d200640 1 --2- 172.21.15.131:0/3312611828 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f22080744b0 0x7f22080769c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2218034000 tx=0x7f221802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:20.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.089+0000 7f2224c00640 1 -- 172.21.15.131:0/3312611828 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f22280d4ac0 con 0x7f22280d44a0 2024-04-25T19:24:20.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.278+0000 7f222e600640 1 -- 172.21.15.131:0/3312611828 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2228050740 con 0x7f22280d44a0 2024-04-25T19:24:20.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.279+0000 7f2224c00640 1 -- 172.21.15.131:0/3312611828 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16637 (secure 0 0 0) 0x7f221405efc0 con 0x7f22280d44a0 2024-04-25T19:24:20.281 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:24:20.282 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":45,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:24:17.195472+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:24:13.848038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T19:24:14.699910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:24:20.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.282+0000 7f222e600640 1 -- 172.21.15.131:0/3312611828 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f22080744b0 msgr2=0x7f22080769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:20.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.282+0000 7f222e600640 1 --2- 172.21.15.131:0/3312611828 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f22080744b0 0x7f22080769c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2218034000 tx=0x7f221802e000 comp rx=0 tx=0).stop 2024-04-25T19:24:20.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.282+0000 7f222e600640 1 -- 172.21.15.131:0/3312611828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22280d44a0 msgr2=0x7f22281f60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:20.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.282+0000 7f222e600640 1 --2- 172.21.15.131:0/3312611828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22280d44a0 0x7f22281f60e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f221400ba10 tx=0x7f221400bed0 comp rx=0 tx=0).stop 2024-04-25T19:24:20.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.282+0000 7f222e600640 1 -- 172.21.15.131:0/3312611828 shutdown_connections 2024-04-25T19:24:20.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.282+0000 7f222e600640 1 --2- 172.21.15.131:0/3312611828 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f22080744b0 0x7f22080769c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:20.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.282+0000 7f222e600640 1 --2- 172.21.15.131:0/3312611828 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2228164860 0x7f2228159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:20.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.282+0000 7f222e600640 1 --2- 172.21.15.131:0/3312611828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22280d44a0 0x7f22281f60e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:20.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.282+0000 7f222e600640 1 --2- 172.21.15.131:0/3312611828 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22280b7540 0x7f22281540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:20.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.282+0000 7f222e600640 1 -- 172.21.15.131:0/3312611828 >> 172.21.15.131:0/3312611828 conn(0x7f22280d2720 msgr2=0x7f22280684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:20.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.282+0000 7f222e600640 1 -- 172.21.15.131:0/3312611828 shutdown_connections 2024-04-25T19:24:20.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.282+0000 7f222e600640 1 -- 172.21.15.131:0/3312611828 wait complete. 2024-04-25T19:24:20.308 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T19:24:20.308 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T19:24:20.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.574+0000 7f5764e00640 1 Processor -- start 2024-04-25T19:24:20.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.574+0000 7f5764e00640 1 -- start start 2024-04-25T19:24:20.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.576+0000 7f5764e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f57600b6a00 0x7f576015d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:20.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.577+0000 7f5764e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f576015a2f0 0x7f576006ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:20.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.577+0000 7f5764e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f576006d390 0x7f576006f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:20.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.577+0000 7f5764e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f5760160d50 con 0x7f57600b6a00 2024-04-25T19:24:20.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.577+0000 7f5764e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f576015a700 con 0x7f576006d390 2024-04-25T19:24:20.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.577+0000 7f5764e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f57601611e0 con 0x7f576015a2f0 2024-04-25T19:24:20.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.577+0000 7f575de00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f57600b6a00 0x7f576015d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:20.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.577+0000 7f575de00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f57600b6a00 0x7f576015d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:42348/0 (socket says 172.21.15.131:42348) 2024-04-25T19:24:20.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.577+0000 7f575de00640 1 -- 172.21.15.131:0/1720714570 learned_addr learned my addr 172.21.15.131:0/1720714570 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:20.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.577+0000 7f575e800640 1 --2- 172.21.15.131:0/1720714570 >> v2:172.21.15.195:3300/0 conn(0x7f576006d390 0x7f576006f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:20.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.577+0000 7f5757e00640 1 --2- 172.21.15.131:0/1720714570 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f576015a2f0 0x7f576006ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:20.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.578+0000 7f575de00640 1 -- 172.21.15.131:0/1720714570 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f576015a2f0 msgr2=0x7f576006ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:20.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.578+0000 7f575de00640 1 --2- 172.21.15.131:0/1720714570 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f576015a2f0 0x7f576006ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:20.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.578+0000 7f575de00640 1 -- 172.21.15.131:0/1720714570 >> v2:172.21.15.195:3300/0 conn(0x7f576006d390 msgr2=0x7f576006f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:20.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.578+0000 7f575de00640 1 --2- 172.21.15.131:0/1720714570 >> v2:172.21.15.195:3300/0 conn(0x7f576006d390 0x7f576006f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:20.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.578+0000 7f575de00640 1 -- 172.21.15.131:0/1720714570 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f576006d7a0 con 0x7f57600b6a00 2024-04-25T19:24:20.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.578+0000 7f575e800640 1 --2- 172.21.15.131:0/1720714570 >> v2:172.21.15.195:3300/0 conn(0x7f576006d390 0x7f576006f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T19:24:20.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.579+0000 7f575de00640 1 --2- 172.21.15.131:0/1720714570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57600b6a00 0x7f576015d6c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5760070db0 tx=0x7f575002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8809843a3199a1a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:20.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.579+0000 7f575d400640 1 -- 172.21.15.131:0/1720714570 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5750037070 con 0x7f57600b6a00 2024-04-25T19:24:20.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.579+0000 7f575d400640 1 -- 172.21.15.131:0/1720714570 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5750032440 con 0x7f57600b6a00 2024-04-25T19:24:20.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.579+0000 7f575d400640 1 -- 172.21.15.131:0/1720714570 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5750032810 con 0x7f57600b6a00 2024-04-25T19:24:20.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.580+0000 7f5764e00640 1 -- 172.21.15.131:0/1720714570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57600b6a00 msgr2=0x7f576015d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:20.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.580+0000 7f5764e00640 1 --2- 172.21.15.131:0/1720714570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57600b6a00 0x7f576015d6c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5760070db0 tx=0x7f575002a1e0 comp rx=0 tx=0).stop 2024-04-25T19:24:20.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.580+0000 7f5764e00640 1 -- 172.21.15.131:0/1720714570 shutdown_connections 2024-04-25T19:24:20.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.580+0000 7f5764e00640 1 --2- 172.21.15.131:0/1720714570 >> v2:172.21.15.195:3300/0 conn(0x7f576006d390 0x7f576006f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:20.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.580+0000 7f5764e00640 1 --2- 172.21.15.131:0/1720714570 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f576015a2f0 0x7f576006ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:20.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.580+0000 7f5764e00640 1 --2- 172.21.15.131:0/1720714570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57600b6a00 0x7f576015d6c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:20.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.580+0000 7f5764e00640 1 -- 172.21.15.131:0/1720714570 >> 172.21.15.131:0/1720714570 conn(0x7f57600d1ae0 msgr2=0x7f57600d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:20.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.580+0000 7f5764e00640 1 -- 172.21.15.131:0/1720714570 shutdown_connections 2024-04-25T19:24:20.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.580+0000 7f5764e00640 1 -- 172.21.15.131:0/1720714570 wait complete. 2024-04-25T19:24:20.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.583+0000 7f5764e00640 1 Processor -- start 2024-04-25T19:24:20.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.583+0000 7f5764e00640 1 -- start start 2024-04-25T19:24:20.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.584+0000 7f5764e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f576006d390 0x7f57600ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:20.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.584+0000 7f5764e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f57600b6a00 0x7f576014e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:20.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.584+0000 7f5764e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f576015a2f0 0x7f57601f9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:20.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.584+0000 7f5764e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f57601609e0 con 0x7f576015a2f0 2024-04-25T19:24:20.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.584+0000 7f5764e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5760160700 con 0x7f576006d390 2024-04-25T19:24:20.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.584+0000 7f5764e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f57600ce580 con 0x7f57600b6a00 2024-04-25T19:24:20.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.585+0000 7f575e800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f576015a2f0 0x7f57601f9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:20.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.585+0000 7f575e800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f576015a2f0 0x7f57601f9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:42362/0 (socket says 172.21.15.131:42362) 2024-04-25T19:24:20.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.585+0000 7f575e800640 1 -- 172.21.15.131:0/2090208253 learned_addr learned my addr 172.21.15.131:0/2090208253 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:20.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.585+0000 7f575de00640 1 --2- 172.21.15.131:0/2090208253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f576006d390 0x7f57600ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:20.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.585+0000 7f575e800640 1 -- 172.21.15.131:0/2090208253 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f57600b6a00 msgr2=0x7f576014e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:20.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.585+0000 7f575e800640 1 --2- 172.21.15.131:0/2090208253 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f57600b6a00 0x7f576014e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:20.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.585+0000 7f575e800640 1 -- 172.21.15.131:0/2090208253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f576006d390 msgr2=0x7f57600ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:20.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.585+0000 7f575e800640 1 --2- 172.21.15.131:0/2090208253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f576006d390 0x7f57600ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:20.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.585+0000 7f575e800640 1 -- 172.21.15.131:0/2090208253 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5760155910 con 0x7f576015a2f0 2024-04-25T19:24:20.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.585+0000 7f575e800640 1 --2- 172.21.15.131:0/2090208253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f576015a2f0 0x7f57601f9c20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5758009d00 tx=0x7f575800d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:20.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.586+0000 7f5756000640 1 -- 172.21.15.131:0/2090208253 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758003990 con 0x7f576015a2f0 2024-04-25T19:24:20.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.586+0000 7f5756000640 1 -- 172.21.15.131:0/2090208253 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5758003b30 con 0x7f576015a2f0 2024-04-25T19:24:20.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.586+0000 7f5756000640 1 -- 172.21.15.131:0/2090208253 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758004030 con 0x7f576015a2f0 2024-04-25T19:24:20.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.586+0000 7f5764e00640 1 -- 172.21.15.131:0/2090208253 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f576015ef50 con 0x7f576015a2f0 2024-04-25T19:24:20.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.586+0000 7f5764e00640 1 -- 172.21.15.131:0/2090208253 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f576015f510 con 0x7f576015a2f0 2024-04-25T19:24:20.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.587+0000 7f5764e00640 1 -- 172.21.15.131:0/2090208253 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5760155680 con 0x7f576015a2f0 2024-04-25T19:24:20.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.588+0000 7f5756000640 1 -- 172.21.15.131:0/2090208253 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5758005d10 con 0x7f576015a2f0 2024-04-25T19:24:20.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.589+0000 7f5756000640 1 --2- 172.21.15.131:0/2090208253 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f573c0744e0 0x7f573c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:20.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.589+0000 7f5756000640 1 -- 172.21.15.131:0/2090208253 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f5758095650 con 0x7f576015a2f0 2024-04-25T19:24:20.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.590+0000 7f575de00640 1 --2- 172.21.15.131:0/2090208253 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f573c0744e0 0x7f573c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:20.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.591+0000 7f575de00640 1 --2- 172.21.15.131:0/2090208253 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f573c0744e0 0x7f573c0769f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5750034000 tx=0x7f575002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:20.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.596+0000 7f5756000640 1 -- 172.21.15.131:0/2090208253 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f575805fde0 con 0x7f576015a2f0 2024-04-25T19:24:20.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.797+0000 7f5764e00640 1 -- 172.21.15.131:0/2090208253 --> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5760050740 con 0x7f573c0744e0 2024-04-25T19:24:20.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.819+0000 7f5756000640 1 -- 172.21.15.131:0/2090208253 <== mgr.4105 v2:172.21.15.195:6832/2541913764 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251949 (secure 0 0 0) 0x7f5760050740 con 0x7f573c0744e0 2024-04-25T19:24:20.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:24:20.825 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-04-25T19:24:20.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.824+0000 7f5764e00640 1 -- 172.21.15.131:0/2090208253 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f573c0744e0 msgr2=0x7f573c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:20.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.824+0000 7f5764e00640 1 --2- 172.21.15.131:0/2090208253 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f573c0744e0 0x7f573c0769f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5750034000 tx=0x7f575002e000 comp rx=0 tx=0).stop 2024-04-25T19:24:20.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.824+0000 7f5764e00640 1 -- 172.21.15.131:0/2090208253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f576015a2f0 msgr2=0x7f57601f9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:20.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.824+0000 7f5764e00640 1 --2- 172.21.15.131:0/2090208253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f576015a2f0 0x7f57601f9c20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5758009d00 tx=0x7f575800d490 comp rx=0 tx=0).stop 2024-04-25T19:24:20.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.824+0000 7f5764e00640 1 -- 172.21.15.131:0/2090208253 shutdown_connections 2024-04-25T19:24:20.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.824+0000 7f5764e00640 1 --2- 172.21.15.131:0/2090208253 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f573c0744e0 0x7f573c0769f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:20.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.824+0000 7f5764e00640 1 --2- 172.21.15.131:0/2090208253 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f57600b6a00 0x7f576014e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:20.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.824+0000 7f5764e00640 1 --2- 172.21.15.131:0/2090208253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f576015a2f0 0x7f57601f9c20 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:20.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.824+0000 7f5764e00640 1 --2- 172.21.15.131:0/2090208253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f576006d390 0x7f57600ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:20.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.824+0000 7f5764e00640 1 -- 172.21.15.131:0/2090208253 >> 172.21.15.131:0/2090208253 conn(0x7f57600d1ae0 msgr2=0x7f57600cdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:20.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.824+0000 7f5764e00640 1 -- 172.21.15.131:0/2090208253 shutdown_connections 2024-04-25T19:24:20.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:20.824+0000 7f5764e00640 1 -- 172.21.15.131:0/2090208253 wait complete. 2024-04-25T19:24:20.854 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2024-04-25T19:24:20.185671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238176,"kb_used_data":5352,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736544,"statfs":{"total":773094113280,"available":772850221056,"internally_reserved":0,"allocated":5480448,"data_stored":2906476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002234"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.137430+0000","last_change":"2024-04-25T19:24:16.213753+0000","last_active":"2024-04-25T19:24:18.137430+0000","last_peered":"2024-04-25T19:24:18.137430+0000","last_clean":"2024-04-25T19:24:18.137430+0000","last_became_active":"2024-04-25T19:24:16.213388+0000","last_became_peered":"2024-04-25T19:24:16.213388+0000","last_unstale":"2024-04-25T19:24:18.137430+0000","last_undegraded":"2024-04-25T19:24:18.137430+0000","last_fullsized":"2024-04-25T19:24:18.137430+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:47:47.007397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.219176+0000","last_change":"2024-04-25T19:24:16.215699+0000","last_active":"2024-04-25T19:24:17.219176+0000","last_peered":"2024-04-25T19:24:17.219176+0000","last_clean":"2024-04-25T19:24:17.219176+0000","last_became_active":"2024-04-25T19:24:16.215371+0000","last_became_peered":"2024-04-25T19:24:16.215371+0000","last_unstale":"2024-04-25T19:24:17.219176+0000","last_undegraded":"2024-04-25T19:24:17.219176+0000","last_fullsized":"2024-04-25T19:24:17.219176+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:04:16.895925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.215033+0000","last_change":"2024-04-25T19:24:16.229059+0000","last_active":"2024-04-25T19:24:17.215033+0000","last_peered":"2024-04-25T19:24:17.215033+0000","last_clean":"2024-04-25T19:24:17.215033+0000","last_became_active":"2024-04-25T19:24:16.226844+0000","last_became_peered":"2024-04-25T19:24:16.226844+0000","last_unstale":"2024-04-25T19:24:17.215033+0000","last_undegraded":"2024-04-25T19:24:17.215033+0000","last_fullsized":"2024-04-25T19:24:17.215033+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:43.393953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.966463+0000","last_change":"2024-04-25T19:24:16.224994+0000","last_active":"2024-04-25T19:24:17.966463+0000","last_peered":"2024-04-25T19:24:17.966463+0000","last_clean":"2024-04-25T19:24:17.966463+0000","last_became_active":"2024-04-25T19:24:16.223422+0000","last_became_peered":"2024-04-25T19:24:16.223422+0000","last_unstale":"2024-04-25T19:24:17.966463+0000","last_undegraded":"2024-04-25T19:24:17.966463+0000","last_fullsized":"2024-04-25T19:24:17.966463+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:26:38.096942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.217563+0000","last_change":"2024-04-25T19:24:16.207546+0000","last_active":"2024-04-25T19:24:17.217563+0000","last_peered":"2024-04-25T19:24:17.217563+0000","last_clean":"2024-04-25T19:24:17.217563+0000","last_became_active":"2024-04-25T19:24:16.207225+0000","last_became_peered":"2024-04-25T19:24:16.207225+0000","last_unstale":"2024-04-25T19:24:17.217563+0000","last_undegraded":"2024-04-25T19:24:17.217563+0000","last_fullsized":"2024-04-25T19:24:17.217563+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:28.368470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.134988+0000","last_change":"2024-04-25T19:24:16.223552+0000","last_active":"2024-04-25T19:24:18.134988+0000","last_peered":"2024-04-25T19:24:18.134988+0000","last_clean":"2024-04-25T19:24:18.134988+0000","last_became_active":"2024-04-25T19:24:16.223256+0000","last_became_peered":"2024-04-25T19:24:16.223256+0000","last_unstale":"2024-04-25T19:24:18.134988+0000","last_undegraded":"2024-04-25T19:24:18.134988+0000","last_fullsized":"2024-04-25T19:24:18.134988+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:56.672911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.137029+0000","last_change":"2024-04-25T19:24:16.208259+0000","last_active":"2024-04-25T19:24:18.137029+0000","last_peered":"2024-04-25T19:24:18.137029+0000","last_clean":"2024-04-25T19:24:18.137029+0000","last_became_active":"2024-04-25T19:24:16.207214+0000","last_became_peered":"2024-04-25T19:24:16.207214+0000","last_unstale":"2024-04-25T19:24:18.137029+0000","last_undegraded":"2024-04-25T19:24:18.137029+0000","last_fullsized":"2024-04-25T19:24:18.137029+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:04:16.895925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.965716+0000","last_change":"2024-04-25T19:24:16.218194+0000","last_active":"2024-04-25T19:24:17.965716+0000","last_peered":"2024-04-25T19:24:17.965716+0000","last_clean":"2024-04-25T19:24:17.965716+0000","last_became_active":"2024-04-25T19:24:16.217561+0000","last_became_peered":"2024-04-25T19:24:16.217561+0000","last_unstale":"2024-04-25T19:24:17.965716+0000","last_undegraded":"2024-04-25T19:24:17.965716+0000","last_fullsized":"2024-04-25T19:24:17.965716+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:49:54.135641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.967522+0000","last_change":"2024-04-25T19:24:16.217154+0000","last_active":"2024-04-25T19:24:17.967522+0000","last_peered":"2024-04-25T19:24:17.967522+0000","last_clean":"2024-04-25T19:24:17.967522+0000","last_became_active":"2024-04-25T19:24:16.211511+0000","last_became_peered":"2024-04-25T19:24:16.211511+0000","last_unstale":"2024-04-25T19:24:17.967522+0000","last_undegraded":"2024-04-25T19:24:17.967522+0000","last_fullsized":"2024-04-25T19:24:17.967522+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:55:02.097905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.967526+0000","last_change":"2024-04-25T19:24:16.217950+0000","last_active":"2024-04-25T19:24:17.967526+0000","last_peered":"2024-04-25T19:24:17.967526+0000","last_clean":"2024-04-25T19:24:17.967526+0000","last_became_active":"2024-04-25T19:24:16.217661+0000","last_became_peered":"2024-04-25T19:24:16.217661+0000","last_unstale":"2024-04-25T19:24:17.967526+0000","last_undegraded":"2024-04-25T19:24:17.967526+0000","last_fullsized":"2024-04-25T19:24:17.967526+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:54.739269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.966834+0000","last_change":"2024-04-25T19:24:16.206750+0000","last_active":"2024-04-25T19:24:17.966834+0000","last_peered":"2024-04-25T19:24:17.966834+0000","last_clean":"2024-04-25T19:24:17.966834+0000","last_became_active":"2024-04-25T19:24:16.206440+0000","last_became_peered":"2024-04-25T19:24:16.206440+0000","last_unstale":"2024-04-25T19:24:17.966834+0000","last_undegraded":"2024-04-25T19:24:17.966834+0000","last_fullsized":"2024-04-25T19:24:17.966834+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:18.130456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.217989+0000","last_change":"2024-04-25T19:24:16.225923+0000","last_active":"2024-04-25T19:24:17.217989+0000","last_peered":"2024-04-25T19:24:17.217989+0000","last_clean":"2024-04-25T19:24:17.217989+0000","last_became_active":"2024-04-25T19:24:16.225582+0000","last_became_peered":"2024-04-25T19:24:16.225582+0000","last_unstale":"2024-04-25T19:24:17.217989+0000","last_undegraded":"2024-04-25T19:24:17.217989+0000","last_fullsized":"2024-04-25T19:24:17.217989+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:10:22.105166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.209661+0000","last_change":"2024-04-25T19:24:16.205951+0000","last_active":"2024-04-25T19:24:17.209661+0000","last_peered":"2024-04-25T19:24:17.209661+0000","last_clean":"2024-04-25T19:24:17.209661+0000","last_became_active":"2024-04-25T19:24:16.205402+0000","last_became_peered":"2024-04-25T19:24:16.205402+0000","last_unstale":"2024-04-25T19:24:17.209661+0000","last_undegraded":"2024-04-25T19:24:17.209661+0000","last_fullsized":"2024-04-25T19:24:17.209661+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:45.268271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.965965+0000","last_change":"2024-04-25T19:24:16.207951+0000","last_active":"2024-04-25T19:24:17.965965+0000","last_peered":"2024-04-25T19:24:17.965965+0000","last_clean":"2024-04-25T19:24:17.965965+0000","last_became_active":"2024-04-25T19:24:16.207650+0000","last_became_peered":"2024-04-25T19:24:16.207650+0000","last_unstale":"2024-04-25T19:24:17.965965+0000","last_undegraded":"2024-04-25T19:24:17.965965+0000","last_fullsized":"2024-04-25T19:24:17.965965+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:28.368470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.134941+0000","last_change":"2024-04-25T19:24:16.214234+0000","last_active":"2024-04-25T19:24:18.134941+0000","last_peered":"2024-04-25T19:24:18.134941+0000","last_clean":"2024-04-25T19:24:18.134941+0000","last_became_active":"2024-04-25T19:24:16.213854+0000","last_became_peered":"2024-04-25T19:24:16.213854+0000","last_unstale":"2024-04-25T19:24:18.134941+0000","last_undegraded":"2024-04-25T19:24:18.134941+0000","last_fullsized":"2024-04-25T19:24:18.134941+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:01:52.299401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.134459+0000","last_change":"2024-04-25T19:24:16.229604+0000","last_active":"2024-04-25T19:24:18.134459+0000","last_peered":"2024-04-25T19:24:18.134459+0000","last_clean":"2024-04-25T19:24:18.134459+0000","last_became_active":"2024-04-25T19:24:16.222129+0000","last_became_peered":"2024-04-25T19:24:16.222129+0000","last_unstale":"2024-04-25T19:24:18.134459+0000","last_undegraded":"2024-04-25T19:24:18.134459+0000","last_fullsized":"2024-04-25T19:24:18.134459+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:15.988478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.215205+0000","last_change":"2024-04-25T19:24:16.224533+0000","last_active":"2024-04-25T19:24:17.215205+0000","last_peered":"2024-04-25T19:24:17.215205+0000","last_clean":"2024-04-25T19:24:17.215205+0000","last_became_active":"2024-04-25T19:24:16.224206+0000","last_became_peered":"2024-04-25T19:24:16.224206+0000","last_unstale":"2024-04-25T19:24:17.215205+0000","last_undegraded":"2024-04-25T19:24:17.215205+0000","last_fullsized":"2024-04-25T19:24:17.215205+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:26.631931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.215216+0000","last_change":"2024-04-25T19:24:16.215307+0000","last_active":"2024-04-25T19:24:17.215216+0000","last_peered":"2024-04-25T19:24:17.215216+0000","last_clean":"2024-04-25T19:24:17.215216+0000","last_became_active":"2024-04-25T19:24:16.214813+0000","last_became_peered":"2024-04-25T19:24:16.214813+0000","last_unstale":"2024-04-25T19:24:17.215216+0000","last_undegraded":"2024-04-25T19:24:17.215216+0000","last_fullsized":"2024-04-25T19:24:17.215216+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:08.338473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.136093+0000","last_change":"2024-04-25T19:24:16.227679+0000","last_active":"2024-04-25T19:24:18.136093+0000","last_peered":"2024-04-25T19:24:18.136093+0000","last_clean":"2024-04-25T19:24:18.136093+0000","last_became_active":"2024-04-25T19:24:16.227297+0000","last_became_peered":"2024-04-25T19:24:16.227297+0000","last_unstale":"2024-04-25T19:24:18.136093+0000","last_undegraded":"2024-04-25T19:24:18.136093+0000","last_fullsized":"2024-04-25T19:24:18.136093+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:26.631931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.210037+0000","last_change":"2024-04-25T19:24:16.215874+0000","last_active":"2024-04-25T19:24:17.210037+0000","last_peered":"2024-04-25T19:24:17.210037+0000","last_clean":"2024-04-25T19:24:17.210037+0000","last_became_active":"2024-04-25T19:24:16.209225+0000","last_became_peered":"2024-04-25T19:24:16.209225+0000","last_unstale":"2024-04-25T19:24:17.210037+0000","last_undegraded":"2024-04-25T19:24:17.210037+0000","last_fullsized":"2024-04-25T19:24:17.210037+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:03.960063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135251+0000","last_change":"2024-04-25T19:24:16.222001+0000","last_active":"2024-04-25T19:24:18.135251+0000","last_peered":"2024-04-25T19:24:18.135251+0000","last_clean":"2024-04-25T19:24:18.135251+0000","last_became_active":"2024-04-25T19:24:16.221671+0000","last_became_peered":"2024-04-25T19:24:16.221671+0000","last_unstale":"2024-04-25T19:24:18.135251+0000","last_undegraded":"2024-04-25T19:24:18.135251+0000","last_fullsized":"2024-04-25T19:24:18.135251+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:27:35.779379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.966203+0000","last_change":"2024-04-25T19:24:16.218918+0000","last_active":"2024-04-25T19:24:17.966203+0000","last_peered":"2024-04-25T19:24:17.966203+0000","last_clean":"2024-04-25T19:24:17.966203+0000","last_became_active":"2024-04-25T19:24:16.218597+0000","last_became_peered":"2024-04-25T19:24:16.218597+0000","last_unstale":"2024-04-25T19:24:17.966203+0000","last_undegraded":"2024-04-25T19:24:17.966203+0000","last_fullsized":"2024-04-25T19:24:17.966203+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:13.668361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135534+0000","last_change":"2024-04-25T19:24:16.217916+0000","last_active":"2024-04-25T19:24:18.135534+0000","last_peered":"2024-04-25T19:24:18.135534+0000","last_clean":"2024-04-25T19:24:18.135534+0000","last_became_active":"2024-04-25T19:24:16.217592+0000","last_became_peered":"2024-04-25T19:24:16.217592+0000","last_unstale":"2024-04-25T19:24:18.135534+0000","last_undegraded":"2024-04-25T19:24:18.135534+0000","last_fullsized":"2024-04-25T19:24:18.135534+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:48.672235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.134904+0000","last_change":"2024-04-25T19:24:16.217983+0000","last_active":"2024-04-25T19:24:18.134904+0000","last_peered":"2024-04-25T19:24:18.134904+0000","last_clean":"2024-04-25T19:24:18.134904+0000","last_became_active":"2024-04-25T19:24:16.217688+0000","last_became_peered":"2024-04-25T19:24:16.217688+0000","last_unstale":"2024-04-25T19:24:18.134904+0000","last_undegraded":"2024-04-25T19:24:18.134904+0000","last_fullsized":"2024-04-25T19:24:18.134904+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:16.356629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135173+0000","last_change":"2024-04-25T19:24:16.223590+0000","last_active":"2024-04-25T19:24:18.135173+0000","last_peered":"2024-04-25T19:24:18.135173+0000","last_clean":"2024-04-25T19:24:18.135173+0000","last_became_active":"2024-04-25T19:24:16.223201+0000","last_became_peered":"2024-04-25T19:24:16.223201+0000","last_unstale":"2024-04-25T19:24:18.135173+0000","last_undegraded":"2024-04-25T19:24:18.135173+0000","last_fullsized":"2024-04-25T19:24:18.135173+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:43:54.527908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.209831+0000","last_change":"2024-04-25T19:24:16.217906+0000","last_active":"2024-04-25T19:24:17.209831+0000","last_peered":"2024-04-25T19:24:17.209831+0000","last_clean":"2024-04-25T19:24:17.209831+0000","last_became_active":"2024-04-25T19:24:16.205951+0000","last_became_peered":"2024-04-25T19:24:16.205951+0000","last_unstale":"2024-04-25T19:24:17.209831+0000","last_undegraded":"2024-04-25T19:24:17.209831+0000","last_fullsized":"2024-04-25T19:24:17.209831+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:05:44.075203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.215311+0000","last_change":"2024-04-25T19:24:16.228758+0000","last_active":"2024-04-25T19:24:17.215311+0000","last_peered":"2024-04-25T19:24:17.215311+0000","last_clean":"2024-04-25T19:24:17.215311+0000","last_became_active":"2024-04-25T19:24:16.222921+0000","last_became_peered":"2024-04-25T19:24:16.222921+0000","last_unstale":"2024-04-25T19:24:17.215311+0000","last_undegraded":"2024-04-25T19:24:17.215311+0000","last_fullsized":"2024-04-25T19:24:17.215311+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:58.352025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.218209+0000","last_change":"2024-04-25T19:24:16.228297+0000","last_active":"2024-04-25T19:24:17.218209+0000","last_peered":"2024-04-25T19:24:17.218209+0000","last_clean":"2024-04-25T19:24:17.218209+0000","last_became_active":"2024-04-25T19:24:16.227743+0000","last_became_peered":"2024-04-25T19:24:16.227743+0000","last_unstale":"2024-04-25T19:24:17.218209+0000","last_undegraded":"2024-04-25T19:24:17.218209+0000","last_fullsized":"2024-04-25T19:24:17.218209+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:13.668361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135360+0000","last_change":"2024-04-25T19:24:16.222897+0000","last_active":"2024-04-25T19:24:18.135360+0000","last_peered":"2024-04-25T19:24:18.135360+0000","last_clean":"2024-04-25T19:24:18.135360+0000","last_became_active":"2024-04-25T19:24:16.222057+0000","last_became_peered":"2024-04-25T19:24:16.222057+0000","last_unstale":"2024-04-25T19:24:18.135360+0000","last_undegraded":"2024-04-25T19:24:18.135360+0000","last_fullsized":"2024-04-25T19:24:18.135360+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:09.578982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.215653+0000","last_change":"2024-04-25T19:24:16.222441+0000","last_active":"2024-04-25T19:24:17.215653+0000","last_peered":"2024-04-25T19:24:17.215653+0000","last_clean":"2024-04-25T19:24:17.215653+0000","last_became_active":"2024-04-25T19:24:16.221855+0000","last_became_peered":"2024-04-25T19:24:16.221855+0000","last_unstale":"2024-04-25T19:24:17.215653+0000","last_undegraded":"2024-04-25T19:24:17.215653+0000","last_fullsized":"2024-04-25T19:24:17.215653+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:45:25.849447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.134722+0000","last_change":"2024-04-25T19:24:16.212097+0000","last_active":"2024-04-25T19:24:18.134722+0000","last_peered":"2024-04-25T19:24:18.134722+0000","last_clean":"2024-04-25T19:24:18.134722+0000","last_became_active":"2024-04-25T19:24:16.211801+0000","last_became_peered":"2024-04-25T19:24:16.211801+0000","last_unstale":"2024-04-25T19:24:18.134722+0000","last_undegraded":"2024-04-25T19:24:18.134722+0000","last_fullsized":"2024-04-25T19:24:18.134722+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:49.186027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.209595+0000","last_change":"2024-04-25T19:24:16.203338+0000","last_active":"2024-04-25T19:24:17.209595+0000","last_peered":"2024-04-25T19:24:17.209595+0000","last_clean":"2024-04-25T19:24:17.209595+0000","last_became_active":"2024-04-25T19:24:16.202965+0000","last_became_peered":"2024-04-25T19:24:16.202965+0000","last_unstale":"2024-04-25T19:24:17.209595+0000","last_undegraded":"2024-04-25T19:24:17.209595+0000","last_fullsized":"2024-04-25T19:24:17.209595+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:34.667937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.667545+0000","last_change":"2024-04-25T19:24:16.213959+0000","last_active":"2024-04-25T19:24:17.667545+0000","last_peered":"2024-04-25T19:24:17.667545+0000","last_clean":"2024-04-25T19:24:17.667545+0000","last_became_active":"2024-04-25T19:24:16.213663+0000","last_became_peered":"2024-04-25T19:24:16.213663+0000","last_unstale":"2024-04-25T19:24:17.667545+0000","last_undegraded":"2024-04-25T19:24:17.667545+0000","last_fullsized":"2024-04-25T19:24:17.667545+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:43.393953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.134718+0000","last_change":"2024-04-25T19:24:15.210899+0000","last_active":"2024-04-25T19:24:18.134718+0000","last_peered":"2024-04-25T19:24:18.134718+0000","last_clean":"2024-04-25T19:24:18.134718+0000","last_became_active":"2024-04-25T19:24:15.210616+0000","last_became_peered":"2024-04-25T19:24:15.210616+0000","last_unstale":"2024-04-25T19:24:18.134718+0000","last_undegraded":"2024-04-25T19:24:18.134718+0000","last_fullsized":"2024-04-25T19:24:18.134718+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:10:21.087989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135740+0000","last_change":"2024-04-25T19:24:16.224840+0000","last_active":"2024-04-25T19:24:18.135740+0000","last_peered":"2024-04-25T19:24:18.135740+0000","last_clean":"2024-04-25T19:24:18.135740+0000","last_became_active":"2024-04-25T19:24:16.224385+0000","last_became_peered":"2024-04-25T19:24:16.224385+0000","last_unstale":"2024-04-25T19:24:18.135740+0000","last_undegraded":"2024-04-25T19:24:18.135740+0000","last_fullsized":"2024-04-25T19:24:18.135740+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:08.338473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.215384+0000","last_change":"2024-04-25T19:24:15.212266+0000","last_active":"2024-04-25T19:24:17.215384+0000","last_peered":"2024-04-25T19:24:17.215384+0000","last_clean":"2024-04-25T19:24:17.215384+0000","last_became_active":"2024-04-25T19:24:15.211912+0000","last_became_peered":"2024-04-25T19:24:15.211912+0000","last_unstale":"2024-04-25T19:24:17.215384+0000","last_undegraded":"2024-04-25T19:24:17.215384+0000","last_fullsized":"2024-04-25T19:24:17.215384+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:45:26.828593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.218451+0000","last_change":"2024-04-25T19:24:16.207807+0000","last_active":"2024-04-25T19:24:17.218451+0000","last_peered":"2024-04-25T19:24:17.218451+0000","last_clean":"2024-04-25T19:24:17.218451+0000","last_became_active":"2024-04-25T19:24:16.204343+0000","last_became_peered":"2024-04-25T19:24:16.204343+0000","last_unstale":"2024-04-25T19:24:17.218451+0000","last_undegraded":"2024-04-25T19:24:17.218451+0000","last_fullsized":"2024-04-25T19:24:17.218451+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:26:38.096942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.667342+0000","last_change":"2024-04-25T19:24:15.207933+0000","last_active":"2024-04-25T19:24:17.667342+0000","last_peered":"2024-04-25T19:24:17.667342+0000","last_clean":"2024-04-25T19:24:17.667342+0000","last_became_active":"2024-04-25T19:24:15.207599+0000","last_became_peered":"2024-04-25T19:24:15.207599+0000","last_unstale":"2024-04-25T19:24:17.667342+0000","last_undegraded":"2024-04-25T19:24:17.667342+0000","last_fullsized":"2024-04-25T19:24:17.667342+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:21.626506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.667450+0000","last_change":"2024-04-25T19:24:16.222494+0000","last_active":"2024-04-25T19:24:17.667450+0000","last_peered":"2024-04-25T19:24:17.667450+0000","last_clean":"2024-04-25T19:24:17.667450+0000","last_became_active":"2024-04-25T19:24:16.222149+0000","last_became_peered":"2024-04-25T19:24:16.222149+0000","last_unstale":"2024-04-25T19:24:17.667450+0000","last_undegraded":"2024-04-25T19:24:17.667450+0000","last_fullsized":"2024-04-25T19:24:17.667450+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:09.578982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.136762+0000","last_change":"2024-04-25T19:24:15.217124+0000","last_active":"2024-04-25T19:24:18.136762+0000","last_peered":"2024-04-25T19:24:18.136762+0000","last_clean":"2024-04-25T19:24:18.136762+0000","last_became_active":"2024-04-25T19:24:15.216606+0000","last_became_peered":"2024-04-25T19:24:15.216606+0000","last_unstale":"2024-04-25T19:24:18.136762+0000","last_undegraded":"2024-04-25T19:24:18.136762+0000","last_fullsized":"2024-04-25T19:24:18.136762+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:07.321296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.215479+0000","last_change":"2024-04-25T19:24:16.218732+0000","last_active":"2024-04-25T19:24:17.215479+0000","last_peered":"2024-04-25T19:24:17.215479+0000","last_clean":"2024-04-25T19:24:17.215479+0000","last_became_active":"2024-04-25T19:24:16.218271+0000","last_became_peered":"2024-04-25T19:24:16.218271+0000","last_unstale":"2024-04-25T19:24:17.215479+0000","last_undegraded":"2024-04-25T19:24:17.215479+0000","last_fullsized":"2024-04-25T19:24:17.215479+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:44:12.794288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135293+0000","last_change":"2024-04-25T19:24:15.205295+0000","last_active":"2024-04-25T19:24:18.135293+0000","last_peered":"2024-04-25T19:24:18.135293+0000","last_clean":"2024-04-25T19:24:18.135293+0000","last_became_active":"2024-04-25T19:24:15.205079+0000","last_became_peered":"2024-04-25T19:24:15.205079+0000","last_unstale":"2024-04-25T19:24:18.135293+0000","last_undegraded":"2024-04-25T19:24:18.135293+0000","last_fullsized":"2024-04-25T19:24:18.135293+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:49:53.118464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.966587+0000","last_change":"2024-04-25T19:24:16.229103+0000","last_active":"2024-04-25T19:24:17.966587+0000","last_peered":"2024-04-25T19:24:17.966587+0000","last_clean":"2024-04-25T19:24:17.966587+0000","last_became_active":"2024-04-25T19:24:16.228759+0000","last_became_peered":"2024-04-25T19:24:16.228759+0000","last_unstale":"2024-04-25T19:24:17.966587+0000","last_undegraded":"2024-04-25T19:24:17.966587+0000","last_fullsized":"2024-04-25T19:24:17.966587+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:04:16.895925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.215645+0000","last_change":"2024-04-25T19:24:15.207458+0000","last_active":"2024-04-25T19:24:17.215645+0000","last_peered":"2024-04-25T19:24:17.215645+0000","last_clean":"2024-04-25T19:24:17.215645+0000","last_became_active":"2024-04-25T19:24:15.207142+0000","last_became_peered":"2024-04-25T19:24:15.207142+0000","last_unstale":"2024-04-25T19:24:17.215645+0000","last_undegraded":"2024-04-25T19:24:17.215645+0000","last_fullsized":"2024-04-25T19:24:17.215645+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:02.942885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.966011+0000","last_change":"2024-04-25T19:24:16.217934+0000","last_active":"2024-04-25T19:24:17.966011+0000","last_peered":"2024-04-25T19:24:17.966011+0000","last_clean":"2024-04-25T19:24:17.966011+0000","last_became_active":"2024-04-25T19:24:16.217546+0000","last_became_peered":"2024-04-25T19:24:16.217546+0000","last_unstale":"2024-04-25T19:24:17.966011+0000","last_undegraded":"2024-04-25T19:24:17.966011+0000","last_fullsized":"2024-04-25T19:24:17.966011+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:10:22.105166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.216399+0000","last_change":"2024-04-25T19:24:15.198754+0000","last_active":"2024-04-25T19:24:17.216399+0000","last_peered":"2024-04-25T19:24:17.216399+0000","last_clean":"2024-04-25T19:24:17.216399+0000","last_became_active":"2024-04-25T19:24:15.195030+0000","last_became_peered":"2024-04-25T19:24:15.195030+0000","last_unstale":"2024-04-25T19:24:17.216399+0000","last_undegraded":"2024-04-25T19:24:17.216399+0000","last_fullsized":"2024-04-25T19:24:17.216399+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:15.339452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.134320+0000","last_change":"2024-04-25T19:24:16.224684+0000","last_active":"2024-04-25T19:24:18.134320+0000","last_peered":"2024-04-25T19:24:18.134320+0000","last_clean":"2024-04-25T19:24:18.134320+0000","last_became_active":"2024-04-25T19:24:16.222355+0000","last_became_peered":"2024-04-25T19:24:16.222355+0000","last_unstale":"2024-04-25T19:24:18.134320+0000","last_undegraded":"2024-04-25T19:24:18.134320+0000","last_fullsized":"2024-04-25T19:24:18.134320+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:19:14.438375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.965879+0000","last_change":"2024-04-25T19:24:15.210113+0000","last_active":"2024-04-25T19:24:17.965879+0000","last_peered":"2024-04-25T19:24:17.965879+0000","last_clean":"2024-04-25T19:24:17.965879+0000","last_became_active":"2024-04-25T19:24:15.209799+0000","last_became_peered":"2024-04-25T19:24:15.209799+0000","last_unstale":"2024-04-25T19:24:17.965879+0000","last_undegraded":"2024-04-25T19:24:17.965879+0000","last_fullsized":"2024-04-25T19:24:17.965879+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:08.586379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.215513+0000","last_change":"2024-04-25T19:24:16.215489+0000","last_active":"2024-04-25T19:24:17.215513+0000","last_peered":"2024-04-25T19:24:17.215513+0000","last_clean":"2024-04-25T19:24:17.215513+0000","last_became_active":"2024-04-25T19:24:16.214802+0000","last_became_peered":"2024-04-25T19:24:16.214802+0000","last_unstale":"2024-04-25T19:24:17.215513+0000","last_undegraded":"2024-04-25T19:24:17.215513+0000","last_fullsized":"2024-04-25T19:24:17.215513+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:49:54.135641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.215279+0000","last_change":"2024-04-25T19:24:15.202638+0000","last_active":"2024-04-25T19:24:17.215279+0000","last_peered":"2024-04-25T19:24:17.215279+0000","last_clean":"2024-04-25T19:24:17.215279+0000","last_became_active":"2024-04-25T19:24:15.201449+0000","last_became_peered":"2024-04-25T19:24:15.201449+0000","last_unstale":"2024-04-25T19:24:17.215279+0000","last_undegraded":"2024-04-25T19:24:17.215279+0000","last_fullsized":"2024-04-25T19:24:17.215279+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:08.586379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.137724+0000","last_change":"2024-04-25T19:24:16.218751+0000","last_active":"2024-04-25T19:24:18.137724+0000","last_peered":"2024-04-25T19:24:18.137724+0000","last_clean":"2024-04-25T19:24:18.137724+0000","last_became_active":"2024-04-25T19:24:16.217010+0000","last_became_peered":"2024-04-25T19:24:16.217010+0000","last_unstale":"2024-04-25T19:24:18.137724+0000","last_undegraded":"2024-04-25T19:24:18.137724+0000","last_fullsized":"2024-04-25T19:24:18.137724+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:54.739269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.967616+0000","last_change":"2024-04-25T19:24:15.212991+0000","last_active":"2024-04-25T19:24:17.967616+0000","last_peered":"2024-04-25T19:24:17.967616+0000","last_clean":"2024-04-25T19:24:17.967616+0000","last_became_active":"2024-04-25T19:24:15.212711+0000","last_became_peered":"2024-04-25T19:24:15.212711+0000","last_unstale":"2024-04-25T19:24:17.967616+0000","last_undegraded":"2024-04-25T19:24:17.967616+0000","last_fullsized":"2024-04-25T19:24:17.967616+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:45:26.828593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135428+0000","last_change":"2024-04-25T19:24:16.227020+0000","last_active":"2024-04-25T19:24:18.135428+0000","last_peered":"2024-04-25T19:24:18.135428+0000","last_clean":"2024-04-25T19:24:18.135428+0000","last_became_active":"2024-04-25T19:24:16.225262+0000","last_became_peered":"2024-04-25T19:24:16.225262+0000","last_unstale":"2024-04-25T19:24:18.135428+0000","last_undegraded":"2024-04-25T19:24:18.135428+0000","last_fullsized":"2024-04-25T19:24:18.135428+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:25.096414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.137520+0000","last_change":"2024-04-25T19:24:15.217441+0000","last_active":"2024-04-25T19:24:18.137520+0000","last_peered":"2024-04-25T19:24:18.137520+0000","last_clean":"2024-04-25T19:24:18.137520+0000","last_became_active":"2024-04-25T19:24:15.215667+0000","last_became_peered":"2024-04-25T19:24:15.215667+0000","last_unstale":"2024-04-25T19:24:18.137520+0000","last_undegraded":"2024-04-25T19:24:18.137520+0000","last_fullsized":"2024-04-25T19:24:18.137520+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:25.614754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.137343+0000","last_change":"2024-04-25T19:24:16.208329+0000","last_active":"2024-04-25T19:24:18.137343+0000","last_peered":"2024-04-25T19:24:18.137343+0000","last_clean":"2024-04-25T19:24:18.137343+0000","last_became_active":"2024-04-25T19:24:16.207850+0000","last_became_peered":"2024-04-25T19:24:16.207850+0000","last_unstale":"2024-04-25T19:24:18.137343+0000","last_undegraded":"2024-04-25T19:24:18.137343+0000","last_fullsized":"2024-04-25T19:24:18.137343+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:18.130456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.209967+0000","last_change":"2024-04-25T19:24:15.201632+0000","last_active":"2024-04-25T19:24:17.209967+0000","last_peered":"2024-04-25T19:24:17.209967+0000","last_clean":"2024-04-25T19:24:17.209967+0000","last_became_active":"2024-04-25T19:24:15.201268+0000","last_became_peered":"2024-04-25T19:24:15.201268+0000","last_unstale":"2024-04-25T19:24:17.209967+0000","last_undegraded":"2024-04-25T19:24:17.209967+0000","last_fullsized":"2024-04-25T19:24:17.209967+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:41.643332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.134644+0000","last_change":"2024-04-25T19:24:16.219696+0000","last_active":"2024-04-25T19:24:18.134644+0000","last_peered":"2024-04-25T19:24:18.134644+0000","last_clean":"2024-04-25T19:24:18.134644+0000","last_became_active":"2024-04-25T19:24:16.219304+0000","last_became_peered":"2024-04-25T19:24:16.219304+0000","last_unstale":"2024-04-25T19:24:18.134644+0000","last_undegraded":"2024-04-25T19:24:18.134644+0000","last_fullsized":"2024-04-25T19:24:18.134644+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:54.263246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135465+0000","last_change":"2024-04-25T19:24:15.212643+0000","last_active":"2024-04-25T19:24:18.135465+0000","last_peered":"2024-04-25T19:24:18.135465+0000","last_clean":"2024-04-25T19:24:18.135465+0000","last_became_active":"2024-04-25T19:24:15.212184+0000","last_became_peered":"2024-04-25T19:24:15.212184+0000","last_unstale":"2024-04-25T19:24:18.135465+0000","last_undegraded":"2024-04-25T19:24:18.135465+0000","last_fullsized":"2024-04-25T19:24:18.135465+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:45:24.832270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.966846+0000","last_change":"2024-04-25T19:24:16.207454+0000","last_active":"2024-04-25T19:24:17.966846+0000","last_peered":"2024-04-25T19:24:17.966846+0000","last_clean":"2024-04-25T19:24:17.966846+0000","last_became_active":"2024-04-25T19:24:16.207104+0000","last_became_peered":"2024-04-25T19:24:16.207104+0000","last_unstale":"2024-04-25T19:24:17.966846+0000","last_undegraded":"2024-04-25T19:24:17.966846+0000","last_fullsized":"2024-04-25T19:24:17.966846+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:47:47.007397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.136295+0000","last_change":"2024-04-25T19:24:15.213052+0000","last_active":"2024-04-25T19:24:18.136295+0000","last_peered":"2024-04-25T19:24:18.136295+0000","last_clean":"2024-04-25T19:24:18.136295+0000","last_became_active":"2024-04-25T19:24:15.212702+0000","last_became_peered":"2024-04-25T19:24:15.212702+0000","last_unstale":"2024-04-25T19:24:18.136295+0000","last_undegraded":"2024-04-25T19:24:18.136295+0000","last_fullsized":"2024-04-25T19:24:18.136295+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:08.561805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.134939+0000","last_change":"2024-04-25T19:24:16.227150+0000","last_active":"2024-04-25T19:24:18.134939+0000","last_peered":"2024-04-25T19:24:18.134939+0000","last_clean":"2024-04-25T19:24:18.134939+0000","last_became_active":"2024-04-25T19:24:16.226836+0000","last_became_peered":"2024-04-25T19:24:16.226836+0000","last_unstale":"2024-04-25T19:24:18.134939+0000","last_undegraded":"2024-04-25T19:24:18.134939+0000","last_fullsized":"2024-04-25T19:24:18.134939+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:38.347099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135119+0000","last_change":"2024-04-25T19:24:15.212808+0000","last_active":"2024-04-25T19:24:18.135119+0000","last_peered":"2024-04-25T19:24:18.135119+0000","last_clean":"2024-04-25T19:24:18.135119+0000","last_became_active":"2024-04-25T19:24:15.212489+0000","last_became_peered":"2024-04-25T19:24:15.212489+0000","last_unstale":"2024-04-25T19:24:18.135119+0000","last_undegraded":"2024-04-25T19:24:18.135119+0000","last_fullsized":"2024-04-25T19:24:18.135119+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:44:11.777111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.137067+0000","last_change":"2024-04-25T19:24:16.224512+0000","last_active":"2024-04-25T19:24:18.137067+0000","last_peered":"2024-04-25T19:24:18.137067+0000","last_clean":"2024-04-25T19:24:18.137067+0000","last_became_active":"2024-04-25T19:24:16.223620+0000","last_became_peered":"2024-04-25T19:24:16.223620+0000","last_unstale":"2024-04-25T19:24:18.137067+0000","last_undegraded":"2024-04-25T19:24:18.137067+0000","last_fullsized":"2024-04-25T19:24:18.137067+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:33.179500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":22,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.966230+0000","last_change":"2024-04-25T19:24:15.207440+0000","last_active":"2024-04-25T19:24:17.966230+0000","last_peered":"2024-04-25T19:24:17.966230+0000","last_clean":"2024-04-25T19:24:17.966230+0000","last_became_active":"2024-04-25T19:24:15.207128+0000","last_became_peered":"2024-04-25T19:24:15.207128+0000","last_unstale":"2024-04-25T19:24:17.966230+0000","last_undegraded":"2024-04-25T19:24:17.966230+0000","last_fullsized":"2024-04-25T19:24:17.966230+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:50.748435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.209897+0000","last_change":"2024-04-25T19:24:16.200069+0000","last_active":"2024-04-25T19:24:17.209897+0000","last_peered":"2024-04-25T19:24:17.209897+0000","last_clean":"2024-04-25T19:24:17.209897+0000","last_became_active":"2024-04-25T19:24:16.199698+0000","last_became_peered":"2024-04-25T19:24:16.199698+0000","last_unstale":"2024-04-25T19:24:17.209897+0000","last_undegraded":"2024-04-25T19:24:17.209897+0000","last_fullsized":"2024-04-25T19:24:17.209897+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:51.765612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.209955+0000","last_change":"2024-04-25T19:24:15.203919+0000","last_active":"2024-04-25T19:24:17.209955+0000","last_peered":"2024-04-25T19:24:17.209955+0000","last_clean":"2024-04-25T19:24:17.209955+0000","last_became_active":"2024-04-25T19:24:15.203604+0000","last_became_peered":"2024-04-25T19:24:15.203604+0000","last_unstale":"2024-04-25T19:24:17.209955+0000","last_undegraded":"2024-04-25T19:24:17.209955+0000","last_fullsized":"2024-04-25T19:24:17.209955+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:18.595417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.967872+0000","last_change":"2024-04-25T19:24:16.200907+0000","last_active":"2024-04-25T19:24:17.967872+0000","last_peered":"2024-04-25T19:24:17.967872+0000","last_clean":"2024-04-25T19:24:17.967872+0000","last_became_active":"2024-04-25T19:24:16.200522+0000","last_became_peered":"2024-04-25T19:24:16.200522+0000","last_unstale":"2024-04-25T19:24:17.967872+0000","last_undegraded":"2024-04-25T19:24:17.967872+0000","last_fullsized":"2024-04-25T19:24:17.967872+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:14.786856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.215808+0000","last_change":"2024-04-25T19:24:15.199220+0000","last_active":"2024-04-25T19:24:17.215808+0000","last_peered":"2024-04-25T19:24:17.215808+0000","last_clean":"2024-04-25T19:24:17.215808+0000","last_became_active":"2024-04-25T19:24:15.195647+0000","last_became_peered":"2024-04-25T19:24:15.195647+0000","last_unstale":"2024-04-25T19:24:17.215808+0000","last_undegraded":"2024-04-25T19:24:17.215808+0000","last_fullsized":"2024-04-25T19:24:17.215808+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:30.628341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135196+0000","last_change":"2024-04-25T19:24:16.230119+0000","last_active":"2024-04-25T19:24:18.135196+0000","last_peered":"2024-04-25T19:24:18.135196+0000","last_clean":"2024-04-25T19:24:18.135196+0000","last_became_active":"2024-04-25T19:24:16.229636+0000","last_became_peered":"2024-04-25T19:24:16.229636+0000","last_unstale":"2024-04-25T19:24:18.135196+0000","last_undegraded":"2024-04-25T19:24:18.135196+0000","last_fullsized":"2024-04-25T19:24:18.135196+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:05:25.623833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.218264+0000","last_change":"2024-04-25T19:24:15.204735+0000","last_active":"2024-04-25T19:24:17.218264+0000","last_peered":"2024-04-25T19:24:17.218264+0000","last_clean":"2024-04-25T19:24:17.218264+0000","last_became_active":"2024-04-25T19:24:15.202315+0000","last_became_peered":"2024-04-25T19:24:15.202315+0000","last_unstale":"2024-04-25T19:24:17.218264+0000","last_undegraded":"2024-04-25T19:24:17.218264+0000","last_fullsized":"2024-04-25T19:24:17.218264+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:05:24.606656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135672+0000","last_change":"2024-04-25T19:24:16.231488+0000","last_active":"2024-04-25T19:24:18.135672+0000","last_peered":"2024-04-25T19:24:18.135672+0000","last_clean":"2024-04-25T19:24:18.135672+0000","last_became_active":"2024-04-25T19:24:16.231092+0000","last_became_peered":"2024-04-25T19:24:16.231092+0000","last_unstale":"2024-04-25T19:24:18.135672+0000","last_undegraded":"2024-04-25T19:24:18.135672+0000","last_fullsized":"2024-04-25T19:24:18.135672+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:43.393953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.134576+0000","last_change":"2024-04-25T19:24:15.211239+0000","last_active":"2024-04-25T19:24:18.134576+0000","last_peered":"2024-04-25T19:24:18.134576+0000","last_clean":"2024-04-25T19:24:18.134576+0000","last_became_active":"2024-04-25T19:24:15.210902+0000","last_became_peered":"2024-04-25T19:24:15.210902+0000","last_unstale":"2024-04-25T19:24:18.134576+0000","last_undegraded":"2024-04-25T19:24:18.134576+0000","last_fullsized":"2024-04-25T19:24:18.134576+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:57.334848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135036+0000","last_change":"2024-04-25T19:24:16.232940+0000","last_active":"2024-04-25T19:24:18.135036+0000","last_peered":"2024-04-25T19:24:18.135036+0000","last_clean":"2024-04-25T19:24:18.135036+0000","last_became_active":"2024-04-25T19:24:16.231824+0000","last_became_peered":"2024-04-25T19:24:16.231824+0000","last_unstale":"2024-04-25T19:24:18.135036+0000","last_undegraded":"2024-04-25T19:24:18.135036+0000","last_fullsized":"2024-04-25T19:24:18.135036+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:51.580958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135703+0000","last_change":"2024-04-25T19:24:15.204643+0000","last_active":"2024-04-25T19:24:18.135703+0000","last_peered":"2024-04-25T19:24:18.135703+0000","last_clean":"2024-04-25T19:24:18.135703+0000","last_became_active":"2024-04-25T19:24:15.204340+0000","last_became_peered":"2024-04-25T19:24:15.204340+0000","last_unstale":"2024-04-25T19:24:18.135703+0000","last_undegraded":"2024-04-25T19:24:18.135703+0000","last_fullsized":"2024-04-25T19:24:18.135703+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:27.351293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.666853+0000","last_change":"2024-04-25T19:24:16.213208+0000","last_active":"2024-04-25T19:24:17.666853+0000","last_peered":"2024-04-25T19:24:17.666853+0000","last_clean":"2024-04-25T19:24:17.666853+0000","last_became_active":"2024-04-25T19:24:16.212440+0000","last_became_peered":"2024-04-25T19:24:16.212440+0000","last_unstale":"2024-04-25T19:24:17.666853+0000","last_undegraded":"2024-04-25T19:24:17.666853+0000","last_fullsized":"2024-04-25T19:24:17.666853+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:05:25.623833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.216997+0000","last_change":"2024-04-25T19:24:15.214629+0000","last_active":"2024-04-25T19:24:17.216997+0000","last_peered":"2024-04-25T19:24:17.216997+0000","last_clean":"2024-04-25T19:24:17.216997+0000","last_became_active":"2024-04-25T19:24:15.214247+0000","last_became_peered":"2024-04-25T19:24:15.214247+0000","last_unstale":"2024-04-25T19:24:17.216997+0000","last_undegraded":"2024-04-25T19:24:17.216997+0000","last_fullsized":"2024-04-25T19:24:17.216997+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:43:53.510731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.209668+0000","last_change":"2024-04-25T19:24:16.220069+0000","last_active":"2024-04-25T19:24:17.209668+0000","last_peered":"2024-04-25T19:24:17.209668+0000","last_clean":"2024-04-25T19:24:17.209668+0000","last_became_active":"2024-04-25T19:24:16.214540+0000","last_became_peered":"2024-04-25T19:24:16.214540+0000","last_unstale":"2024-04-25T19:24:17.209668+0000","last_undegraded":"2024-04-25T19:24:17.209668+0000","last_fullsized":"2024-04-25T19:24:17.209668+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:55.190332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.965741+0000","last_change":"2024-04-25T19:24:15.207133+0000","last_active":"2024-04-25T19:24:17.965741+0000","last_peered":"2024-04-25T19:24:17.965741+0000","last_clean":"2024-04-25T19:24:17.965741+0000","last_became_active":"2024-04-25T19:24:15.206721+0000","last_became_peered":"2024-04-25T19:24:15.206721+0000","last_unstale":"2024-04-25T19:24:17.965741+0000","last_undegraded":"2024-04-25T19:24:17.965741+0000","last_fullsized":"2024-04-25T19:24:17.965741+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:30.628341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.965948+0000","last_change":"2024-04-25T19:24:16.215652+0000","last_active":"2024-04-25T19:24:17.965948+0000","last_peered":"2024-04-25T19:24:17.965948+0000","last_clean":"2024-04-25T19:24:17.965948+0000","last_became_active":"2024-04-25T19:24:16.211826+0000","last_became_peered":"2024-04-25T19:24:16.211826+0000","last_unstale":"2024-04-25T19:24:17.965948+0000","last_undegraded":"2024-04-25T19:24:17.965948+0000","last_fullsized":"2024-04-25T19:24:17.965948+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:45:25.849447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135314+0000","last_change":"2024-04-25T19:24:15.211538+0000","last_active":"2024-04-25T19:24:18.135314+0000","last_peered":"2024-04-25T19:24:18.135314+0000","last_clean":"2024-04-25T19:24:18.135314+0000","last_became_active":"2024-04-25T19:24:15.211151+0000","last_became_peered":"2024-04-25T19:24:15.211151+0000","last_unstale":"2024-04-25T19:24:18.135314+0000","last_undegraded":"2024-04-25T19:24:18.135314+0000","last_fullsized":"2024-04-25T19:24:18.135314+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:05:24.606656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.136149+0000","last_change":"2024-04-25T19:24:16.222133+0000","last_active":"2024-04-25T19:24:18.136149+0000","last_peered":"2024-04-25T19:24:18.136149+0000","last_clean":"2024-04-25T19:24:18.136149+0000","last_became_active":"2024-04-25T19:24:16.221818+0000","last_became_peered":"2024-04-25T19:24:16.221818+0000","last_unstale":"2024-04-25T19:24:18.136149+0000","last_undegraded":"2024-04-25T19:24:18.136149+0000","last_fullsized":"2024-04-25T19:24:18.136149+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:58.352025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"45'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.134663+0000","last_change":"2024-04-25T19:24:15.200431+0000","last_active":"2024-04-25T19:24:18.134663+0000","last_peered":"2024-04-25T19:24:18.134663+0000","last_clean":"2024-04-25T19:24:18.134663+0000","last_became_active":"2024-04-25T19:24:15.200095+0000","last_became_peered":"2024-04-25T19:24:15.200095+0000","last_unstale":"2024-04-25T19:24:18.134663+0000","last_undegraded":"2024-04-25T19:24:18.134663+0000","last_fullsized":"2024-04-25T19:24:18.134663+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:12.651184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.966669+0000","last_change":"2024-04-25T19:24:16.215207+0000","last_active":"2024-04-25T19:24:17.966669+0000","last_peered":"2024-04-25T19:24:17.966669+0000","last_clean":"2024-04-25T19:24:17.966669+0000","last_became_active":"2024-04-25T19:24:16.214558+0000","last_became_peered":"2024-04-25T19:24:16.214558+0000","last_unstale":"2024-04-25T19:24:17.966669+0000","last_undegraded":"2024-04-25T19:24:17.966669+0000","last_fullsized":"2024-04-25T19:24:17.966669+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:33.179500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.137850+0000","last_change":"2024-04-25T19:24:15.217752+0000","last_active":"2024-04-25T19:24:18.137850+0000","last_peered":"2024-04-25T19:24:18.137850+0000","last_clean":"2024-04-25T19:24:18.137850+0000","last_became_active":"2024-04-25T19:24:15.215757+0000","last_became_peered":"2024-04-25T19:24:15.215757+0000","last_unstale":"2024-04-25T19:24:18.137850+0000","last_undegraded":"2024-04-25T19:24:18.137850+0000","last_fullsized":"2024-04-25T19:24:18.137850+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:57.334848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.137695+0000","last_change":"2024-04-25T19:24:16.226796+0000","last_active":"2024-04-25T19:24:18.137695+0000","last_peered":"2024-04-25T19:24:18.137695+0000","last_clean":"2024-04-25T19:24:18.137695+0000","last_became_active":"2024-04-25T19:24:16.226424+0000","last_became_peered":"2024-04-25T19:24:16.226424+0000","last_unstale":"2024-04-25T19:24:18.137695+0000","last_undegraded":"2024-04-25T19:24:18.137695+0000","last_fullsized":"2024-04-25T19:24:18.137695+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:55:02.097905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.666808+0000","last_change":"2024-04-25T19:24:15.207239+0000","last_active":"2024-04-25T19:24:17.666808+0000","last_peered":"2024-04-25T19:24:17.666808+0000","last_clean":"2024-04-25T19:24:17.666808+0000","last_became_active":"2024-04-25T19:24:15.206936+0000","last_became_peered":"2024-04-25T19:24:15.206936+0000","last_unstale":"2024-04-25T19:24:17.666808+0000","last_undegraded":"2024-04-25T19:24:17.666808+0000","last_fullsized":"2024-04-25T19:24:17.666808+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:14.971301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135530+0000","last_change":"2024-04-25T19:24:16.210055+0000","last_active":"2024-04-25T19:24:18.135530+0000","last_peered":"2024-04-25T19:24:18.135530+0000","last_clean":"2024-04-25T19:24:18.135530+0000","last_became_active":"2024-04-25T19:24:16.209720+0000","last_became_peered":"2024-04-25T19:24:16.209720+0000","last_unstale":"2024-04-25T19:24:18.135530+0000","last_undegraded":"2024-04-25T19:24:18.135530+0000","last_fullsized":"2024-04-25T19:24:18.135530+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:40.378588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.136856+0000","last_change":"2024-04-25T19:24:15.217257+0000","last_active":"2024-04-25T19:24:18.136856+0000","last_peered":"2024-04-25T19:24:18.136856+0000","last_clean":"2024-04-25T19:24:18.136856+0000","last_became_active":"2024-04-25T19:24:15.216069+0000","last_became_peered":"2024-04-25T19:24:15.216069+0000","last_unstale":"2024-04-25T19:24:18.136856+0000","last_undegraded":"2024-04-25T19:24:18.136856+0000","last_fullsized":"2024-04-25T19:24:18.136856+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:42.376776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135142+0000","last_change":"2024-04-25T19:24:16.227980+0000","last_active":"2024-04-25T19:24:18.135142+0000","last_peered":"2024-04-25T19:24:18.135142+0000","last_clean":"2024-04-25T19:24:18.135142+0000","last_became_active":"2024-04-25T19:24:16.227661+0000","last_became_peered":"2024-04-25T19:24:16.227661+0000","last_unstale":"2024-04-25T19:24:18.135142+0000","last_undegraded":"2024-04-25T19:24:18.135142+0000","last_fullsized":"2024-04-25T19:24:18.135142+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:39.178758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.215828+0000","last_change":"2024-04-25T19:24:15.204853+0000","last_active":"2024-04-25T19:24:17.215828+0000","last_peered":"2024-04-25T19:24:17.215828+0000","last_clean":"2024-04-25T19:24:17.215828+0000","last_became_active":"2024-04-25T19:24:15.204488+0000","last_became_peered":"2024-04-25T19:24:15.204488+0000","last_unstale":"2024-04-25T19:24:17.215828+0000","last_undegraded":"2024-04-25T19:24:17.215828+0000","last_fullsized":"2024-04-25T19:24:17.215828+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:42:37.699864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.216733+0000","last_change":"2024-04-25T19:24:16.202811+0000","last_active":"2024-04-25T19:24:17.216733+0000","last_peered":"2024-04-25T19:24:17.216733+0000","last_clean":"2024-04-25T19:24:17.216733+0000","last_became_active":"2024-04-25T19:24:16.202394+0000","last_became_peered":"2024-04-25T19:24:16.202394+0000","last_unstale":"2024-04-25T19:24:17.216733+0000","last_undegraded":"2024-04-25T19:24:17.216733+0000","last_fullsized":"2024-04-25T19:24:17.216733+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:45:25.849447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.666414+0000","last_change":"2024-04-25T19:24:15.213366+0000","last_active":"2024-04-25T19:24:17.666414+0000","last_peered":"2024-04-25T19:24:17.666414+0000","last_clean":"2024-04-25T19:24:17.666414+0000","last_became_active":"2024-04-25T19:24:15.213099+0000","last_became_peered":"2024-04-25T19:24:15.213099+0000","last_unstale":"2024-04-25T19:24:17.666414+0000","last_undegraded":"2024-04-25T19:24:17.666414+0000","last_fullsized":"2024-04-25T19:24:17.666414+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:19:13.421198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.214701+0000","last_change":"2024-04-25T19:24:16.213336+0000","last_active":"2024-04-25T19:24:17.214701+0000","last_peered":"2024-04-25T19:24:17.214701+0000","last_clean":"2024-04-25T19:24:17.214701+0000","last_became_active":"2024-04-25T19:24:16.213000+0000","last_became_peered":"2024-04-25T19:24:16.213000+0000","last_unstale":"2024-04-25T19:24:17.214701+0000","last_undegraded":"2024-04-25T19:24:17.214701+0000","last_fullsized":"2024-04-25T19:24:17.214701+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:09.578982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.966242+0000","last_change":"2024-04-25T19:24:15.206660+0000","last_active":"2024-04-25T19:24:17.966242+0000","last_peered":"2024-04-25T19:24:17.966242+0000","last_clean":"2024-04-25T19:24:17.966242+0000","last_became_active":"2024-04-25T19:24:15.206225+0000","last_became_peered":"2024-04-25T19:24:15.206225+0000","last_unstale":"2024-04-25T19:24:17.966242+0000","last_undegraded":"2024-04-25T19:24:17.966242+0000","last_fullsized":"2024-04-25T19:24:17.966242+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:02.942885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.967539+0000","last_change":"2024-04-25T19:24:16.207645+0000","last_active":"2024-04-25T19:24:17.967539+0000","last_peered":"2024-04-25T19:24:17.967539+0000","last_clean":"2024-04-25T19:24:17.967539+0000","last_became_active":"2024-04-25T19:24:16.207113+0000","last_became_peered":"2024-04-25T19:24:16.207113+0000","last_unstale":"2024-04-25T19:24:17.967539+0000","last_undegraded":"2024-04-25T19:24:17.967539+0000","last_fullsized":"2024-04-25T19:24:17.967539+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:35.810661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.219591+0000","last_change":"2024-04-25T19:24:15.208272+0000","last_active":"2024-04-25T19:24:17.219591+0000","last_peered":"2024-04-25T19:24:17.219591+0000","last_clean":"2024-04-25T19:24:17.219591+0000","last_became_active":"2024-04-25T19:24:15.207916+0000","last_became_peered":"2024-04-25T19:24:15.207916+0000","last_unstale":"2024-04-25T19:24:17.219591+0000","last_undegraded":"2024-04-25T19:24:17.219591+0000","last_fullsized":"2024-04-25T19:24:17.219591+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:08.561805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":156,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135936+0000","last_change":"2024-04-25T19:22:06.081655+0000","last_active":"2024-04-25T19:24:18.135936+0000","last_peered":"2024-04-25T19:24:18.135936+0000","last_clean":"2024-04-25T19:24:18.135936+0000","last_became_active":"2024-04-25T19:22:06.078999+0000","last_became_peered":"2024-04-25T19:22:06.078999+0000","last_unstale":"2024-04-25T19:24:18.135936+0000","last_undegraded":"2024-04-25T19:24:18.135936+0000","last_fullsized":"2024-04-25T19:24:18.135936+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_clean_scrub_stamp":"2024-04-25T19:22:04.921147+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:30.543734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1126400,"data_stored":805573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31704,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":536576,"data_stored":215787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":532480,"data_stored":215185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":540672,"data_stored":216727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":540672,"data_stored":215753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":544768,"data_stored":216749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":532480,"data_stored":215185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1126400,"data_stored":805517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T19:24:20.859 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T19:24:21.140 INFO:tasks.ceph.mds.c.smithi131.stderr:2024-04-25T19:24:21.139+0000 7f688a200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T19:24:21.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.163+0000 7f255be00640 1 Processor -- start 2024-04-25T19:24:21.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.163+0000 7f255be00640 1 -- start start 2024-04-25T19:24:21.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.165+0000 7f255be00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f255c0cf2f0 0x7f255c0cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:21.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.165+0000 7f255be00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f255c071180 con 0x7f255c168010 2024-04-25T19:24:21.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.165+0000 7f255be00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f255c0700e0 con 0x7f255c06c5c0 2024-04-25T19:24:21.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.165+0000 7f255be00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f255c070cf0 con 0x7f255c0cf2f0 2024-04-25T19:24:21.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.166+0000 7f2552000640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f255c168010 0x7f255c168420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:40754/0 (socket says 172.21.15.131:40754) 2024-04-25T19:24:21.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.166+0000 7f2552000640 1 -- 172.21.15.131:0/3265278919 learned_addr learned my addr 172.21.15.131:0/3265278919 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:24:21.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.166+0000 7f255aa00640 1 --2- 172.21.15.131:0/3265278919 >> v2:172.21.15.195:3300/0 conn(0x7f255c0cf2f0 0x7f255c0cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:21.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.166+0000 7f255a000640 1 -- 172.21.15.131:0/3265278919 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1819922908 0 0) 0x7f255c071180 con 0x7f255c168010 2024-04-25T19:24:21.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.166+0000 7f255a000640 1 -- 172.21.15.131:0/3265278919 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2540003520 con 0x7f255c168010 2024-04-25T19:24:21.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.167+0000 7f255a000640 1 -- 172.21.15.131:0/3265278919 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2021083513 0 0) 0x7f2540003520 con 0x7f255c168010 2024-04-25T19:24:21.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.167+0000 7f255a000640 1 -- 172.21.15.131:0/3265278919 >> v2:172.21.15.195:3300/0 conn(0x7f255c0cf2f0 msgr2=0x7f255c0cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:21.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.167+0000 7f255a000640 1 --2- 172.21.15.131:0/3265278919 >> v2:172.21.15.195:3300/0 conn(0x7f255c0cf2f0 0x7f255c0cf700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:21.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.167+0000 7f255a000640 1 -- 172.21.15.131:0/3265278919 >> v1:172.21.15.195:6789/0 conn(0x7f255c06c5c0 legacy=0x7f255c06c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:21.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.167+0000 7f255a000640 1 -- 172.21.15.131:0/3265278919 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f255c0703c0 con 0x7f255c168010 2024-04-25T19:24:21.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.167+0000 7f255a000640 1 -- 172.21.15.131:0/3265278919 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f2544001670 con 0x7f255c168010 2024-04-25T19:24:21.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.167+0000 7f255a000640 1 -- 172.21.15.131:0/3265278919 >> v1:172.21.15.131:6789/0 conn(0x7f255c168010 legacy=0x7f255c168420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:21.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.167+0000 7f255a000640 1 --2- 172.21.15.131:0/3265278919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2540003a00 0x7f2540003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:21.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.167+0000 7f255a000640 1 --2- 172.21.15.131:0/3265278919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2540004800 0x7f2540004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:21.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.167+0000 7f255a000640 1 --2- 172.21.15.131:0/3265278919 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2540005270 0x7f254000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:21.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.167+0000 7f255a000640 1 -- 172.21.15.131:0/3265278919 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f255c070cf0 con 0x7f2540003a00 2024-04-25T19:24:21.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.167+0000 7f255a000640 1 -- 172.21.15.131:0/3265278919 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f254000c190 con 0x7f2540004800 2024-04-25T19:24:21.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.167+0000 7f255a000640 1 -- 172.21.15.131:0/3265278919 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f254000c390 con 0x7f2540005270 2024-04-25T19:24:21.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.167+0000 7f255aa00640 1 --2- 172.21.15.131:0/3265278919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2540003a00 0x7f2540003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:21.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.168+0000 7f2552000640 1 --2- 172.21.15.131:0/3265278919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2540004800 0x7f2540004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:21.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.168+0000 7f255aa00640 1 -- 172.21.15.131:0/3265278919 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2540005270 msgr2=0x7f254000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:21.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.168+0000 7f255aa00640 1 --2- 172.21.15.131:0/3265278919 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2540005270 0x7f254000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:21.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.168+0000 7f255aa00640 1 -- 172.21.15.131:0/3265278919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2540004800 msgr2=0x7f2540004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:21.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.168+0000 7f255aa00640 1 --2- 172.21.15.131:0/3265278919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2540004800 0x7f2540004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:21.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.168+0000 7f255aa00640 1 -- 172.21.15.131:0/3265278919 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2540003520 con 0x7f2540003a00 2024-04-25T19:24:21.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.168+0000 7f255b400640 1 -- 172.21.15.131:0/3265278919 reap_dead start 2024-04-25T19:24:21.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.169+0000 7f255aa00640 1 --2- 172.21.15.131:0/3265278919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2540003a00 0x7f2540003e70 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f255c074630 tx=0x7f2540005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabf0b79de1c1fb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:21.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.169+0000 7f255a000640 1 -- 172.21.15.131:0/3265278919 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c037070 con 0x7f2540003a00 2024-04-25T19:24:21.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.169+0000 7f255a000640 1 -- 172.21.15.131:0/3265278919 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f254c02e050 con 0x7f2540003a00 2024-04-25T19:24:21.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.169+0000 7f255a000640 1 -- 172.21.15.131:0/3265278919 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c009c10 con 0x7f2540003a00 2024-04-25T19:24:21.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.170+0000 7f255be00640 1 -- 172.21.15.131:0/3265278919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2540003a00 msgr2=0x7f2540003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:21.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.170+0000 7f255be00640 1 --2- 172.21.15.131:0/3265278919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2540003a00 0x7f2540003e70 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f255c074630 tx=0x7f2540005830 comp rx=0 tx=0).stop 2024-04-25T19:24:21.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.170+0000 7f255be00640 1 -- 172.21.15.131:0/3265278919 shutdown_connections 2024-04-25T19:24:21.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.170+0000 7f255be00640 1 --2- 172.21.15.131:0/3265278919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2540003a00 0x7f2540003e70 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:21.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.170+0000 7f255be00640 1 -- 172.21.15.131:0/3265278919 >> 172.21.15.131:0/3265278919 conn(0x7f255c0d1720 msgr2=0x7f255c0d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:21.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.170+0000 7f255be00640 1 -- 172.21.15.131:0/3265278919 shutdown_connections 2024-04-25T19:24:21.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.170+0000 7f255be00640 1 -- 172.21.15.131:0/3265278919 wait complete. 2024-04-25T19:24:21.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.172+0000 7f255be00640 1 Processor -- start 2024-04-25T19:24:21.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.173+0000 7f255be00640 1 -- start start 2024-04-25T19:24:21.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.174+0000 7f255be00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2540003a00 0x7f255c0b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:21.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.174+0000 7f255be00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f255c1ee8d0 0x7f255c1eece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:21.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.174+0000 7f255be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f255c13e1c0 0x7f255c13e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:21.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.174+0000 7f255be00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f255c168d00 con 0x7f255c13e1c0 2024-04-25T19:24:21.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.174+0000 7f255be00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f255c070980 con 0x7f255c1ee8d0 2024-04-25T19:24:21.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.174+0000 7f255be00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f255c168e80 con 0x7f2540003a00 2024-04-25T19:24:21.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.175+0000 7f255b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f255c13e1c0 0x7f255c13e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:21.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.175+0000 7f255b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f255c13e1c0 0x7f255c13e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:42384/0 (socket says 172.21.15.131:42384) 2024-04-25T19:24:21.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.175+0000 7f255b400640 1 -- 172.21.15.131:0/1422960086 learned_addr learned my addr 172.21.15.131:0/1422960086 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:21.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.175+0000 7f2552000640 1 --2- 172.21.15.131:0/1422960086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f255c1ee8d0 0x7f255c1eece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:21.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.175+0000 7f255aa00640 1 --2- 172.21.15.131:0/1422960086 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2540003a00 0x7f255c0b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:21.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.175+0000 7f255b400640 1 -- 172.21.15.131:0/1422960086 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2540003a00 msgr2=0x7f255c0b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:21.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.175+0000 7f255b400640 1 --2- 172.21.15.131:0/1422960086 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2540003a00 0x7f255c0b05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:21.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.175+0000 7f255b400640 1 -- 172.21.15.131:0/1422960086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f255c1ee8d0 msgr2=0x7f255c1eece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:21.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.175+0000 7f255b400640 1 --2- 172.21.15.131:0/1422960086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f255c1ee8d0 0x7f255c1eece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:21.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.175+0000 7f255b400640 1 -- 172.21.15.131:0/1422960086 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f255c1ef600 con 0x7f255c13e1c0 2024-04-25T19:24:21.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.175+0000 7f255b400640 1 --2- 172.21.15.131:0/1422960086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f255c13e1c0 0x7f255c13e5d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f255c0b4a40 tx=0x7f255400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:21.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.176+0000 7f2553400640 1 -- 172.21.15.131:0/1422960086 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2554004220 con 0x7f255c13e1c0 2024-04-25T19:24:21.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.176+0000 7f2553400640 1 -- 172.21.15.131:0/1422960086 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25540043e0 con 0x7f255c13e1c0 2024-04-25T19:24:21.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.176+0000 7f2553400640 1 -- 172.21.15.131:0/1422960086 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2554007310 con 0x7f255c13e1c0 2024-04-25T19:24:21.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.176+0000 7f255be00640 1 -- 172.21.15.131:0/1422960086 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f255c1ef8e0 con 0x7f255c13e1c0 2024-04-25T19:24:21.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.176+0000 7f255be00640 1 -- 172.21.15.131:0/1422960086 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f255c1efea0 con 0x7f255c13e1c0 2024-04-25T19:24:21.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.177+0000 7f255be00640 1 -- 172.21.15.131:0/1422960086 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f255c1ef370 con 0x7f255c13e1c0 2024-04-25T19:24:21.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.178+0000 7f2553400640 1 -- 172.21.15.131:0/1422960086 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f25540074b0 con 0x7f255c13e1c0 2024-04-25T19:24:21.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.180+0000 7f2553400640 1 --2- 172.21.15.131:0/1422960086 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f25380744b0 0x7f25380769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:21.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.180+0000 7f2553400640 1 -- 172.21.15.131:0/1422960086 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f25540944b0 con 0x7f255c13e1c0 2024-04-25T19:24:21.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.180+0000 7f255aa00640 1 --2- 172.21.15.131:0/1422960086 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f25380744b0 0x7f25380769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:21.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.181+0000 7f255aa00640 1 --2- 172.21.15.131:0/1422960086 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f25380744b0 0x7f25380769c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f254c034000 tx=0x7f254c02f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:21.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.185+0000 7f2553400640 1 -- 172.21.15.131:0/1422960086 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f255405eba0 con 0x7f255c13e1c0 2024-04-25T19:24:21.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.386+0000 7f255be00640 1 -- 172.21.15.131:0/1422960086 --> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f255c1670c0 con 0x7f25380744b0 2024-04-25T19:24:21.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.405+0000 7f2553400640 1 -- 172.21.15.131:0/1422960086 <== mgr.4105 v2:172.21.15.195:6832/2541913764 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251949 (secure 0 0 0) 0x7f255c1670c0 con 0x7f25380744b0 2024-04-25T19:24:21.411 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:24:21.412 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-04-25T19:24:21.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.411+0000 7f255be00640 1 -- 172.21.15.131:0/1422960086 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f25380744b0 msgr2=0x7f25380769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:21.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.411+0000 7f255be00640 1 --2- 172.21.15.131:0/1422960086 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f25380744b0 0x7f25380769c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f254c034000 tx=0x7f254c02f000 comp rx=0 tx=0).stop 2024-04-25T19:24:21.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.411+0000 7f255be00640 1 -- 172.21.15.131:0/1422960086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f255c13e1c0 msgr2=0x7f255c13e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:21.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.411+0000 7f255be00640 1 --2- 172.21.15.131:0/1422960086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f255c13e1c0 0x7f255c13e5d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f255c0b4a40 tx=0x7f255400c820 comp rx=0 tx=0).stop 2024-04-25T19:24:21.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.411+0000 7f255be00640 1 -- 172.21.15.131:0/1422960086 shutdown_connections 2024-04-25T19:24:21.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.411+0000 7f255be00640 1 --2- 172.21.15.131:0/1422960086 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f25380744b0 0x7f25380769c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:21.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.411+0000 7f255be00640 1 --2- 172.21.15.131:0/1422960086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f255c13e1c0 0x7f255c13e5d0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:21.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.411+0000 7f255be00640 1 --2- 172.21.15.131:0/1422960086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f255c1ee8d0 0x7f255c1eece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:21.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.411+0000 7f255be00640 1 --2- 172.21.15.131:0/1422960086 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2540003a00 0x7f255c0b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:21.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.411+0000 7f255be00640 1 -- 172.21.15.131:0/1422960086 >> 172.21.15.131:0/1422960086 conn(0x7f255c0d1720 msgr2=0x7f255c0684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:21.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.411+0000 7f255be00640 1 -- 172.21.15.131:0/1422960086 shutdown_connections 2024-04-25T19:24:21.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.411+0000 7f255be00640 1 -- 172.21.15.131:0/1422960086 wait complete. 2024-04-25T19:24:21.438 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2024-04-25T19:24:20.185671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238176,"kb_used_data":5352,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736544,"statfs":{"total":773094113280,"available":772850221056,"internally_reserved":0,"allocated":5480448,"data_stored":2906476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002234"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.137430+0000","last_change":"2024-04-25T19:24:16.213753+0000","last_active":"2024-04-25T19:24:18.137430+0000","last_peered":"2024-04-25T19:24:18.137430+0000","last_clean":"2024-04-25T19:24:18.137430+0000","last_became_active":"2024-04-25T19:24:16.213388+0000","last_became_peered":"2024-04-25T19:24:16.213388+0000","last_unstale":"2024-04-25T19:24:18.137430+0000","last_undegraded":"2024-04-25T19:24:18.137430+0000","last_fullsized":"2024-04-25T19:24:18.137430+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:47:47.007397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.219176+0000","last_change":"2024-04-25T19:24:16.215699+0000","last_active":"2024-04-25T19:24:17.219176+0000","last_peered":"2024-04-25T19:24:17.219176+0000","last_clean":"2024-04-25T19:24:17.219176+0000","last_became_active":"2024-04-25T19:24:16.215371+0000","last_became_peered":"2024-04-25T19:24:16.215371+0000","last_unstale":"2024-04-25T19:24:17.219176+0000","last_undegraded":"2024-04-25T19:24:17.219176+0000","last_fullsized":"2024-04-25T19:24:17.219176+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:04:16.895925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.215033+0000","last_change":"2024-04-25T19:24:16.229059+0000","last_active":"2024-04-25T19:24:17.215033+0000","last_peered":"2024-04-25T19:24:17.215033+0000","last_clean":"2024-04-25T19:24:17.215033+0000","last_became_active":"2024-04-25T19:24:16.226844+0000","last_became_peered":"2024-04-25T19:24:16.226844+0000","last_unstale":"2024-04-25T19:24:17.215033+0000","last_undegraded":"2024-04-25T19:24:17.215033+0000","last_fullsized":"2024-04-25T19:24:17.215033+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:43.393953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.966463+0000","last_change":"2024-04-25T19:24:16.224994+0000","last_active":"2024-04-25T19:24:17.966463+0000","last_peered":"2024-04-25T19:24:17.966463+0000","last_clean":"2024-04-25T19:24:17.966463+0000","last_became_active":"2024-04-25T19:24:16.223422+0000","last_became_peered":"2024-04-25T19:24:16.223422+0000","last_unstale":"2024-04-25T19:24:17.966463+0000","last_undegraded":"2024-04-25T19:24:17.966463+0000","last_fullsized":"2024-04-25T19:24:17.966463+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:26:38.096942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.217563+0000","last_change":"2024-04-25T19:24:16.207546+0000","last_active":"2024-04-25T19:24:17.217563+0000","last_peered":"2024-04-25T19:24:17.217563+0000","last_clean":"2024-04-25T19:24:17.217563+0000","last_became_active":"2024-04-25T19:24:16.207225+0000","last_became_peered":"2024-04-25T19:24:16.207225+0000","last_unstale":"2024-04-25T19:24:17.217563+0000","last_undegraded":"2024-04-25T19:24:17.217563+0000","last_fullsized":"2024-04-25T19:24:17.217563+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:28.368470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.134988+0000","last_change":"2024-04-25T19:24:16.223552+0000","last_active":"2024-04-25T19:24:18.134988+0000","last_peered":"2024-04-25T19:24:18.134988+0000","last_clean":"2024-04-25T19:24:18.134988+0000","last_became_active":"2024-04-25T19:24:16.223256+0000","last_became_peered":"2024-04-25T19:24:16.223256+0000","last_unstale":"2024-04-25T19:24:18.134988+0000","last_undegraded":"2024-04-25T19:24:18.134988+0000","last_fullsized":"2024-04-25T19:24:18.134988+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:56.672911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.137029+0000","last_change":"2024-04-25T19:24:16.208259+0000","last_active":"2024-04-25T19:24:18.137029+0000","last_peered":"2024-04-25T19:24:18.137029+0000","last_clean":"2024-04-25T19:24:18.137029+0000","last_became_active":"2024-04-25T19:24:16.207214+0000","last_became_peered":"2024-04-25T19:24:16.207214+0000","last_unstale":"2024-04-25T19:24:18.137029+0000","last_undegraded":"2024-04-25T19:24:18.137029+0000","last_fullsized":"2024-04-25T19:24:18.137029+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:04:16.895925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.965716+0000","last_change":"2024-04-25T19:24:16.218194+0000","last_active":"2024-04-25T19:24:17.965716+0000","last_peered":"2024-04-25T19:24:17.965716+0000","last_clean":"2024-04-25T19:24:17.965716+0000","last_became_active":"2024-04-25T19:24:16.217561+0000","last_became_peered":"2024-04-25T19:24:16.217561+0000","last_unstale":"2024-04-25T19:24:17.965716+0000","last_undegraded":"2024-04-25T19:24:17.965716+0000","last_fullsized":"2024-04-25T19:24:17.965716+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:49:54.135641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.967522+0000","last_change":"2024-04-25T19:24:16.217154+0000","last_active":"2024-04-25T19:24:17.967522+0000","last_peered":"2024-04-25T19:24:17.967522+0000","last_clean":"2024-04-25T19:24:17.967522+0000","last_became_active":"2024-04-25T19:24:16.211511+0000","last_became_peered":"2024-04-25T19:24:16.211511+0000","last_unstale":"2024-04-25T19:24:17.967522+0000","last_undegraded":"2024-04-25T19:24:17.967522+0000","last_fullsized":"2024-04-25T19:24:17.967522+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:55:02.097905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.967526+0000","last_change":"2024-04-25T19:24:16.217950+0000","last_active":"2024-04-25T19:24:17.967526+0000","last_peered":"2024-04-25T19:24:17.967526+0000","last_clean":"2024-04-25T19:24:17.967526+0000","last_became_active":"2024-04-25T19:24:16.217661+0000","last_became_peered":"2024-04-25T19:24:16.217661+0000","last_unstale":"2024-04-25T19:24:17.967526+0000","last_undegraded":"2024-04-25T19:24:17.967526+0000","last_fullsized":"2024-04-25T19:24:17.967526+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:54.739269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.966834+0000","last_change":"2024-04-25T19:24:16.206750+0000","last_active":"2024-04-25T19:24:17.966834+0000","last_peered":"2024-04-25T19:24:17.966834+0000","last_clean":"2024-04-25T19:24:17.966834+0000","last_became_active":"2024-04-25T19:24:16.206440+0000","last_became_peered":"2024-04-25T19:24:16.206440+0000","last_unstale":"2024-04-25T19:24:17.966834+0000","last_undegraded":"2024-04-25T19:24:17.966834+0000","last_fullsized":"2024-04-25T19:24:17.966834+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:18.130456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.217989+0000","last_change":"2024-04-25T19:24:16.225923+0000","last_active":"2024-04-25T19:24:17.217989+0000","last_peered":"2024-04-25T19:24:17.217989+0000","last_clean":"2024-04-25T19:24:17.217989+0000","last_became_active":"2024-04-25T19:24:16.225582+0000","last_became_peered":"2024-04-25T19:24:16.225582+0000","last_unstale":"2024-04-25T19:24:17.217989+0000","last_undegraded":"2024-04-25T19:24:17.217989+0000","last_fullsized":"2024-04-25T19:24:17.217989+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:10:22.105166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.209661+0000","last_change":"2024-04-25T19:24:16.205951+0000","last_active":"2024-04-25T19:24:17.209661+0000","last_peered":"2024-04-25T19:24:17.209661+0000","last_clean":"2024-04-25T19:24:17.209661+0000","last_became_active":"2024-04-25T19:24:16.205402+0000","last_became_peered":"2024-04-25T19:24:16.205402+0000","last_unstale":"2024-04-25T19:24:17.209661+0000","last_undegraded":"2024-04-25T19:24:17.209661+0000","last_fullsized":"2024-04-25T19:24:17.209661+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:45.268271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.965965+0000","last_change":"2024-04-25T19:24:16.207951+0000","last_active":"2024-04-25T19:24:17.965965+0000","last_peered":"2024-04-25T19:24:17.965965+0000","last_clean":"2024-04-25T19:24:17.965965+0000","last_became_active":"2024-04-25T19:24:16.207650+0000","last_became_peered":"2024-04-25T19:24:16.207650+0000","last_unstale":"2024-04-25T19:24:17.965965+0000","last_undegraded":"2024-04-25T19:24:17.965965+0000","last_fullsized":"2024-04-25T19:24:17.965965+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:28.368470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.134941+0000","last_change":"2024-04-25T19:24:16.214234+0000","last_active":"2024-04-25T19:24:18.134941+0000","last_peered":"2024-04-25T19:24:18.134941+0000","last_clean":"2024-04-25T19:24:18.134941+0000","last_became_active":"2024-04-25T19:24:16.213854+0000","last_became_peered":"2024-04-25T19:24:16.213854+0000","last_unstale":"2024-04-25T19:24:18.134941+0000","last_undegraded":"2024-04-25T19:24:18.134941+0000","last_fullsized":"2024-04-25T19:24:18.134941+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:01:52.299401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.134459+0000","last_change":"2024-04-25T19:24:16.229604+0000","last_active":"2024-04-25T19:24:18.134459+0000","last_peered":"2024-04-25T19:24:18.134459+0000","last_clean":"2024-04-25T19:24:18.134459+0000","last_became_active":"2024-04-25T19:24:16.222129+0000","last_became_peered":"2024-04-25T19:24:16.222129+0000","last_unstale":"2024-04-25T19:24:18.134459+0000","last_undegraded":"2024-04-25T19:24:18.134459+0000","last_fullsized":"2024-04-25T19:24:18.134459+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:15.988478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.215205+0000","last_change":"2024-04-25T19:24:16.224533+0000","last_active":"2024-04-25T19:24:17.215205+0000","last_peered":"2024-04-25T19:24:17.215205+0000","last_clean":"2024-04-25T19:24:17.215205+0000","last_became_active":"2024-04-25T19:24:16.224206+0000","last_became_peered":"2024-04-25T19:24:16.224206+0000","last_unstale":"2024-04-25T19:24:17.215205+0000","last_undegraded":"2024-04-25T19:24:17.215205+0000","last_fullsized":"2024-04-25T19:24:17.215205+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:26.631931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.215216+0000","last_change":"2024-04-25T19:24:16.215307+0000","last_active":"2024-04-25T19:24:17.215216+0000","last_peered":"2024-04-25T19:24:17.215216+0000","last_clean":"2024-04-25T19:24:17.215216+0000","last_became_active":"2024-04-25T19:24:16.214813+0000","last_became_peered":"2024-04-25T19:24:16.214813+0000","last_unstale":"2024-04-25T19:24:17.215216+0000","last_undegraded":"2024-04-25T19:24:17.215216+0000","last_fullsized":"2024-04-25T19:24:17.215216+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:08.338473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.136093+0000","last_change":"2024-04-25T19:24:16.227679+0000","last_active":"2024-04-25T19:24:18.136093+0000","last_peered":"2024-04-25T19:24:18.136093+0000","last_clean":"2024-04-25T19:24:18.136093+0000","last_became_active":"2024-04-25T19:24:16.227297+0000","last_became_peered":"2024-04-25T19:24:16.227297+0000","last_unstale":"2024-04-25T19:24:18.136093+0000","last_undegraded":"2024-04-25T19:24:18.136093+0000","last_fullsized":"2024-04-25T19:24:18.136093+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:26.631931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.210037+0000","last_change":"2024-04-25T19:24:16.215874+0000","last_active":"2024-04-25T19:24:17.210037+0000","last_peered":"2024-04-25T19:24:17.210037+0000","last_clean":"2024-04-25T19:24:17.210037+0000","last_became_active":"2024-04-25T19:24:16.209225+0000","last_became_peered":"2024-04-25T19:24:16.209225+0000","last_unstale":"2024-04-25T19:24:17.210037+0000","last_undegraded":"2024-04-25T19:24:17.210037+0000","last_fullsized":"2024-04-25T19:24:17.210037+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:03.960063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135251+0000","last_change":"2024-04-25T19:24:16.222001+0000","last_active":"2024-04-25T19:24:18.135251+0000","last_peered":"2024-04-25T19:24:18.135251+0000","last_clean":"2024-04-25T19:24:18.135251+0000","last_became_active":"2024-04-25T19:24:16.221671+0000","last_became_peered":"2024-04-25T19:24:16.221671+0000","last_unstale":"2024-04-25T19:24:18.135251+0000","last_undegraded":"2024-04-25T19:24:18.135251+0000","last_fullsized":"2024-04-25T19:24:18.135251+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:27:35.779379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.966203+0000","last_change":"2024-04-25T19:24:16.218918+0000","last_active":"2024-04-25T19:24:17.966203+0000","last_peered":"2024-04-25T19:24:17.966203+0000","last_clean":"2024-04-25T19:24:17.966203+0000","last_became_active":"2024-04-25T19:24:16.218597+0000","last_became_peered":"2024-04-25T19:24:16.218597+0000","last_unstale":"2024-04-25T19:24:17.966203+0000","last_undegraded":"2024-04-25T19:24:17.966203+0000","last_fullsized":"2024-04-25T19:24:17.966203+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:13.668361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135534+0000","last_change":"2024-04-25T19:24:16.217916+0000","last_active":"2024-04-25T19:24:18.135534+0000","last_peered":"2024-04-25T19:24:18.135534+0000","last_clean":"2024-04-25T19:24:18.135534+0000","last_became_active":"2024-04-25T19:24:16.217592+0000","last_became_peered":"2024-04-25T19:24:16.217592+0000","last_unstale":"2024-04-25T19:24:18.135534+0000","last_undegraded":"2024-04-25T19:24:18.135534+0000","last_fullsized":"2024-04-25T19:24:18.135534+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:48.672235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.134904+0000","last_change":"2024-04-25T19:24:16.217983+0000","last_active":"2024-04-25T19:24:18.134904+0000","last_peered":"2024-04-25T19:24:18.134904+0000","last_clean":"2024-04-25T19:24:18.134904+0000","last_became_active":"2024-04-25T19:24:16.217688+0000","last_became_peered":"2024-04-25T19:24:16.217688+0000","last_unstale":"2024-04-25T19:24:18.134904+0000","last_undegraded":"2024-04-25T19:24:18.134904+0000","last_fullsized":"2024-04-25T19:24:18.134904+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:16.356629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135173+0000","last_change":"2024-04-25T19:24:16.223590+0000","last_active":"2024-04-25T19:24:18.135173+0000","last_peered":"2024-04-25T19:24:18.135173+0000","last_clean":"2024-04-25T19:24:18.135173+0000","last_became_active":"2024-04-25T19:24:16.223201+0000","last_became_peered":"2024-04-25T19:24:16.223201+0000","last_unstale":"2024-04-25T19:24:18.135173+0000","last_undegraded":"2024-04-25T19:24:18.135173+0000","last_fullsized":"2024-04-25T19:24:18.135173+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:43:54.527908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.209831+0000","last_change":"2024-04-25T19:24:16.217906+0000","last_active":"2024-04-25T19:24:17.209831+0000","last_peered":"2024-04-25T19:24:17.209831+0000","last_clean":"2024-04-25T19:24:17.209831+0000","last_became_active":"2024-04-25T19:24:16.205951+0000","last_became_peered":"2024-04-25T19:24:16.205951+0000","last_unstale":"2024-04-25T19:24:17.209831+0000","last_undegraded":"2024-04-25T19:24:17.209831+0000","last_fullsized":"2024-04-25T19:24:17.209831+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:05:44.075203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.215311+0000","last_change":"2024-04-25T19:24:16.228758+0000","last_active":"2024-04-25T19:24:17.215311+0000","last_peered":"2024-04-25T19:24:17.215311+0000","last_clean":"2024-04-25T19:24:17.215311+0000","last_became_active":"2024-04-25T19:24:16.222921+0000","last_became_peered":"2024-04-25T19:24:16.222921+0000","last_unstale":"2024-04-25T19:24:17.215311+0000","last_undegraded":"2024-04-25T19:24:17.215311+0000","last_fullsized":"2024-04-25T19:24:17.215311+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:58.352025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.218209+0000","last_change":"2024-04-25T19:24:16.228297+0000","last_active":"2024-04-25T19:24:17.218209+0000","last_peered":"2024-04-25T19:24:17.218209+0000","last_clean":"2024-04-25T19:24:17.218209+0000","last_became_active":"2024-04-25T19:24:16.227743+0000","last_became_peered":"2024-04-25T19:24:16.227743+0000","last_unstale":"2024-04-25T19:24:17.218209+0000","last_undegraded":"2024-04-25T19:24:17.218209+0000","last_fullsized":"2024-04-25T19:24:17.218209+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:13.668361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135360+0000","last_change":"2024-04-25T19:24:16.222897+0000","last_active":"2024-04-25T19:24:18.135360+0000","last_peered":"2024-04-25T19:24:18.135360+0000","last_clean":"2024-04-25T19:24:18.135360+0000","last_became_active":"2024-04-25T19:24:16.222057+0000","last_became_peered":"2024-04-25T19:24:16.222057+0000","last_unstale":"2024-04-25T19:24:18.135360+0000","last_undegraded":"2024-04-25T19:24:18.135360+0000","last_fullsized":"2024-04-25T19:24:18.135360+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:09.578982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.215653+0000","last_change":"2024-04-25T19:24:16.222441+0000","last_active":"2024-04-25T19:24:17.215653+0000","last_peered":"2024-04-25T19:24:17.215653+0000","last_clean":"2024-04-25T19:24:17.215653+0000","last_became_active":"2024-04-25T19:24:16.221855+0000","last_became_peered":"2024-04-25T19:24:16.221855+0000","last_unstale":"2024-04-25T19:24:17.215653+0000","last_undegraded":"2024-04-25T19:24:17.215653+0000","last_fullsized":"2024-04-25T19:24:17.215653+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:45:25.849447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.134722+0000","last_change":"2024-04-25T19:24:16.212097+0000","last_active":"2024-04-25T19:24:18.134722+0000","last_peered":"2024-04-25T19:24:18.134722+0000","last_clean":"2024-04-25T19:24:18.134722+0000","last_became_active":"2024-04-25T19:24:16.211801+0000","last_became_peered":"2024-04-25T19:24:16.211801+0000","last_unstale":"2024-04-25T19:24:18.134722+0000","last_undegraded":"2024-04-25T19:24:18.134722+0000","last_fullsized":"2024-04-25T19:24:18.134722+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:49.186027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.209595+0000","last_change":"2024-04-25T19:24:16.203338+0000","last_active":"2024-04-25T19:24:17.209595+0000","last_peered":"2024-04-25T19:24:17.209595+0000","last_clean":"2024-04-25T19:24:17.209595+0000","last_became_active":"2024-04-25T19:24:16.202965+0000","last_became_peered":"2024-04-25T19:24:16.202965+0000","last_unstale":"2024-04-25T19:24:17.209595+0000","last_undegraded":"2024-04-25T19:24:17.209595+0000","last_fullsized":"2024-04-25T19:24:17.209595+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:34.667937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.667545+0000","last_change":"2024-04-25T19:24:16.213959+0000","last_active":"2024-04-25T19:24:17.667545+0000","last_peered":"2024-04-25T19:24:17.667545+0000","last_clean":"2024-04-25T19:24:17.667545+0000","last_became_active":"2024-04-25T19:24:16.213663+0000","last_became_peered":"2024-04-25T19:24:16.213663+0000","last_unstale":"2024-04-25T19:24:17.667545+0000","last_undegraded":"2024-04-25T19:24:17.667545+0000","last_fullsized":"2024-04-25T19:24:17.667545+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:43.393953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.134718+0000","last_change":"2024-04-25T19:24:15.210899+0000","last_active":"2024-04-25T19:24:18.134718+0000","last_peered":"2024-04-25T19:24:18.134718+0000","last_clean":"2024-04-25T19:24:18.134718+0000","last_became_active":"2024-04-25T19:24:15.210616+0000","last_became_peered":"2024-04-25T19:24:15.210616+0000","last_unstale":"2024-04-25T19:24:18.134718+0000","last_undegraded":"2024-04-25T19:24:18.134718+0000","last_fullsized":"2024-04-25T19:24:18.134718+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:10:21.087989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135740+0000","last_change":"2024-04-25T19:24:16.224840+0000","last_active":"2024-04-25T19:24:18.135740+0000","last_peered":"2024-04-25T19:24:18.135740+0000","last_clean":"2024-04-25T19:24:18.135740+0000","last_became_active":"2024-04-25T19:24:16.224385+0000","last_became_peered":"2024-04-25T19:24:16.224385+0000","last_unstale":"2024-04-25T19:24:18.135740+0000","last_undegraded":"2024-04-25T19:24:18.135740+0000","last_fullsized":"2024-04-25T19:24:18.135740+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:08.338473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.215384+0000","last_change":"2024-04-25T19:24:15.212266+0000","last_active":"2024-04-25T19:24:17.215384+0000","last_peered":"2024-04-25T19:24:17.215384+0000","last_clean":"2024-04-25T19:24:17.215384+0000","last_became_active":"2024-04-25T19:24:15.211912+0000","last_became_peered":"2024-04-25T19:24:15.211912+0000","last_unstale":"2024-04-25T19:24:17.215384+0000","last_undegraded":"2024-04-25T19:24:17.215384+0000","last_fullsized":"2024-04-25T19:24:17.215384+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:45:26.828593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.218451+0000","last_change":"2024-04-25T19:24:16.207807+0000","last_active":"2024-04-25T19:24:17.218451+0000","last_peered":"2024-04-25T19:24:17.218451+0000","last_clean":"2024-04-25T19:24:17.218451+0000","last_became_active":"2024-04-25T19:24:16.204343+0000","last_became_peered":"2024-04-25T19:24:16.204343+0000","last_unstale":"2024-04-25T19:24:17.218451+0000","last_undegraded":"2024-04-25T19:24:17.218451+0000","last_fullsized":"2024-04-25T19:24:17.218451+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:26:38.096942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.667342+0000","last_change":"2024-04-25T19:24:15.207933+0000","last_active":"2024-04-25T19:24:17.667342+0000","last_peered":"2024-04-25T19:24:17.667342+0000","last_clean":"2024-04-25T19:24:17.667342+0000","last_became_active":"2024-04-25T19:24:15.207599+0000","last_became_peered":"2024-04-25T19:24:15.207599+0000","last_unstale":"2024-04-25T19:24:17.667342+0000","last_undegraded":"2024-04-25T19:24:17.667342+0000","last_fullsized":"2024-04-25T19:24:17.667342+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:21.626506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.667450+0000","last_change":"2024-04-25T19:24:16.222494+0000","last_active":"2024-04-25T19:24:17.667450+0000","last_peered":"2024-04-25T19:24:17.667450+0000","last_clean":"2024-04-25T19:24:17.667450+0000","last_became_active":"2024-04-25T19:24:16.222149+0000","last_became_peered":"2024-04-25T19:24:16.222149+0000","last_unstale":"2024-04-25T19:24:17.667450+0000","last_undegraded":"2024-04-25T19:24:17.667450+0000","last_fullsized":"2024-04-25T19:24:17.667450+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:09.578982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.136762+0000","last_change":"2024-04-25T19:24:15.217124+0000","last_active":"2024-04-25T19:24:18.136762+0000","last_peered":"2024-04-25T19:24:18.136762+0000","last_clean":"2024-04-25T19:24:18.136762+0000","last_became_active":"2024-04-25T19:24:15.216606+0000","last_became_peered":"2024-04-25T19:24:15.216606+0000","last_unstale":"2024-04-25T19:24:18.136762+0000","last_undegraded":"2024-04-25T19:24:18.136762+0000","last_fullsized":"2024-04-25T19:24:18.136762+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:07.321296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.215479+0000","last_change":"2024-04-25T19:24:16.218732+0000","last_active":"2024-04-25T19:24:17.215479+0000","last_peered":"2024-04-25T19:24:17.215479+0000","last_clean":"2024-04-25T19:24:17.215479+0000","last_became_active":"2024-04-25T19:24:16.218271+0000","last_became_peered":"2024-04-25T19:24:16.218271+0000","last_unstale":"2024-04-25T19:24:17.215479+0000","last_undegraded":"2024-04-25T19:24:17.215479+0000","last_fullsized":"2024-04-25T19:24:17.215479+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:44:12.794288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135293+0000","last_change":"2024-04-25T19:24:15.205295+0000","last_active":"2024-04-25T19:24:18.135293+0000","last_peered":"2024-04-25T19:24:18.135293+0000","last_clean":"2024-04-25T19:24:18.135293+0000","last_became_active":"2024-04-25T19:24:15.205079+0000","last_became_peered":"2024-04-25T19:24:15.205079+0000","last_unstale":"2024-04-25T19:24:18.135293+0000","last_undegraded":"2024-04-25T19:24:18.135293+0000","last_fullsized":"2024-04-25T19:24:18.135293+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:49:53.118464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.966587+0000","last_change":"2024-04-25T19:24:16.229103+0000","last_active":"2024-04-25T19:24:17.966587+0000","last_peered":"2024-04-25T19:24:17.966587+0000","last_clean":"2024-04-25T19:24:17.966587+0000","last_became_active":"2024-04-25T19:24:16.228759+0000","last_became_peered":"2024-04-25T19:24:16.228759+0000","last_unstale":"2024-04-25T19:24:17.966587+0000","last_undegraded":"2024-04-25T19:24:17.966587+0000","last_fullsized":"2024-04-25T19:24:17.966587+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:04:16.895925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.215645+0000","last_change":"2024-04-25T19:24:15.207458+0000","last_active":"2024-04-25T19:24:17.215645+0000","last_peered":"2024-04-25T19:24:17.215645+0000","last_clean":"2024-04-25T19:24:17.215645+0000","last_became_active":"2024-04-25T19:24:15.207142+0000","last_became_peered":"2024-04-25T19:24:15.207142+0000","last_unstale":"2024-04-25T19:24:17.215645+0000","last_undegraded":"2024-04-25T19:24:17.215645+0000","last_fullsized":"2024-04-25T19:24:17.215645+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:02.942885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.966011+0000","last_change":"2024-04-25T19:24:16.217934+0000","last_active":"2024-04-25T19:24:17.966011+0000","last_peered":"2024-04-25T19:24:17.966011+0000","last_clean":"2024-04-25T19:24:17.966011+0000","last_became_active":"2024-04-25T19:24:16.217546+0000","last_became_peered":"2024-04-25T19:24:16.217546+0000","last_unstale":"2024-04-25T19:24:17.966011+0000","last_undegraded":"2024-04-25T19:24:17.966011+0000","last_fullsized":"2024-04-25T19:24:17.966011+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:10:22.105166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.216399+0000","last_change":"2024-04-25T19:24:15.198754+0000","last_active":"2024-04-25T19:24:17.216399+0000","last_peered":"2024-04-25T19:24:17.216399+0000","last_clean":"2024-04-25T19:24:17.216399+0000","last_became_active":"2024-04-25T19:24:15.195030+0000","last_became_peered":"2024-04-25T19:24:15.195030+0000","last_unstale":"2024-04-25T19:24:17.216399+0000","last_undegraded":"2024-04-25T19:24:17.216399+0000","last_fullsized":"2024-04-25T19:24:17.216399+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:15.339452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.134320+0000","last_change":"2024-04-25T19:24:16.224684+0000","last_active":"2024-04-25T19:24:18.134320+0000","last_peered":"2024-04-25T19:24:18.134320+0000","last_clean":"2024-04-25T19:24:18.134320+0000","last_became_active":"2024-04-25T19:24:16.222355+0000","last_became_peered":"2024-04-25T19:24:16.222355+0000","last_unstale":"2024-04-25T19:24:18.134320+0000","last_undegraded":"2024-04-25T19:24:18.134320+0000","last_fullsized":"2024-04-25T19:24:18.134320+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:19:14.438375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.965879+0000","last_change":"2024-04-25T19:24:15.210113+0000","last_active":"2024-04-25T19:24:17.965879+0000","last_peered":"2024-04-25T19:24:17.965879+0000","last_clean":"2024-04-25T19:24:17.965879+0000","last_became_active":"2024-04-25T19:24:15.209799+0000","last_became_peered":"2024-04-25T19:24:15.209799+0000","last_unstale":"2024-04-25T19:24:17.965879+0000","last_undegraded":"2024-04-25T19:24:17.965879+0000","last_fullsized":"2024-04-25T19:24:17.965879+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:08.586379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.215513+0000","last_change":"2024-04-25T19:24:16.215489+0000","last_active":"2024-04-25T19:24:17.215513+0000","last_peered":"2024-04-25T19:24:17.215513+0000","last_clean":"2024-04-25T19:24:17.215513+0000","last_became_active":"2024-04-25T19:24:16.214802+0000","last_became_peered":"2024-04-25T19:24:16.214802+0000","last_unstale":"2024-04-25T19:24:17.215513+0000","last_undegraded":"2024-04-25T19:24:17.215513+0000","last_fullsized":"2024-04-25T19:24:17.215513+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:49:54.135641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.215279+0000","last_change":"2024-04-25T19:24:15.202638+0000","last_active":"2024-04-25T19:24:17.215279+0000","last_peered":"2024-04-25T19:24:17.215279+0000","last_clean":"2024-04-25T19:24:17.215279+0000","last_became_active":"2024-04-25T19:24:15.201449+0000","last_became_peered":"2024-04-25T19:24:15.201449+0000","last_unstale":"2024-04-25T19:24:17.215279+0000","last_undegraded":"2024-04-25T19:24:17.215279+0000","last_fullsized":"2024-04-25T19:24:17.215279+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:08.586379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.137724+0000","last_change":"2024-04-25T19:24:16.218751+0000","last_active":"2024-04-25T19:24:18.137724+0000","last_peered":"2024-04-25T19:24:18.137724+0000","last_clean":"2024-04-25T19:24:18.137724+0000","last_became_active":"2024-04-25T19:24:16.217010+0000","last_became_peered":"2024-04-25T19:24:16.217010+0000","last_unstale":"2024-04-25T19:24:18.137724+0000","last_undegraded":"2024-04-25T19:24:18.137724+0000","last_fullsized":"2024-04-25T19:24:18.137724+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:54.739269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.967616+0000","last_change":"2024-04-25T19:24:15.212991+0000","last_active":"2024-04-25T19:24:17.967616+0000","last_peered":"2024-04-25T19:24:17.967616+0000","last_clean":"2024-04-25T19:24:17.967616+0000","last_became_active":"2024-04-25T19:24:15.212711+0000","last_became_peered":"2024-04-25T19:24:15.212711+0000","last_unstale":"2024-04-25T19:24:17.967616+0000","last_undegraded":"2024-04-25T19:24:17.967616+0000","last_fullsized":"2024-04-25T19:24:17.967616+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:45:26.828593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135428+0000","last_change":"2024-04-25T19:24:16.227020+0000","last_active":"2024-04-25T19:24:18.135428+0000","last_peered":"2024-04-25T19:24:18.135428+0000","last_clean":"2024-04-25T19:24:18.135428+0000","last_became_active":"2024-04-25T19:24:16.225262+0000","last_became_peered":"2024-04-25T19:24:16.225262+0000","last_unstale":"2024-04-25T19:24:18.135428+0000","last_undegraded":"2024-04-25T19:24:18.135428+0000","last_fullsized":"2024-04-25T19:24:18.135428+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:25.096414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.137520+0000","last_change":"2024-04-25T19:24:15.217441+0000","last_active":"2024-04-25T19:24:18.137520+0000","last_peered":"2024-04-25T19:24:18.137520+0000","last_clean":"2024-04-25T19:24:18.137520+0000","last_became_active":"2024-04-25T19:24:15.215667+0000","last_became_peered":"2024-04-25T19:24:15.215667+0000","last_unstale":"2024-04-25T19:24:18.137520+0000","last_undegraded":"2024-04-25T19:24:18.137520+0000","last_fullsized":"2024-04-25T19:24:18.137520+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:25.614754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.137343+0000","last_change":"2024-04-25T19:24:16.208329+0000","last_active":"2024-04-25T19:24:18.137343+0000","last_peered":"2024-04-25T19:24:18.137343+0000","last_clean":"2024-04-25T19:24:18.137343+0000","last_became_active":"2024-04-25T19:24:16.207850+0000","last_became_peered":"2024-04-25T19:24:16.207850+0000","last_unstale":"2024-04-25T19:24:18.137343+0000","last_undegraded":"2024-04-25T19:24:18.137343+0000","last_fullsized":"2024-04-25T19:24:18.137343+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:18.130456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.209967+0000","last_change":"2024-04-25T19:24:15.201632+0000","last_active":"2024-04-25T19:24:17.209967+0000","last_peered":"2024-04-25T19:24:17.209967+0000","last_clean":"2024-04-25T19:24:17.209967+0000","last_became_active":"2024-04-25T19:24:15.201268+0000","last_became_peered":"2024-04-25T19:24:15.201268+0000","last_unstale":"2024-04-25T19:24:17.209967+0000","last_undegraded":"2024-04-25T19:24:17.209967+0000","last_fullsized":"2024-04-25T19:24:17.209967+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:41.643332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.134644+0000","last_change":"2024-04-25T19:24:16.219696+0000","last_active":"2024-04-25T19:24:18.134644+0000","last_peered":"2024-04-25T19:24:18.134644+0000","last_clean":"2024-04-25T19:24:18.134644+0000","last_became_active":"2024-04-25T19:24:16.219304+0000","last_became_peered":"2024-04-25T19:24:16.219304+0000","last_unstale":"2024-04-25T19:24:18.134644+0000","last_undegraded":"2024-04-25T19:24:18.134644+0000","last_fullsized":"2024-04-25T19:24:18.134644+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:54.263246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135465+0000","last_change":"2024-04-25T19:24:15.212643+0000","last_active":"2024-04-25T19:24:18.135465+0000","last_peered":"2024-04-25T19:24:18.135465+0000","last_clean":"2024-04-25T19:24:18.135465+0000","last_became_active":"2024-04-25T19:24:15.212184+0000","last_became_peered":"2024-04-25T19:24:15.212184+0000","last_unstale":"2024-04-25T19:24:18.135465+0000","last_undegraded":"2024-04-25T19:24:18.135465+0000","last_fullsized":"2024-04-25T19:24:18.135465+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:45:24.832270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.966846+0000","last_change":"2024-04-25T19:24:16.207454+0000","last_active":"2024-04-25T19:24:17.966846+0000","last_peered":"2024-04-25T19:24:17.966846+0000","last_clean":"2024-04-25T19:24:17.966846+0000","last_became_active":"2024-04-25T19:24:16.207104+0000","last_became_peered":"2024-04-25T19:24:16.207104+0000","last_unstale":"2024-04-25T19:24:17.966846+0000","last_undegraded":"2024-04-25T19:24:17.966846+0000","last_fullsized":"2024-04-25T19:24:17.966846+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:47:47.007397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.136295+0000","last_change":"2024-04-25T19:24:15.213052+0000","last_active":"2024-04-25T19:24:18.136295+0000","last_peered":"2024-04-25T19:24:18.136295+0000","last_clean":"2024-04-25T19:24:18.136295+0000","last_became_active":"2024-04-25T19:24:15.212702+0000","last_became_peered":"2024-04-25T19:24:15.212702+0000","last_unstale":"2024-04-25T19:24:18.136295+0000","last_undegraded":"2024-04-25T19:24:18.136295+0000","last_fullsized":"2024-04-25T19:24:18.136295+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:08.561805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.134939+0000","last_change":"2024-04-25T19:24:16.227150+0000","last_active":"2024-04-25T19:24:18.134939+0000","last_peered":"2024-04-25T19:24:18.134939+0000","last_clean":"2024-04-25T19:24:18.134939+0000","last_became_active":"2024-04-25T19:24:16.226836+0000","last_became_peered":"2024-04-25T19:24:16.226836+0000","last_unstale":"2024-04-25T19:24:18.134939+0000","last_undegraded":"2024-04-25T19:24:18.134939+0000","last_fullsized":"2024-04-25T19:24:18.134939+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:38.347099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135119+0000","last_change":"2024-04-25T19:24:15.212808+0000","last_active":"2024-04-25T19:24:18.135119+0000","last_peered":"2024-04-25T19:24:18.135119+0000","last_clean":"2024-04-25T19:24:18.135119+0000","last_became_active":"2024-04-25T19:24:15.212489+0000","last_became_peered":"2024-04-25T19:24:15.212489+0000","last_unstale":"2024-04-25T19:24:18.135119+0000","last_undegraded":"2024-04-25T19:24:18.135119+0000","last_fullsized":"2024-04-25T19:24:18.135119+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:44:11.777111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.137067+0000","last_change":"2024-04-25T19:24:16.224512+0000","last_active":"2024-04-25T19:24:18.137067+0000","last_peered":"2024-04-25T19:24:18.137067+0000","last_clean":"2024-04-25T19:24:18.137067+0000","last_became_active":"2024-04-25T19:24:16.223620+0000","last_became_peered":"2024-04-25T19:24:16.223620+0000","last_unstale":"2024-04-25T19:24:18.137067+0000","last_undegraded":"2024-04-25T19:24:18.137067+0000","last_fullsized":"2024-04-25T19:24:18.137067+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:33.179500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":22,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.966230+0000","last_change":"2024-04-25T19:24:15.207440+0000","last_active":"2024-04-25T19:24:17.966230+0000","last_peered":"2024-04-25T19:24:17.966230+0000","last_clean":"2024-04-25T19:24:17.966230+0000","last_became_active":"2024-04-25T19:24:15.207128+0000","last_became_peered":"2024-04-25T19:24:15.207128+0000","last_unstale":"2024-04-25T19:24:17.966230+0000","last_undegraded":"2024-04-25T19:24:17.966230+0000","last_fullsized":"2024-04-25T19:24:17.966230+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:50.748435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.209897+0000","last_change":"2024-04-25T19:24:16.200069+0000","last_active":"2024-04-25T19:24:17.209897+0000","last_peered":"2024-04-25T19:24:17.209897+0000","last_clean":"2024-04-25T19:24:17.209897+0000","last_became_active":"2024-04-25T19:24:16.199698+0000","last_became_peered":"2024-04-25T19:24:16.199698+0000","last_unstale":"2024-04-25T19:24:17.209897+0000","last_undegraded":"2024-04-25T19:24:17.209897+0000","last_fullsized":"2024-04-25T19:24:17.209897+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:51.765612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.209955+0000","last_change":"2024-04-25T19:24:15.203919+0000","last_active":"2024-04-25T19:24:17.209955+0000","last_peered":"2024-04-25T19:24:17.209955+0000","last_clean":"2024-04-25T19:24:17.209955+0000","last_became_active":"2024-04-25T19:24:15.203604+0000","last_became_peered":"2024-04-25T19:24:15.203604+0000","last_unstale":"2024-04-25T19:24:17.209955+0000","last_undegraded":"2024-04-25T19:24:17.209955+0000","last_fullsized":"2024-04-25T19:24:17.209955+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:18.595417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.967872+0000","last_change":"2024-04-25T19:24:16.200907+0000","last_active":"2024-04-25T19:24:17.967872+0000","last_peered":"2024-04-25T19:24:17.967872+0000","last_clean":"2024-04-25T19:24:17.967872+0000","last_became_active":"2024-04-25T19:24:16.200522+0000","last_became_peered":"2024-04-25T19:24:16.200522+0000","last_unstale":"2024-04-25T19:24:17.967872+0000","last_undegraded":"2024-04-25T19:24:17.967872+0000","last_fullsized":"2024-04-25T19:24:17.967872+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:14.786856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.215808+0000","last_change":"2024-04-25T19:24:15.199220+0000","last_active":"2024-04-25T19:24:17.215808+0000","last_peered":"2024-04-25T19:24:17.215808+0000","last_clean":"2024-04-25T19:24:17.215808+0000","last_became_active":"2024-04-25T19:24:15.195647+0000","last_became_peered":"2024-04-25T19:24:15.195647+0000","last_unstale":"2024-04-25T19:24:17.215808+0000","last_undegraded":"2024-04-25T19:24:17.215808+0000","last_fullsized":"2024-04-25T19:24:17.215808+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:30.628341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135196+0000","last_change":"2024-04-25T19:24:16.230119+0000","last_active":"2024-04-25T19:24:18.135196+0000","last_peered":"2024-04-25T19:24:18.135196+0000","last_clean":"2024-04-25T19:24:18.135196+0000","last_became_active":"2024-04-25T19:24:16.229636+0000","last_became_peered":"2024-04-25T19:24:16.229636+0000","last_unstale":"2024-04-25T19:24:18.135196+0000","last_undegraded":"2024-04-25T19:24:18.135196+0000","last_fullsized":"2024-04-25T19:24:18.135196+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:05:25.623833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.218264+0000","last_change":"2024-04-25T19:24:15.204735+0000","last_active":"2024-04-25T19:24:17.218264+0000","last_peered":"2024-04-25T19:24:17.218264+0000","last_clean":"2024-04-25T19:24:17.218264+0000","last_became_active":"2024-04-25T19:24:15.202315+0000","last_became_peered":"2024-04-25T19:24:15.202315+0000","last_unstale":"2024-04-25T19:24:17.218264+0000","last_undegraded":"2024-04-25T19:24:17.218264+0000","last_fullsized":"2024-04-25T19:24:17.218264+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:05:24.606656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135672+0000","last_change":"2024-04-25T19:24:16.231488+0000","last_active":"2024-04-25T19:24:18.135672+0000","last_peered":"2024-04-25T19:24:18.135672+0000","last_clean":"2024-04-25T19:24:18.135672+0000","last_became_active":"2024-04-25T19:24:16.231092+0000","last_became_peered":"2024-04-25T19:24:16.231092+0000","last_unstale":"2024-04-25T19:24:18.135672+0000","last_undegraded":"2024-04-25T19:24:18.135672+0000","last_fullsized":"2024-04-25T19:24:18.135672+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:43.393953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.134576+0000","last_change":"2024-04-25T19:24:15.211239+0000","last_active":"2024-04-25T19:24:18.134576+0000","last_peered":"2024-04-25T19:24:18.134576+0000","last_clean":"2024-04-25T19:24:18.134576+0000","last_became_active":"2024-04-25T19:24:15.210902+0000","last_became_peered":"2024-04-25T19:24:15.210902+0000","last_unstale":"2024-04-25T19:24:18.134576+0000","last_undegraded":"2024-04-25T19:24:18.134576+0000","last_fullsized":"2024-04-25T19:24:18.134576+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:57.334848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135036+0000","last_change":"2024-04-25T19:24:16.232940+0000","last_active":"2024-04-25T19:24:18.135036+0000","last_peered":"2024-04-25T19:24:18.135036+0000","last_clean":"2024-04-25T19:24:18.135036+0000","last_became_active":"2024-04-25T19:24:16.231824+0000","last_became_peered":"2024-04-25T19:24:16.231824+0000","last_unstale":"2024-04-25T19:24:18.135036+0000","last_undegraded":"2024-04-25T19:24:18.135036+0000","last_fullsized":"2024-04-25T19:24:18.135036+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:51.580958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135703+0000","last_change":"2024-04-25T19:24:15.204643+0000","last_active":"2024-04-25T19:24:18.135703+0000","last_peered":"2024-04-25T19:24:18.135703+0000","last_clean":"2024-04-25T19:24:18.135703+0000","last_became_active":"2024-04-25T19:24:15.204340+0000","last_became_peered":"2024-04-25T19:24:15.204340+0000","last_unstale":"2024-04-25T19:24:18.135703+0000","last_undegraded":"2024-04-25T19:24:18.135703+0000","last_fullsized":"2024-04-25T19:24:18.135703+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:27.351293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.666853+0000","last_change":"2024-04-25T19:24:16.213208+0000","last_active":"2024-04-25T19:24:17.666853+0000","last_peered":"2024-04-25T19:24:17.666853+0000","last_clean":"2024-04-25T19:24:17.666853+0000","last_became_active":"2024-04-25T19:24:16.212440+0000","last_became_peered":"2024-04-25T19:24:16.212440+0000","last_unstale":"2024-04-25T19:24:17.666853+0000","last_undegraded":"2024-04-25T19:24:17.666853+0000","last_fullsized":"2024-04-25T19:24:17.666853+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:05:25.623833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.216997+0000","last_change":"2024-04-25T19:24:15.214629+0000","last_active":"2024-04-25T19:24:17.216997+0000","last_peered":"2024-04-25T19:24:17.216997+0000","last_clean":"2024-04-25T19:24:17.216997+0000","last_became_active":"2024-04-25T19:24:15.214247+0000","last_became_peered":"2024-04-25T19:24:15.214247+0000","last_unstale":"2024-04-25T19:24:17.216997+0000","last_undegraded":"2024-04-25T19:24:17.216997+0000","last_fullsized":"2024-04-25T19:24:17.216997+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:43:53.510731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.209668+0000","last_change":"2024-04-25T19:24:16.220069+0000","last_active":"2024-04-25T19:24:17.209668+0000","last_peered":"2024-04-25T19:24:17.209668+0000","last_clean":"2024-04-25T19:24:17.209668+0000","last_became_active":"2024-04-25T19:24:16.214540+0000","last_became_peered":"2024-04-25T19:24:16.214540+0000","last_unstale":"2024-04-25T19:24:17.209668+0000","last_undegraded":"2024-04-25T19:24:17.209668+0000","last_fullsized":"2024-04-25T19:24:17.209668+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:55.190332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.965741+0000","last_change":"2024-04-25T19:24:15.207133+0000","last_active":"2024-04-25T19:24:17.965741+0000","last_peered":"2024-04-25T19:24:17.965741+0000","last_clean":"2024-04-25T19:24:17.965741+0000","last_became_active":"2024-04-25T19:24:15.206721+0000","last_became_peered":"2024-04-25T19:24:15.206721+0000","last_unstale":"2024-04-25T19:24:17.965741+0000","last_undegraded":"2024-04-25T19:24:17.965741+0000","last_fullsized":"2024-04-25T19:24:17.965741+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:30.628341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.965948+0000","last_change":"2024-04-25T19:24:16.215652+0000","last_active":"2024-04-25T19:24:17.965948+0000","last_peered":"2024-04-25T19:24:17.965948+0000","last_clean":"2024-04-25T19:24:17.965948+0000","last_became_active":"2024-04-25T19:24:16.211826+0000","last_became_peered":"2024-04-25T19:24:16.211826+0000","last_unstale":"2024-04-25T19:24:17.965948+0000","last_undegraded":"2024-04-25T19:24:17.965948+0000","last_fullsized":"2024-04-25T19:24:17.965948+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:45:25.849447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135314+0000","last_change":"2024-04-25T19:24:15.211538+0000","last_active":"2024-04-25T19:24:18.135314+0000","last_peered":"2024-04-25T19:24:18.135314+0000","last_clean":"2024-04-25T19:24:18.135314+0000","last_became_active":"2024-04-25T19:24:15.211151+0000","last_became_peered":"2024-04-25T19:24:15.211151+0000","last_unstale":"2024-04-25T19:24:18.135314+0000","last_undegraded":"2024-04-25T19:24:18.135314+0000","last_fullsized":"2024-04-25T19:24:18.135314+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:05:24.606656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.136149+0000","last_change":"2024-04-25T19:24:16.222133+0000","last_active":"2024-04-25T19:24:18.136149+0000","last_peered":"2024-04-25T19:24:18.136149+0000","last_clean":"2024-04-25T19:24:18.136149+0000","last_became_active":"2024-04-25T19:24:16.221818+0000","last_became_peered":"2024-04-25T19:24:16.221818+0000","last_unstale":"2024-04-25T19:24:18.136149+0000","last_undegraded":"2024-04-25T19:24:18.136149+0000","last_fullsized":"2024-04-25T19:24:18.136149+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:58.352025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"45'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.134663+0000","last_change":"2024-04-25T19:24:15.200431+0000","last_active":"2024-04-25T19:24:18.134663+0000","last_peered":"2024-04-25T19:24:18.134663+0000","last_clean":"2024-04-25T19:24:18.134663+0000","last_became_active":"2024-04-25T19:24:15.200095+0000","last_became_peered":"2024-04-25T19:24:15.200095+0000","last_unstale":"2024-04-25T19:24:18.134663+0000","last_undegraded":"2024-04-25T19:24:18.134663+0000","last_fullsized":"2024-04-25T19:24:18.134663+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:12.651184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.966669+0000","last_change":"2024-04-25T19:24:16.215207+0000","last_active":"2024-04-25T19:24:17.966669+0000","last_peered":"2024-04-25T19:24:17.966669+0000","last_clean":"2024-04-25T19:24:17.966669+0000","last_became_active":"2024-04-25T19:24:16.214558+0000","last_became_peered":"2024-04-25T19:24:16.214558+0000","last_unstale":"2024-04-25T19:24:17.966669+0000","last_undegraded":"2024-04-25T19:24:17.966669+0000","last_fullsized":"2024-04-25T19:24:17.966669+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:33.179500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.137850+0000","last_change":"2024-04-25T19:24:15.217752+0000","last_active":"2024-04-25T19:24:18.137850+0000","last_peered":"2024-04-25T19:24:18.137850+0000","last_clean":"2024-04-25T19:24:18.137850+0000","last_became_active":"2024-04-25T19:24:15.215757+0000","last_became_peered":"2024-04-25T19:24:15.215757+0000","last_unstale":"2024-04-25T19:24:18.137850+0000","last_undegraded":"2024-04-25T19:24:18.137850+0000","last_fullsized":"2024-04-25T19:24:18.137850+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:57.334848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.137695+0000","last_change":"2024-04-25T19:24:16.226796+0000","last_active":"2024-04-25T19:24:18.137695+0000","last_peered":"2024-04-25T19:24:18.137695+0000","last_clean":"2024-04-25T19:24:18.137695+0000","last_became_active":"2024-04-25T19:24:16.226424+0000","last_became_peered":"2024-04-25T19:24:16.226424+0000","last_unstale":"2024-04-25T19:24:18.137695+0000","last_undegraded":"2024-04-25T19:24:18.137695+0000","last_fullsized":"2024-04-25T19:24:18.137695+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:55:02.097905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.666808+0000","last_change":"2024-04-25T19:24:15.207239+0000","last_active":"2024-04-25T19:24:17.666808+0000","last_peered":"2024-04-25T19:24:17.666808+0000","last_clean":"2024-04-25T19:24:17.666808+0000","last_became_active":"2024-04-25T19:24:15.206936+0000","last_became_peered":"2024-04-25T19:24:15.206936+0000","last_unstale":"2024-04-25T19:24:17.666808+0000","last_undegraded":"2024-04-25T19:24:17.666808+0000","last_fullsized":"2024-04-25T19:24:17.666808+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:14.971301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135530+0000","last_change":"2024-04-25T19:24:16.210055+0000","last_active":"2024-04-25T19:24:18.135530+0000","last_peered":"2024-04-25T19:24:18.135530+0000","last_clean":"2024-04-25T19:24:18.135530+0000","last_became_active":"2024-04-25T19:24:16.209720+0000","last_became_peered":"2024-04-25T19:24:16.209720+0000","last_unstale":"2024-04-25T19:24:18.135530+0000","last_undegraded":"2024-04-25T19:24:18.135530+0000","last_fullsized":"2024-04-25T19:24:18.135530+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:40.378588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.136856+0000","last_change":"2024-04-25T19:24:15.217257+0000","last_active":"2024-04-25T19:24:18.136856+0000","last_peered":"2024-04-25T19:24:18.136856+0000","last_clean":"2024-04-25T19:24:18.136856+0000","last_became_active":"2024-04-25T19:24:15.216069+0000","last_became_peered":"2024-04-25T19:24:15.216069+0000","last_unstale":"2024-04-25T19:24:18.136856+0000","last_undegraded":"2024-04-25T19:24:18.136856+0000","last_fullsized":"2024-04-25T19:24:18.136856+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:42.376776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135142+0000","last_change":"2024-04-25T19:24:16.227980+0000","last_active":"2024-04-25T19:24:18.135142+0000","last_peered":"2024-04-25T19:24:18.135142+0000","last_clean":"2024-04-25T19:24:18.135142+0000","last_became_active":"2024-04-25T19:24:16.227661+0000","last_became_peered":"2024-04-25T19:24:16.227661+0000","last_unstale":"2024-04-25T19:24:18.135142+0000","last_undegraded":"2024-04-25T19:24:18.135142+0000","last_fullsized":"2024-04-25T19:24:18.135142+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:39.178758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.215828+0000","last_change":"2024-04-25T19:24:15.204853+0000","last_active":"2024-04-25T19:24:17.215828+0000","last_peered":"2024-04-25T19:24:17.215828+0000","last_clean":"2024-04-25T19:24:17.215828+0000","last_became_active":"2024-04-25T19:24:15.204488+0000","last_became_peered":"2024-04-25T19:24:15.204488+0000","last_unstale":"2024-04-25T19:24:17.215828+0000","last_undegraded":"2024-04-25T19:24:17.215828+0000","last_fullsized":"2024-04-25T19:24:17.215828+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:42:37.699864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.216733+0000","last_change":"2024-04-25T19:24:16.202811+0000","last_active":"2024-04-25T19:24:17.216733+0000","last_peered":"2024-04-25T19:24:17.216733+0000","last_clean":"2024-04-25T19:24:17.216733+0000","last_became_active":"2024-04-25T19:24:16.202394+0000","last_became_peered":"2024-04-25T19:24:16.202394+0000","last_unstale":"2024-04-25T19:24:17.216733+0000","last_undegraded":"2024-04-25T19:24:17.216733+0000","last_fullsized":"2024-04-25T19:24:17.216733+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:45:25.849447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.666414+0000","last_change":"2024-04-25T19:24:15.213366+0000","last_active":"2024-04-25T19:24:17.666414+0000","last_peered":"2024-04-25T19:24:17.666414+0000","last_clean":"2024-04-25T19:24:17.666414+0000","last_became_active":"2024-04-25T19:24:15.213099+0000","last_became_peered":"2024-04-25T19:24:15.213099+0000","last_unstale":"2024-04-25T19:24:17.666414+0000","last_undegraded":"2024-04-25T19:24:17.666414+0000","last_fullsized":"2024-04-25T19:24:17.666414+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:19:13.421198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.214701+0000","last_change":"2024-04-25T19:24:16.213336+0000","last_active":"2024-04-25T19:24:17.214701+0000","last_peered":"2024-04-25T19:24:17.214701+0000","last_clean":"2024-04-25T19:24:17.214701+0000","last_became_active":"2024-04-25T19:24:16.213000+0000","last_became_peered":"2024-04-25T19:24:16.213000+0000","last_unstale":"2024-04-25T19:24:17.214701+0000","last_undegraded":"2024-04-25T19:24:17.214701+0000","last_fullsized":"2024-04-25T19:24:17.214701+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:09.578982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.966242+0000","last_change":"2024-04-25T19:24:15.206660+0000","last_active":"2024-04-25T19:24:17.966242+0000","last_peered":"2024-04-25T19:24:17.966242+0000","last_clean":"2024-04-25T19:24:17.966242+0000","last_became_active":"2024-04-25T19:24:15.206225+0000","last_became_peered":"2024-04-25T19:24:15.206225+0000","last_unstale":"2024-04-25T19:24:17.966242+0000","last_undegraded":"2024-04-25T19:24:17.966242+0000","last_fullsized":"2024-04-25T19:24:17.966242+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:02.942885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.967539+0000","last_change":"2024-04-25T19:24:16.207645+0000","last_active":"2024-04-25T19:24:17.967539+0000","last_peered":"2024-04-25T19:24:17.967539+0000","last_clean":"2024-04-25T19:24:17.967539+0000","last_became_active":"2024-04-25T19:24:16.207113+0000","last_became_peered":"2024-04-25T19:24:16.207113+0000","last_unstale":"2024-04-25T19:24:17.967539+0000","last_undegraded":"2024-04-25T19:24:17.967539+0000","last_fullsized":"2024-04-25T19:24:17.967539+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:15.156798+0000","last_clean_scrub_stamp":"2024-04-25T19:24:15.156798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:35.810661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:17.219591+0000","last_change":"2024-04-25T19:24:15.208272+0000","last_active":"2024-04-25T19:24:17.219591+0000","last_peered":"2024-04-25T19:24:17.219591+0000","last_clean":"2024-04-25T19:24:17.219591+0000","last_became_active":"2024-04-25T19:24:15.207916+0000","last_became_peered":"2024-04-25T19:24:15.207916+0000","last_unstale":"2024-04-25T19:24:17.219591+0000","last_undegraded":"2024-04-25T19:24:17.219591+0000","last_fullsized":"2024-04-25T19:24:17.219591+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:24:14.139621+0000","last_clean_scrub_stamp":"2024-04-25T19:24:14.139621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:08.561805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":156,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T19:24:18.135936+0000","last_change":"2024-04-25T19:22:06.081655+0000","last_active":"2024-04-25T19:24:18.135936+0000","last_peered":"2024-04-25T19:24:18.135936+0000","last_clean":"2024-04-25T19:24:18.135936+0000","last_became_active":"2024-04-25T19:22:06.078999+0000","last_became_peered":"2024-04-25T19:22:06.078999+0000","last_unstale":"2024-04-25T19:24:18.135936+0000","last_undegraded":"2024-04-25T19:24:18.135936+0000","last_fullsized":"2024-04-25T19:24:18.135936+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_clean_scrub_stamp":"2024-04-25T19:22:04.921147+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:30.543734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1126400,"data_stored":805573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31704,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":536576,"data_stored":215787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":532480,"data_stored":215185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":540672,"data_stored":216727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":540672,"data_stored":215753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":544768,"data_stored":216749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":532480,"data_stored":215185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1126400,"data_stored":805517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T19:24:21.443 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T19:24:21.443 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T19:24:21.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.768+0000 7f9135800640 1 Processor -- start 2024-04-25T19:24:21.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.769+0000 7f9135800640 1 -- start start 2024-04-25T19:24:21.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.771+0000 7f9135800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9130070630 0x7f91300cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:21.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.771+0000 7f9135800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f913006dce0 0x7f9130160d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:21.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.771+0000 7f9135800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9130071110 con 0x7f913015adf0 2024-04-25T19:24:21.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.771+0000 7f9135800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f91300713f0 con 0x7f9130070630 2024-04-25T19:24:21.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.771+0000 7f9135800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f91300701a0 con 0x7f913006dce0 2024-04-25T19:24:21.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.771+0000 7f912ea00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9130070630 0x7f91300cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:21.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.771+0000 7f912ea00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9130070630 0x7f91300cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:42392/0 (socket says 172.21.15.131:42392) 2024-04-25T19:24:21.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.771+0000 7f912ea00640 1 -- 172.21.15.131:0/3356249893 learned_addr learned my addr 172.21.15.131:0/3356249893 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:21.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.772+0000 7f912f400640 1 --2- 172.21.15.131:0/3356249893 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f913006dce0 0x7f9130160d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:21.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.772+0000 7f912ea00640 1 -- 172.21.15.131:0/3356249893 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f913006dce0 msgr2=0x7f9130160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:21.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.772+0000 7f912ea00640 1 --2- 172.21.15.131:0/3356249893 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f913006dce0 0x7f9130160d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:21.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.772+0000 7f912ea00640 1 -- 172.21.15.131:0/3356249893 >> v1:172.21.15.195:6789/0 conn(0x7f913015adf0 legacy=0x7f913006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:21.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.772+0000 7f912ea00640 1 -- 172.21.15.131:0/3356249893 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f913006fb50 con 0x7f9130070630 2024-04-25T19:24:21.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.772+0000 7f912f400640 1 --2- 172.21.15.131:0/3356249893 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f913006dce0 0x7f9130160d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:24:21.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.773+0000 7f912ea00640 1 --2- 172.21.15.131:0/3356249893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9130070630 0x7f91300cec50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f912000d150 tx=0x7f912002c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba151158922e27d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:21.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.773+0000 7f912d600640 1 -- 172.21.15.131:0/3356249893 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9120039070 con 0x7f9130070630 2024-04-25T19:24:21.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.773+0000 7f912d600640 1 -- 172.21.15.131:0/3356249893 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9120009600 con 0x7f9130070630 2024-04-25T19:24:21.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.773+0000 7f912d600640 1 -- 172.21.15.131:0/3356249893 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91200099d0 con 0x7f9130070630 2024-04-25T19:24:21.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.774+0000 7f9135800640 1 -- 172.21.15.131:0/3356249893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9130070630 msgr2=0x7f91300cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:21.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.774+0000 7f9135800640 1 --2- 172.21.15.131:0/3356249893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9130070630 0x7f91300cec50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f912000d150 tx=0x7f912002c840 comp rx=0 tx=0).stop 2024-04-25T19:24:21.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.774+0000 7f9135800640 1 -- 172.21.15.131:0/3356249893 shutdown_connections 2024-04-25T19:24:21.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.774+0000 7f9135800640 1 --2- 172.21.15.131:0/3356249893 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f913006dce0 0x7f9130160d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:21.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.774+0000 7f9135800640 1 --2- 172.21.15.131:0/3356249893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9130070630 0x7f91300cec50 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:21.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.774+0000 7f9135800640 1 -- 172.21.15.131:0/3356249893 >> 172.21.15.131:0/3356249893 conn(0x7f9130073090 msgr2=0x7f91300734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:21.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.774+0000 7f9135800640 1 -- 172.21.15.131:0/3356249893 shutdown_connections 2024-04-25T19:24:21.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.774+0000 7f9135800640 1 -- 172.21.15.131:0/3356249893 wait complete. 2024-04-25T19:24:21.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.777+0000 7f9135800640 1 Processor -- start 2024-04-25T19:24:21.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.777+0000 7f9135800640 1 -- start start 2024-04-25T19:24:21.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.778+0000 7f9135800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9130070630 0x7f913014a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:21.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.778+0000 7f9135800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f913015adf0 0x7f913015e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:21.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.778+0000 7f9135800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f913015e9d0 0x7f913006cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:21.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.778+0000 7f9135800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f91300b0e80 con 0x7f9130070630 2024-04-25T19:24:21.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.778+0000 7f9135800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f91300b0d00 con 0x7f913015adf0 2024-04-25T19:24:21.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.778+0000 7f9135800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9130070c80 con 0x7f913015e9d0 2024-04-25T19:24:21.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.779+0000 7f912ea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9130070630 0x7f913014a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:21.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.779+0000 7f912ea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9130070630 0x7f913014a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:42402/0 (socket says 172.21.15.131:42402) 2024-04-25T19:24:21.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.779+0000 7f912ea00640 1 -- 172.21.15.131:0/1599638037 learned_addr learned my addr 172.21.15.131:0/1599638037 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:21.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.779+0000 7f912ea00640 1 -- 172.21.15.131:0/1599638037 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f913015e9d0 msgr2=0x7f913006cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:21.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.779+0000 7f912ea00640 1 --2- 172.21.15.131:0/1599638037 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f913015e9d0 0x7f913006cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:21.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.779+0000 7f912ea00640 1 -- 172.21.15.131:0/1599638037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f913015adf0 msgr2=0x7f913015e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:21.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.779+0000 7f912e000640 1 --2- 172.21.15.131:0/1599638037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f913015adf0 0x7f913015e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:21.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.779+0000 7f912ea00640 1 --2- 172.21.15.131:0/1599638037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f913015adf0 0x7f913015e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:21.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.779+0000 7f912ea00640 1 -- 172.21.15.131:0/1599638037 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91300b5fa0 con 0x7f9130070630 2024-04-25T19:24:21.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.779+0000 7f912e000640 1 --2- 172.21.15.131:0/1599638037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f913015adf0 0x7f913015e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:24:21.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.780+0000 7f912ea00640 1 --2- 172.21.15.131:0/1599638037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9130070630 0x7f913014a550 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f912000d270 tx=0x7f9120004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:21.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.780+0000 7f9126a00640 1 -- 172.21.15.131:0/1599638037 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9120039040 con 0x7f9130070630 2024-04-25T19:24:21.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.780+0000 7f9126a00640 1 -- 172.21.15.131:0/1599638037 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9120009370 con 0x7f9130070630 2024-04-25T19:24:21.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.780+0000 7f9126a00640 1 -- 172.21.15.131:0/1599638037 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912003f8b0 con 0x7f9130070630 2024-04-25T19:24:21.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.780+0000 7f9135800640 1 -- 172.21.15.131:0/1599638037 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91300b4a00 con 0x7f9130070630 2024-04-25T19:24:21.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.780+0000 7f9135800640 1 -- 172.21.15.131:0/1599638037 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91300b51e0 con 0x7f9130070630 2024-04-25T19:24:21.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.781+0000 7f9135800640 1 -- 172.21.15.131:0/1599638037 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9130050740 con 0x7f9130070630 2024-04-25T19:24:21.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.782+0000 7f9126a00640 1 -- 172.21.15.131:0/1599638037 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f912003fa50 con 0x7f9130070630 2024-04-25T19:24:21.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.783+0000 7f9126a00640 1 --2- 172.21.15.131:0/1599638037 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f910c0744b0 0x7f910c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:21.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.784+0000 7f9126a00640 1 -- 172.21.15.131:0/1599638037 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f91200b5e60 con 0x7f9130070630 2024-04-25T19:24:21.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.784+0000 7f912e000640 1 --2- 172.21.15.131:0/1599638037 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f910c0744b0 0x7f910c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:21.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.785+0000 7f912e000640 1 --2- 172.21.15.131:0/1599638037 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f910c0744b0 0x7f910c0769c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f91300d14c0 tx=0x7f9118008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:21.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:21.789+0000 7f9126a00640 1 -- 172.21.15.131:0/1599638037 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9120031070 con 0x7f9130070630 2024-04-25T19:24:22.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.059+0000 7f9135800640 1 -- 172.21.15.131:0/1599638037 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f913006c6f0 con 0x7f9130070630 2024-04-25T19:24:22.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.065+0000 7f9126a00640 1 -- 172.21.15.131:0/1599638037 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f9120080710 con 0x7f9130070630 2024-04-25T19:24:22.067 INFO:teuthology.orchestra.run.smithi131.stdout:[client.0] 2024-04-25T19:24:22.067 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAnrSpmvjE7CxAABw7VdVfflQSjatWfjdHUXQ== 2024-04-25T19:24:22.067 INFO:teuthology.orchestra.run.smithi131.stdout: caps mds = "allow" 2024-04-25T19:24:22.067 INFO:teuthology.orchestra.run.smithi131.stdout: caps mon = "allow r" 2024-04-25T19:24:22.067 INFO:teuthology.orchestra.run.smithi131.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T19:24:22.067 INFO:teuthology.orchestra.run.smithi131.stderr:updated caps for client.0 2024-04-25T19:24:22.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.068+0000 7f9135800640 1 -- 172.21.15.131:0/1599638037 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f910c0744b0 msgr2=0x7f910c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:22.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.068+0000 7f9135800640 1 --2- 172.21.15.131:0/1599638037 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f910c0744b0 0x7f910c0769c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f91300d14c0 tx=0x7f9118008040 comp rx=0 tx=0).stop 2024-04-25T19:24:22.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.068+0000 7f9135800640 1 -- 172.21.15.131:0/1599638037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9130070630 msgr2=0x7f913014a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:22.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.068+0000 7f9135800640 1 --2- 172.21.15.131:0/1599638037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9130070630 0x7f913014a550 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f912000d270 tx=0x7f9120004a40 comp rx=0 tx=0).stop 2024-04-25T19:24:22.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.068+0000 7f9135800640 1 -- 172.21.15.131:0/1599638037 shutdown_connections 2024-04-25T19:24:22.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.068+0000 7f9135800640 1 --2- 172.21.15.131:0/1599638037 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f910c0744b0 0x7f910c0769c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:22.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.068+0000 7f9135800640 1 --2- 172.21.15.131:0/1599638037 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f913015e9d0 0x7f913006cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:22.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.068+0000 7f9135800640 1 --2- 172.21.15.131:0/1599638037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f913015adf0 0x7f913015e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:22.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.068+0000 7f9135800640 1 --2- 172.21.15.131:0/1599638037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9130070630 0x7f913014a550 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:22.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.068+0000 7f9135800640 1 -- 172.21.15.131:0/1599638037 >> 172.21.15.131:0/1599638037 conn(0x7f9130073090 msgr2=0x7f9130155160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:22.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.068+0000 7f9135800640 1 -- 172.21.15.131:0/1599638037 shutdown_connections 2024-04-25T19:24:22.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.068+0000 7f9135800640 1 -- 172.21.15.131:0/1599638037 wait complete. 2024-04-25T19:24:22.096 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:24:22.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.365+0000 7f505fe00640 1 Processor -- start 2024-04-25T19:24:22.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.365+0000 7f505fe00640 1 -- start start 2024-04-25T19:24:22.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.367+0000 7f505fe00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f506006c5c0 0x7f50600cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:22.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.368+0000 7f505fe00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50600d1230 con 0x7f50600b4ea0 2024-04-25T19:24:22.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.368+0000 7f505fe00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50600d06b0 con 0x7f5060144370 2024-04-25T19:24:22.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.368+0000 7f505fe00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f50600d0990 con 0x7f506006c5c0 2024-04-25T19:24:22.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.368+0000 7f505f400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f50600b4ea0 0x7f506015e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:40768/0 (socket says 172.21.15.131:40768) 2024-04-25T19:24:22.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.368+0000 7f505f400640 1 -- 172.21.15.131:0/4025702574 learned_addr learned my addr 172.21.15.131:0/4025702574 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:24:22.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.368+0000 7f505ea00640 1 --2- 172.21.15.131:0/4025702574 >> v2:172.21.15.195:3300/0 conn(0x7f506006c5c0 0x7f50600cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:22.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.368+0000 7f505d600640 1 -- 172.21.15.131:0/4025702574 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1753788370 0 0) 0x7f50600d1230 con 0x7f50600b4ea0 2024-04-25T19:24:22.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.368+0000 7f505d600640 1 -- 172.21.15.131:0/4025702574 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5044003520 con 0x7f50600b4ea0 2024-04-25T19:24:22.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.369+0000 7f505d600640 1 -- 172.21.15.131:0/4025702574 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2979918068 0 0) 0x7f5044003520 con 0x7f50600b4ea0 2024-04-25T19:24:22.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.369+0000 7f505d600640 1 -- 172.21.15.131:0/4025702574 >> v2:172.21.15.195:3300/0 conn(0x7f506006c5c0 msgr2=0x7f50600cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:22.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.369+0000 7f505d600640 1 --2- 172.21.15.131:0/4025702574 >> v2:172.21.15.195:3300/0 conn(0x7f506006c5c0 0x7f50600cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:22.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.369+0000 7f505d600640 1 -- 172.21.15.131:0/4025702574 >> v1:172.21.15.195:6789/0 conn(0x7f5060144370 legacy=0x7f50600b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:22.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.369+0000 7f505d600640 1 -- 172.21.15.131:0/4025702574 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50600d0c70 con 0x7f50600b4ea0 2024-04-25T19:24:22.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.369+0000 7f505d600640 1 -- 172.21.15.131:0/4025702574 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f50580019f0 con 0x7f50600b4ea0 2024-04-25T19:24:22.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.369+0000 7f505d600640 1 -- 172.21.15.131:0/4025702574 >> v1:172.21.15.131:6789/0 conn(0x7f50600b4ea0 legacy=0x7f506015e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:22.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.369+0000 7f505d600640 1 --2- 172.21.15.131:0/4025702574 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5044003a00 0x7f5044003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:22.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.369+0000 7f505d600640 1 --2- 172.21.15.131:0/4025702574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5044004800 0x7f5044004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:22.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.369+0000 7f505d600640 1 --2- 172.21.15.131:0/4025702574 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5044005270 0x7f504400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:22.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.369+0000 7f505d600640 1 -- 172.21.15.131:0/4025702574 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f50600d0990 con 0x7f5044004800 2024-04-25T19:24:22.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.369+0000 7f505d600640 1 -- 172.21.15.131:0/4025702574 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f504400c190 con 0x7f5044003a00 2024-04-25T19:24:22.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.369+0000 7f505d600640 1 -- 172.21.15.131:0/4025702574 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f504400c390 con 0x7f5044005270 2024-04-25T19:24:22.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.369+0000 7f505e000640 1 --2- 172.21.15.131:0/4025702574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5044004800 0x7f5044004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:22.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.370+0000 7f505ea00640 1 --2- 172.21.15.131:0/4025702574 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5044003a00 0x7f5044003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:22.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.370+0000 7f505f400640 1 --2- 172.21.15.131:0/4025702574 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5044005270 0x7f504400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:22.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.370+0000 7f505e000640 1 -- 172.21.15.131:0/4025702574 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5044005270 msgr2=0x7f504400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:22.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.370+0000 7f505e000640 1 --2- 172.21.15.131:0/4025702574 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5044005270 0x7f504400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:22.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.370+0000 7f505e000640 1 -- 172.21.15.131:0/4025702574 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5044003a00 msgr2=0x7f5044003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:22.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.370+0000 7f505e000640 1 --2- 172.21.15.131:0/4025702574 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5044003a00 0x7f5044003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:22.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.370+0000 7f505e000640 1 -- 172.21.15.131:0/4025702574 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5044003520 con 0x7f5044004800 2024-04-25T19:24:22.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.370+0000 7f505f400640 1 -- 172.21.15.131:0/4025702574 reap_dead start 2024-04-25T19:24:22.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.370+0000 7f505ea00640 1 --2- 172.21.15.131:0/4025702574 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5044003a00 0x7f5044003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T19:24:22.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.371+0000 7f505e000640 1 --2- 172.21.15.131:0/4025702574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5044004800 0x7f5044004c10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5048001750 tx=0x7f5044005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a691bb9ab92f0fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:22.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.371+0000 7f505d600640 1 -- 172.21.15.131:0/4025702574 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048001370 con 0x7f5044004800 2024-04-25T19:24:22.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.371+0000 7f505d600640 1 -- 172.21.15.131:0/4025702574 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50480052d0 con 0x7f5044004800 2024-04-25T19:24:22.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.371+0000 7f505d600640 1 -- 172.21.15.131:0/4025702574 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504802abe0 con 0x7f5044004800 2024-04-25T19:24:22.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.372+0000 7f505fe00640 1 -- 172.21.15.131:0/4025702574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5044004800 msgr2=0x7f5044004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:22.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.372+0000 7f505fe00640 1 --2- 172.21.15.131:0/4025702574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5044004800 0x7f5044004c10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5048001750 tx=0x7f5044005830 comp rx=0 tx=0).stop 2024-04-25T19:24:22.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.372+0000 7f505fe00640 1 -- 172.21.15.131:0/4025702574 shutdown_connections 2024-04-25T19:24:22.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.372+0000 7f505fe00640 1 --2- 172.21.15.131:0/4025702574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5044004800 0x7f5044004c10 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:22.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.372+0000 7f505fe00640 1 -- 172.21.15.131:0/4025702574 >> 172.21.15.131:0/4025702574 conn(0x7f50600d1720 msgr2=0x7f50600d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:22.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.372+0000 7f505fe00640 1 -- 172.21.15.131:0/4025702574 shutdown_connections 2024-04-25T19:24:22.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.372+0000 7f505fe00640 1 -- 172.21.15.131:0/4025702574 wait complete. 2024-04-25T19:24:22.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.375+0000 7f505fe00640 1 Processor -- start 2024-04-25T19:24:22.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.375+0000 7f505fe00640 1 -- start start 2024-04-25T19:24:22.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.376+0000 7f505fe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5044004800 0x7f5060155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:22.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.376+0000 7f505fe00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5060153190 0x7f5060142e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:22.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.376+0000 7f505fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50601535a0 0x7f5060070500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:22.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.376+0000 7f505fe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f50600d0450 con 0x7f50601535a0 2024-04-25T19:24:22.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.376+0000 7f505fe00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f50600d02d0 con 0x7f5060153190 2024-04-25T19:24:22.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.376+0000 7f505fe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5060147760 con 0x7f5044004800 2024-04-25T19:24:22.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.377+0000 7f505f400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50601535a0 0x7f5060070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:22.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.377+0000 7f505f400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50601535a0 0x7f5060070500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:42424/0 (socket says 172.21.15.131:42424) 2024-04-25T19:24:22.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.377+0000 7f505f400640 1 -- 172.21.15.131:0/2479408951 learned_addr learned my addr 172.21.15.131:0/2479408951 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:22.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.377+0000 7f505e000640 1 --2- 172.21.15.131:0/2479408951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5060153190 0x7f5060142e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:22.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.377+0000 7f505f400640 1 -- 172.21.15.131:0/2479408951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5044004800 msgr2=0x7f5060155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:22.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.377+0000 7f505f400640 1 --2- 172.21.15.131:0/2479408951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5044004800 0x7f5060155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:22.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.377+0000 7f505f400640 1 -- 172.21.15.131:0/2479408951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5060153190 msgr2=0x7f5060142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:22.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.377+0000 7f505f400640 1 --2- 172.21.15.131:0/2479408951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5060153190 0x7f5060142e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:22.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.377+0000 7f505f400640 1 -- 172.21.15.131:0/2479408951 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5060162650 con 0x7f50601535a0 2024-04-25T19:24:22.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.377+0000 7f505e000640 1 --2- 172.21.15.131:0/2479408951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5060153190 0x7f5060142e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:24:22.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.377+0000 7f505f400640 1 --2- 172.21.15.131:0/2479408951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50601535a0 0x7f5060070500 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f50600b6bf0 tx=0x7f505800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:22.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.378+0000 7f5057400640 1 -- 172.21.15.131:0/2479408951 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505800ec10 con 0x7f50601535a0 2024-04-25T19:24:22.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.378+0000 7f5057400640 1 -- 172.21.15.131:0/2479408951 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5058018070 con 0x7f50601535a0 2024-04-25T19:24:22.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.378+0000 7f5057400640 1 -- 172.21.15.131:0/2479408951 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5058013420 con 0x7f50601535a0 2024-04-25T19:24:22.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.378+0000 7f505fe00640 1 -- 172.21.15.131:0/2479408951 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f506006f460 con 0x7f50601535a0 2024-04-25T19:24:22.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.378+0000 7f505fe00640 1 -- 172.21.15.131:0/2479408951 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f506006fa20 con 0x7f50601535a0 2024-04-25T19:24:22.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.379+0000 7f505fe00640 1 -- 172.21.15.131:0/2479408951 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5060050740 con 0x7f50601535a0 2024-04-25T19:24:22.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.380+0000 7f5057400640 1 -- 172.21.15.131:0/2479408951 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f50580135c0 con 0x7f50601535a0 2024-04-25T19:24:22.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.381+0000 7f5057400640 1 --2- 172.21.15.131:0/2479408951 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f503c0744b0 0x7f503c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:22.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.382+0000 7f5057400640 1 -- 172.21.15.131:0/2479408951 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f5058095680 con 0x7f50601535a0 2024-04-25T19:24:22.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.382+0000 7f505ea00640 1 --2- 172.21.15.131:0/2479408951 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f503c0744b0 0x7f503c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:22.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.383+0000 7f505ea00640 1 --2- 172.21.15.131:0/2479408951 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f503c0744b0 0x7f503c0769c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f506006bc20 tx=0x7f5050008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:22.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.386+0000 7f5057400640 1 -- 172.21.15.131:0/2479408951 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f505805fd70 con 0x7f50601535a0 2024-04-25T19:24:22.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.624+0000 7f505fe00640 1 -- 172.21.15.131:0/2479408951 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f506015bae0 con 0x7f50601535a0 2024-04-25T19:24:22.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.626+0000 7f5057400640 1 -- 172.21.15.131:0/2479408951 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5190 (secure 0 0 0) 0x7f505805f670 con 0x7f50601535a0 2024-04-25T19:24:22.628 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:24:22.628 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4706,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3512447940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":3512447940},{"type":"v1","addr":"172.21.15.195:6837","nonce":3512447940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2666088311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":2666088311},{"type":"v1","addr":"172.21.15.195:6836","nonce":2666088311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1450320216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1450320216},{"type":"v1","addr":"172.21.15.131:6834","nonce":1450320216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T19:24:15.727328+0000","modified":"2024-04-25T19:24:18.791952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/274211686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":274211686},{"type":"v1","addr":"172.21.15.131:6835","nonce":274211686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5481,"qdb_cluster":[5481]},"id":3}]} 2024-04-25T19:24:22.628 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 25 2024-04-25T19:24:22.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.629+0000 7f505fe00640 1 -- 172.21.15.131:0/2479408951 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f503c0744b0 msgr2=0x7f503c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:22.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.629+0000 7f505fe00640 1 --2- 172.21.15.131:0/2479408951 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f503c0744b0 0x7f503c0769c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f506006bc20 tx=0x7f5050008040 comp rx=0 tx=0).stop 2024-04-25T19:24:22.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.629+0000 7f505fe00640 1 -- 172.21.15.131:0/2479408951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50601535a0 msgr2=0x7f5060070500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:22.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.629+0000 7f505fe00640 1 --2- 172.21.15.131:0/2479408951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50601535a0 0x7f5060070500 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f50600b6bf0 tx=0x7f505800e530 comp rx=0 tx=0).stop 2024-04-25T19:24:22.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.629+0000 7f505fe00640 1 -- 172.21.15.131:0/2479408951 shutdown_connections 2024-04-25T19:24:22.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.629+0000 7f505fe00640 1 --2- 172.21.15.131:0/2479408951 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f503c0744b0 0x7f503c0769c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:22.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.629+0000 7f505fe00640 1 --2- 172.21.15.131:0/2479408951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50601535a0 0x7f5060070500 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:22.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.629+0000 7f505fe00640 1 --2- 172.21.15.131:0/2479408951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5060153190 0x7f5060142e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:22.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.629+0000 7f505fe00640 1 --2- 172.21.15.131:0/2479408951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5044004800 0x7f5060155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:22.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.629+0000 7f505fe00640 1 -- 172.21.15.131:0/2479408951 >> 172.21.15.131:0/2479408951 conn(0x7f50600d1720 msgr2=0x7f5060144d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:22.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.629+0000 7f505fe00640 1 -- 172.21.15.131:0/2479408951 shutdown_connections 2024-04-25T19:24:22.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:22.629+0000 7f505fe00640 1 -- 172.21.15.131:0/2479408951 wait complete. 2024-04-25T19:24:23.063 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T19:24:15.727328+0000', 'modified': '2024-04-25T19:24:18.791952+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5481}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5481': {'gid': 5481, 'name': 'c', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.131:6835/274211686', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6833', 'nonce': 274211686}, {'type': 'v1', 'addr': '172.21.15.131:6835', 'nonce': 274211686}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5481, 'qdb_cluster': [5481]} 2024-04-25T19:24:23.063 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T19:24:23.063 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T19:24:23.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.342+0000 7f4afc000640 1 Processor -- start 2024-04-25T19:24:23.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.342+0000 7f4afc000640 1 -- start start 2024-04-25T19:24:23.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.344+0000 7f4afc000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4af41443c0 0x7f4af406fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.344+0000 7f4afc000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4af40cfcf0 0x7f4af406c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.344+0000 7f4afc000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4af415f5f0 con 0x7f4af4070370 2024-04-25T19:24:23.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.344+0000 7f4afc000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4af40708d0 con 0x7f4af41443c0 2024-04-25T19:24:23.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.344+0000 7f4afc000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4af415f160 con 0x7f4af40cfcf0 2024-04-25T19:24:23.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.345+0000 7f4af8c00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f4af4070370 0x7f4af40cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:40780/0 (socket says 172.21.15.131:40780) 2024-04-25T19:24:23.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.345+0000 7f4af8c00640 1 -- 172.21.15.131:0/801680656 learned_addr learned my addr 172.21.15.131:0/801680656 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:24:23.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.345+0000 7f4af9600640 1 --2- 172.21.15.131:0/801680656 >> v2:172.21.15.195:3300/0 conn(0x7f4af41443c0 0x7f4af406fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:23.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.345+0000 7f4afa000640 1 --2- 172.21.15.131:0/801680656 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4af40cfcf0 0x7f4af406c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:23.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.345+0000 7f4af3e00640 1 -- 172.21.15.131:0/801680656 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3832767885 0 0) 0x7f4af415f5f0 con 0x7f4af4070370 2024-04-25T19:24:23.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.345+0000 7f4af3e00640 1 -- 172.21.15.131:0/801680656 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4adc003520 con 0x7f4af4070370 2024-04-25T19:24:23.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.345+0000 7f4af3e00640 1 -- 172.21.15.131:0/801680656 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4138712429 0 0) 0x7f4adc003520 con 0x7f4af4070370 2024-04-25T19:24:23.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.345+0000 7f4af3e00640 1 -- 172.21.15.131:0/801680656 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4af40cfcf0 msgr2=0x7f4af406c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:23.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.346+0000 7f4af3e00640 1 --2- 172.21.15.131:0/801680656 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4af40cfcf0 0x7f4af406c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.346+0000 7f4af3e00640 1 -- 172.21.15.131:0/801680656 >> v2:172.21.15.195:3300/0 conn(0x7f4af41443c0 msgr2=0x7f4af406fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:23.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.346+0000 7f4af3e00640 1 --2- 172.21.15.131:0/801680656 >> v2:172.21.15.195:3300/0 conn(0x7f4af41443c0 0x7f4af406fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.346+0000 7f4af3e00640 1 -- 172.21.15.131:0/801680656 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af415e830 con 0x7f4af4070370 2024-04-25T19:24:23.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.346+0000 7f4af3e00640 1 -- 172.21.15.131:0/801680656 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f4ae0001670 con 0x7f4af4070370 2024-04-25T19:24:23.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.346+0000 7f4af3e00640 1 -- 172.21.15.131:0/801680656 >> v1:172.21.15.131:6789/0 conn(0x7f4af4070370 legacy=0x7f4af40cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:23.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.346+0000 7f4af3e00640 1 --2- 172.21.15.131:0/801680656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4adc0039b0 0x7f4adc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.346+0000 7f4af3e00640 1 --2- 172.21.15.131:0/801680656 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4adc004800 0x7f4adc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.346+0000 7f4af3e00640 1 --2- 172.21.15.131:0/801680656 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4adc005150 0x7f4adc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.346+0000 7f4af3e00640 1 -- 172.21.15.131:0/801680656 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4af40708d0 con 0x7f4adc0039b0 2024-04-25T19:24:23.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.346+0000 7f4af3e00640 1 -- 172.21.15.131:0/801680656 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4af415f160 con 0x7f4adc005150 2024-04-25T19:24:23.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.346+0000 7f4af3e00640 1 -- 172.21.15.131:0/801680656 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4adc00bf00 con 0x7f4adc004800 2024-04-25T19:24:23.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.346+0000 7f4af9600640 1 --2- 172.21.15.131:0/801680656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4adc0039b0 0x7f4adc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:23.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.346+0000 7f4af8c00640 1 --2- 172.21.15.131:0/801680656 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4adc004800 0x7f4adc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:23.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.346+0000 7f4af9600640 1 -- 172.21.15.131:0/801680656 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4adc004800 msgr2=0x7f4adc004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:23.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.347+0000 7f4af9600640 1 --2- 172.21.15.131:0/801680656 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4adc004800 0x7f4adc004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.347+0000 7f4afa000640 1 --2- 172.21.15.131:0/801680656 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4adc005150 0x7f4adc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:23.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.347+0000 7f4af9600640 1 -- 172.21.15.131:0/801680656 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4adc005150 msgr2=0x7f4adc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:23.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.347+0000 7f4af9600640 1 --2- 172.21.15.131:0/801680656 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4adc005150 0x7f4adc00b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.347+0000 7f4af9600640 1 -- 172.21.15.131:0/801680656 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4adc003520 con 0x7f4adc0039b0 2024-04-25T19:24:23.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.347+0000 7f4af8c00640 1 --2- 172.21.15.131:0/801680656 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4adc004800 0x7f4adc004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:24:23.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.348+0000 7f4af9600640 1 --2- 172.21.15.131:0/801680656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4adc0039b0 0x7f4adc003e20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8009a90 tx=0x7f4adc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3037d1b50072f214 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:23.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.348+0000 7f4af3e00640 1 -- 172.21.15.131:0/801680656 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8036070 con 0x7f4adc0039b0 2024-04-25T19:24:23.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.348+0000 7f4af3e00640 1 -- 172.21.15.131:0/801680656 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae8031400 con 0x7f4adc0039b0 2024-04-25T19:24:23.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.348+0000 7f4af3e00640 1 -- 172.21.15.131:0/801680656 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8009690 con 0x7f4adc0039b0 2024-04-25T19:24:23.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.349+0000 7f4afc000640 1 -- 172.21.15.131:0/801680656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4adc0039b0 msgr2=0x7f4adc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:23.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.349+0000 7f4afc000640 1 --2- 172.21.15.131:0/801680656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4adc0039b0 0x7f4adc003e20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8009a90 tx=0x7f4adc005830 comp rx=0 tx=0).stop 2024-04-25T19:24:23.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.349+0000 7f4afa000640 1 -- 172.21.15.131:0/801680656 reap_dead start 2024-04-25T19:24:23.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.349+0000 7f4afc000640 1 -- 172.21.15.131:0/801680656 shutdown_connections 2024-04-25T19:24:23.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.349+0000 7f4afc000640 1 -- 172.21.15.131:0/801680656 >> 172.21.15.131:0/801680656 conn(0x7f4af40d1ae0 msgr2=0x7f4af40d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:23.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.349+0000 7f4afc000640 1 -- 172.21.15.131:0/801680656 shutdown_connections 2024-04-25T19:24:23.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.349+0000 7f4afc000640 1 -- 172.21.15.131:0/801680656 wait complete. 2024-04-25T19:24:23.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.351+0000 7f4afc000640 1 Processor -- start 2024-04-25T19:24:23.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.351+0000 7f4afc000640 1 -- start start 2024-04-25T19:24:23.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.353+0000 7f4afc000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4adc0039b0 0x7f4af413eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.353+0000 7f4afc000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4af4155e50 0x7f4af4158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.353+0000 7f4afc000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4af4159330 0x7f4af4141b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.353+0000 7f4afc000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4af41447d0 con 0x7f4af4159330 2024-04-25T19:24:23.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.353+0000 7f4afc000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4af415edf0 con 0x7f4adc0039b0 2024-04-25T19:24:23.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.353+0000 7f4afc000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4af4162b00 con 0x7f4af4155e50 2024-04-25T19:24:23.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.353+0000 7f4afa000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4af4159330 0x7f4af4141b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:23.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.353+0000 7f4afa000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4af4159330 0x7f4af4141b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:42432/0 (socket says 172.21.15.131:42432) 2024-04-25T19:24:23.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.353+0000 7f4afa000640 1 -- 172.21.15.131:0/278040823 learned_addr learned my addr 172.21.15.131:0/278040823 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:23.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.353+0000 7f4af9600640 1 --2- 172.21.15.131:0/278040823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4adc0039b0 0x7f4af413eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:23.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.354+0000 7f4af8c00640 1 --2- 172.21.15.131:0/278040823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4af4155e50 0x7f4af4158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:23.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.354+0000 7f4afa000640 1 -- 172.21.15.131:0/278040823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4af4155e50 msgr2=0x7f4af4158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:23.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.354+0000 7f4afa000640 1 --2- 172.21.15.131:0/278040823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4af4155e50 0x7f4af4158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.354+0000 7f4afa000640 1 -- 172.21.15.131:0/278040823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4adc0039b0 msgr2=0x7f4af413eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:23.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.354+0000 7f4afa000640 1 --2- 172.21.15.131:0/278040823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4adc0039b0 0x7f4af413eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.354+0000 7f4afa000640 1 -- 172.21.15.131:0/278040823 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af4159740 con 0x7f4af4159330 2024-04-25T19:24:23.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.354+0000 7f4afa000640 1 --2- 172.21.15.131:0/278040823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4af4159330 0x7f4af4141b00 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4af406f8f0 tx=0x7f4aec00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:23.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.354+0000 7f4af1600640 1 -- 172.21.15.131:0/278040823 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec01c070 con 0x7f4af4159330 2024-04-25T19:24:23.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.354+0000 7f4af1600640 1 -- 172.21.15.131:0/278040823 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aec017400 con 0x7f4af4159330 2024-04-25T19:24:23.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.354+0000 7f4af1600640 1 -- 172.21.15.131:0/278040823 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0177f0 con 0x7f4af4159330 2024-04-25T19:24:23.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.354+0000 7f4afc000640 1 -- 172.21.15.131:0/278040823 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af413efe0 con 0x7f4af4159330 2024-04-25T19:24:23.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.355+0000 7f4afc000640 1 -- 172.21.15.131:0/278040823 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af413e260 con 0x7f4af4159330 2024-04-25T19:24:23.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.357+0000 7f4af1600640 1 -- 172.21.15.131:0/278040823 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4aec005d10 con 0x7f4af4159330 2024-04-25T19:24:23.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.358+0000 7f4af1600640 1 --2- 172.21.15.131:0/278040823 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f4ad4074450 0x7f4ad4076960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.358+0000 7f4af1600640 1 -- 172.21.15.131:0/278040823 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f4aec0954d0 con 0x7f4af4159330 2024-04-25T19:24:23.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.358+0000 7f4af9600640 1 --2- 172.21.15.131:0/278040823 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f4ad4074450 0x7f4ad4076960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:23.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.359+0000 7f4b0316e740 1 Processor -- start 2024-04-25T19:24:23.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.359+0000 7f4b0316e740 1 -- start start 2024-04-25T19:24:23.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.360+0000 7f4af9600640 1 --2- 172.21.15.131:0/278040823 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f4ad4074450 0x7f4ad4076960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8033000 tx=0x7f4ae8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:23.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.360+0000 7f4b0316e740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f30270 0x5613022fd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.360+0000 7f4b0316e740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561301f073b0 0x561302317d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.360+0000 7f4b0316e740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x561301f0f590 0x5613023182b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.360+0000 7f4b0316e740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x561302236600 con 0x561301f30270 2024-04-25T19:24:23.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.360+0000 7f4b0316e740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5613021d3100 con 0x561301f073b0 2024-04-25T19:24:23.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.360+0000 7f4b0316e740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x5613022325c0 con 0x561301f0f590 2024-04-25T19:24:23.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.361+0000 7f4af9600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f30270 0x5613022fd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:23.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.361+0000 7f4af9600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f30270 0x5613022fd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:42442/0 (socket says 172.21.15.131:42442) 2024-04-25T19:24:23.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.361+0000 7f4af9600640 1 -- 172.21.15.131:0/4227824489 learned_addr learned my addr 172.21.15.131:0/4227824489 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:23.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.361+0000 7f4af8c00640 1 --2- 172.21.15.131:0/4227824489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561301f073b0 0x561302317d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:23.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.361+0000 7f4af9600640 1 -- 172.21.15.131:0/4227824489 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x561301f0f590 msgr2=0x5613023182b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:23.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.361+0000 7f4af9600640 1 --2- 172.21.15.131:0/4227824489 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x561301f0f590 0x5613023182b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.361+0000 7f4af9600640 1 -- 172.21.15.131:0/4227824489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561301f073b0 msgr2=0x561302317d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:23.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.361+0000 7f4af9600640 1 --2- 172.21.15.131:0/4227824489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561301f073b0 0x561302317d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.361+0000 7f4af9600640 1 -- 172.21.15.131:0/4227824489 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561301f482d0 con 0x561301f30270 2024-04-25T19:24:23.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.361+0000 7f4af9600640 1 --2- 172.21.15.131:0/4227824489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f30270 0x5613022fd040 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8009b80 tx=0x7f4ae802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4b411a3c11ce32 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:23.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.362+0000 7f4ae5c00640 1 -- 172.21.15.131:0/4227824489 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8036040 con 0x561301f30270 2024-04-25T19:24:23.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.362+0000 7f4ae5c00640 1 -- 172.21.15.131:0/4227824489 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae804b070 con 0x561301f30270 2024-04-25T19:24:23.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.362+0000 7f4ae5c00640 1 -- 172.21.15.131:0/4227824489 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae803c870 con 0x561301f30270 2024-04-25T19:24:23.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.363+0000 7f4b0316e740 1 -- 172.21.15.131:0/4227824489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f30270 msgr2=0x5613022fd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:23.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.363+0000 7f4b0316e740 1 --2- 172.21.15.131:0/4227824489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f30270 0x5613022fd040 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8009b80 tx=0x7f4ae802e000 comp rx=0 tx=0).stop 2024-04-25T19:24:23.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.363+0000 7f4b0316e740 1 -- 172.21.15.131:0/4227824489 shutdown_connections 2024-04-25T19:24:23.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.363+0000 7f4b0316e740 1 --2- 172.21.15.131:0/4227824489 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x561301f0f590 0x5613023182b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.363+0000 7f4b0316e740 1 --2- 172.21.15.131:0/4227824489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561301f073b0 0x561302317d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.363+0000 7f4b0316e740 1 --2- 172.21.15.131:0/4227824489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f30270 0x5613022fd040 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.363+0000 7f4b0316e740 1 -- 172.21.15.131:0/4227824489 >> 172.21.15.131:0/4227824489 conn(0x561301f243c0 msgr2=0x5613022d26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:23.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.363+0000 7f4b0316e740 1 -- 172.21.15.131:0/4227824489 shutdown_connections 2024-04-25T19:24:23.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.363+0000 7f4b0316e740 1 -- 172.21.15.131:0/4227824489 wait complete. 2024-04-25T19:24:23.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.364+0000 7f4b0316e740 1 -- start start 2024-04-25T19:24:23.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.364+0000 7f4b0316e740 1 Processor -- start 2024-04-25T19:24:23.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.366+0000 7f4b0316e740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x561301f073b0 0x561302314060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.366+0000 7f4b0316e740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f0f590 0x5613022fe9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.366+0000 7f4b0316e740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561301f30270 0x561302312300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.366+0000 7f4b0316e740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5613021bdf70 con 0x561301f0f590 2024-04-25T19:24:23.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.366+0000 7f4b0316e740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5613022ff620 con 0x561301f30270 2024-04-25T19:24:23.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.366+0000 7f4b0316e740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x561302312d70 con 0x561301f073b0 2024-04-25T19:24:23.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.366+0000 7f4b0316e740 10 client.0 _ll_register_callbacks cb 0x56130222c480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T19:24:23.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.366+0000 7f4af8c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f0f590 0x5613022fe9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:23.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.366+0000 7f4af8c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f0f590 0x5613022fe9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:42452/0 (socket says 172.21.15.131:42452) 2024-04-25T19:24:23.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.366+0000 7f4af8c00640 1 -- 172.21.15.131:0/1371905958 learned_addr learned my addr 172.21.15.131:0/1371905958 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:23.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.366+0000 7f4afa000640 1 --2- 172.21.15.131:0/1371905958 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561301f30270 0x561302312300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:23.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.366+0000 7f4af8c00640 1 -- 172.21.15.131:0/1371905958 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x561301f073b0 msgr2=0x561302314060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:23.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.366+0000 7f4af8c00640 1 --2- 172.21.15.131:0/1371905958 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x561301f073b0 0x561302314060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.366+0000 7f4af8c00640 1 -- 172.21.15.131:0/1371905958 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561301f30270 msgr2=0x561302312300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:23.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.366+0000 7f4af8c00640 1 --2- 172.21.15.131:0/1371905958 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561301f30270 0x561302312300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.366+0000 7f4af8c00640 1 -- 172.21.15.131:0/1371905958 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613020126b0 con 0x561301f0f590 2024-04-25T19:24:23.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.367+0000 7f4af8c00640 1 --2- 172.21.15.131:0/1371905958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f0f590 0x5613022fe9e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4af406f410 tx=0x7f4ae000f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85dae545349ae9ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:23.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.367+0000 7f4ada000640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-04-25T19:24:23.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.367+0000 7f4ada000640 1 -- 172.21.15.131:0/1371905958 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae00072e0 con 0x561301f0f590 2024-04-25T19:24:23.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.367+0000 7f4ada000640 1 -- 172.21.15.131:0/1371905958 <== mon.0 v2:172.21.15.131:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f4ae0007480 con 0x561301f0f590 2024-04-25T19:24:23.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.367+0000 7f4b0316e740 1 -- 172.21.15.131:0/1371905958 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ae804b070 con 0x561301f0f590 2024-04-25T19:24:23.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.367+0000 7f4ada000640 1 -- 172.21.15.131:0/1371905958 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4ae00047e0 con 0x561301f0f590 2024-04-25T19:24:23.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.367+0000 7f4b0316e740 10 client.5616 fetch_fsmap learned FSMap version 25 2024-04-25T19:24:23.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.367+0000 7f4b0316e740 1 -- 172.21.15.131:0/1371905958 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x5613022f6cb0 con 0x561301f0f590 2024-04-25T19:24:23.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.367+0000 7f4ada000640 1 -- 172.21.15.131:0/1371905958 <== mon.0 v2:172.21.15.131:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae804b070 con 0x561301f0f590 2024-04-25T19:24:23.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.368+0000 7f4ada000640 1 -- 172.21.15.131:0/1371905958 <== mon.0 v2:172.21.15.131:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7f4ae0004980 con 0x561301f0f590 2024-04-25T19:24:23.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.368+0000 7f4b0316e740 10 client.5616 fetch_fsmap finished waiting for FSMap version 25 2024-04-25T19:24:23.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.368+0000 7f4b0316e740 10 client.5616 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T19:24:23.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.368+0000 7f4b0316e740 20 client.5616 populate_metadata read hostname 'smithi131' 2024-04-25T19:24:23.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.368+0000 7f4b0316e740 1 --2- 172.21.15.131:0/1371905958 >> [v2:172.21.15.131:6833/274211686,v1:172.21.15.131:6835/274211686] conn(0x561301eeee40 0x56130230f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.368+0000 7f4b0316e740 4 client.5616 mds_command: new command op to 5481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T19:24:23.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.368+0000 7f4b0316e740 1 -- 172.21.15.131:0/1371905958 --> [v2:172.21.15.131:6833/274211686,v1:172.21.15.131:6835/274211686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561302244210 con 0x561301eeee40 2024-04-25T19:24:23.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.368+0000 7f4af9600640 1 --2- 172.21.15.131:0/1371905958 >> [v2:172.21.15.131:6833/274211686,v1:172.21.15.131:6835/274211686] conn(0x561301eeee40 0x56130230f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:23.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.369+0000 7f4af9600640 1 --2- 172.21.15.131:0/1371905958 >> [v2:172.21.15.131:6833/274211686,v1:172.21.15.131:6835/274211686] conn(0x561301eeee40 0x56130230f560 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe74c4b64e6e1766 server_cookie=59b208f5880d9a11 in_seq=0 out_seq=0 2024-04-25T19:24:23.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.369+0000 7f4ada000640 10 client.5616 ms_handle_connect on v2:172.21.15.131:6833/274211686 2024-04-25T19:24:23.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.369+0000 7f4ada000640 1 -- 172.21.15.131:0/1371905958 <== mds.0 v2:172.21.15.131:6833/274211686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561302244210 con 0x561301eeee40 2024-04-25T19:24:23.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.369+0000 7f4ada000640 10 client.5616 handle_command_reply: tid=0 2024-04-25T19:24:23.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.370+0000 7f4b0316e740 1 client.5616 shutdown 2024-04-25T19:24:23.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.370+0000 7f4b0316e740 1 -- 172.21.15.131:0/1371905958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f0f590 msgr2=0x5613022fe9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:23.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.370+0000 7f4b0316e740 1 --2- 172.21.15.131:0/1371905958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f0f590 0x5613022fe9e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4af406f410 tx=0x7f4ae000f6c0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.370+0000 7f4b0316e740 1 -- 172.21.15.131:0/1371905958 shutdown_connections 2024-04-25T19:24:23.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.370+0000 7f4b0316e740 1 --2- 172.21.15.131:0/1371905958 >> [v2:172.21.15.131:6833/274211686,v1:172.21.15.131:6835/274211686] conn(0x561301eeee40 0x56130230f560 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.370+0000 7f4b0316e740 1 --2- 172.21.15.131:0/1371905958 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561301f30270 0x561302312300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.370+0000 7f4b0316e740 1 --2- 172.21.15.131:0/1371905958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f0f590 0x5613022fe9e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.370+0000 7f4b0316e740 1 --2- 172.21.15.131:0/1371905958 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x561301f073b0 0x561302314060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.370+0000 7f4ada000640 0 client.5616 ms_handle_reset on v2:172.21.15.131:6833/274211686 2024-04-25T19:24:23.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.370+0000 7f4b0316e740 1 -- 172.21.15.131:0/1371905958 >> 172.21.15.131:0/1371905958 conn(0x561301f243c0 msgr2=0x5613022d26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:23.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.370+0000 7f4b0316e740 1 -- 172.21.15.131:0/1371905958 shutdown_connections 2024-04-25T19:24:23.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.370+0000 7f4b0316e740 1 -- 172.21.15.131:0/1371905958 wait complete. 2024-04-25T19:24:23.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.370+0000 7f4b0316e740 20 client.5616 trim_cache size 0 max 16384 2024-04-25T19:24:23.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.391+0000 7f4b0316e740 1 Processor -- start 2024-04-25T19:24:23.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.391+0000 7f4b0316e740 1 -- start start 2024-04-25T19:24:23.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.392+0000 7f4b0316e740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f073b0 0x561302313f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.392+0000 7f4b0316e740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x561301f0f590 0x5613022d31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.392+0000 7f4b0316e740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561301f30270 0x5613022f92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.392+0000 7f4b0316e740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4af41fdb60 con 0x561301f073b0 2024-04-25T19:24:23.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.392+0000 7f4b0316e740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4af4157dc0 con 0x561301f30270 2024-04-25T19:24:23.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.392+0000 7f4b0316e740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4af41fd6d0 con 0x561301f0f590 2024-04-25T19:24:23.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.393+0000 7f4af9600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f073b0 0x561302313f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:23.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.393+0000 7f4af9600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f073b0 0x561302313f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:42456/0 (socket says 172.21.15.131:42456) 2024-04-25T19:24:23.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.393+0000 7f4af9600640 1 -- 172.21.15.131:0/3993938421 learned_addr learned my addr 172.21.15.131:0/3993938421 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:23.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.393+0000 7f4af9600640 1 -- 172.21.15.131:0/3993938421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x561301f0f590 msgr2=0x5613022d31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:23.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.393+0000 7f4af9600640 1 --2- 172.21.15.131:0/3993938421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x561301f0f590 0x5613022d31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.393+0000 7f4af9600640 1 -- 172.21.15.131:0/3993938421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561301f30270 msgr2=0x5613022f92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:23.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.393+0000 7f4af9600640 1 --2- 172.21.15.131:0/3993938421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561301f30270 0x5613022f92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.393+0000 7f4af9600640 1 -- 172.21.15.131:0/3993938421 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613022ce700 con 0x561301f073b0 2024-04-25T19:24:23.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.393+0000 7f4af9600640 1 --2- 172.21.15.131:0/3993938421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f073b0 0x561302313f40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4ae802abb0 tx=0x7f4ae802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee0f64c0b11bf89 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:23.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.394+0000 7f4ae5200640 1 -- 172.21.15.131:0/3993938421 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8058070 con 0x561301f073b0 2024-04-25T19:24:23.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.394+0000 7f4ae5200640 1 -- 172.21.15.131:0/3993938421 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae804b040 con 0x561301f073b0 2024-04-25T19:24:23.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.394+0000 7f4ae5200640 1 -- 172.21.15.131:0/3993938421 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8036040 con 0x561301f073b0 2024-04-25T19:24:23.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.394+0000 7f4b0316e740 1 -- 172.21.15.131:0/3993938421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f073b0 msgr2=0x561302313f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:23.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.394+0000 7f4b0316e740 1 --2- 172.21.15.131:0/3993938421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f073b0 0x561302313f40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4ae802abb0 tx=0x7f4ae802c000 comp rx=0 tx=0).stop 2024-04-25T19:24:23.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.395+0000 7f4b0316e740 1 -- 172.21.15.131:0/3993938421 shutdown_connections 2024-04-25T19:24:23.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.395+0000 7f4b0316e740 1 --2- 172.21.15.131:0/3993938421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x561301f0f590 0x5613022d31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.395+0000 7f4b0316e740 1 --2- 172.21.15.131:0/3993938421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561301f30270 0x5613022f92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.395+0000 7f4b0316e740 1 --2- 172.21.15.131:0/3993938421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f073b0 0x561302313f40 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.395+0000 7f4b0316e740 1 -- 172.21.15.131:0/3993938421 >> 172.21.15.131:0/3993938421 conn(0x561301f243c0 msgr2=0x5613022cd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:23.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.395+0000 7f4b0316e740 1 -- 172.21.15.131:0/3993938421 shutdown_connections 2024-04-25T19:24:23.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.395+0000 7f4b0316e740 1 -- 172.21.15.131:0/3993938421 wait complete. 2024-04-25T19:24:23.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.396+0000 7f4b0316e740 1 -- start start 2024-04-25T19:24:23.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.396+0000 7f4b0316e740 1 Processor -- start 2024-04-25T19:24:23.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.397+0000 7f4b0316e740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561301f073b0 0x5613022f9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.397+0000 7f4b0316e740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f0f590 0x56130230f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.397+0000 7f4b0316e740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x561301f30270 0x56130230fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.397+0000 7f4b0316e740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5613022ff130 con 0x561301f0f590 2024-04-25T19:24:23.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.397+0000 7f4b0316e740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5613022ff480 con 0x561301f073b0 2024-04-25T19:24:23.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.397+0000 7f4b0316e740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x5613022d1a50 con 0x561301f30270 2024-04-25T19:24:23.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.398+0000 7f4b0316e740 10 client.0 _ll_register_callbacks cb 0x7f4ae0001cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T19:24:23.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.398+0000 7f4af8c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f0f590 0x56130230f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:23.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.398+0000 7f4af8c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f0f590 0x56130230f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:42466/0 (socket says 172.21.15.131:42466) 2024-04-25T19:24:23.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.398+0000 7f4af8c00640 1 -- 172.21.15.131:0/199173599 learned_addr learned my addr 172.21.15.131:0/199173599 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:23.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.398+0000 7f4af9600640 1 --2- 172.21.15.131:0/199173599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561301f073b0 0x5613022f9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:23.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.398+0000 7f4af8c00640 1 -- 172.21.15.131:0/199173599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x561301f30270 msgr2=0x56130230fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:23.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.398+0000 7f4af8c00640 1 --2- 172.21.15.131:0/199173599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x561301f30270 0x56130230fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.398+0000 7f4af8c00640 1 -- 172.21.15.131:0/199173599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561301f073b0 msgr2=0x5613022f9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:23.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.398+0000 7f4af8c00640 1 --2- 172.21.15.131:0/199173599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561301f073b0 0x5613022f9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.398+0000 7f4af8c00640 1 -- 172.21.15.131:0/199173599 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613022fe3a0 con 0x561301f0f590 2024-04-25T19:24:23.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.398+0000 7f4af8c00640 1 --2- 172.21.15.131:0/199173599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f0f590 0x56130230f4c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000f700 tx=0x7f4af415f7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a544ead38a18d25a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:23.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.398+0000 7f4ada000640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-04-25T19:24:23.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.399+0000 7f4ada000640 1 -- 172.21.15.131:0/199173599 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae001e620 con 0x561301f0f590 2024-04-25T19:24:23.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.399+0000 7f4ada000640 1 -- 172.21.15.131:0/199173599 <== mon.0 v2:172.21.15.131:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f4ae001e7c0 con 0x561301f0f590 2024-04-25T19:24:23.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.399+0000 7f4b0316e740 1 -- 172.21.15.131:0/199173599 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ae804b040 con 0x561301f0f590 2024-04-25T19:24:23.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.399+0000 7f4ada000640 1 -- 172.21.15.131:0/199173599 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4ae0034050 con 0x561301f0f590 2024-04-25T19:24:23.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.399+0000 7f4b0316e740 10 client.5622 fetch_fsmap learned FSMap version 25 2024-04-25T19:24:23.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.399+0000 7f4b0316e740 1 -- 172.21.15.131:0/199173599 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x561302300e40 con 0x561301f0f590 2024-04-25T19:24:23.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.399+0000 7f4ada000640 1 -- 172.21.15.131:0/199173599 <== mon.0 v2:172.21.15.131:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae804b040 con 0x561301f0f590 2024-04-25T19:24:23.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.399+0000 7f4ada000640 1 -- 172.21.15.131:0/199173599 <== mon.0 v2:172.21.15.131:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7f4ae0037020 con 0x561301f0f590 2024-04-25T19:24:23.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.399+0000 7f4b0316e740 10 client.5622 fetch_fsmap finished waiting for FSMap version 25 2024-04-25T19:24:23.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.399+0000 7f4b0316e740 10 client.5622 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T19:24:23.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.399+0000 7f4b0316e740 20 client.5622 populate_metadata read hostname 'smithi131' 2024-04-25T19:24:23.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.399+0000 7f4b0316e740 1 --2- 172.21.15.131:0/199173599 >> [v2:172.21.15.131:6833/274211686,v1:172.21.15.131:6835/274211686] conn(0x5613022f4d20 0x5613022f5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.400+0000 7f4b0316e740 4 client.5622 mds_command: new command op to 5481 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T19:24:23.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.400+0000 7f4b0316e740 1 -- 172.21.15.131:0/199173599 --> [v2:172.21.15.131:6833/274211686,v1:172.21.15.131:6835/274211686] -- command(tid 0: {"prefix": "status"}) -- 0x5613022d43b0 con 0x5613022f4d20 2024-04-25T19:24:23.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.400+0000 7f4af9600640 1 --2- 172.21.15.131:0/199173599 >> [v2:172.21.15.131:6833/274211686,v1:172.21.15.131:6835/274211686] conn(0x5613022f4d20 0x5613022f5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:23.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.400+0000 7f4af9600640 1 --2- 172.21.15.131:0/199173599 >> [v2:172.21.15.131:6833/274211686,v1:172.21.15.131:6835/274211686] conn(0x5613022f4d20 0x5613022f5130 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bfbe5007d01df30 server_cookie=22a2a02cbaf9b930 in_seq=0 out_seq=0 2024-04-25T19:24:23.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.400+0000 7f4ada000640 10 client.5622 ms_handle_connect on v2:172.21.15.131:6833/274211686 2024-04-25T19:24:23.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.400+0000 7f4ada000640 1 -- 172.21.15.131:0/199173599 <== mds.0 v2:172.21.15.131:6833/274211686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5613022d43b0 con 0x5613022f4d20 2024-04-25T19:24:23.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.401+0000 7f4ada000640 10 client.5622 handle_command_reply: tid=0 2024-04-25T19:24:23.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.401+0000 7f4b0316e740 1 client.5622 shutdown 2024-04-25T19:24:23.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.401+0000 7f4b0316e740 1 -- 172.21.15.131:0/199173599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f0f590 msgr2=0x56130230f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:23.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.401+0000 7f4b0316e740 1 --2- 172.21.15.131:0/199173599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f0f590 0x56130230f4c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000f700 tx=0x7f4af415f7c0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.401+0000 7f4b0316e740 1 -- 172.21.15.131:0/199173599 shutdown_connections 2024-04-25T19:24:23.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.401+0000 7f4b0316e740 1 --2- 172.21.15.131:0/199173599 >> [v2:172.21.15.131:6833/274211686,v1:172.21.15.131:6835/274211686] conn(0x5613022f4d20 0x5613022f5130 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.401+0000 7f4b0316e740 1 --2- 172.21.15.131:0/199173599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x561301f30270 0x56130230fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.401+0000 7f4b0316e740 1 --2- 172.21.15.131:0/199173599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561301f0f590 0x56130230f4c0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.401+0000 7f4b0316e740 1 --2- 172.21.15.131:0/199173599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561301f073b0 0x5613022f9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.401+0000 7f4ada000640 0 client.5622 ms_handle_reset on v2:172.21.15.131:6833/274211686 2024-04-25T19:24:23.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.401+0000 7f4b0316e740 1 -- 172.21.15.131:0/199173599 >> 172.21.15.131:0/199173599 conn(0x561301f243c0 msgr2=0x5613022d2500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:23.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.401+0000 7f4b0316e740 1 -- 172.21.15.131:0/199173599 shutdown_connections 2024-04-25T19:24:23.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.401+0000 7f4b0316e740 1 -- 172.21.15.131:0/199173599 wait complete. 2024-04-25T19:24:23.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.401+0000 7f4b0316e740 20 client.5622 trim_cache size 0 max 16384 2024-04-25T19:24:23.408 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-25T19:24:23.408 INFO:teuthology.orchestra.run.smithi131.stdout: "cluster_fsid": "4ba607f8-c2c3-4d8d-85a8-7800763c470f", 2024-04-25T19:24:23.408 INFO:teuthology.orchestra.run.smithi131.stdout: "whoami": 0, 2024-04-25T19:24:23.409 INFO:teuthology.orchestra.run.smithi131.stdout: "id": 5481, 2024-04-25T19:24:23.409 INFO:teuthology.orchestra.run.smithi131.stdout: "want_state": "up:active", 2024-04-25T19:24:23.409 INFO:teuthology.orchestra.run.smithi131.stdout: "state": "up:active", 2024-04-25T19:24:23.409 INFO:teuthology.orchestra.run.smithi131.stdout: "fs_name": "cephfs", 2024-04-25T19:24:23.409 INFO:teuthology.orchestra.run.smithi131.stdout: "rank_uptime": 7.2238622719999999, 2024-04-25T19:24:23.409 INFO:teuthology.orchestra.run.smithi131.stdout: "mdsmap_epoch": 25, 2024-04-25T19:24:23.409 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_epoch": 45, 2024-04-25T19:24:23.409 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_epoch_barrier": 45, 2024-04-25T19:24:23.409 INFO:teuthology.orchestra.run.smithi131.stdout: "uptime": 13.447220187999999 2024-04-25T19:24:23.409 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-25T19:24:23.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.402+0000 7f4afc000640 1 -- 172.21.15.131:0/278040823 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f4ad4074450 msgr2=0x7f4ad4076960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:23.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.402+0000 7f4afc000640 1 --2- 172.21.15.131:0/278040823 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f4ad4074450 0x7f4ad4076960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8033000 tx=0x7f4ae8008030 comp rx=0 tx=0).stop 2024-04-25T19:24:23.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.402+0000 7f4afc000640 1 -- 172.21.15.131:0/278040823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4af4159330 msgr2=0x7f4af4141b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:23.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.402+0000 7f4afc000640 1 --2- 172.21.15.131:0/278040823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4af4159330 0x7f4af4141b00 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4af406f8f0 tx=0x7f4aec00f4a0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.402+0000 7f4afc000640 1 -- 172.21.15.131:0/278040823 shutdown_connections 2024-04-25T19:24:23.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.402+0000 7f4afc000640 1 --2- 172.21.15.131:0/278040823 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f4ad4074450 0x7f4ad4076960 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.402+0000 7f4afc000640 1 --2- 172.21.15.131:0/278040823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4af4155e50 0x7f4af4158df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.402+0000 7f4afc000640 1 --2- 172.21.15.131:0/278040823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4af4159330 0x7f4af4141b00 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.402+0000 7f4afc000640 1 --2- 172.21.15.131:0/278040823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4adc0039b0 0x7f4af413eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.402+0000 7f4afc000640 1 -- 172.21.15.131:0/278040823 >> 172.21.15.131:0/278040823 conn(0x7f4af40d1ae0 msgr2=0x7f4af415ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:23.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.402+0000 7f4afc000640 1 -- 172.21.15.131:0/278040823 shutdown_connections 2024-04-25T19:24:23.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.402+0000 7f4afc000640 1 -- 172.21.15.131:0/278040823 wait complete. 2024-04-25T19:24:23.429 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T19:24:23.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.699+0000 7fcb70e00640 1 Processor -- start 2024-04-25T19:24:23.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.700+0000 7fcb70e00640 1 -- start start 2024-04-25T19:24:23.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.702+0000 7fcb70e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcb6c140e00 0x7fcb6c143550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.702+0000 7fcb70e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb6c143a90 0x7fcb6c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.702+0000 7fcb70e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcb6c06db10 0x7fcb6c161a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.702+0000 7fcb70e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fcb6c141b40 con 0x7fcb6c140e00 2024-04-25T19:24:23.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.702+0000 7fcb70e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fcb6c143ea0 con 0x7fcb6c06db10 2024-04-25T19:24:23.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.702+0000 7fcb70e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcb6c06df20 con 0x7fcb6c143a90 2024-04-25T19:24:23.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.703+0000 7fcb6b400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcb6c140e00 0x7fcb6c143550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:23.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.703+0000 7fcb6b400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcb6c140e00 0x7fcb6c143550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:42482/0 (socket says 172.21.15.131:42482) 2024-04-25T19:24:23.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.703+0000 7fcb6b400640 1 -- 172.21.15.131:0/1390525267 learned_addr learned my addr 172.21.15.131:0/1390525267 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:23.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.703+0000 7fcb6be00640 1 --2- 172.21.15.131:0/1390525267 >> v2:172.21.15.195:3300/0 conn(0x7fcb6c06db10 0x7fcb6c161a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:23.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.703+0000 7fcb6aa00640 1 --2- 172.21.15.131:0/1390525267 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb6c143a90 0x7fcb6c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:23.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.703+0000 7fcb6b400640 1 -- 172.21.15.131:0/1390525267 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb6c143a90 msgr2=0x7fcb6c06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:23.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.703+0000 7fcb6b400640 1 --2- 172.21.15.131:0/1390525267 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb6c143a90 0x7fcb6c06d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.703+0000 7fcb6b400640 1 -- 172.21.15.131:0/1390525267 >> v2:172.21.15.195:3300/0 conn(0x7fcb6c06db10 msgr2=0x7fcb6c161a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:24:23.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.703+0000 7fcb6b400640 1 --2- 172.21.15.131:0/1390525267 >> v2:172.21.15.195:3300/0 conn(0x7fcb6c06db10 0x7fcb6c161a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.703+0000 7fcb6b400640 1 -- 172.21.15.131:0/1390525267 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6c141210 con 0x7fcb6c140e00 2024-04-25T19:24:23.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.704+0000 7fcb6b400640 1 --2- 172.21.15.131:0/1390525267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb6c140e00 0x7fcb6c143550 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0b73a0 tx=0x7fcb5c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ca76d63559a4fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:23.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.704+0000 7fcb6a000640 1 -- 172.21.15.131:0/1390525267 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c036070 con 0x7fcb6c140e00 2024-04-25T19:24:23.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.704+0000 7fcb6a000640 1 -- 172.21.15.131:0/1390525267 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb5c031600 con 0x7fcb6c140e00 2024-04-25T19:24:23.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.704+0000 7fcb6a000640 1 -- 172.21.15.131:0/1390525267 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c0319d0 con 0x7fcb6c140e00 2024-04-25T19:24:23.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.705+0000 7fcb70e00640 1 -- 172.21.15.131:0/1390525267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb6c140e00 msgr2=0x7fcb6c143550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:23.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.705+0000 7fcb70e00640 1 --2- 172.21.15.131:0/1390525267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb6c140e00 0x7fcb6c143550 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0b73a0 tx=0x7fcb5c02a6a0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.705+0000 7fcb70e00640 1 -- 172.21.15.131:0/1390525267 shutdown_connections 2024-04-25T19:24:23.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.705+0000 7fcb70e00640 1 --2- 172.21.15.131:0/1390525267 >> v2:172.21.15.195:3300/0 conn(0x7fcb6c06db10 0x7fcb6c161a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.705+0000 7fcb70e00640 1 --2- 172.21.15.131:0/1390525267 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb6c143a90 0x7fcb6c06d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.705+0000 7fcb70e00640 1 --2- 172.21.15.131:0/1390525267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb6c140e00 0x7fcb6c143550 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.705+0000 7fcb70e00640 1 -- 172.21.15.131:0/1390525267 >> 172.21.15.131:0/1390525267 conn(0x7fcb6c072ee0 msgr2=0x7fcb6c0732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:23.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.705+0000 7fcb70e00640 1 -- 172.21.15.131:0/1390525267 shutdown_connections 2024-04-25T19:24:23.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.705+0000 7fcb70e00640 1 -- 172.21.15.131:0/1390525267 wait complete. 2024-04-25T19:24:23.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.708+0000 7fcb70e00640 1 Processor -- start 2024-04-25T19:24:23.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.708+0000 7fcb70e00640 1 -- start start 2024-04-25T19:24:23.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.709+0000 7fcb70e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb6c06db10 0x7fcb6c0b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.710+0000 7fcb70e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb6c140e00 0x7fcb6c0b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.710+0000 7fcb70e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb6c143a90 0x7fcb6c1468a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.710+0000 7fcb70e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c1443d0 con 0x7fcb6c06db10 2024-04-25T19:24:23.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.710+0000 7fcb70e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c1440f0 con 0x7fcb6c140e00 2024-04-25T19:24:23.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.710+0000 7fcb70e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcb6c1417d0 con 0x7fcb6c143a90 2024-04-25T19:24:23.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.710+0000 7fcb6b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb6c06db10 0x7fcb6c0b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:23.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.710+0000 7fcb6b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb6c06db10 0x7fcb6c0b0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:42498/0 (socket says 172.21.15.131:42498) 2024-04-25T19:24:23.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.710+0000 7fcb6b400640 1 -- 172.21.15.131:0/1746752672 learned_addr learned my addr 172.21.15.131:0/1746752672 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:24:23.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.710+0000 7fcb6b400640 1 -- 172.21.15.131:0/1746752672 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb6c143a90 msgr2=0x7fcb6c1468a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:23.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.710+0000 7fcb6b400640 1 --2- 172.21.15.131:0/1746752672 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb6c143a90 0x7fcb6c1468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.710+0000 7fcb6b400640 1 -- 172.21.15.131:0/1746752672 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb6c140e00 msgr2=0x7fcb6c0b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:23.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.710+0000 7fcb6b400640 1 --2- 172.21.15.131:0/1746752672 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb6c140e00 0x7fcb6c0b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.710+0000 7fcb6b400640 1 -- 172.21.15.131:0/1746752672 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6c0b56e0 con 0x7fcb6c06db10 2024-04-25T19:24:23.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.711+0000 7fcb6b400640 1 --2- 172.21.15.131:0/1746752672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb6c06db10 0x7fcb6c0b0b60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c000f80 tx=0x7fcb5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:23.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.711+0000 7fcb63400640 1 -- 172.21.15.131:0/1746752672 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c036050 con 0x7fcb6c06db10 2024-04-25T19:24:23.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.711+0000 7fcb63400640 1 -- 172.21.15.131:0/1746752672 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb5c042070 con 0x7fcb6c06db10 2024-04-25T19:24:23.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.711+0000 7fcb63400640 1 -- 172.21.15.131:0/1746752672 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c009510 con 0x7fcb6c06db10 2024-04-25T19:24:23.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.711+0000 7fcb70e00640 1 -- 172.21.15.131:0/1746752672 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb6c0b59c0 con 0x7fcb6c06db10 2024-04-25T19:24:23.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.711+0000 7fcb70e00640 1 -- 172.21.15.131:0/1746752672 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb6c0b5f80 con 0x7fcb6c06db10 2024-04-25T19:24:23.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.712+0000 7fcb70e00640 1 -- 172.21.15.131:0/1746752672 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb6c050740 con 0x7fcb6c06db10 2024-04-25T19:24:23.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.713+0000 7fcb63400640 1 -- 172.21.15.131:0/1746752672 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fcb5c007c70 con 0x7fcb6c06db10 2024-04-25T19:24:23.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.714+0000 7fcb63400640 1 --2- 172.21.15.131:0/1746752672 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fcb4c0744b0 0x7fcb4c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:24:23.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.715+0000 7fcb63400640 1 -- 172.21.15.131:0/1746752672 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fcb5c0b6140 con 0x7fcb6c06db10 2024-04-25T19:24:23.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.715+0000 7fcb6aa00640 1 --2- 172.21.15.131:0/1746752672 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fcb4c0744b0 0x7fcb4c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:24:23.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.716+0000 7fcb6aa00640 1 --2- 172.21.15.131:0/1746752672 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fcb4c0744b0 0x7fcb4c0769c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcb58006fd0 tx=0x7fcb58008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:24:23.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.719+0000 7fcb63400640 1 -- 172.21.15.131:0/1746752672 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcb5c0808e0 con 0x7fcb6c06db10 2024-04-25T19:24:23.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.954+0000 7fcb70e00640 1 -- 172.21.15.131:0/1746752672 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcb6c0b7710 con 0x7fcb6c06db10 2024-04-25T19:24:23.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.955+0000 7fcb63400640 1 -- 172.21.15.131:0/1746752672 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7fcb5c0801e0 con 0x7fcb6c06db10 2024-04-25T19:24:23.957 INFO:teuthology.orchestra.run.smithi131.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T19:24:23.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.958+0000 7fcb70e00640 1 -- 172.21.15.131:0/1746752672 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fcb4c0744b0 msgr2=0x7fcb4c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:23.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.958+0000 7fcb70e00640 1 --2- 172.21.15.131:0/1746752672 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fcb4c0744b0 0x7fcb4c0769c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcb58006fd0 tx=0x7fcb58008040 comp rx=0 tx=0).stop 2024-04-25T19:24:23.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.958+0000 7fcb70e00640 1 -- 172.21.15.131:0/1746752672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb6c06db10 msgr2=0x7fcb6c0b0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:24:23.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.958+0000 7fcb70e00640 1 --2- 172.21.15.131:0/1746752672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb6c06db10 0x7fcb6c0b0b60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c000f80 tx=0x7fcb5c004a40 comp rx=0 tx=0).stop 2024-04-25T19:24:23.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.958+0000 7fcb70e00640 1 -- 172.21.15.131:0/1746752672 shutdown_connections 2024-04-25T19:24:23.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.958+0000 7fcb70e00640 1 --2- 172.21.15.131:0/1746752672 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fcb4c0744b0 0x7fcb4c0769c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.958+0000 7fcb70e00640 1 --2- 172.21.15.131:0/1746752672 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb6c143a90 0x7fcb6c1468a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.958+0000 7fcb70e00640 1 --2- 172.21.15.131:0/1746752672 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb6c140e00 0x7fcb6c0b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.958+0000 7fcb70e00640 1 --2- 172.21.15.131:0/1746752672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb6c06db10 0x7fcb6c0b0b60 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:24:23.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.958+0000 7fcb70e00640 1 -- 172.21.15.131:0/1746752672 >> 172.21.15.131:0/1746752672 conn(0x7fcb6c072ee0 msgr2=0x7fcb6c0cf2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:24:23.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.958+0000 7fcb70e00640 1 -- 172.21.15.131:0/1746752672 shutdown_connections 2024-04-25T19:24:23.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:23.958+0000 7fcb70e00640 1 -- 172.21.15.131:0/1746752672 wait complete. 2024-04-25T19:24:23.986 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T19:24:23.986 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T19:24:23.986 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2024-04-25T19:24:23.987 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T19:24:23.987 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T19:24:23.987 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T19:24:23.987 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T19:24:23.987 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T19:24:23.987 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T19:24:23.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:24:23.987 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2024-04-25T19:24:24.037 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T19:24:24.037 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T19:24:24.037 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T19:24:24.037 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:24:24.037 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2024-04-25T19:24:24.038 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:24:24.038 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T19:24:24.038 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:24:24.038 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2024-04-25T19:24:24.038 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T19:24:24.038 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:24:24.038 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2024-04-25T19:24:24.038 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T19:24:24.038 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:24:24.038 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T19:24:24.038 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:24:24.038 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T19:24:24.039 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42545sec preferred_lft 42545sec 2024-04-25T19:24:24.039 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2024-04-25T19:24:24.039 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:24:24.039 INFO:teuthology.orchestra.run.smithi131.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T19:24:24.039 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 06:e0:b4:1f:52:82 brd ff:ff:ff:ff:ff:ff 2024-04-25T19:24:24.039 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T19:24:24.039 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:24:24.039 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::d448:c8ff:fe91:466b/64 scope link 2024-04-25T19:24:24.040 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:24:24.040 INFO:teuthology.orchestra.run.smithi131.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T19:24:24.040 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 06:e0:b4:1f:52:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T19:24:24.040 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::4e0:b4ff:fe1f:5282/64 scope link 2024-04-25T19:24:24.040 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:24:24.040 INFO:teuthology.orchestra.run.smithi131.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T19:24:24.040 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 8e:5f:bd:1f:12:67 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T19:24:24.041 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::8c5f:bdff:fe1f:1267/64 scope link 2024-04-25T19:24:24.041 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-25T19:24:24.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:24:24.042 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T19:24:24.120 INFO:teuthology.orchestra.run.smithi131.stdout:1 2024-04-25T19:24:24.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:24:24.125 DEBUG:teuthology.orchestra.run.smithi131:> route 2024-04-25T19:24:24.176 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2024-04-25T19:24:24.176 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T19:24:24.176 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T19:24:24.176 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T19:24:24.176 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T19:24:24.176 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T19:24:24.176 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-04-25T19:24:24.177 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T19:24:24.177 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T19:24:24.177 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T19:24:24.177 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-04-25T19:24:24.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T19:24:24.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:24.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:24:24.384 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-04-25T19:24:24.431 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T19:24:24.431 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T19:24:24.431 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T19:24:24.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:24:24.432 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.0 up 2024-04-25T19:24:24.515 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T19:24:24.515 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T19:24:24.565 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T19:24:24.566 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T19:24:24.566 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T19:24:24.613 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T19:24:24.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:24:24.613 DEBUG:teuthology.orchestra.run.smithi131:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T19:24:24.811 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T19:24:24.811 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T19:24:24.811 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2024-04-25T19:24:24.837 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T19:24:24.837 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T19:24:24.837 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2024-04-25T19:24:24.838 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.131:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T19:24:24.838 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T19:24:24.872 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T19:24:24.872 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T19:24:24.872 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2024-04-25T19:24:24.873 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.131:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T19:24:24.873 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T19:24:24.873 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.131:6789,172.21.15.195:6789,172.21.15.195:6790" 2024-04-25T19:24:24.873 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.131:6789,172.21.15.195:6789,172.21.15.195:6790:/ 2024-04-25T19:24:24.873 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=4ba607f8-c2c3-4d8d-85a8-7800763c470f" will pass to kernel 2024-04-25T19:24:24.875 INFO:teuthology.orchestra.run.smithi131.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T19:24:24.875 INFO:teuthology.orchestra.run.smithi131.stdout: You just mounted a file system that supports labels which does not 2024-04-25T19:24:24.875 INFO:teuthology.orchestra.run.smithi131.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T19:24:24.875 INFO:teuthology.orchestra.run.smithi131.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T19:24:24.875 INFO:teuthology.orchestra.run.smithi131.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T19:24:24.879 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T19:24:24.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:24:24.879 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T19:24:24.946 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T19:24:25.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T19:24:25.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:25.059 INFO:teuthology.orchestra.run.smithi131.stdout:client4751 2024-04-25T19:24:25.059 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:24:25.059 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:24:25.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:24:25.109 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://github.com/ceph/ceph-qa-suite) 2024-04-25T19:24:25.216 INFO:teuthology.orchestra.run.smithi131.stderr:Cloning into 'ceph-qa-suite'... 2024-04-25T19:24:33.206 INFO:teuthology.orchestra.run.smithi131.stderr:Updating files: 18% (256/1396) Updating files: 19% (266/1396) Updating files: 20% (280/1396) Updating files: 21% (294/1396) Updating files: 22% (308/1396) Updating files: 23% (322/1396) Updating files: 24% (336/1396) Updating files: 25% (349/1396) Updating files: 26% (363/1396) Updating files: 27% (377/1396) Updating files: 28% (391/1396) Updating files: 29% (405/1396) Updating files: 30% (419/1396) Updating files: 31% (433/1396) Updating files: 32% (447/1396) Updating files: 33% (461/1396) Updating files: 34% (475/1396) Updating files: 35% (489/1396) Updating files: 35% (495/1396) Updating files: 36% (503/1396) Updating files: 37% (517/1396) Updating files: 38% (531/1396) Updating files: 39% (545/1396) Updating files: 40% (559/1396) Updating files: 41% (573/1396) Updating files: 42% (587/1396) Updating files: 43% (601/1396) Updating files: 44% (615/1396) Updating files: 45% (629/1396) Updating files: 46% (643/1396) Updating files: 47% (657/1396) Updating files: 48% (671/1396) Updating files: 48% (674/1396) Updating files: 49% (685/1396) Updating files: 50% (698/1396) Updating files: 51% (712/1396) Updating files: 52% (726/1396) Updating files: 53% (740/1396) Updating files: 54% (754/1396) Updating files: 55% (768/1396) Updating files: 56% (782/1396) Updating files: 57% (796/1396) Updating files: 58% (810/1396) Updating files: 59% (824/1396) Updating files: 60% (838/1396) Updating files: 61% (852/1396) Updating files: 62% (866/1396) Updating files: 63% (880/1396) Updating files: 64% (894/1396) Updating files: 65% (908/1396) Updating files: 66% (922/1396) Updating files: 67% (936/1396) Updating files: 68% (950/1396) Updating files: 69% (964/1396) Updating files: 70% (978/1396) Updating files: 71% (992/1396) Updating files: 72% (1006/1396) Updating files: 73% (1020/1396) Updating files: 74% (1034/1396) Updating files: 75% (1047/1396) Updating files: 76% (1061/1396) Updating files: 77% (1075/1396) Updating files: 78% (1089/1396) Updating files: 79% (1103/1396) Updating files: 80% (1117/1396) Updating files: 81% (1131/1396) Updating files: 82% (1145/1396) Updating files: 83% (1159/1396) Updating files: 84% (1173/1396) Updating files: 85% (1187/1396) Updating files: 86% (1201/1396) Updating files: 86% (1205/1396) Updating files: 87% (1215/1396) Updating files: 88% (1229/1396) Updating files: 89% (1243/1396) Updating files: 90% (1257/1396) Updating files: 91% (1271/1396) Updating files: 92% (1285/1396) Updating files: 93% (1299/1396) Updating files: 94% (1313/1396) Updating files: 95% (1327/1396) Updating files: 96% (1341/1396) Updating files: 97% (1355/1396) Updating files: 98% (1369/1396) Updating files: 99% (1383/1396) Updating files: 100% (1396/1396) Updating files: 100% (1396/1396), done. 2024-04-25T19:24:33.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:24:33.223 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T19:24:33.434 INFO:teuthology.orchestra.run.smithi131.stdout:./ 2024-04-25T19:24:33.435 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite 2024-04-25T19:24:33.435 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/erasure-code 2024-04-25T19:24:33.435 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/erasure-code/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml 2024-04-25T19:24:33.435 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/erasure-code/ec-rados-plugin=jerasure-k=3-m=1.yaml 2024-04-25T19:24:33.435 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/erasure-code/ec-rados-plugin=isa-k=2-m=1.yaml 2024-04-25T19:24:33.435 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/erasure-code/ec-rados-plugin=jerasure-k=2-m=1.yaml 2024-04-25T19:24:33.435 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/erasure-code/ec-rados-plugin=shec-k=4-m=3-c=2.yaml 2024-04-25T19:24:33.435 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/erasure-code/ec-feature-plugins-v3.yaml 2024-04-25T19:24:33.435 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/erasure-code/ec-rados-default.yaml 2024-04-25T19:24:33.436 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/erasure-code/ec-rados-sequential.yaml 2024-04-25T19:24:33.436 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/erasure-code/ec-rados-parallel.yaml 2024-04-25T19:24:33.436 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/erasure-code/ec-feature-plugins-v2.yaml 2024-04-25T19:24:33.436 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/releases 2024-04-25T19:24:33.436 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/releases/jewel.yaml 2024-04-25T19:24:33.436 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/releases/kraken.yaml 2024-04-25T19:24:33.436 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/releases/infernalis.yaml 2024-04-25T19:24:33.436 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tox.ini 2024-04-25T19:24:33.436 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/ceph-deploy-overrides 2024-04-25T19:24:33.436 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/ceph-deploy-overrides/enable_dmcrypt_diff_journal_disk.yaml 2024-04-25T19:24:33.437 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/ceph-deploy-overrides/ceph_deploy_dmcrypt.yaml 2024-04-25T19:24:33.437 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/ceph-deploy-overrides/enable_diff_journal_disk.yaml 2024-04-25T19:24:33.437 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/ceph-deploy-overrides/disable_diff_journal_disk.yaml 2024-04-25T19:24:33.437 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/nightlies 2024-04-25T19:24:33.437 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/nightlies/cron_wrapper 2024-04-25T19:24:33.437 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/overrides 2024-04-25T19:24:33.437 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/overrides/3-size-2-min-size.yaml 2024-04-25T19:24:33.437 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/overrides/whitelist_wrongly_marked_down.yaml 2024-04-25T19:24:33.437 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/overrides/2-size-2-min-size.yaml 2024-04-25T19:24:33.437 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/overrides/2-size-1-min-size.yaml 2024-04-25T19:24:33.438 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/overrides/short_pg_log.yaml 2024-04-25T19:24:33.438 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/packages 2024-04-25T19:24:33.438 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/packages/packages.yaml 2024-04-25T19:24:33.438 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/clusters 2024-04-25T19:24:33.438 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/clusters/extra-client.yaml 2024-04-25T19:24:33.438 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/clusters/fixed-2.yaml 2024-04-25T19:24:33.438 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/clusters/fixed-3.yaml 2024-04-25T19:24:33.438 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/clusters/fixed-3-cephfs.yaml 2024-04-25T19:24:33.438 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/clusters/fixed-4.yaml 2024-04-25T19:24:33.438 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/clusters/fixed-1.yaml 2024-04-25T19:24:33.438 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/cephfs 2024-04-25T19:24:33.438 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/cephfs/overrides 2024-04-25T19:24:33.438 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/cephfs/overrides/whitelist_wrongly_marked_down.yaml 2024-04-25T19:24:33.439 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/cephfs/overrides/debug.yaml 2024-04-25T19:24:33.439 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/cephfs/overrides/fuse 2024-04-25T19:24:33.439 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/cephfs/overrides/fuse/default-perm 2024-04-25T19:24:33.439 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/cephfs/overrides/fuse/default-perm/yes.yaml 2024-04-25T19:24:33.439 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/cephfs/overrides/fuse/default-perm/no.yaml 2024-04-25T19:24:33.439 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/cephfs/overrides/fuse/default-perm/% 2024-04-25T19:24:33.439 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/cephfs/overrides/frag_enable.yaml 2024-04-25T19:24:33.439 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/cephfs/clusters 2024-04-25T19:24:33.439 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/cephfs/clusters/9-mds.yaml 2024-04-25T19:24:33.439 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/cephfs/clusters/3-mds.yaml 2024-04-25T19:24:33.439 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/cephfs/clusters/fixed-2-ucephfs.yaml 2024-04-25T19:24:33.439 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/cephfs/mount 2024-04-25T19:24:33.440 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/cephfs/mount/kclient.yaml 2024-04-25T19:24:33.440 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/cephfs/mount/fuse.yaml 2024-04-25T19:24:33.440 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/cephfs/begin.yaml 2024-04-25T19:24:33.440 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/cephfs/tasks 2024-04-25T19:24:33.440 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/cephfs/tasks/libcephfs_interface_tests.yaml 2024-04-25T19:24:33.440 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/cephfs/tasks/cfuse_workunit_trivial_sync.yaml 2024-04-25T19:24:33.440 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/cephfs/tasks/cfuse_workunit_suites_ffsb.yaml 2024-04-25T19:24:33.440 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/cephfs/tasks/cfuse_workunit_suites_blogbench.yaml 2024-04-25T19:24:33.440 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/cephfs/tasks/cfuse_workunit_suites_fsstress.yaml 2024-04-25T19:24:33.440 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/cephfs/tasks/cfuse_workunit_suites_dbench.yaml 2024-04-25T19:24:33.440 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/objectstore 2024-04-25T19:24:33.440 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/objectstore/bluestore.yaml 2024-04-25T19:24:33.440 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/objectstore/filestore.yaml 2024-04-25T19:24:33.440 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/config 2024-04-25T19:24:33.440 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/config/rados.yaml 2024-04-25T19:24:33.441 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/archs 2024-04-25T19:24:33.441 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/archs/armv7.yaml 2024-04-25T19:24:33.441 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/archs/i686.yaml 2024-04-25T19:24:33.441 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/archs/aarch64.yaml 2024-04-25T19:24:33.441 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/archs/x86_64.yaml 2024-04-25T19:24:33.441 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/fs 2024-04-25T19:24:33.441 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/fs/btrfs.yaml 2024-04-25T19:24:33.441 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/fs/xfs.yaml 2024-04-25T19:24:33.441 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/fs/ext4.yaml 2024-04-25T19:24:33.441 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/rgw_pool_type 2024-04-25T19:24:33.441 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/rgw_pool_type/ec-profile.yaml 2024-04-25T19:24:33.441 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/rgw_pool_type/ec.yaml 2024-04-25T19:24:33.441 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/rgw_pool_type/ec-cache.yaml 2024-04-25T19:24:33.441 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/rgw_pool_type/replicated.yaml 2024-04-25T19:24:33.441 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git 2024-04-25T19:24:33.442 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/HEAD 2024-04-25T19:24:33.442 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/description 2024-04-25T19:24:33.442 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/index 2024-04-25T19:24:33.442 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/objects 2024-04-25T19:24:33.442 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/objects/info 2024-04-25T19:24:33.442 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/objects/pack 2024-04-25T19:24:33.442 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/objects/pack/pack-ac547ca4f300164f23b0bf1b8b1e66d5a7352309.idx 2024-04-25T19:24:33.442 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/objects/pack/pack-ac547ca4f300164f23b0bf1b8b1e66d5a7352309.rev 2024-04-25T19:24:33.442 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/objects/pack/pack-ac547ca4f300164f23b0bf1b8b1e66d5a7352309.pack 2024-04-25T19:24:33.472 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/hooks 2024-04-25T19:24:33.472 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/hooks/pre-merge-commit.sample 2024-04-25T19:24:33.472 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/hooks/pre-commit.sample 2024-04-25T19:24:33.472 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/hooks/fsmonitor-watchman.sample 2024-04-25T19:24:33.472 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/hooks/commit-msg.sample 2024-04-25T19:24:33.472 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/hooks/pre-rebase.sample 2024-04-25T19:24:33.472 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/hooks/pre-receive.sample 2024-04-25T19:24:33.473 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/hooks/prepare-commit-msg.sample 2024-04-25T19:24:33.473 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/hooks/update.sample 2024-04-25T19:24:33.473 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/hooks/pre-push.sample 2024-04-25T19:24:33.473 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/hooks/sendemail-validate.sample 2024-04-25T19:24:33.473 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/hooks/pre-applypatch.sample 2024-04-25T19:24:33.473 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/hooks/push-to-checkout.sample 2024-04-25T19:24:33.473 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/hooks/post-update.sample 2024-04-25T19:24:33.473 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/hooks/applypatch-msg.sample 2024-04-25T19:24:33.473 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/logs 2024-04-25T19:24:33.473 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/logs/HEAD 2024-04-25T19:24:33.473 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/logs/refs 2024-04-25T19:24:33.473 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/logs/refs/heads 2024-04-25T19:24:33.473 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/logs/refs/heads/master 2024-04-25T19:24:33.473 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/logs/refs/remotes 2024-04-25T19:24:33.473 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/logs/refs/remotes/origin 2024-04-25T19:24:33.474 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/logs/refs/remotes/origin/HEAD 2024-04-25T19:24:33.474 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/packed-refs 2024-04-25T19:24:33.474 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/config 2024-04-25T19:24:33.474 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/info 2024-04-25T19:24:33.474 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/info/exclude 2024-04-25T19:24:33.474 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/refs 2024-04-25T19:24:33.474 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/refs/tags 2024-04-25T19:24:33.474 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/refs/heads 2024-04-25T19:24:33.474 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/refs/heads/master 2024-04-25T19:24:33.475 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/refs/remotes 2024-04-25T19:24:33.475 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/refs/remotes/origin 2024-04-25T19:24:33.475 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/refs/remotes/origin/HEAD 2024-04-25T19:24:33.475 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.git/branches 2024-04-25T19:24:33.475 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/config_options 2024-04-25T19:24:33.475 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/config_options/cephdeploy_conf.yaml 2024-04-25T19:24:33.475 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros 2024-04-25T19:24:33.475 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/a-supported-distro.yaml 2024-04-25T19:24:33.475 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/supported 2024-04-25T19:24:33.475 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/supported/ubuntu_16.04.yaml 2024-04-25T19:24:33.476 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/supported/centos_7.2.yaml 2024-04-25T19:24:33.476 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/supported/ubuntu_14.04.yaml 2024-04-25T19:24:33.476 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all 2024-04-25T19:24:33.476 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/fedora_17.yaml 2024-04-25T19:24:33.476 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/centos_6.4.yaml 2024-04-25T19:24:33.476 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/debian_7.0.yaml 2024-04-25T19:24:33.476 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/debian_6.0.yaml 2024-04-25T19:24:33.476 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/fedora_19.yaml 2024-04-25T19:24:33.476 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/ubuntu_16.04.yaml 2024-04-25T19:24:33.476 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/opensuse_13.2.yaml 2024-04-25T19:24:33.476 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/opensuse_12.2.yaml 2024-04-25T19:24:33.476 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/rhel_6.3.yaml 2024-04-25T19:24:33.476 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/sles_11-sp2.yaml 2024-04-25T19:24:33.476 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/centos_7.2.yaml 2024-04-25T19:24:33.477 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/rhel_6.4.yaml 2024-04-25T19:24:33.477 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/centos_7.0.yaml 2024-04-25T19:24:33.477 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/ubuntu_14.04_i686.yaml 2024-04-25T19:24:33.477 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/opensuse_42.1.yaml 2024-04-25T19:24:33.477 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/debian_8.0.yaml 2024-04-25T19:24:33.477 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/fedora_18.yaml 2024-04-25T19:24:33.477 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/rhel_7.0.yaml 2024-04-25T19:24:33.477 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/ubuntu_14.04.yaml 2024-04-25T19:24:33.477 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/centos_7.1.yaml 2024-04-25T19:24:33.477 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/ubuntu_12.10.yaml 2024-04-25T19:24:33.477 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/ubuntu_12.04.yaml 2024-04-25T19:24:33.477 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/centos_6.3.yaml 2024-04-25T19:24:33.477 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/rhel_6.5.yaml 2024-04-25T19:24:33.477 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/ubuntu_14.04_aarch64.yaml 2024-04-25T19:24:33.478 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/distros/all/centos_6.5.yaml 2024-04-25T19:24:33.478 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites 2024-04-25T19:24:33.478 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress 2024-04-25T19:24:33.478 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/bench 2024-04-25T19:24:33.478 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/bench/clusters 2024-04-25T19:24:33.478 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/bench/clusters/fixed-3-cephfs.yaml 2024-04-25T19:24:33.478 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/bench/% 2024-04-25T19:24:33.478 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/bench/tasks 2024-04-25T19:24:33.478 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/bench/tasks/kclient_workunit_suites_fsx.yaml 2024-04-25T19:24:33.478 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/bench/tasks/cfuse_workunit_snaps.yaml 2024-04-25T19:24:33.478 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/thrash 2024-04-25T19:24:33.478 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/thrash/clusters 2024-04-25T19:24:33.478 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/thrash/clusters/16-osd.yaml 2024-04-25T19:24:33.478 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/thrash/clusters/3-osd-1-machine.yaml 2024-04-25T19:24:33.478 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/thrash/clusters/8-osd.yaml 2024-04-25T19:24:33.479 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/thrash/fs 2024-04-25T19:24:33.479 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/thrash/fs/none.yaml 2024-04-25T19:24:33.479 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/thrash/fs/btrfs.yaml 2024-04-25T19:24:33.479 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/thrash/fs/xfs.yaml 2024-04-25T19:24:33.479 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/thrash/workloads 2024-04-25T19:24:33.479 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/thrash/workloads/readwrite.yaml 2024-04-25T19:24:33.479 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/thrash/workloads/radosbench.yaml 2024-04-25T19:24:33.479 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/thrash/workloads/iozone_cfuse.yaml 2024-04-25T19:24:33.509 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/thrash/workloads/bonnie_cfuse.yaml 2024-04-25T19:24:33.509 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/thrash/% 2024-04-25T19:24:33.509 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/thrash/thrashers 2024-04-25T19:24:33.509 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/thrash/thrashers/default.yaml 2024-04-25T19:24:33.509 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/thrash/thrashers/more-down.yaml 2024-04-25T19:24:33.509 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/stress/thrash/thrashers/fast.yaml 2024-04-25T19:24:33.509 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/mgr 2024-04-25T19:24:33.509 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/mgr/basic 2024-04-25T19:24:33.509 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/mgr/basic/clusters 2024-04-25T19:24:33.509 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/mgr/basic/clusters/2-node-mgr.yaml 2024-04-25T19:24:33.510 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/mgr/basic/fs 2024-04-25T19:24:33.510 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/mgr/basic/fs/xfs.yaml 2024-04-25T19:24:33.510 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/mgr/basic/% 2024-04-25T19:24:33.510 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/mgr/basic/tasks 2024-04-25T19:24:33.510 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/mgr/basic/tasks/failover.yaml 2024-04-25T19:24:33.510 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/mgr/basic/debug 2024-04-25T19:24:33.510 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/mgr/basic/debug/mgr.yaml 2024-04-25T19:24:33.510 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle 2024-04-25T19:24:33.510 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle/osd 2024-04-25T19:24:33.510 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle/osd/powercycle 2024-04-25T19:24:33.510 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle/osd/powercycle/default.yaml 2024-04-25T19:24:33.510 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle/osd/clusters 2024-04-25T19:24:33.510 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle/osd/clusters/3osd-1per-target.yaml 2024-04-25T19:24:33.510 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle/osd/objectstore 2024-04-25T19:24:33.511 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle/osd/fs 2024-04-25T19:24:33.511 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle/osd/fs/btrfs.yaml 2024-04-25T19:24:33.511 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle/osd/fs/xfs.yaml 2024-04-25T19:24:33.511 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle/osd/% 2024-04-25T19:24:33.511 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks 2024-04-25T19:24:33.511 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/readwrite.yaml 2024-04-25T19:24:33.511 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_fsync.yaml 2024-04-25T19:24:33.511 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/radosbench.yaml 2024-04-25T19:24:33.511 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_pjd.yaml 2024-04-25T19:24:33.511 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_ffsb.yaml 2024-04-25T19:24:33.511 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_fsx.yaml 2024-04-25T19:24:33.511 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/snaps-few-objects.yaml 2024-04-25T19:24:33.514 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_misc.yaml 2024-04-25T19:24:33.514 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/admin_socket_objecter_requests.yaml 2024-04-25T19:24:33.514 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_truncate_delay.yaml 2024-04-25T19:24:33.515 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/snaps-many-objects.yaml 2024-04-25T19:24:33.515 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_kernel_untar_build.yaml 2024-04-25T19:24:33.515 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/rados_api_tests.yaml 2024-04-25T19:24:33.515 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_fsstress.yaml 2024-04-25T19:24:33.515 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd 2024-04-25T19:24:33.515 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/cli 2024-04-25T19:24:33.515 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/cli/features 2024-04-25T19:24:33.515 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/cli/features/defaults.yaml 2024-04-25T19:24:33.515 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/cli/features/journaling.yaml 2024-04-25T19:24:33.515 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/cli/features/layering.yaml 2024-04-25T19:24:33.515 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/cli/features/format-1.yaml 2024-04-25T19:24:33.515 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/cli/base 2024-04-25T19:24:33.515 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/cli/base/install.yaml 2024-04-25T19:24:33.515 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/cli/pool 2024-04-25T19:24:33.516 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/cli/pool/small-cache-pool.yaml 2024-04-25T19:24:33.516 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/cli/pool/replicated-data-pool.yaml 2024-04-25T19:24:33.516 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/cli/pool/ec-data-pool.yaml 2024-04-25T19:24:33.516 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/cli/pool/none.yaml 2024-04-25T19:24:33.516 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/cli/clusters 2024-04-25T19:24:33.516 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/cli/msgr-failures 2024-04-25T19:24:33.516 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/cli/msgr-failures/many.yaml 2024-04-25T19:24:33.516 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/cli/msgr-failures/few.yaml 2024-04-25T19:24:33.516 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/cli/objectstore 2024-04-25T19:24:33.516 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/cli/fs 2024-04-25T19:24:33.516 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/cli/workloads 2024-04-25T19:24:33.516 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/cli/workloads/rbd_cli_import_export.yaml 2024-04-25T19:24:33.516 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/cli/workloads/rbd_cli_copy.yaml 2024-04-25T19:24:33.516 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/cli/% 2024-04-25T19:24:33.516 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/maintenance 2024-04-25T19:24:33.517 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/maintenance/base 2024-04-25T19:24:33.517 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/maintenance/base/install.yaml 2024-04-25T19:24:33.517 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/maintenance/clusters 2024-04-25T19:24:33.517 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/maintenance/clusters/openstack.yaml 2024-04-25T19:24:33.517 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/maintenance/clusters/+ 2024-04-25T19:24:33.517 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/maintenance/clusters/fixed-3.yaml 2024-04-25T19:24:33.517 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/maintenance/objectstore 2024-04-25T19:24:33.517 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/maintenance/workloads 2024-04-25T19:24:33.517 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/maintenance/workloads/dynamic_features.yaml 2024-04-25T19:24:33.517 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/maintenance/workloads/rebuild_object_map.yaml 2024-04-25T19:24:33.533 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/maintenance/% 2024-04-25T19:24:33.534 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/maintenance/xfs.yaml 2024-04-25T19:24:33.534 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/maintenance/qemu 2024-04-25T19:24:33.534 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/maintenance/qemu/xfstests.yaml 2024-04-25T19:24:33.534 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/singleton 2024-04-25T19:24:33.534 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/singleton/openstack.yaml 2024-04-25T19:24:33.534 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/singleton/objectstore 2024-04-25T19:24:33.534 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/singleton/% 2024-04-25T19:24:33.534 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/singleton/all 2024-04-25T19:24:33.534 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/singleton/all/rbd-vs-unmanaged-snaps.yaml 2024-04-25T19:24:33.534 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/singleton/all/rbd_mirror.yaml 2024-04-25T19:24:33.534 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/singleton/all/verify_pool.yaml 2024-04-25T19:24:33.534 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/singleton/all/formatted-output.yaml 2024-04-25T19:24:33.535 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/singleton/all/rbdmap_RBDMAPFILE.yaml 2024-04-25T19:24:33.535 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/singleton/all/qemu-iotests-writeback.yaml 2024-04-25T19:24:33.535 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/singleton/all/read-flags-writeback.yaml 2024-04-25T19:24:33.535 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/singleton/all/permissions.yaml 2024-04-25T19:24:33.535 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/singleton/all/read-flags-no-cache.yaml 2024-04-25T19:24:33.535 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/singleton/all/qemu-iotests-no-cache.yaml 2024-04-25T19:24:33.535 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/singleton/all/qemu-iotests-writethrough.yaml 2024-04-25T19:24:33.535 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/singleton/all/read-flags-writethrough.yaml 2024-04-25T19:24:33.535 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/singleton/all/admin_socket.yaml 2024-04-25T19:24:33.535 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/singleton/all/merge_diff.yaml 2024-04-25T19:24:33.535 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/basic 2024-04-25T19:24:33.535 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/basic/base 2024-04-25T19:24:33.535 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/basic/base/install.yaml 2024-04-25T19:24:33.535 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/basic/cachepool 2024-04-25T19:24:33.536 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/basic/cachepool/none.yaml 2024-04-25T19:24:33.536 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/basic/cachepool/small.yaml 2024-04-25T19:24:33.536 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/basic/clusters 2024-04-25T19:24:33.536 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/basic/clusters/openstack.yaml 2024-04-25T19:24:33.536 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/basic/clusters/+ 2024-04-25T19:24:33.536 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/basic/clusters/fixed-1.yaml 2024-04-25T19:24:33.536 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/basic/msgr-failures 2024-04-25T19:24:33.536 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/basic/msgr-failures/many.yaml 2024-04-25T19:24:33.536 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/basic/msgr-failures/few.yaml 2024-04-25T19:24:33.536 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/basic/objectstore 2024-04-25T19:24:33.536 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/basic/fs 2024-04-25T19:24:33.536 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/basic/fs/xfs.yaml 2024-04-25T19:24:33.536 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/basic/% 2024-04-25T19:24:33.536 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/basic/tasks 2024-04-25T19:24:33.537 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/basic/tasks/rbd_lock_and_fence.yaml 2024-04-25T19:24:33.537 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/basic/tasks/rbd_cli_tests.yaml 2024-04-25T19:24:33.537 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/basic/tasks/rbd_api_tests_old_format.yaml 2024-04-25T19:24:33.537 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/basic/tasks/rbd_cls_tests.yaml 2024-04-25T19:24:33.537 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/basic/tasks/rbd_python_api_tests_old_format.yaml 2024-04-25T19:24:33.537 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd 2024-04-25T19:24:33.537 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/pool 2024-04-25T19:24:33.537 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/pool/small-cache-pool.yaml 2024-04-25T19:24:33.537 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/pool/replicated-data-pool.yaml 2024-04-25T19:24:33.537 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/pool/ec-data-pool.yaml 2024-04-25T19:24:33.537 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/pool/none.yaml 2024-04-25T19:24:33.537 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/clusters 2024-04-25T19:24:33.537 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/clusters/openstack.yaml 2024-04-25T19:24:33.537 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/clusters/+ 2024-04-25T19:24:33.537 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/clusters/fixed-3.yaml 2024-04-25T19:24:33.538 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/msgr-failures 2024-04-25T19:24:33.538 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/msgr-failures/few.yaml 2024-04-25T19:24:33.538 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/objectstore 2024-04-25T19:24:33.538 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/config 2024-04-25T19:24:33.538 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/config/skip-partial-discard.yaml 2024-04-25T19:24:33.538 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/config/none.yaml 2024-04-25T19:24:33.538 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/config/copy-on-read.yaml 2024-04-25T19:24:33.538 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/fs 2024-04-25T19:24:33.538 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads 2024-04-25T19:24:33.538 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads/c_api_tests.yaml 2024-04-25T19:24:33.538 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads/rbd_fio.yaml 2024-04-25T19:24:33.538 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads/c_api_tests_with_defaults.yaml 2024-04-25T19:24:33.538 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads/python_api_tests.yaml 2024-04-25T19:24:33.538 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads/fsx.yaml 2024-04-25T19:24:33.539 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads/python_api_tests_with_journaling.yaml 2024-04-25T19:24:33.539 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads/c_api_tests_with_journaling.yaml 2024-04-25T19:24:33.539 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads/python_api_tests_with_defaults.yaml 2024-04-25T19:24:33.539 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/cache 2024-04-25T19:24:33.539 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/cache/writeback.yaml 2024-04-25T19:24:33.539 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/cache/writethrough.yaml 2024-04-25T19:24:33.563 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/cache/none.yaml 2024-04-25T19:24:33.563 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/librbd/% 2024-04-25T19:24:33.563 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/valgrind 2024-04-25T19:24:33.563 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/valgrind/base 2024-04-25T19:24:33.563 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/valgrind/base/install.yaml 2024-04-25T19:24:33.563 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/valgrind/clusters 2024-04-25T19:24:33.563 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/valgrind/objectstore 2024-04-25T19:24:33.563 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/valgrind/fs 2024-04-25T19:24:33.563 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads 2024-04-25T19:24:33.563 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads/rbd_mirror.yaml 2024-04-25T19:24:33.563 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads/c_api_tests.yaml 2024-04-25T19:24:33.564 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads/c_api_tests_with_defaults.yaml 2024-04-25T19:24:33.564 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads/python_api_tests.yaml 2024-04-25T19:24:33.564 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads/fsx.yaml 2024-04-25T19:24:33.564 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads/python_api_tests_with_journaling.yaml 2024-04-25T19:24:33.564 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads/c_api_tests_with_journaling.yaml 2024-04-25T19:24:33.564 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads/python_api_tests_with_defaults.yaml 2024-04-25T19:24:33.564 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/valgrind/validator 2024-04-25T19:24:33.564 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/valgrind/validator/memcheck.yaml 2024-04-25T19:24:33.564 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/valgrind/% 2024-04-25T19:24:33.564 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/nbd 2024-04-25T19:24:33.564 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/nbd/base 2024-04-25T19:24:33.564 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/nbd/cluster 2024-04-25T19:24:33.565 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/nbd/cluster/openstack.yaml 2024-04-25T19:24:33.565 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/nbd/cluster/+ 2024-04-25T19:24:33.565 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/nbd/cluster/fixed-3.yaml 2024-04-25T19:24:33.565 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/nbd/msgr-failures 2024-04-25T19:24:33.565 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/nbd/objectstore 2024-04-25T19:24:33.565 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/nbd/fs 2024-04-25T19:24:33.565 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/nbd/workloads 2024-04-25T19:24:33.565 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/nbd/workloads/rbd_nbd.yaml 2024-04-25T19:24:33.565 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/nbd/workloads/rbd_fsx_nbd.yaml 2024-04-25T19:24:33.565 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/nbd/% 2024-04-25T19:24:33.566 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/nbd/thrashers 2024-04-25T19:24:33.566 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash 2024-04-25T19:24:33.566 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/base 2024-04-25T19:24:33.566 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/base/install.yaml 2024-04-25T19:24:33.566 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/clusters 2024-04-25T19:24:33.566 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/clusters/openstack.yaml 2024-04-25T19:24:33.566 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/clusters/fixed-2.yaml 2024-04-25T19:24:33.566 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/clusters/+ 2024-04-25T19:24:33.566 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/msgr-failures 2024-04-25T19:24:33.566 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/msgr-failures/few.yaml 2024-04-25T19:24:33.566 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/objectstore 2024-04-25T19:24:33.566 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/fs 2024-04-25T19:24:33.566 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/fs/xfs.yaml 2024-04-25T19:24:33.566 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads 2024-04-25T19:24:33.567 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_cache_writeback.yaml 2024-04-25T19:24:33.567 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_copy_on_read.yaml 2024-04-25T19:24:33.567 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_journal.yaml 2024-04-25T19:24:33.567 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_api_tests_journaling.yaml 2024-04-25T19:24:33.567 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_nocache.yaml 2024-04-25T19:24:33.567 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_api_tests.yaml 2024-04-25T19:24:33.567 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/journal.yaml 2024-04-25T19:24:33.568 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_api_tests_copy_on_read.yaml 2024-04-25T19:24:33.568 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_api_tests_no_locking.yaml 2024-04-25T19:24:33.568 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_cache_writethrough.yaml 2024-04-25T19:24:33.568 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/% 2024-04-25T19:24:33.568 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/thrashers 2024-04-25T19:24:33.568 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/thrashers/default.yaml 2024-04-25T19:24:33.568 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/thrash/thrashers/cache.yaml 2024-04-25T19:24:33.568 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/mirror 2024-04-25T19:24:33.568 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/mirror/base 2024-04-25T19:24:33.568 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/mirror/base/install.yaml 2024-04-25T19:24:33.569 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/mirror/cluster 2024-04-25T19:24:33.569 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/mirror/cluster/openstack.yaml 2024-04-25T19:24:33.569 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/mirror/cluster/2-node.yaml 2024-04-25T19:24:33.569 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/mirror/cluster/+ 2024-04-25T19:24:33.569 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/mirror/msgr-failures 2024-04-25T19:24:33.569 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/mirror/objectstore 2024-04-25T19:24:33.569 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/mirror/fs 2024-04-25T19:24:33.569 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/mirror/workloads 2024-04-25T19:24:33.569 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/mirror/workloads/rbd-mirror-stress-workunit.yaml 2024-04-25T19:24:33.569 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/mirror/workloads/rbd-mirror-workunit.yaml 2024-04-25T19:24:33.569 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/mirror/% 2024-04-25T19:24:33.570 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/mirror/rbd-mirror 2024-04-25T19:24:33.570 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/mirror/rbd-mirror/one-per-cluster.yaml 2024-04-25T19:24:33.570 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu 2024-04-25T19:24:33.570 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/features 2024-04-25T19:24:33.593 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/features/defaults.yaml 2024-04-25T19:24:33.593 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/features/journaling.yaml 2024-04-25T19:24:33.593 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/pool 2024-04-25T19:24:33.593 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/pool/small-cache-pool.yaml 2024-04-25T19:24:33.593 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/pool/replicated-data-pool.yaml 2024-04-25T19:24:33.593 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/pool/ec-cache-pool.yaml 2024-04-25T19:24:33.593 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/pool/ec-data-pool.yaml 2024-04-25T19:24:33.593 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/pool/none.yaml 2024-04-25T19:24:33.593 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/clusters 2024-04-25T19:24:33.594 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/clusters/openstack.yaml 2024-04-25T19:24:33.594 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/clusters/+ 2024-04-25T19:24:33.594 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/clusters/fixed-3.yaml 2024-04-25T19:24:33.594 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/msgr-failures 2024-04-25T19:24:33.594 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/msgr-failures/few.yaml 2024-04-25T19:24:33.594 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/objectstore 2024-04-25T19:24:33.594 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/fs 2024-04-25T19:24:33.594 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/workloads 2024-04-25T19:24:33.594 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/workloads/qemu_iozone.yaml.disabled 2024-04-25T19:24:33.594 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/workloads/#qemu_xfstests.yaml# 2024-04-25T19:24:33.595 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/workloads/qemu_xfstests.yaml 2024-04-25T19:24:33.595 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/workloads/qemu_fsstress.yaml 2024-04-25T19:24:33.595 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/workloads/qemu_bonnie.yaml 2024-04-25T19:24:33.595 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/cache 2024-04-25T19:24:33.595 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/cache/writeback.yaml 2024-04-25T19:24:33.595 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/cache/writethrough.yaml 2024-04-25T19:24:33.595 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/cache/none.yaml 2024-04-25T19:24:33.595 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rbd/qemu/% 2024-04-25T19:24:33.595 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rest 2024-04-25T19:24:33.595 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rest/basic 2024-04-25T19:24:33.596 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rest/basic/tasks 2024-04-25T19:24:33.596 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rest/basic/tasks/rest_test.yaml 2024-04-25T19:24:33.596 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw 2024-04-25T19:24:33.596 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/multifs 2024-04-25T19:24:33.596 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/multifs/clusters 2024-04-25T19:24:33.596 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/multifs/clusters/fixed-2.yaml 2024-04-25T19:24:33.596 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/multifs/objectstore 2024-04-25T19:24:33.596 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/multifs/fs 2024-04-25T19:24:33.596 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/multifs/fs/xfs.yaml 2024-04-25T19:24:33.596 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/multifs/rgw_pool_type 2024-04-25T19:24:33.596 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/multifs/frontend 2024-04-25T19:24:33.596 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/multifs/frontend/apache.yaml 2024-04-25T19:24:33.596 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/multifs/frontend/civetweb.yaml 2024-04-25T19:24:33.597 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/multifs/overrides.yaml 2024-04-25T19:24:33.597 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/multifs/% 2024-04-25T19:24:33.597 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/multifs/tasks 2024-04-25T19:24:33.597 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_roundtrip.yaml 2024-04-25T19:24:33.597 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_multipart_upload.yaml 2024-04-25T19:24:33.597 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_user_quota.yaml 2024-04-25T19:24:33.597 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_readwrite.yaml 2024-04-25T19:24:33.597 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_swift.yaml 2024-04-25T19:24:33.597 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_s3tests.yaml 2024-04-25T19:24:33.597 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_bucket_quota.yaml 2024-04-25T19:24:33.597 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/singleton 2024-04-25T19:24:33.597 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/singleton/objectstore 2024-04-25T19:24:33.597 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/singleton/fs 2024-04-25T19:24:33.598 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/singleton/fs/xfs.yaml 2024-04-25T19:24:33.598 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/singleton/rgw_pool_type 2024-04-25T19:24:33.598 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/singleton/frontend 2024-04-25T19:24:33.598 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/singleton/frontend/apache.yaml 2024-04-25T19:24:33.598 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/singleton/frontend/civetweb.yaml 2024-04-25T19:24:33.598 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/singleton/overrides.yaml 2024-04-25T19:24:33.598 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/singleton/% 2024-04-25T19:24:33.598 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/singleton/xfs.yaml 2024-04-25T19:24:33.598 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/singleton/all 2024-04-25T19:24:33.598 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/singleton/all/radosgw-admin-multi-region.yaml 2024-04-25T19:24:33.599 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/singleton/all/radosgw-admin.yaml 2024-04-25T19:24:33.599 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/singleton/all/radosgw-admin-data-sync.yaml 2024-04-25T19:24:33.599 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/singleton/all/radosgw-convert-to-region.yaml 2024-04-25T19:24:33.599 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/verify 2024-04-25T19:24:33.599 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/verify/validater 2024-04-25T19:24:33.600 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/verify/validater/valgrind.yaml 2024-04-25T19:24:33.600 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/verify/validater/lockdep.yaml 2024-04-25T19:24:33.600 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/verify/clusters 2024-04-25T19:24:33.600 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/verify/clusters/fixed-2.yaml 2024-04-25T19:24:33.600 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/verify/msgr-failures 2024-04-25T19:24:33.600 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/verify/msgr-failures/few.yaml 2024-04-25T19:24:33.600 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/verify/objectstore 2024-04-25T19:24:33.600 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/verify/fs 2024-04-25T19:24:33.601 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/verify/fs/xfs.yaml 2024-04-25T19:24:33.601 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/verify/rgw_pool_type 2024-04-25T19:24:33.601 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/verify/frontend 2024-04-25T19:24:33.601 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/verify/frontend/apache.yaml 2024-04-25T19:24:33.623 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/verify/frontend/civetweb.yaml 2024-04-25T19:24:33.624 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/verify/overrides.yaml 2024-04-25T19:24:33.624 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/verify/% 2024-04-25T19:24:33.624 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/verify/tasks 2024-04-25T19:24:33.624 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/verify/tasks/rgw_s3tests_multiregion.yaml 2024-04-25T19:24:33.624 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/verify/tasks/rgw_swift.yaml 2024-04-25T19:24:33.624 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rgw/verify/tasks/rgw_s3tests.yaml 2024-04-25T19:24:33.624 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-deploy 2024-04-25T19:24:33.624 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-deploy/basic 2024-04-25T19:24:33.624 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/ceph-deploy-overrides 2024-04-25T19:24:33.624 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/python_versions 2024-04-25T19:24:33.624 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/python_versions/python_3.yaml 2024-04-25T19:24:33.624 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/python_versions/python_2.yaml 2024-04-25T19:24:33.625 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/config_options 2024-04-25T19:24:33.625 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/distros 2024-04-25T19:24:33.625 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/% 2024-04-25T19:24:33.625 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/tasks 2024-04-25T19:24:33.625 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/tasks/ceph-admin-commands.yaml 2024-04-25T19:24:33.625 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/tgt 2024-04-25T19:24:33.625 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/tgt/basic 2024-04-25T19:24:33.625 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/tgt/basic/clusters 2024-04-25T19:24:33.625 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/tgt/basic/clusters/fixed-3.yaml 2024-04-25T19:24:33.625 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/tgt/basic/msgr-failures 2024-04-25T19:24:33.625 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/tgt/basic/msgr-failures/many.yaml 2024-04-25T19:24:33.625 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/tgt/basic/msgr-failures/few.yaml 2024-04-25T19:24:33.625 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/tgt/basic/fs 2024-04-25T19:24:33.626 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/tgt/basic/fs/btrfs.yaml 2024-04-25T19:24:33.626 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/tgt/basic/% 2024-04-25T19:24:33.626 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/tgt/basic/tasks 2024-04-25T19:24:33.626 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/iozone-sync.yaml 2024-04-25T19:24:33.626 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/dbench-short.yaml 2024-04-25T19:24:33.626 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/blogbench.yaml 2024-04-25T19:24:33.626 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/ffsb.yaml 2024-04-25T19:24:33.626 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/pjd.yaml 2024-04-25T19:24:33.626 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/fsync-tester.yaml 2024-04-25T19:24:33.626 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/iogen.yaml 2024-04-25T19:24:33.626 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/fsx.yaml 2024-04-25T19:24:33.626 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/bonnie.yaml 2024-04-25T19:24:33.626 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/fio.yaml 2024-04-25T19:24:33.627 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/iozone.yaml 2024-04-25T19:24:33.627 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/dbench.yaml 2024-04-25T19:24:33.627 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/fsstress.yaml 2024-04-25T19:24:33.627 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/samba 2024-04-25T19:24:33.627 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/samba/install 2024-04-25T19:24:33.627 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/samba/install/install.yaml 2024-04-25T19:24:33.627 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/samba/clusters 2024-04-25T19:24:33.627 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/samba/clusters/samba-basic.yaml 2024-04-25T19:24:33.627 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/samba/workload 2024-04-25T19:24:33.627 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/samba/workload/cifs-kernel-build.yaml.disabled 2024-04-25T19:24:33.627 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/samba/workload/cifs-fsstress.yaml 2024-04-25T19:24:33.627 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/samba/workload/smbtorture.yaml 2024-04-25T19:24:33.627 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/samba/workload/cifs-dbench.yaml 2024-04-25T19:24:33.627 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/samba/fs 2024-04-25T19:24:33.628 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/samba/fs/xfs.yaml 2024-04-25T19:24:33.628 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/samba/mount 2024-04-25T19:24:33.628 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/samba/mount/noceph.yaml 2024-04-25T19:24:33.628 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/samba/mount/kclient.yaml 2024-04-25T19:24:33.628 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/samba/mount/fuse.yaml 2024-04-25T19:24:33.628 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/samba/mount/native.yaml 2024-04-25T19:24:33.628 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/samba/% 2024-04-25T19:24:33.628 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible 2024-04-25T19:24:33.628 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke 2024-04-25T19:24:33.628 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests 2024-04-25T19:24:33.628 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests/cls.yaml 2024-04-25T19:24:33.628 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests/rbd_cli_tests.yaml.disabled 2024-04-25T19:24:33.628 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests/rbd_import_export.yaml 2024-04-25T19:24:33.628 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests/ceph-admin-commands.yaml 2024-04-25T19:24:33.628 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/1-distros 2024-04-25T19:24:33.629 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/0-clusters 2024-04-25T19:24:33.629 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/0-clusters/single_mon_osd.yaml 2024-04-25T19:24:33.629 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/0-clusters/3-node.yaml 2024-04-25T19:24:33.629 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/3-common 2024-04-25T19:24:33.629 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/os_tuning 2024-04-25T19:24:33.629 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/os_tuning/vm_friendly.yaml 2024-04-25T19:24:33.629 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/source 2024-04-25T19:24:33.629 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/source/upstream_stable.yaml 2024-04-25T19:24:33.629 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/% 2024-04-25T19:24:33.629 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/% 2024-04-25T19:24:33.629 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd 2024-04-25T19:24:33.629 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/journal 2024-04-25T19:24:33.657 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/journal/collocated.yaml 2024-04-25T19:24:33.657 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/% 2024-04-25T19:24:33.657 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/devices 2024-04-25T19:24:33.657 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/devices/osd_auto_discovery.yaml 2024-04-25T19:24:33.657 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/devices/from_teuthology.yaml 2024-04-25T19:24:33.657 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/2-setup 2024-04-25T19:24:33.657 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/2-setup/ceph_ansible.yaml 2024-04-25T19:24:33.657 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/big 2024-04-25T19:24:33.657 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/big/rados-thrash 2024-04-25T19:24:33.657 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/big/rados-thrash/clusters 2024-04-25T19:24:33.658 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/big/rados-thrash/clusters/medium.yaml 2024-04-25T19:24:33.658 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/big/rados-thrash/clusters/big.yaml 2024-04-25T19:24:33.658 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/big/rados-thrash/clusters/small.yaml 2024-04-25T19:24:33.658 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/big/rados-thrash/fs 2024-04-25T19:24:33.658 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/big/rados-thrash/fs/btrfs.yaml 2024-04-25T19:24:33.658 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/big/rados-thrash/fs/xfs.yaml 2024-04-25T19:24:33.658 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/big/rados-thrash/workloads 2024-04-25T19:24:33.658 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/big/rados-thrash/workloads/snaps-few-objects.yaml 2024-04-25T19:24:33.658 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/big/rados-thrash/ceph 2024-04-25T19:24:33.658 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/big/rados-thrash/ceph/ceph.yaml 2024-04-25T19:24:33.658 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/big/rados-thrash/% 2024-04-25T19:24:33.658 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/big/rados-thrash/thrashers 2024-04-25T19:24:33.658 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/big/rados-thrash/thrashers/default.yaml 2024-04-25T19:24:33.659 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/mixed-clients 2024-04-25T19:24:33.659 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/mixed-clients/basic 2024-04-25T19:24:33.659 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/mixed-clients/basic/clusters 2024-04-25T19:24:33.659 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/mixed-clients/basic/clusters/fixed-3.yaml 2024-04-25T19:24:33.659 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/mixed-clients/basic/fs 2024-04-25T19:24:33.659 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/mixed-clients/basic/fs/btrfs.yaml 2024-04-25T19:24:33.659 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/mixed-clients/basic/tasks 2024-04-25T19:24:33.659 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/mixed-clients/basic/tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml 2024-04-25T19:24:33.659 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/mixed-clients/basic/tasks/kernel_cfuse_workunits_dbench_iozone.yaml 2024-04-25T19:24:33.659 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs 2024-04-25T19:24:33.659 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/traceless 2024-04-25T19:24:33.659 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/traceless/traceless 2024-04-25T19:24:33.659 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/traceless/traceless/50pc.yaml 2024-04-25T19:24:33.659 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/traceless/overrides 2024-04-25T19:24:33.660 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/traceless/overrides/whitelist_wrongly_marked_down.yaml 2024-04-25T19:24:33.660 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/traceless/overrides/debug.yaml 2024-04-25T19:24:33.660 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/traceless/overrides/+ 2024-04-25T19:24:33.660 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/traceless/overrides/frag_enable.yaml 2024-04-25T19:24:33.660 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/traceless/clusters 2024-04-25T19:24:33.660 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/traceless/clusters/fixed-2-ucephfs.yaml 2024-04-25T19:24:33.661 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/traceless/objectstore 2024-04-25T19:24:33.661 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/traceless/fs 2024-04-25T19:24:33.661 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/traceless/fs/xfs.yaml 2024-04-25T19:24:33.661 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/traceless/mount 2024-04-25T19:24:33.661 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/traceless/mount/fuse.yaml 2024-04-25T19:24:33.661 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/traceless/begin.yaml 2024-04-25T19:24:33.661 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/traceless/% 2024-04-25T19:24:33.661 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/traceless/tasks 2024-04-25T19:24:33.661 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/traceless/tasks/cfuse_workunit_suites_ffsb.yaml 2024-04-25T19:24:33.661 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/traceless/tasks/cfuse_workunit_suites_blogbench.yaml 2024-04-25T19:24:33.661 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/traceless/tasks/cfuse_workunit_suites_fsstress.yaml 2024-04-25T19:24:33.661 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/traceless/tasks/cfuse_workunit_suites_dbench.yaml 2024-04-25T19:24:33.661 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multifs 2024-04-25T19:24:33.661 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multifs/overrides 2024-04-25T19:24:33.662 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multifs/overrides/whitelist_wrongly_marked_down.yaml 2024-04-25T19:24:33.662 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multifs/overrides/mon-debug.yaml 2024-04-25T19:24:33.662 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multifs/overrides/debug.yaml 2024-04-25T19:24:33.662 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multifs/overrides/+ 2024-04-25T19:24:33.662 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multifs/overrides/frag_enable.yaml 2024-04-25T19:24:33.662 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multifs/clusters 2024-04-25T19:24:33.662 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multifs/clusters/2-remote-clients.yaml 2024-04-25T19:24:33.662 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multifs/objectstore 2024-04-25T19:24:33.662 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multifs/fs 2024-04-25T19:24:33.662 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multifs/fs/xfs.yaml 2024-04-25T19:24:33.662 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multifs/mount 2024-04-25T19:24:33.662 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multifs/mount/fuse.yaml 2024-04-25T19:24:33.663 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multifs/begin.yaml 2024-04-25T19:24:33.663 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multifs/% 2024-04-25T19:24:33.663 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multifs/tasks 2024-04-25T19:24:33.663 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multifs/tasks/failover.yaml 2024-04-25T19:24:33.663 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/snaps 2024-04-25T19:24:33.663 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/snaps/overrides 2024-04-25T19:24:33.663 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/snaps/overrides/whitelist_wrongly_marked_down.yaml 2024-04-25T19:24:33.676 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/snaps/overrides/debug.yaml 2024-04-25T19:24:33.676 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/snaps/overrides/+ 2024-04-25T19:24:33.676 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/snaps/overrides/frag_enable.yaml 2024-04-25T19:24:33.677 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/snaps/clusters 2024-04-25T19:24:33.677 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/snaps/clusters/fixed-2-ucephfs.yaml 2024-04-25T19:24:33.677 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/snaps/objectstore 2024-04-25T19:24:33.677 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/snaps/fs 2024-04-25T19:24:33.677 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/snaps/fs/xfs.yaml 2024-04-25T19:24:33.677 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/snaps/mount 2024-04-25T19:24:33.677 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/snaps/mount/fuse.yaml 2024-04-25T19:24:33.677 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/snaps/begin.yaml 2024-04-25T19:24:33.677 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/snaps/% 2024-04-25T19:24:33.677 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/snaps/tasks 2024-04-25T19:24:33.677 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/snaps/tasks/snaptests.yaml 2024-04-25T19:24:33.677 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic 2024-04-25T19:24:33.677 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/overrides 2024-04-25T19:24:33.677 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/overrides/whitelist_wrongly_marked_down.yaml 2024-04-25T19:24:33.677 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/overrides/debug.yaml 2024-04-25T19:24:33.678 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/overrides/+ 2024-04-25T19:24:33.678 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/overrides/frag_enable.yaml 2024-04-25T19:24:33.678 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/clusters 2024-04-25T19:24:33.678 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/clusters/fixed-2-ucephfs.yaml 2024-04-25T19:24:33.678 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/objectstore 2024-04-25T19:24:33.678 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/fs 2024-04-25T19:24:33.678 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/fs/xfs.yaml 2024-04-25T19:24:33.678 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/mount 2024-04-25T19:24:33.678 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/mount/fuse.yaml 2024-04-25T19:24:33.678 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/inline 2024-04-25T19:24:33.678 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/inline/yes.yaml 2024-04-25T19:24:33.678 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/inline/no.yaml 2024-04-25T19:24:33.678 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/begin.yaml 2024-04-25T19:24:33.679 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/% 2024-04-25T19:24:33.679 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/tasks 2024-04-25T19:24:33.679 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_fsync.yaml 2024-04-25T19:24:33.679 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/tasks/libcephfs_interface_tests.yaml 2024-04-25T19:24:33.679 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_pjd.yaml 2024-04-25T19:24:33.679 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_norstats.yaml 2024-04-25T19:24:33.679 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_trivial_sync.yaml 2024-04-25T19:24:33.679 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_ffsb.yaml 2024-04-25T19:24:33.679 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_fsx.yaml 2024-04-25T19:24:33.680 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/tasks/libcephfs_java.yaml 2024-04-25T19:24:33.680 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_misc.yaml 2024-04-25T19:24:33.680 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_misc_test_o_trunc.yaml 2024-04-25T19:24:33.680 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/tasks/mds_creation_retry.yaml 2024-04-25T19:24:33.680 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/tasks/asok_dump_tree.yaml 2024-04-25T19:24:33.680 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_quota.yaml 2024-04-25T19:24:33.680 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_truncate_delay.yaml 2024-04-25T19:24:33.680 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_kernel_untar_build.yaml 2024-04-25T19:24:33.680 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_blogbench.yaml 2024-04-25T19:24:33.680 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/tasks/libcephfs_python.yaml 2024-04-25T19:24:33.680 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_fsstress.yaml 2024-04-25T19:24:33.680 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cephfs_scrub_tests.yaml 2024-04-25T19:24:33.680 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_iogen.yaml 2024-04-25T19:24:33.680 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_dbench.yaml 2024-04-25T19:24:33.681 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_iozone.yaml 2024-04-25T19:24:33.681 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery 2024-04-25T19:24:33.681 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/overrides 2024-04-25T19:24:33.681 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/overrides/whitelist_wrongly_marked_down.yaml 2024-04-25T19:24:33.681 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/overrides/fuse-unmounted.yaml 2024-04-25T19:24:33.681 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/overrides/debug.yaml 2024-04-25T19:24:33.681 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/overrides/+ 2024-04-25T19:24:33.681 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/overrides/frag_enable.yaml 2024-04-25T19:24:33.681 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/clusters 2024-04-25T19:24:33.681 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/clusters/4-remote-clients.yaml 2024-04-25T19:24:33.681 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/objectstore 2024-04-25T19:24:33.681 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/fs 2024-04-25T19:24:33.681 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/fs/xfs.yaml 2024-04-25T19:24:33.681 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/mount 2024-04-25T19:24:33.682 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/mount/fuse.yaml 2024-04-25T19:24:33.682 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/begin.yaml 2024-04-25T19:24:33.682 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/% 2024-04-25T19:24:33.682 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/tasks 2024-04-25T19:24:33.682 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/backtrace.yaml 2024-04-25T19:24:33.682 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/forward-scrub.yaml 2024-04-25T19:24:33.682 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/client-readahad.yaml 2024-04-25T19:24:33.682 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/volume-client.yaml 2024-04-25T19:24:33.699 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/config-commands.yaml 2024-04-25T19:24:33.699 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/mds-full.yaml 2024-04-25T19:24:33.699 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/sessionmap.yaml 2024-04-25T19:24:33.699 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/data-scan.yaml 2024-04-25T19:24:33.700 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/cap-flush.yaml 2024-04-25T19:24:33.700 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/mds-flush.yaml 2024-04-25T19:24:33.700 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/auto-repair.yaml 2024-04-25T19:24:33.700 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/damage.yaml 2024-04-25T19:24:33.700 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/client-recovery.yaml 2024-04-25T19:24:33.700 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/journal-repair.yaml 2024-04-25T19:24:33.700 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/client-limits.yaml 2024-04-25T19:24:33.700 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/strays.yaml 2024-04-25T19:24:33.700 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/fragment.yaml 2024-04-25T19:24:33.700 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/pool-perm.yaml 2024-04-25T19:24:33.700 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/permission 2024-04-25T19:24:33.700 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/permission/overrides 2024-04-25T19:24:33.700 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/permission/overrides/whitelist_wrongly_marked_down.yaml 2024-04-25T19:24:33.700 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/permission/overrides/debug.yaml 2024-04-25T19:24:33.700 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/permission/overrides/+ 2024-04-25T19:24:33.701 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/permission/overrides/frag_enable.yaml 2024-04-25T19:24:33.701 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/permission/clusters 2024-04-25T19:24:33.701 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/permission/clusters/fixed-2-ucephfs.yaml 2024-04-25T19:24:33.701 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/permission/objectstore 2024-04-25T19:24:33.701 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/permission/fs 2024-04-25T19:24:33.701 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/permission/fs/xfs.yaml 2024-04-25T19:24:33.701 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/permission/mount 2024-04-25T19:24:33.701 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/permission/mount/fuse.yaml 2024-04-25T19:24:33.701 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/permission/begin.yaml 2024-04-25T19:24:33.701 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/permission/% 2024-04-25T19:24:33.701 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/permission/tasks 2024-04-25T19:24:33.702 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/permission/tasks/cfuse_workunit_suites_pjd.yaml 2024-04-25T19:24:33.702 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/permission/tasks/cfuse_workunit_misc.yaml 2024-04-25T19:24:33.702 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/standbyreplay 2024-04-25T19:24:33.702 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/standbyreplay/overrides 2024-04-25T19:24:33.702 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/standbyreplay/overrides/whitelist_wrongly_marked_down.yaml 2024-04-25T19:24:33.702 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/standbyreplay/overrides/debug.yaml 2024-04-25T19:24:33.702 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/standbyreplay/overrides/+ 2024-04-25T19:24:33.702 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/standbyreplay/overrides/frag_enable.yaml 2024-04-25T19:24:33.702 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/standbyreplay/clusters 2024-04-25T19:24:33.702 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/standbyreplay/clusters/standby-replay.yaml 2024-04-25T19:24:33.702 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/standbyreplay/objectstore 2024-04-25T19:24:33.702 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/standbyreplay/fs 2024-04-25T19:24:33.702 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/standbyreplay/fs/xfs.yaml 2024-04-25T19:24:33.702 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/standbyreplay/mount 2024-04-25T19:24:33.703 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/standbyreplay/mount/fuse.yaml 2024-04-25T19:24:33.703 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/standbyreplay/begin.yaml 2024-04-25T19:24:33.703 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/standbyreplay/% 2024-04-25T19:24:33.703 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/standbyreplay/tasks 2024-04-25T19:24:33.703 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/standbyreplay/tasks/migration.yaml 2024-04-25T19:24:33.703 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/32bits 2024-04-25T19:24:33.703 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/32bits/overrides 2024-04-25T19:24:33.703 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/32bits/overrides/whitelist_wrongly_marked_down.yaml 2024-04-25T19:24:33.703 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/32bits/overrides/debug.yaml 2024-04-25T19:24:33.703 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/32bits/overrides/+ 2024-04-25T19:24:33.703 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/32bits/overrides/faked-ino.yaml 2024-04-25T19:24:33.703 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/32bits/overrides/frag_enable.yaml 2024-04-25T19:24:33.703 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/32bits/clusters 2024-04-25T19:24:33.703 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/32bits/clusters/fixed-2-ucephfs.yaml 2024-04-25T19:24:33.704 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/32bits/objectstore 2024-04-25T19:24:33.704 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/32bits/fs 2024-04-25T19:24:33.704 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/32bits/fs/xfs.yaml 2024-04-25T19:24:33.704 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/32bits/mount 2024-04-25T19:24:33.704 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/32bits/mount/fuse.yaml 2024-04-25T19:24:33.704 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/32bits/begin.yaml 2024-04-25T19:24:33.704 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/32bits/% 2024-04-25T19:24:33.704 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/32bits/tasks 2024-04-25T19:24:33.704 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/32bits/tasks/cfuse_workunit_suites_pjd.yaml 2024-04-25T19:24:33.704 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/32bits/tasks/cfuse_workunit_suites_fsstress.yaml 2024-04-25T19:24:33.704 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/thrash 2024-04-25T19:24:33.704 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/thrash/ceph-thrash 2024-04-25T19:24:33.704 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/thrash/ceph-thrash/default.yaml 2024-04-25T19:24:33.704 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/thrash/overrides 2024-04-25T19:24:33.705 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/thrash/overrides/whitelist_wrongly_marked_down.yaml 2024-04-25T19:24:33.705 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/thrash/overrides/debug.yaml 2024-04-25T19:24:33.705 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/thrash/overrides/+ 2024-04-25T19:24:33.705 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/thrash/overrides/frag_enable.yaml 2024-04-25T19:24:33.705 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/thrash/clusters 2024-04-25T19:24:33.727 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/thrash/clusters/mds-1active-1standby.yaml 2024-04-25T19:24:33.727 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/thrash/msgr-failures 2024-04-25T19:24:33.727 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/thrash/msgr-failures/osd-mds-delay.yaml 2024-04-25T19:24:33.727 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/thrash/msgr-failures/none.yaml 2024-04-25T19:24:33.727 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/thrash/objectstore 2024-04-25T19:24:33.727 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/thrash/fs 2024-04-25T19:24:33.727 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/thrash/fs/xfs.yaml 2024-04-25T19:24:33.727 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/thrash/mount 2024-04-25T19:24:33.728 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/thrash/mount/fuse.yaml 2024-04-25T19:24:33.728 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/thrash/begin.yaml 2024-04-25T19:24:33.728 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/thrash/% 2024-04-25T19:24:33.728 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/thrash/tasks 2024-04-25T19:24:33.728 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/thrash/tasks/cfuse_workunit_suites_pjd.yaml 2024-04-25T19:24:33.728 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/thrash/tasks/cfuse_workunit_trivial_sync.yaml 2024-04-25T19:24:33.728 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/thrash/tasks/cfuse_workunit_snaptests.yaml 2024-04-25T19:24:33.728 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/thrash/tasks/cfuse_workunit_suites_fsstress.yaml 2024-04-25T19:24:33.728 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/verify 2024-04-25T19:24:33.728 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/verify/validater 2024-04-25T19:24:33.728 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-04-25T19:24:33.729 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/verify/validater/lockdep.yaml 2024-04-25T19:24:33.729 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/verify/overrides 2024-04-25T19:24:33.729 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/verify/overrides/whitelist_wrongly_marked_down.yaml 2024-04-25T19:24:33.729 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/verify/overrides/mon-debug.yaml 2024-04-25T19:24:33.729 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/verify/overrides/debug.yaml 2024-04-25T19:24:33.729 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/verify/overrides/+ 2024-04-25T19:24:33.729 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/verify/overrides/frag_enable.yaml 2024-04-25T19:24:33.729 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/verify/clusters 2024-04-25T19:24:33.729 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/verify/clusters/fixed-2-ucephfs.yaml 2024-04-25T19:24:33.729 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/verify/objectstore 2024-04-25T19:24:33.729 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/verify/fs 2024-04-25T19:24:33.729 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/verify/fs/xfs.yaml 2024-04-25T19:24:33.730 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/verify/mount 2024-04-25T19:24:33.730 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/verify/mount/fuse.yaml 2024-04-25T19:24:33.730 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/verify/begin.yaml 2024-04-25T19:24:33.730 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/verify/% 2024-04-25T19:24:33.730 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/verify/tasks 2024-04-25T19:24:33.730 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/verify/tasks/libcephfs_interface_tests.yaml 2024-04-25T19:24:33.730 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/verify/tasks/cfuse_workunit_suites_fsstress.yaml 2024-04-25T19:24:33.730 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/verify/tasks/cfuse_workunit_suites_dbench.yaml 2024-04-25T19:24:33.730 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multiclient 2024-04-25T19:24:33.730 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multiclient/overrides 2024-04-25T19:24:33.730 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multiclient/overrides/whitelist_wrongly_marked_down.yaml 2024-04-25T19:24:33.731 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multiclient/overrides/debug.yaml 2024-04-25T19:24:33.731 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multiclient/overrides/+ 2024-04-25T19:24:33.731 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multiclient/overrides/frag_enable.yaml 2024-04-25T19:24:33.731 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multiclient/clusters 2024-04-25T19:24:33.731 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multiclient/clusters/three_clients.yaml 2024-04-25T19:24:33.731 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multiclient/clusters/two_clients.yaml 2024-04-25T19:24:33.731 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multiclient/objectstore 2024-04-25T19:24:33.731 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multiclient/fs 2024-04-25T19:24:33.731 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multiclient/fs/xfs.yaml 2024-04-25T19:24:33.731 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multiclient/mount 2024-04-25T19:24:33.731 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multiclient/mount/fuse.yaml 2024-04-25T19:24:33.731 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multiclient/mount/kclient.yaml.disabled 2024-04-25T19:24:33.731 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multiclient/begin.yaml 2024-04-25T19:24:33.731 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multiclient/% 2024-04-25T19:24:33.731 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multiclient/tasks 2024-04-25T19:24:33.732 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multiclient/tasks/fsx-mpi.yaml.disabled 2024-04-25T19:24:33.732 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multiclient/tasks/ior-shared-file.yaml 2024-04-25T19:24:33.732 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multiclient/tasks/cephfs_misc_tests.yaml 2024-04-25T19:24:33.732 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/fs/multiclient/tasks/mdtest.yaml 2024-04-25T19:24:33.732 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-disk 2024-04-25T19:24:33.732 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-disk/basic 2024-04-25T19:24:33.732 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-disk/basic/distros 2024-04-25T19:24:33.732 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-disk/basic/% 2024-04-25T19:24:33.732 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-disk/basic/tasks 2024-04-25T19:24:33.732 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/ceph-disk/basic/tasks/ceph-disk.yaml 2024-04-25T19:24:33.732 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd 2024-04-25T19:24:33.733 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/unmap 2024-04-25T19:24:33.733 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/unmap/clusters 2024-04-25T19:24:33.733 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/unmap/clusters/separate-client.yaml 2024-04-25T19:24:33.733 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/unmap/ceph 2024-04-25T19:24:33.733 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/unmap/ceph/ceph.yaml 2024-04-25T19:24:33.733 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/unmap/kernels 2024-04-25T19:24:33.734 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/unmap/kernels/pre-single-major.yaml 2024-04-25T19:24:33.734 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/unmap/kernels/single-major-on.yaml 2024-04-25T19:24:33.734 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/unmap/kernels/single-major-off.yaml 2024-04-25T19:24:33.734 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/unmap/conf.yaml 2024-04-25T19:24:33.734 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/unmap/% 2024-04-25T19:24:33.756 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/unmap/xfs.yaml 2024-04-25T19:24:33.756 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/unmap/tasks 2024-04-25T19:24:33.756 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/unmap/tasks/unmap.yaml 2024-04-25T19:24:33.756 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd 2024-04-25T19:24:33.756 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd/clusters 2024-04-25T19:24:33.757 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd/clusters/fixed-3.yaml 2024-04-25T19:24:33.757 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd/msgr-failures 2024-04-25T19:24:33.757 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd/msgr-failures/many.yaml 2024-04-25T19:24:33.757 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd/msgr-failures/few.yaml 2024-04-25T19:24:33.757 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd/fs 2024-04-25T19:24:33.757 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd/fs/btrfs.yaml 2024-04-25T19:24:33.757 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd/conf.yaml 2024-04-25T19:24:33.757 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd/% 2024-04-25T19:24:33.757 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks 2024-04-25T19:24:33.757 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_fsstress.yaml 2024-04-25T19:24:33.757 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_fio.yaml 2024-04-25T19:24:33.757 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_ffsb.yaml 2024-04-25T19:24:33.757 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_fsstress_ext4.yaml 2024-04-25T19:24:33.757 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_iozone.yaml 2024-04-25T19:24:33.757 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_dbench.yaml 2024-04-25T19:24:33.758 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_kernel_untar_build.yaml 2024-04-25T19:24:33.758 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_trivial_sync.yaml 2024-04-25T19:24:33.758 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_fsstress_btrfs.yaml 2024-04-25T19:24:33.758 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_fsx.yaml 2024-04-25T19:24:33.758 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/singleton 2024-04-25T19:24:33.758 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/singleton/msgr-failures 2024-04-25T19:24:33.758 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/singleton/msgr-failures/many.yaml 2024-04-25T19:24:33.758 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/singleton/msgr-failures/few.yaml 2024-04-25T19:24:33.759 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/singleton/fs 2024-04-25T19:24:33.759 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/singleton/fs/btrfs.yaml 2024-04-25T19:24:33.759 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/singleton/conf.yaml 2024-04-25T19:24:33.759 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/singleton/% 2024-04-25T19:24:33.759 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/singleton/tasks 2024-04-25T19:24:33.759 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/singleton/tasks/rbd_xfstests.yaml 2024-04-25T19:24:33.760 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount 2024-04-25T19:24:33.760 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/install 2024-04-25T19:24:33.760 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/install/ceph.yaml 2024-04-25T19:24:33.760 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/clusters 2024-04-25T19:24:33.760 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/clusters/fixed-3.yaml 2024-04-25T19:24:33.760 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/msgr-failures 2024-04-25T19:24:33.761 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/msgr-failures/many.yaml 2024-04-25T19:24:33.761 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/msgr-failures/few.yaml 2024-04-25T19:24:33.761 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/fs 2024-04-25T19:24:33.761 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/fs/btrfs.yaml 2024-04-25T19:24:33.761 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/conf.yaml 2024-04-25T19:24:33.761 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/% 2024-04-25T19:24:33.762 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks 2024-04-25T19:24:33.762 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_map_unmap.yaml 2024-04-25T19:24:33.762 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_kfsx.yaml 2024-04-25T19:24:33.762 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_image_read.yaml 2024-04-25T19:24:33.762 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_simple_big.yaml 2024-04-25T19:24:33.762 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_concurrent.yaml 2024-04-25T19:24:33.763 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_map_snapshot_io.yaml 2024-04-25T19:24:33.763 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_huge_tickets.yaml 2024-04-25T19:24:33.763 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_kernel.yaml 2024-04-25T19:24:33.763 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/thrash 2024-04-25T19:24:33.764 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/thrash/clusters 2024-04-25T19:24:33.764 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/thrash/clusters/fixed-3.yaml 2024-04-25T19:24:33.764 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/thrash/fs 2024-04-25T19:24:33.764 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/thrash/fs/btrfs.yaml 2024-04-25T19:24:33.764 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/thrash/workloads 2024-04-25T19:24:33.764 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/thrash/workloads/rbd_fio.yaml 2024-04-25T19:24:33.765 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/thrash/workloads/rbd_workunit_suites_ffsb.yaml 2024-04-25T19:24:33.765 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/thrash/workloads/rbd_workunit_suites_iozone.yaml.disabled 2024-04-25T19:24:33.765 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/thrash/conf.yaml 2024-04-25T19:24:33.765 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/thrash/% 2024-04-25T19:24:33.765 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/thrash/thrashers 2024-04-25T19:24:33.765 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/thrash/thrashers/default.yaml 2024-04-25T19:24:33.765 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/krbd/thrash/thrashers/mon-thrasher.yaml 2024-04-25T19:24:33.766 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/buildpackages 2024-04-25T19:24:33.766 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/buildpackages/tests 2024-04-25T19:24:33.766 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/buildpackages/tests/distros 2024-04-25T19:24:33.766 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/buildpackages/tests/% 2024-04-25T19:24:33.766 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/buildpackages/tests/tasks 2024-04-25T19:24:33.767 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/buildpackages/tests/tasks/release.yaml 2024-04-25T19:24:33.767 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/buildpackages/any 2024-04-25T19:24:33.767 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/buildpackages/any/distros 2024-04-25T19:24:33.772 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/buildpackages/any/% 2024-04-25T19:24:33.773 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/buildpackages/any/tasks 2024-04-25T19:24:33.773 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/buildpackages/any/tasks/release.yaml 2024-04-25T19:24:33.773 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados 2024-04-25T19:24:33.773 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/objectstore 2024-04-25T19:24:33.773 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/objectstore/filestore-idempotent-aio-journal.yaml 2024-04-25T19:24:33.773 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/objectstore/ceph_objectstore_tool.yaml 2024-04-25T19:24:33.773 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/objectstore/fusestore.yaml 2024-04-25T19:24:33.773 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/objectstore/keyvaluedb.yaml 2024-04-25T19:24:33.774 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/objectstore/objectstore.yaml 2024-04-25T19:24:33.774 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/objectstore/alloc-hint.yaml 2024-04-25T19:24:33.774 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/objectstore/filejournal.yaml 2024-04-25T19:24:33.774 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/objectstore/objectcacher-stress.yaml 2024-04-25T19:24:33.774 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/objectstore/filestore-idempotent.yaml 2024-04-25T19:24:33.774 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton 2024-04-25T19:24:33.774 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/msgr 2024-04-25T19:24:33.774 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/msgr-failures 2024-04-25T19:24:33.775 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/msgr-failures/many.yaml 2024-04-25T19:24:33.775 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/msgr-failures/few.yaml 2024-04-25T19:24:33.775 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/objectstore 2024-04-25T19:24:33.775 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/fs 2024-04-25T19:24:33.775 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/fs/xfs.yaml 2024-04-25T19:24:33.775 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/% 2024-04-25T19:24:33.776 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all 2024-04-25T19:24:33.776 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all/divergent_priors.yaml 2024-04-25T19:24:33.776 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all/watch-notify-same-primary.yaml 2024-04-25T19:24:33.776 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all/ec-lost-unfound.yaml 2024-04-25T19:24:33.776 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all/rest-api.yaml 2024-04-25T19:24:33.776 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all/mon-config-keys.yaml 2024-04-25T19:24:33.776 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all/mon-thrasher.yaml 2024-04-25T19:24:33.776 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all/osd-recovery-incomplete.yaml 2024-04-25T19:24:33.776 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all/osd-recovery.yaml 2024-04-25T19:24:33.776 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all/admin-socket.yaml 2024-04-25T19:24:33.776 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all/reg11184.yaml 2024-04-25T19:24:33.776 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all/mon-seesaw.yaml 2024-04-25T19:24:33.777 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all/radostool.yaml 2024-04-25T19:24:33.777 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all/thrash_cache_writeback_proxy_none.yaml 2024-04-25T19:24:33.777 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all/dump-stuck.yaml 2024-04-25T19:24:33.777 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all/resolve_stuck_peering.yaml 2024-04-25T19:24:33.777 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all/osd-backfill.yaml 2024-04-25T19:24:33.777 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all/divergent_priors2.yaml 2024-04-25T19:24:33.777 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all/peer.yaml 2024-04-25T19:24:33.777 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all/test_envlibrados_for_rocksdb.yaml 2024-04-25T19:24:33.777 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all/thrash-rados.yaml 2024-04-25T19:24:33.777 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all/lost-unfound.yaml 2024-04-25T19:24:33.777 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all/cephtool.yaml 2024-04-25T19:24:33.777 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all/pg-removal-interruption.yaml 2024-04-25T19:24:33.777 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all/rebuild-mondb.yaml 2024-04-25T19:24:33.778 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/all/lost-unfound-delete.yaml 2024-04-25T19:24:33.778 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton/rados.yaml 2024-04-25T19:24:33.778 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic 2024-04-25T19:24:33.778 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/msgr 2024-04-25T19:24:33.778 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/msgr/async.yaml 2024-04-25T19:24:33.778 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/msgr/simple.yaml 2024-04-25T19:24:33.778 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/msgr/random.yaml 2024-04-25T19:24:33.778 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/clusters 2024-04-25T19:24:33.778 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/clusters/openstack.yaml 2024-04-25T19:24:33.778 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/clusters/fixed-2.yaml 2024-04-25T19:24:33.778 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/clusters/+ 2024-04-25T19:24:33.778 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/msgr-failures 2024-04-25T19:24:33.779 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/msgr-failures/many.yaml 2024-04-25T19:24:33.779 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/msgr-failures/few.yaml 2024-04-25T19:24:33.779 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/objectstore 2024-04-25T19:24:33.779 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/fs 2024-04-25T19:24:33.779 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/fs/btrfs.yaml 2024-04-25T19:24:33.779 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/fs/xfs.yaml 2024-04-25T19:24:33.779 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/% 2024-04-25T19:24:33.779 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/mon_kv_backend 2024-04-25T19:24:33.779 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/tasks 2024-04-25T19:24:33.779 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/tasks/readwrite.yaml 2024-04-25T19:24:33.779 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rados_cls_all.yaml 2024-04-25T19:24:33.779 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rados_workunit_loadgen_mostlyread.yaml 2024-04-25T19:24:33.779 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rados_stress_watch.yaml 2024-04-25T19:24:33.786 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rados_workunit_loadgen_big.yaml 2024-04-25T19:24:33.786 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/tasks/scrub_test.yaml 2024-04-25T19:24:33.786 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rados_workunit_loadgen_mix.yaml 2024-04-25T19:24:33.787 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rados_python.yaml 2024-04-25T19:24:33.787 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/tasks/repair_test.yaml 2024-04-25T19:24:33.787 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rados_api_tests.yaml 2024-04-25T19:24:33.787 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rgw_snaps.yaml 2024-04-25T19:24:33.787 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rados_striper.yaml 2024-04-25T19:24:33.787 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/basic/rados.yaml 2024-04-25T19:24:33.788 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec 2024-04-25T19:24:33.788 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/leveldb.yaml 2024-04-25T19:24:33.788 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/clusters 2024-04-25T19:24:33.788 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/clusters/openstack.yaml 2024-04-25T19:24:33.788 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/clusters/+ 2024-04-25T19:24:33.788 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/clusters/fixed-4.yaml 2024-04-25T19:24:33.788 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/msgr-failures 2024-04-25T19:24:33.789 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/objectstore 2024-04-25T19:24:33.789 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/fs 2024-04-25T19:24:33.789 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/fs/xfs.yaml 2024-04-25T19:24:33.789 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/workloads 2024-04-25T19:24:33.789 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml 2024-04-25T19:24:33.790 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/% 2024-04-25T19:24:33.790 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/thrashers 2024-04-25T19:24:33.790 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/thrashers/default.yaml 2024-04-25T19:24:33.790 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/rados.yaml 2024-04-25T19:24:33.791 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code 2024-04-25T19:24:33.791 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/fast 2024-04-25T19:24:33.791 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/fast/normal.yaml 2024-04-25T19:24:33.791 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/fast/fast.yaml 2024-04-25T19:24:33.791 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/leveldb.yaml 2024-04-25T19:24:33.792 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/clusters 2024-04-25T19:24:33.792 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/msgr-failures 2024-04-25T19:24:33.792 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/objectstore 2024-04-25T19:24:33.792 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/fs 2024-04-25T19:24:33.792 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads 2024-04-25T19:24:33.792 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-small-objects-fast-read-overwrites.yaml 2024-04-25T19:24:33.793 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-small-objects-overwrites.yaml 2024-04-25T19:24:33.793 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml 2024-04-25T19:24:33.793 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-snaps-few-objects-overwrites.yaml 2024-04-25T19:24:33.793 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-radosbench.yaml 2024-04-25T19:24:33.793 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-rados-plugin=jerasure-k=2-m=1.yaml 2024-04-25T19:24:33.793 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-small-objects.yaml 2024-04-25T19:24:33.794 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-small-objects-fast-read.yaml 2024-04-25T19:24:33.794 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-pool-snaps-few-objects-overwrites.yaml 2024-04-25T19:24:33.794 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/% 2024-04-25T19:24:33.794 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers 2024-04-25T19:24:33.794 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/default.yaml 2024-04-25T19:24:33.795 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/fastread.yaml 2024-04-25T19:24:33.795 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/morepggrow.yaml 2024-04-25T19:24:33.795 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/pggrow.yaml 2024-04-25T19:24:33.795 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/mapgap.yaml 2024-04-25T19:24:33.795 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/rados.yaml 2024-04-25T19:24:33.795 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr 2024-04-25T19:24:33.796 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/% 2024-04-25T19:24:33.796 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/all 2024-04-25T19:24:33.796 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/all/multi-backfill-reject.yaml 2024-04-25T19:24:33.796 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/all/full-tiering.yaml 2024-04-25T19:24:33.796 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/all/cache-fs-trunc.yaml 2024-04-25T19:24:33.796 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/all/msgr.yaml 2024-04-25T19:24:33.797 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/all/ceph-post-file.yaml 2024-04-25T19:24:33.809 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/all/export-after-evict.yaml 2024-04-25T19:24:33.810 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/all/valgrind-leaks.yaml 2024-04-25T19:24:33.810 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/rados.yaml 2024-04-25T19:24:33.810 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade 2024-04-25T19:24:33.810 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton 2024-04-25T19:24:33.810 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/6-next-mon 2024-04-25T19:24:33.811 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/6-next-mon/monb.yaml 2024-04-25T19:24:33.811 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/8-next-mon 2024-04-25T19:24:33.811 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/8-next-mon/monc.yaml 2024-04-25T19:24:33.811 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/1-jewel-install 2024-04-25T19:24:33.811 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/1-jewel-install/jewel.yaml 2024-04-25T19:24:33.811 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload 2024-04-25T19:24:33.812 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/readwrite.yaml 2024-04-25T19:24:33.812 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/snaps-few-objects.yaml 2024-04-25T19:24:33.812 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/rbd-cls.yaml 2024-04-25T19:24:33.812 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/rbd-import-export.yaml 2024-04-25T19:24:33.812 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/+ 2024-04-25T19:24:33.812 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/4-mon 2024-04-25T19:24:33.813 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/4-mon/mona.yaml 2024-04-25T19:24:33.813 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/% 2024-04-25T19:24:33.813 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload 2024-04-25T19:24:33.813 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload/rbd-python.yaml 2024-04-25T19:24:33.813 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload/rgw-swift.yaml 2024-04-25T19:24:33.813 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload/snaps-many-objects.yaml 2024-04-25T19:24:33.814 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload/+ 2024-04-25T19:24:33.814 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/2-partial-upgrade 2024-04-25T19:24:33.814 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/2-partial-upgrade/firsthalf.yaml 2024-04-25T19:24:33.814 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/3-thrash 2024-04-25T19:24:33.814 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/3-thrash/default.yaml 2024-04-25T19:24:33.814 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/7-workload 2024-04-25T19:24:33.815 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/7-workload/radosbench.yaml 2024-04-25T19:24:33.815 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/7-workload/rbd_api.yaml 2024-04-25T19:24:33.815 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/7-workload/+ 2024-04-25T19:24:33.815 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/0-cluster 2024-04-25T19:24:33.815 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/0-cluster/openstack.yaml 2024-04-25T19:24:33.815 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/0-cluster/+ 2024-04-25T19:24:33.816 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/0-cluster/start.yaml 2024-04-25T19:24:33.816 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash 2024-04-25T19:24:33.816 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/msgr 2024-04-25T19:24:33.816 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/clusters 2024-04-25T19:24:33.816 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/clusters/3-mons.yaml 2024-04-25T19:24:33.816 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/clusters/9-mons.yaml 2024-04-25T19:24:33.816 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/msgr-failures 2024-04-25T19:24:33.817 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/msgr-failures/mon-delay.yaml 2024-04-25T19:24:33.817 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/msgr-failures/few.yaml 2024-04-25T19:24:33.817 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/objectstore 2024-04-25T19:24:33.817 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/fs 2024-04-25T19:24:33.817 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/fs/xfs.yaml 2024-04-25T19:24:33.817 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/workloads 2024-04-25T19:24:33.818 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/workloads/pool-create-delete.yaml 2024-04-25T19:24:33.818 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/workloads/snaps-few-objects.yaml 2024-04-25T19:24:33.818 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/workloads/rados_mon_workunits.yaml 2024-04-25T19:24:33.818 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/workloads/rados_5925.yaml 2024-04-25T19:24:33.818 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/workloads/rados_api_tests.yaml 2024-04-25T19:24:33.818 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/ceph 2024-04-25T19:24:33.819 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/ceph/ceph.yaml 2024-04-25T19:24:33.819 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/% 2024-04-25T19:24:33.819 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/mon_kv_backend 2024-04-25T19:24:33.819 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/thrashers 2024-04-25T19:24:33.819 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/thrashers/many.yaml 2024-04-25T19:24:33.819 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/thrashers/one.yaml 2024-04-25T19:24:33.820 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/thrashers/sync.yaml 2024-04-25T19:24:33.820 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/thrashers/sync-many.yaml 2024-04-25T19:24:33.829 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/thrashers/force-sync-many.yaml 2024-04-25T19:24:33.829 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/monthrash/rados.yaml 2024-04-25T19:24:33.829 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash 2024-04-25T19:24:33.829 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/msgr 2024-04-25T19:24:33.829 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/clusters 2024-04-25T19:24:33.829 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/clusters/openstack.yaml 2024-04-25T19:24:33.829 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/clusters/fixed-2.yaml 2024-04-25T19:24:33.830 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/clusters/+ 2024-04-25T19:24:33.830 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/1-pg-log-overrides 2024-04-25T19:24:33.830 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/1-pg-log-overrides/normal_pg_log.yaml 2024-04-25T19:24:33.830 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/1-pg-log-overrides/short_pg_log.yaml 2024-04-25T19:24:33.830 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/msgr-failures 2024-04-25T19:24:33.830 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/msgr-failures/few.yaml 2024-04-25T19:24:33.830 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/msgr-failures/fastclose.yaml 2024-04-25T19:24:33.830 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/msgr-failures/osd-delay.yaml 2024-04-25T19:24:33.830 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/0-size-min-size-overrides 2024-04-25T19:24:33.831 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/0-size-min-size-overrides/3-size-2-min-size.yaml 2024-04-25T19:24:33.831 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/0-size-min-size-overrides/2-size-2-min-size.yaml 2024-04-25T19:24:33.831 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/0-size-min-size-overrides/2-size-1-min-size.yaml 2024-04-25T19:24:33.831 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/objectstore 2024-04-25T19:24:33.831 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/fs 2024-04-25T19:24:33.831 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/fs/btrfs.yaml 2024-04-25T19:24:33.831 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/fs/xfs.yaml 2024-04-25T19:24:33.831 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/workloads 2024-04-25T19:24:33.831 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/radosbench.yaml 2024-04-25T19:24:33.831 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/cache-agent-big.yaml 2024-04-25T19:24:33.831 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/cache.yaml 2024-04-25T19:24:33.831 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/cache-agent-small.yaml 2024-04-25T19:24:33.831 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/snaps-few-objects.yaml 2024-04-25T19:24:33.831 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/write_fadvise_dontneed.yaml 2024-04-25T19:24:33.831 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/cache-pool-snaps.yaml 2024-04-25T19:24:33.832 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/admin_socket_objecter_requests.yaml 2024-04-25T19:24:33.832 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/cache-pool-snaps-readproxy.yaml 2024-04-25T19:24:33.832 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/cache-snaps.yaml 2024-04-25T19:24:33.832 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/pool-snaps-few-objects.yaml 2024-04-25T19:24:33.832 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/rados_api_tests.yaml 2024-04-25T19:24:33.832 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/small-objects.yaml 2024-04-25T19:24:33.832 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/hobj-sort.yaml 2024-04-25T19:24:33.832 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/% 2024-04-25T19:24:33.832 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/thrashers 2024-04-25T19:24:33.832 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/thrashers/default.yaml 2024-04-25T19:24:33.832 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/thrashers/morepggrow.yaml 2024-04-25T19:24:33.832 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/thrashers/pggrow.yaml 2024-04-25T19:24:33.832 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/thrashers/mapgap.yaml 2024-04-25T19:24:33.832 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/rocksdb.yaml 2024-04-25T19:24:33.833 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash/rados.yaml 2024-04-25T19:24:33.833 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/verify 2024-04-25T19:24:33.833 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/verify/msgr 2024-04-25T19:24:33.833 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/verify/validater 2024-04-25T19:24:33.833 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/verify/validater/valgrind.yaml 2024-04-25T19:24:33.833 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/verify/validater/lockdep.yaml 2024-04-25T19:24:33.833 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/verify/clusters 2024-04-25T19:24:33.833 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/verify/clusters/openstack.yaml 2024-04-25T19:24:33.833 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/verify/clusters/fixed-2.yaml 2024-04-25T19:24:33.833 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/verify/clusters/+ 2024-04-25T19:24:33.833 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/verify/msgr-failures 2024-04-25T19:24:33.833 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/verify/msgr-failures/few.yaml 2024-04-25T19:24:33.833 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/verify/objectstore 2024-04-25T19:24:33.833 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/verify/fs 2024-04-25T19:24:33.834 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/verify/fs/btrfs.yaml 2024-04-25T19:24:33.834 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/verify/1thrash 2024-04-25T19:24:33.834 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/verify/1thrash/default.yaml 2024-04-25T19:24:33.834 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/verify/1thrash/none.yaml 2024-04-25T19:24:33.834 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/verify/% 2024-04-25T19:24:33.834 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/verify/mon_kv_backend 2024-04-25T19:24:33.834 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/verify/tasks 2024-04-25T19:24:33.834 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/verify/tasks/rados_cls_all.yaml 2024-04-25T19:24:33.834 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/verify/tasks/mon_recovery.yaml 2024-04-25T19:24:33.834 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/verify/tasks/rados_api_tests.yaml 2024-04-25T19:24:33.834 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/verify/rados.yaml 2024-04-25T19:24:33.834 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/multimon 2024-04-25T19:24:33.834 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/multimon/msgr 2024-04-25T19:24:33.850 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/multimon/clusters 2024-04-25T19:24:33.851 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/multimon/clusters/21.yaml 2024-04-25T19:24:33.851 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/multimon/clusters/9.yaml 2024-04-25T19:24:33.851 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/multimon/clusters/3.yaml 2024-04-25T19:24:33.851 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/multimon/clusters/6.yaml 2024-04-25T19:24:33.851 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/multimon/msgr-failures 2024-04-25T19:24:33.851 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/multimon/msgr-failures/many.yaml 2024-04-25T19:24:33.851 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/multimon/msgr-failures/few.yaml 2024-04-25T19:24:33.851 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/multimon/objectstore 2024-04-25T19:24:33.851 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/multimon/fs 2024-04-25T19:24:33.851 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/multimon/fs/xfs.yaml 2024-04-25T19:24:33.852 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/multimon/% 2024-04-25T19:24:33.852 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/multimon/mon_kv_backend 2024-04-25T19:24:33.852 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/multimon/tasks 2024-04-25T19:24:33.852 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/multimon/tasks/mon_clock_with_skews.yaml 2024-04-25T19:24:33.852 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/multimon/tasks/mon_recovery.yaml 2024-04-25T19:24:33.852 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/multimon/tasks/mon_clock_no_skews.yaml 2024-04-25T19:24:33.852 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/multimon/rados.yaml 2024-04-25T19:24:33.852 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa 2024-04-25T19:24:33.852 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/leveldb.yaml 2024-04-25T19:24:33.852 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/clusters 2024-04-25T19:24:33.852 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/msgr-failures 2024-04-25T19:24:33.853 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/objectstore 2024-04-25T19:24:33.853 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/supported 2024-04-25T19:24:33.853 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/fs 2024-04-25T19:24:33.853 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/workloads 2024-04-25T19:24:33.853 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/workloads/ec-rados-plugin=isa-k=2-m=1.yaml 2024-04-25T19:24:33.853 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/arch 2024-04-25T19:24:33.853 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/arch/x86_64.yaml 2024-04-25T19:24:33.853 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/% 2024-04-25T19:24:33.853 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/thrashers 2024-04-25T19:24:33.853 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/rados.yaml 2024-04-25T19:24:33.853 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big 2024-04-25T19:24:33.853 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/cluster 2024-04-25T19:24:33.853 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/cluster/openstack.yaml 2024-04-25T19:24:33.853 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/cluster/12-osds.yaml 2024-04-25T19:24:33.853 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/cluster/+ 2024-04-25T19:24:33.854 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/leveldb.yaml 2024-04-25T19:24:33.854 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/msgr-failures 2024-04-25T19:24:33.854 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/objectstore 2024-04-25T19:24:33.854 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/fs 2024-04-25T19:24:33.854 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/workloads 2024-04-25T19:24:33.854 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml 2024-04-25T19:24:33.854 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/% 2024-04-25T19:24:33.854 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers 2024-04-25T19:24:33.854 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/default.yaml 2024-04-25T19:24:33.854 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/fastread.yaml 2024-04-25T19:24:33.854 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/morepggrow.yaml 2024-04-25T19:24:33.855 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/pggrow.yaml 2024-04-25T19:24:33.855 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/mapgap.yaml 2024-04-25T19:24:33.855 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/rados.yaml 2024-04-25T19:24:33.855 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/knfs 2024-04-25T19:24:33.855 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/knfs/basic 2024-04-25T19:24:33.855 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/knfs/basic/clusters 2024-04-25T19:24:33.855 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/knfs/basic/clusters/extra-client.yaml 2024-04-25T19:24:33.855 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/knfs/basic/fs 2024-04-25T19:24:33.855 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/knfs/basic/fs/xfs.yaml 2024-04-25T19:24:33.855 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/knfs/basic/mount 2024-04-25T19:24:33.855 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/knfs/basic/mount/v4.yaml 2024-04-25T19:24:33.856 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/knfs/basic/mount/v3.yaml 2024-04-25T19:24:33.856 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/knfs/basic/ceph 2024-04-25T19:24:33.856 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/knfs/basic/ceph/base.yaml 2024-04-25T19:24:33.856 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/knfs/basic/% 2024-04-25T19:24:33.856 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/knfs/basic/tasks 2024-04-25T19:24:33.856 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_dbench.yaml 2024-04-25T19:24:33.856 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/knfs/basic/tasks/nfs-workunit-kernel-untar-build.yaml 2024-04-25T19:24:33.856 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_ffsb.yaml 2024-04-25T19:24:33.856 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_blogbench.yaml 2024-04-25T19:24:33.856 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_misc.yaml 2024-04-25T19:24:33.884 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_fsstress.yaml 2024-04-25T19:24:33.884 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_iozone.yaml 2024-04-25T19:24:33.884 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/experimental 2024-04-25T19:24:33.884 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/experimental/multimds 2024-04-25T19:24:33.884 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/experimental/multimds/clusters 2024-04-25T19:24:33.884 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/experimental/multimds/clusters/7-multimds.yaml 2024-04-25T19:24:33.884 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/experimental/multimds/% 2024-04-25T19:24:33.885 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/experimental/multimds/tasks 2024-04-25T19:24:33.885 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/experimental/multimds/tasks/fsstress_thrash_subtrees.yaml 2024-04-25T19:24:33.885 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal 2024-04-25T19:24:33.885 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/fs-misc 2024-04-25T19:24:33.885 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/fs-misc/clusters 2024-04-25T19:24:33.885 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/fs-misc/clusters/two_clients.yaml 2024-04-25T19:24:33.885 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/fs-misc/fs 2024-04-25T19:24:33.885 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/fs-misc/fs/btrfs.yaml 2024-04-25T19:24:33.885 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/fs-misc/% 2024-04-25T19:24:33.885 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/fs-misc/tasks 2024-04-25T19:24:33.885 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/fs-misc/tasks/locktest.yaml 2024-04-25T19:24:33.885 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/basic 2024-04-25T19:24:33.885 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/basic/clusters 2024-04-25T19:24:33.886 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/basic/clusters/fixed-3.yaml 2024-04-25T19:24:33.886 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/basic/fs 2024-04-25T19:24:33.886 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/basic/fs/btrfs.yaml 2024-04-25T19:24:33.886 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/basic/% 2024-04-25T19:24:33.886 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/basic/tasks 2024-04-25T19:24:33.886 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/basic/tasks/kclient_workunit_suites_blogbench.yaml 2024-04-25T19:24:33.886 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/basic/tasks/kclient_workunit_suites_fsx.yaml 2024-04-25T19:24:33.886 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/mds_restart 2024-04-25T19:24:33.886 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/mds_restart/clusters 2024-04-25T19:24:33.886 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/mds_restart/clusters/one_mds.yaml 2024-04-25T19:24:33.886 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/mds_restart/% 2024-04-25T19:24:33.886 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/mds_restart/tasks 2024-04-25T19:24:33.886 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/mds_restart/tasks/restart-workunit-backtraces.yaml 2024-04-25T19:24:33.886 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/multimds 2024-04-25T19:24:33.887 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/multimds/clusters 2024-04-25T19:24:33.887 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/multimds/clusters/3-node-3-mds.yaml 2024-04-25T19:24:33.887 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/multimds/clusters/3-node-9-mds.yaml 2024-04-25T19:24:33.887 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/multimds/fs 2024-04-25T19:24:33.887 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/multimds/fs/btrfs.yaml 2024-04-25T19:24:33.887 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/multimds/% 2024-04-25T19:24:33.887 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/multimds/mounts 2024-04-25T19:24:33.887 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/multimds/mounts/ceph-fuse.yaml 2024-04-25T19:24:33.887 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/multimds/mounts/kclient.yaml 2024-04-25T19:24:33.887 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/multimds/tasks 2024-04-25T19:24:33.887 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_pjd.yaml 2024-04-25T19:24:33.887 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_fsstress.yaml 2024-04-25T19:24:33.887 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_truncate_delay.yaml 2024-04-25T19:24:33.887 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_misc.yaml 2024-04-25T19:24:33.887 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_blogbench.yaml 2024-04-25T19:24:33.888 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_fsync.yaml 2024-04-25T19:24:33.888 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_dbench.yaml 2024-04-25T19:24:33.888 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/multimds/thrash 2024-04-25T19:24:33.888 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/multimds/thrash/normal.yaml 2024-04-25T19:24:33.888 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/marginal/multimds/thrash/exports.yaml 2024-04-25T19:24:33.888 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs 2024-04-25T19:24:33.888 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/cephfs 2024-04-25T19:24:33.888 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/clusters 2024-04-25T19:24:33.888 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/clusters/fixed-3-cephfs.yaml 2024-04-25T19:24:33.888 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/fs 2024-04-25T19:24:33.888 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/fs/xfs.yaml 2024-04-25T19:24:33.888 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/inline 2024-04-25T19:24:33.888 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/inline/yes.yaml 2024-04-25T19:24:33.888 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/inline/no.yaml 2024-04-25T19:24:33.888 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/conf.yaml 2024-04-25T19:24:33.889 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/% 2024-04-25T19:24:33.889 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks 2024-04-25T19:24:33.889 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_misc.yaml 2024-04-25T19:24:33.889 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_fsstress.yaml 2024-04-25T19:24:33.889 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_trivial_sync.yaml 2024-04-25T19:24:33.889 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_snaps.yaml 2024-04-25T19:24:33.889 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_direct_io.yaml 2024-04-25T19:24:33.889 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_fsx.yaml 2024-04-25T19:24:33.910 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_kernel_untar_build.yaml 2024-04-25T19:24:33.910 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_ffsb.yaml 2024-04-25T19:24:33.911 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_dbench.yaml 2024-04-25T19:24:33.911 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_fsync.yaml 2024-04-25T19:24:33.911 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_pjd.yaml 2024-04-25T19:24:33.911 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_iozone.yaml 2024-04-25T19:24:33.911 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_o_trunc.yaml 2024-04-25T19:24:33.911 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients 2024-04-25T19:24:33.912 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/clusters 2024-04-25T19:24:33.912 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/clusters/2-clients.yaml 2024-04-25T19:24:33.912 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/fs 2024-04-25T19:24:33.912 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/fs/xfs.yaml 2024-04-25T19:24:33.912 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/conf.yaml 2024-04-25T19:24:33.912 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/% 2024-04-25T19:24:33.912 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/tasks 2024-04-25T19:24:33.912 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml 2024-04-25T19:24:33.913 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/tasks/kernel_cfuse_workunits_dbench_iozone.yaml 2024-04-25T19:24:33.913 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery 2024-04-25T19:24:33.913 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/dirfrag 2024-04-25T19:24:33.913 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/dirfrag/frag_enable.yaml 2024-04-25T19:24:33.913 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/clusters 2024-04-25T19:24:33.913 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/clusters/4-remote-clients.yaml 2024-04-25T19:24:33.913 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/% 2024-04-25T19:24:33.914 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/mounts 2024-04-25T19:24:33.914 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/mounts/kmounts.yaml 2024-04-25T19:24:33.914 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/xfs.yaml 2024-04-25T19:24:33.914 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks 2024-04-25T19:24:33.914 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/backtrace.yaml 2024-04-25T19:24:33.915 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/forward-scrub.yaml 2024-04-25T19:24:33.915 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/volume-client.yaml 2024-04-25T19:24:33.915 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/config-commands.yaml 2024-04-25T19:24:33.915 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/sessionmap.yaml 2024-04-25T19:24:33.915 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/failover.yaml.disabled 2024-04-25T19:24:33.915 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/data-scan.yaml 2024-04-25T19:24:33.915 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/mds-flush.yaml 2024-04-25T19:24:33.916 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/auto-repair.yaml 2024-04-25T19:24:33.916 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/damage.yaml 2024-04-25T19:24:33.916 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/client-recovery.yaml 2024-04-25T19:24:33.916 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/journal-repair.yaml 2024-04-25T19:24:33.916 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/client-limits.yaml 2024-04-25T19:24:33.916 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/strays.yaml.disabled 2024-04-25T19:24:33.917 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/pool-perm.yaml 2024-04-25T19:24:33.917 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/debug 2024-04-25T19:24:33.917 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/recovery/debug/mds_client.yaml 2024-04-25T19:24:33.917 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/thrash 2024-04-25T19:24:33.917 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/thrash/clusters 2024-04-25T19:24:33.917 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/thrash/clusters/fixed-3-cephfs.yaml 2024-04-25T19:24:33.918 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/thrash/fs 2024-04-25T19:24:33.918 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/thrash/fs/xfs.yaml 2024-04-25T19:24:33.918 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/thrash/workloads 2024-04-25T19:24:33.918 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/thrash/workloads/kclient_workunit_suites_ffsb.yaml 2024-04-25T19:24:33.918 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/thrash/workloads/kclient_workunit_suites_iozone.yaml 2024-04-25T19:24:33.918 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/thrash/conf.yaml 2024-04-25T19:24:33.919 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/thrash/% 2024-04-25T19:24:33.919 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/thrash/thrashers 2024-04-25T19:24:33.919 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/thrash/thrashers/default.yaml 2024-04-25T19:24:33.919 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/thrash/thrashers/mon.yaml 2024-04-25T19:24:33.919 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/kcephfs/thrash/thrashers/mds.yaml 2024-04-25T19:24:33.919 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade 2024-04-25T19:24:33.920 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x 2024-04-25T19:24:33.920 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x 2024-04-25T19:24:33.920 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/point-to-point-upgrade.yaml 2024-04-25T19:24:33.920 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/distros 2024-04-25T19:24:33.920 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/distros/centos_7.2.yaml 2024-04-25T19:24:33.920 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/distros/ubuntu_14.04.yaml 2024-04-25T19:24:33.920 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/% 2024-04-25T19:24:33.920 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel 2024-04-25T19:24:33.920 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/kraken.yaml 2024-04-25T19:24:33.930 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/1-jewel-install 2024-04-25T19:24:33.931 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/1-jewel-install/jewel.yaml 2024-04-25T19:24:33.931 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/4-kraken.yaml 2024-04-25T19:24:33.931 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/3-upgrade-sequence 2024-04-25T19:24:33.931 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/3-upgrade-sequence/upgrade-all.yaml 2024-04-25T19:24:33.931 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/3-upgrade-sequence/upgrade-mon-osd-mds.yaml 2024-04-25T19:24:33.931 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/distros 2024-04-25T19:24:33.931 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/% 2024-04-25T19:24:33.931 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload 2024-04-25T19:24:33.931 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/test_rbd_python.yaml 2024-04-25T19:24:33.931 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/blogbench.yaml 2024-04-25T19:24:33.931 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/rados_api.yaml 2024-04-25T19:24:33.931 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/rados_loadgenbig.yaml 2024-04-25T19:24:33.932 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/ec-rados-default.yaml 2024-04-25T19:24:33.932 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/+ 2024-04-25T19:24:33.932 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/test_rbd_api.yaml 2024-04-25T19:24:33.932 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/0-cluster 2024-04-25T19:24:33.932 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/0-cluster/openstack.yaml 2024-04-25T19:24:33.932 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/0-cluster/+ 2024-04-25T19:24:33.932 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/0-cluster/start.yaml 2024-04-25T19:24:33.932 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload 2024-04-25T19:24:33.932 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/blogbench.yaml 2024-04-25T19:24:33.932 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rados-snaps-few-objects.yaml 2024-04-25T19:24:33.932 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/+ 2024-04-25T19:24:33.932 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rados_loadgenmix.yaml 2024-04-25T19:24:33.932 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rbd_cls.yaml 2024-04-25T19:24:33.932 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rados_mon_thrash.yaml 2024-04-25T19:24:33.932 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rgw_swift.yaml 2024-04-25T19:24:33.933 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rbd_import_export.yaml 2024-04-25T19:24:33.933 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split 2024-04-25T19:24:33.933 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/6-next-mon 2024-04-25T19:24:33.933 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/6-next-mon/monb.yaml 2024-04-25T19:24:33.933 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/8-next-mon 2024-04-25T19:24:33.933 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/8-next-mon/monc.yaml 2024-04-25T19:24:33.933 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/1-jewel-install 2024-04-25T19:24:33.933 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/1-jewel-install/jewel.yaml 2024-04-25T19:24:33.933 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload 2024-04-25T19:24:33.933 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/readwrite.yaml 2024-04-25T19:24:33.933 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/snaps-few-objects.yaml 2024-04-25T19:24:33.933 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/rbd-cls.yaml 2024-04-25T19:24:33.933 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/rbd-import-export.yaml 2024-04-25T19:24:33.933 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/+ 2024-04-25T19:24:33.933 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/4-mon 2024-04-25T19:24:33.934 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/4-mon/mona.yaml 2024-04-25T19:24:33.934 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/distros 2024-04-25T19:24:33.934 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/% 2024-04-25T19:24:33.934 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload 2024-04-25T19:24:33.934 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload/rbd-python.yaml 2024-04-25T19:24:33.934 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload/rgw-swift.yaml 2024-04-25T19:24:33.934 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload/snaps-many-objects.yaml 2024-04-25T19:24:33.934 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload/+ 2024-04-25T19:24:33.934 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/2-partial-upgrade 2024-04-25T19:24:33.934 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/2-partial-upgrade/firsthalf.yaml 2024-04-25T19:24:33.935 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/3-thrash 2024-04-25T19:24:33.935 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/3-thrash/default.yaml 2024-04-25T19:24:33.935 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/7-workload 2024-04-25T19:24:33.935 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/7-workload/radosbench.yaml 2024-04-25T19:24:33.952 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/7-workload/rbd_api.yaml 2024-04-25T19:24:33.952 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/7-workload/+ 2024-04-25T19:24:33.952 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/0-cluster 2024-04-25T19:24:33.952 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/0-cluster/openstack.yaml 2024-04-25T19:24:33.952 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/0-cluster/+ 2024-04-25T19:24:33.952 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/0-cluster/start.yaml 2024-04-25T19:24:33.952 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64 2024-04-25T19:24:33.952 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/6-next-mon 2024-04-25T19:24:33.953 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/8-next-mon 2024-04-25T19:24:33.953 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/1-jewel-install 2024-04-25T19:24:33.953 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/5-workload 2024-04-25T19:24:33.953 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/5-workload/ec-rados-default.yaml 2024-04-25T19:24:33.953 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/4-mon 2024-04-25T19:24:33.953 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/% 2024-04-25T19:24:33.953 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/0-x86_64.yaml 2024-04-25T19:24:33.953 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/9-workload 2024-04-25T19:24:33.953 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/9-workload/ec-rados-plugin=jerasure-k=3-m=1.yaml 2024-04-25T19:24:33.953 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/2-partial-upgrade 2024-04-25T19:24:33.953 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/3-thrash 2024-04-25T19:24:33.953 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/3-thrash/default.yaml 2024-04-25T19:24:33.953 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/0-cluster 2024-04-25T19:24:33.954 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code 2024-04-25T19:24:33.954 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/6-next-mon 2024-04-25T19:24:33.954 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/8-next-mon 2024-04-25T19:24:33.954 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/1-jewel-install 2024-04-25T19:24:33.954 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/5-workload 2024-04-25T19:24:33.954 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/5-workload/ec-rados-default.yaml 2024-04-25T19:24:33.954 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/4-mon 2024-04-25T19:24:33.954 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/distros 2024-04-25T19:24:33.954 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/% 2024-04-25T19:24:33.954 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/9-workload 2024-04-25T19:24:33.954 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/9-workload/ec-rados-plugin=jerasure-k=3-m=1.yaml 2024-04-25T19:24:33.954 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/2-partial-upgrade 2024-04-25T19:24:33.955 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/3-thrash 2024-04-25T19:24:33.955 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/3-thrash/default.yaml 2024-04-25T19:24:33.955 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/0-cluster 2024-04-25T19:24:33.955 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x 2024-04-25T19:24:33.955 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel 2024-04-25T19:24:33.955 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/8-kraken.yaml 2024-04-25T19:24:33.955 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/1-hammer-jewel-install 2024-04-25T19:24:33.955 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/1-hammer-jewel-install/hammer-jewel.yaml 2024-04-25T19:24:33.955 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/4-jewel.yaml 2024-04-25T19:24:33.955 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/3.5-finish.yaml 2024-04-25T19:24:33.955 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/3-upgrade-sequence 2024-04-25T19:24:33.955 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/3-upgrade-sequence/upgrade-osd-mds-mon.yaml 2024-04-25T19:24:33.955 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/3-upgrade-sequence/upgrade-all.yaml 2024-04-25T19:24:33.955 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/7-upgrade-sequence 2024-04-25T19:24:33.955 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/7-upgrade-sequence/upgrade-by-daemon.yaml 2024-04-25T19:24:33.956 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/7-upgrade-sequence/upgrade-all.yaml 2024-04-25T19:24:33.956 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/distros 2024-04-25T19:24:33.956 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/distros/centos_7.2.yaml 2024-04-25T19:24:33.956 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/distros/ubuntu_14.04.yaml 2024-04-25T19:24:33.970 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/% 2024-04-25T19:24:33.970 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload 2024-04-25T19:24:33.970 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rados-snaps-few-objects.yaml 2024-04-25T19:24:33.970 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/+ 2024-04-25T19:24:33.970 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rados_loadgenmix.yaml 2024-04-25T19:24:33.970 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rbd_cls.yaml 2024-04-25T19:24:33.970 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rados_mon_thrash.yaml 2024-04-25T19:24:33.970 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rbd_import_export.yaml 2024-04-25T19:24:33.970 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rgw_s3tests.yaml 2024-04-25T19:24:33.970 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload 2024-04-25T19:24:33.970 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/test_rbd_python.yaml 2024-04-25T19:24:33.970 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/rados_api.yaml 2024-04-25T19:24:33.971 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/rados_loadgenbig.yaml 2024-04-25T19:24:33.971 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/ec-rados-default.yaml 2024-04-25T19:24:33.971 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/+ 2024-04-25T19:24:33.971 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/test_rbd_api.yaml 2024-04-25T19:24:33.971 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload 2024-04-25T19:24:33.971 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/test_rbd_python.yaml 2024-04-25T19:24:33.971 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/rados_api.yaml 2024-04-25T19:24:33.971 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/rados_loadgenbig.yaml 2024-04-25T19:24:33.971 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/ec-rados-default.yaml 2024-04-25T19:24:33.971 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/+ 2024-04-25T19:24:33.971 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/test_rbd_api.yaml 2024-04-25T19:24:33.971 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/5-hammer-jewel-x-upgrade 2024-04-25T19:24:33.971 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/5-hammer-jewel-x-upgrade/hammer-jewel-x.yaml 2024-04-25T19:24:33.971 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/0-cluster 2024-04-25T19:24:33.972 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/0-cluster/start.yaml 2024-04-25T19:24:33.972 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split 2024-04-25T19:24:33.972 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/6-next-mon 2024-04-25T19:24:33.972 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/8-next-mon 2024-04-25T19:24:33.972 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/5-workload 2024-04-25T19:24:33.972 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/4-mon 2024-04-25T19:24:33.972 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/distros 2024-04-25T19:24:33.972 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/distros/centos_7.2.yaml 2024-04-25T19:24:33.972 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/distros/ubuntu_14.04.yaml 2024-04-25T19:24:33.972 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/% 2024-04-25T19:24:33.972 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/9-workload 2024-04-25T19:24:33.972 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/1-hammer-install-and-upgrade-to-jewel 2024-04-25T19:24:33.972 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/1-hammer-install-and-upgrade-to-jewel/hammer-to-jewel.yaml 2024-04-25T19:24:33.972 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/2-partial-upgrade 2024-04-25T19:24:33.973 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/3-thrash 2024-04-25T19:24:33.973 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/7-workload 2024-04-25T19:24:33.973 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/0-cluster 2024-04-25T19:24:33.973 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade 2024-04-25T19:24:33.973 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x 2024-04-25T19:24:33.973 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd 2024-04-25T19:24:33.973 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/1-install 2024-04-25T19:24:33.973 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/1-install/hammer-client-x.yaml 2024-04-25T19:24:33.973 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/% 2024-04-25T19:24:33.973 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/2-workload 2024-04-25T19:24:33.973 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/2-workload/rbd_notification_tests.yaml 2024-04-25T19:24:33.974 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/0-cluster 2024-04-25T19:24:34.004 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/0-cluster/start.yaml 2024-04-25T19:24:34.004 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic 2024-04-25T19:24:34.004 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/1-install 2024-04-25T19:24:34.005 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/1-install/hammer-client-x.yaml 2024-04-25T19:24:34.005 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/% 2024-04-25T19:24:34.005 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/2-workload 2024-04-25T19:24:34.005 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/2-workload/rbd_cli_import_export.yaml 2024-04-25T19:24:34.005 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/2-workload/rbd_api_tests.yaml 2024-04-25T19:24:34.005 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/0-cluster 2024-04-25T19:24:34.005 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/0-cluster/start.yaml 2024-04-25T19:24:34.005 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x 2024-04-25T19:24:34.005 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd 2024-04-25T19:24:34.005 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/1-install 2024-04-25T19:24:34.005 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/1-install/jewel-client-x.yaml 2024-04-25T19:24:34.005 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/% 2024-04-25T19:24:34.005 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/2-workload 2024-04-25T19:24:34.005 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/2-workload/rbd_notification_tests.yaml 2024-04-25T19:24:34.006 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/0-cluster 2024-04-25T19:24:34.006 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/0-cluster/start.yaml 2024-04-25T19:24:34.006 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic 2024-04-25T19:24:34.006 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/1-install 2024-04-25T19:24:34.006 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/1-install/jewel-client-x.yaml 2024-04-25T19:24:34.006 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/% 2024-04-25T19:24:34.006 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/2-workload 2024-04-25T19:24:34.006 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/2-workload/rbd_cli_import_export.yaml 2024-04-25T19:24:34.006 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/2-workload/rbd_api_tests.yaml 2024-04-25T19:24:34.006 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/0-cluster 2024-04-25T19:24:34.006 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/0-cluster/start.yaml 2024-04-25T19:24:34.006 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/dummy 2024-04-25T19:24:34.006 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/dummy/% 2024-04-25T19:24:34.006 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/dummy/all 2024-04-25T19:24:34.006 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/dummy/all/nop.yaml 2024-04-25T19:24:34.007 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/hadoop 2024-04-25T19:24:34.007 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/hadoop/basic 2024-04-25T19:24:34.007 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/hadoop/basic/clusters 2024-04-25T19:24:34.007 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/hadoop/basic/clusters/fixed-3.yaml 2024-04-25T19:24:34.007 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/hadoop/basic/% 2024-04-25T19:24:34.007 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/hadoop/basic/xfs.yaml 2024-04-25T19:24:34.007 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/hadoop/basic/tasks 2024-04-25T19:24:34.007 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/hadoop/basic/tasks/wordcount.yaml 2024-04-25T19:24:34.007 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/hadoop/basic/tasks/repl.yaml 2024-04-25T19:24:34.007 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/hadoop/basic/tasks/terasort.yaml 2024-04-25T19:24:34.007 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology 2024-04-25T19:24:34.007 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/integration.yaml 2024-04-25T19:24:34.007 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/nop 2024-04-25T19:24:34.007 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/nop/% 2024-04-25T19:24:34.007 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/nop/all 2024-04-25T19:24:34.008 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/nop/all/nop.yaml 2024-04-25T19:24:34.008 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/rgw 2024-04-25T19:24:34.008 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/rgw/distros 2024-04-25T19:24:34.008 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/rgw/% 2024-04-25T19:24:34.008 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/rgw/tasks 2024-04-25T19:24:34.008 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/rgw/tasks/s3tests-fastcgi.yaml 2024-04-25T19:24:34.008 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/rgw/tasks/s3tests-fcgi.yaml 2024-04-25T19:24:34.008 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/rgw/tasks/s3tests-civetweb.yaml 2024-04-25T19:24:34.008 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/no-ceph 2024-04-25T19:24:34.008 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/no-ceph/clusters 2024-04-25T19:24:34.008 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/no-ceph/clusters/single.yaml 2024-04-25T19:24:34.008 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/no-ceph/% 2024-04-25T19:24:34.008 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/no-ceph/tasks 2024-04-25T19:24:34.008 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/no-ceph/tasks/teuthology.yaml 2024-04-25T19:24:34.008 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/ceph 2024-04-25T19:24:34.009 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/ceph/clusters 2024-04-25T19:24:34.009 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/ceph/clusters/single.yaml 2024-04-25T19:24:34.009 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/ceph/distros 2024-04-25T19:24:34.009 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/ceph/% 2024-04-25T19:24:34.009 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/ceph/tasks 2024-04-25T19:24:34.033 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/ceph/tasks/teuthology.yaml 2024-04-25T19:24:34.033 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/buildpackages 2024-04-25T19:24:34.033 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/buildpackages/distros 2024-04-25T19:24:34.034 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/buildpackages/% 2024-04-25T19:24:34.034 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/buildpackages/tasks 2024-04-25T19:24:34.034 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/buildpackages/tasks/default.yaml 2024-04-25T19:24:34.034 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/buildpackages/tasks/tag.yaml 2024-04-25T19:24:34.034 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/buildpackages/tasks/branch.yaml 2024-04-25T19:24:34.034 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster 2024-04-25T19:24:34.034 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster/fs 2024-04-25T19:24:34.034 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster/fs/xfs.yaml 2024-04-25T19:24:34.034 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster/% 2024-04-25T19:24:34.035 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster/all 2024-04-25T19:24:34.035 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster/all/thrashosds.yaml 2024-04-25T19:24:34.035 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster/all/ceph.yaml 2024-04-25T19:24:34.035 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster/all/upgrade.yaml 2024-04-25T19:24:34.035 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster/all/workunit.yaml 2024-04-25T19:24:34.035 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/workunits 2024-04-25T19:24:34.035 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/teuthology/workunits/yes.yaml 2024-04-25T19:24:34.035 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds 2024-04-25T19:24:34.036 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/basic 2024-04-25T19:24:34.036 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/basic/overrides 2024-04-25T19:24:34.036 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/basic/overrides/fuse-default-perm-no.yaml 2024-04-25T19:24:34.036 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/basic/overrides/basic 2024-04-25T19:24:34.036 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/basic/overrides/% 2024-04-25T19:24:34.036 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/basic/clusters 2024-04-25T19:24:34.036 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/basic/clusters/9-mds.yaml 2024-04-25T19:24:34.036 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/basic/clusters/3-mds.yaml 2024-04-25T19:24:34.036 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/basic/fs 2024-04-25T19:24:34.036 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/basic/mount 2024-04-25T19:24:34.036 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/basic/mount/kclient.yaml 2024-04-25T19:24:34.036 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/basic/mount/fuse.yaml 2024-04-25T19:24:34.036 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/basic/inline 2024-04-25T19:24:34.036 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/basic/begin.yaml 2024-04-25T19:24:34.037 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/basic/% 2024-04-25T19:24:34.037 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/basic/tasks 2024-04-25T19:24:34.037 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/verify 2024-04-25T19:24:34.037 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/verify/validater 2024-04-25T19:24:34.037 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/verify/overrides 2024-04-25T19:24:34.037 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/verify/overrides/fuse-default-perm-no.yaml 2024-04-25T19:24:34.037 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/verify/overrides/% 2024-04-25T19:24:34.037 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/verify/overrides/verify 2024-04-25T19:24:34.037 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/verify/clusters 2024-04-25T19:24:34.037 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/verify/clusters/9-mds.yaml 2024-04-25T19:24:34.037 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/verify/clusters/3-mds.yaml 2024-04-25T19:24:34.037 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/verify/fs 2024-04-25T19:24:34.037 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/verify/mount 2024-04-25T19:24:34.037 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/verify/mount/kclient.yaml 2024-04-25T19:24:34.038 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/verify/mount/fuse.yaml 2024-04-25T19:24:34.038 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/verify/begin.yaml 2024-04-25T19:24:34.038 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/verify/% 2024-04-25T19:24:34.038 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/multimds/verify/tasks 2024-04-25T19:24:34.038 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke 2024-04-25T19:24:34.038 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/1node 2024-04-25T19:24:34.038 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/1node/clusters 2024-04-25T19:24:34.038 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/1node/clusters/openstack.yaml 2024-04-25T19:24:34.038 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/1node/clusters/+ 2024-04-25T19:24:34.038 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/1node/clusters/fixed-1.yaml 2024-04-25T19:24:34.038 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/1node/% 2024-04-25T19:24:34.038 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/1node/tasks 2024-04-25T19:24:34.038 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/1node/tasks/ceph-deploy.yaml 2024-04-25T19:24:34.038 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/systemd 2024-04-25T19:24:34.039 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/systemd/distro 2024-04-25T19:24:34.039 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/systemd/distro/ubuntu_16.04.yaml 2024-04-25T19:24:34.039 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/systemd/distro/centos_7.2.yaml 2024-04-25T19:24:34.039 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/systemd/% 2024-04-25T19:24:34.039 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/systemd/tasks 2024-04-25T19:24:34.039 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/systemd/tasks/systemd.yaml 2024-04-25T19:24:34.039 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic 2024-04-25T19:24:34.039 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/clusters 2024-04-25T19:24:34.039 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/clusters/fixed-3-cephfs.yaml 2024-04-25T19:24:34.039 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/fs 2024-04-25T19:24:34.039 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/fs/btrfs.yaml 2024-04-25T19:24:34.039 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/% 2024-04-25T19:24:34.039 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks 2024-04-25T19:24:34.039 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/libcephfs_interface_tests.yaml 2024-04-25T19:24:34.039 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rados_cache_snaps.yaml 2024-04-25T19:24:34.040 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rados_cls_all.yaml 2024-04-25T19:24:34.040 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rbd_cli_import_export.yaml 2024-04-25T19:24:34.046 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/kclient_workunit_suites_fsstress.yaml 2024-04-25T19:24:34.046 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/cfuse_workunit_suites_pjd.yaml 2024-04-25T19:24:34.047 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/mon_thrash.yaml 2024-04-25T19:24:34.047 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/kclient_workunit_direct_io.yaml 2024-04-25T19:24:34.047 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rbd_fsx.yaml 2024-04-25T19:24:34.047 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rbd_python_api_tests.yaml 2024-04-25T19:24:34.047 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rbd_workunit_suites_iozone.yaml 2024-04-25T19:24:34.047 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/kclient_workunit_suites_dbench.yaml 2024-04-25T19:24:34.047 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rbd_api_tests.yaml 2024-04-25T19:24:34.047 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/cfuse_workunit_suites_blogbench.yaml 2024-04-25T19:24:34.047 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rados_ec_snaps.yaml 2024-04-25T19:24:34.047 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rgw_ec_s3tests.yaml 2024-04-25T19:24:34.047 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/kclient_workunit_suites_pjd.yaml 2024-04-25T19:24:34.047 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rados_workunit_loadgen_mix.yaml 2024-04-25T19:24:34.048 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rados_python.yaml 2024-04-25T19:24:34.048 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rgw_swift.yaml 2024-04-25T19:24:34.048 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rados_bench.yaml 2024-04-25T19:24:34.048 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rados_api_tests.yaml 2024-04-25T19:24:34.048 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/cfuse_workunit_suites_fsstress.yaml 2024-04-25T19:24:34.048 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rgw_s3tests.yaml 2024-04-25T19:24:34.048 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/cfuse_workunit_suites_iozone.yaml 2024-04-25T19:24:34.048 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/machine_types 2024-04-25T19:24:34.048 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/machine_types/vps.yaml 2024-04-25T19:24:34.048 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/machine_types/schedule_rados_ovh.sh 2024-04-25T19:24:34.048 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/machine_types/schedule_rados.sh 2024-04-25T19:24:34.048 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/mon_kv_backend 2024-04-25T19:24:34.048 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/mon_kv_backend/leveldb.yaml 2024-04-25T19:24:34.048 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/mon_kv_backend/rocksdb.yaml 2024-04-25T19:24:34.048 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/README 2024-04-25T19:24:34.049 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks 2024-04-25T19:24:34.049 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/rebuild_mondb.py 2024-04-25T19:24:34.049 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/workunit.py 2024-04-25T19:24:34.049 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/osd_backfill.py 2024-04-25T19:24:34.049 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/calamari_setup.py 2024-04-25T19:24:34.049 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/object_source_down.py 2024-04-25T19:24:34.049 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/populate_rbd_pool.py 2024-04-25T19:24:34.049 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/util 2024-04-25T19:24:34.049 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/util/rgw.py 2024-04-25T19:24:34.050 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/util/__init__.py 2024-04-25T19:24:34.050 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/util/rados.py 2024-04-25T19:24:34.050 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/util/test 2024-04-25T19:24:34.050 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/util/test/__init__.py 2024-04-25T19:24:34.050 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/util/test/test_rados.py 2024-04-25T19:24:34.050 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/osd_failsafe_enospc.py 2024-04-25T19:24:34.050 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/osd_recovery.py 2024-04-25T19:24:34.050 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/die_on_err.py 2024-04-25T19:24:34.050 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/calamari_nosetests.py 2024-04-25T19:24:34.050 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/admin_socket.py 2024-04-25T19:24:34.050 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/mgr 2024-04-25T19:24:34.050 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/mgr/__init__.py 2024-04-25T19:24:34.050 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/mgr/test_failover.py 2024-04-25T19:24:34.050 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/mgr/mgr_test_case.py 2024-04-25T19:24:34.051 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/thrash_pool_snaps.py 2024-04-25T19:24:34.051 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/userdata_teardown.yaml 2024-04-25T19:24:34.051 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/radosbenchsweep.py 2024-04-25T19:24:34.051 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/mds_thrash.py 2024-04-25T19:24:34.051 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/rbd.py 2024-04-25T19:24:34.051 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/rgw.py 2024-04-25T19:24:34.051 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/teuthology_integration.py 2024-04-25T19:24:34.051 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/mon_seesaw.py 2024-04-25T19:24:34.051 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/repair_test.py 2024-04-25T19:24:34.051 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/watch_notify_same_primary.py 2024-04-25T19:24:34.051 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/peer.py 2024-04-25T19:24:34.051 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/restart.py 2024-04-25T19:24:34.052 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/ceph.py 2024-04-25T19:24:34.052 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/tests 2024-04-25T19:24:34.052 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/tests/test_buildpackages.py 2024-04-25T19:24:34.052 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/tests/test_radosgw_admin.py 2024-04-25T19:24:34.052 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/tests/test_devstack.py 2024-04-25T19:24:34.052 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/tests/__init__.py 2024-04-25T19:24:34.052 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/rgw_logsocket.py 2024-04-25T19:24:34.052 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/radosgw_admin.py 2024-04-25T19:24:34.052 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/ceph_client.py 2024-04-25T19:24:34.053 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/__init__.py 2024-04-25T19:24:34.053 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/aver.py 2024-04-25T19:24:34.053 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cram.py 2024-04-25T19:24:34.053 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs 2024-04-25T19:24:34.053 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/test_misc.py 2024-04-25T19:24:34.053 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/test_client_limits.py 2024-04-25T19:24:34.053 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/test_pool_perm.py 2024-04-25T19:24:34.053 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/test_data_scan.py 2024-04-25T19:24:34.053 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/test_client_recovery.py 2024-04-25T19:24:34.053 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/test_journal_migration.py 2024-04-25T19:24:34.054 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/test_dump_tree.py 2024-04-25T19:24:34.054 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/test_mantle.py 2024-04-25T19:24:34.054 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/test_sessionmap.py 2024-04-25T19:24:34.054 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/__init__.py 2024-04-25T19:24:34.054 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/test_journal_repair.py 2024-04-25T19:24:34.054 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/kernel_mount.py 2024-04-25T19:24:34.055 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/test_cap_flush.py 2024-04-25T19:24:34.055 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/test_readahead.py 2024-04-25T19:24:34.055 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/test_backtrace.py 2024-04-25T19:24:34.056 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/test_auto_repair.py 2024-04-25T19:24:34.056 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/test_strays.py 2024-04-25T19:24:34.056 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/test_volume_client.py 2024-04-25T19:24:34.056 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/cephfs_test_case.py 2024-04-25T19:24:34.056 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/test_fragment.py 2024-04-25T19:24:34.056 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/test_failover.py 2024-04-25T19:24:34.056 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/test_full.py 2024-04-25T19:24:34.056 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/filesystem.py 2024-04-25T19:24:34.056 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/mount.py 2024-04-25T19:24:34.056 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/test_damage.py 2024-04-25T19:24:34.056 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/test_scrub_checks.py 2024-04-25T19:24:34.056 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/test_config_commands.py 2024-04-25T19:24:34.056 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/test_flush.py 2024-04-25T19:24:34.056 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/fuse_mount.py 2024-04-25T19:24:34.057 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs/test_forward_scrub.py 2024-04-25T19:24:34.057 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/recovery_bench.py 2024-04-25T19:24:34.057 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/multibench.py 2024-04-25T19:24:34.057 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/devstack.py 2024-04-25T19:24:34.057 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cephfs_test_runner.py 2024-04-25T19:24:34.057 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/filestore_idempotent.py 2024-04-25T19:24:34.057 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/mod_proxy_fcgi.tcp.conf.template 2024-04-25T19:24:34.057 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/scrub.py 2024-04-25T19:24:34.057 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/divergent_priors.py 2024-04-25T19:24:34.057 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/samba.py 2024-04-25T19:24:34.057 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/watch_notify_stress.py 2024-04-25T19:24:34.057 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/boto.cfg.template 2024-04-25T19:24:34.057 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/buildpackages.py 2024-04-25T19:24:34.058 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/ceph_test_case.py 2024-04-25T19:24:34.058 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/s3roundtrip.py 2024-04-25T19:24:34.058 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/qemu.py 2024-04-25T19:24:34.058 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/locktest.py 2024-04-25T19:24:34.058 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/manypools.py 2024-04-25T19:24:34.058 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/mds_creation_failure.py 2024-04-25T19:24:34.058 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/apache.conf.template 2024-04-25T19:24:34.058 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/ec_lost_unfound.py 2024-04-25T19:24:34.058 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/buildpackages 2024-04-25T19:24:34.058 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/buildpackages/ubuntu-16.04-user-data.txt 2024-04-25T19:24:34.059 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/buildpackages/ubuntu-14.04-user-data.txt 2024-04-25T19:24:34.059 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/buildpackages/centos-6.5-user-data.txt 2024-04-25T19:24:34.059 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/buildpackages/centos-7.1-user-data.txt 2024-04-25T19:24:34.059 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/buildpackages/make-deb.sh 2024-04-25T19:24:34.059 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/buildpackages/centos-7.0-user-data.txt 2024-04-25T19:24:34.059 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/buildpackages/make-rpm.sh 2024-04-25T19:24:34.059 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/buildpackages/opensuse-42.1-user-data.txt 2024-04-25T19:24:34.059 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/buildpackages/Makefile 2024-04-25T19:24:34.059 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/buildpackages/ubuntu-12.04-user-data.txt 2024-04-25T19:24:34.060 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/buildpackages/common.sh 2024-04-25T19:24:34.060 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/buildpackages/user-data.txt 2024-04-25T19:24:34.060 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/buildpackages/debian-8.0-user-data.txt 2024-04-25T19:24:34.060 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/buildpackages/centos-7.2-user-data.txt 2024-04-25T19:24:34.060 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/rbd_mirror.py 2024-04-25T19:24:34.060 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/dump_stuck.py 2024-04-25T19:24:34.060 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/ceph_objectstore_tool.py 2024-04-25T19:24:34.060 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/rbd_fsx.py 2024-04-25T19:24:34.060 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/radosgw_agent.py 2024-04-25T19:24:34.060 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/tgt.py 2024-04-25T19:24:34.060 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/vstart_runner.py 2024-04-25T19:24:34.060 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/resolve_stuck_peering.py 2024-04-25T19:24:34.061 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/rados.py 2024-04-25T19:24:34.061 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/s3tests.py 2024-04-25T19:24:34.061 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/userdata_setup.yaml 2024-04-25T19:24:34.061 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/lost_unfound.py 2024-04-25T19:24:34.061 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/s3readwrite.py 2024-04-25T19:24:34.061 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/ceph_fuse.py 2024-04-25T19:24:34.061 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/rest_api.py 2024-04-25T19:24:34.061 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/reg11184.py 2024-04-25T19:24:34.061 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/rep_lost_unfound_delete.py 2024-04-25T19:24:34.061 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/mod_proxy_fcgi.uds.conf.template 2024-04-25T19:24:34.061 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/ceph_deploy.py 2024-04-25T19:24:34.061 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/ceph_manager.py 2024-04-25T19:24:34.061 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/radosbench.py 2024-04-25T19:24:34.061 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/scrub_test.py 2024-04-25T19:24:34.062 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/mon_clock_skew_check.py 2024-04-25T19:24:34.062 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/kclient.py 2024-04-25T19:24:34.062 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/omapbench.py 2024-04-25T19:24:34.062 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/autotest.py 2024-04-25T19:24:34.062 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/mod_fastcgi.conf.template 2024-04-25T19:24:34.062 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/peering_speed_test.py 2024-04-25T19:24:34.062 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/mon_recovery.py 2024-04-25T19:24:34.062 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/cifs_mount.py 2024-04-25T19:24:34.062 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/rbd_fio.py 2024-04-25T19:24:34.062 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/logrotate.conf 2024-04-25T19:24:34.062 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/mon_thrash.py 2024-04-25T19:24:34.062 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/metadata.yaml 2024-04-25T19:24:34.063 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/divergent_priors2.py 2024-04-25T19:24:34.063 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/blktrace.py 2024-04-25T19:24:34.063 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/thrashosds.py 2024-04-25T19:24:34.063 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/systemd.py 2024-04-25T19:24:34.063 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/radosgw_admin_rest.py 2024-04-25T19:24:34.063 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/tasks/create_verify_lfn_objects.py 2024-04-25T19:24:34.063 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/timezone 2024-04-25T19:24:34.063 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/timezone/random.yaml 2024-04-25T19:24:34.063 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/timezone/eastern.yaml 2024-04-25T19:24:34.063 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/timezone/pacific.yaml 2024-04-25T19:24:34.063 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/.gitignore 2024-04-25T19:24:34.064 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/debug 2024-04-25T19:24:34.064 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/debug/openstack-30G.yaml 2024-04-25T19:24:34.064 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/debug/buildpackages.yaml 2024-04-25T19:24:34.064 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/debug/mds_client.yaml 2024-04-25T19:24:34.064 INFO:teuthology.orchestra.run.smithi131.stdout:./ceph-qa-suite/debug/openstack-15G.yaml 2024-04-25T19:24:34.064 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:34.065 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:34.065 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:34.065 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:34.065 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T19:24:34.065 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:34.203 INFO:teuthology.orchestra.run.smithi131.stdout:1 2024-04-25T19:24:34.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:34.216 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:34.217 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:34.217 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:34.217 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:34.217 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite").st_ino) 2024-04-25T19:24:34.217 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:34.385 INFO:teuthology.orchestra.run.smithi131.stdout:1099511627776 2024-04-25T19:24:34.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:34.399 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:34.399 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:34.399 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:34.399 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:34.399 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code").st_ino) 2024-04-25T19:24:34.399 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:34.581 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628424 2024-04-25T19:24:34.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:34.595 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:34.595 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:34.595 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:34.595 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:34.595 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml").st_ino) 2024-04-25T19:24:34.595 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:34.780 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628432 2024-04-25T19:24:34.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:34.796 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:34.796 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:34.796 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:34.796 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:34.796 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-rados-plugin=jerasure-k=3-m=1.yaml").st_ino) 2024-04-25T19:24:34.797 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:34.984 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628431 2024-04-25T19:24:34.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:35.003 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:35.004 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:35.004 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:35.004 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:35.004 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-rados-plugin=isa-k=2-m=1.yaml").st_ino) 2024-04-25T19:24:35.004 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:35.165 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628429 2024-04-25T19:24:35.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:35.177 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:35.177 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:35.177 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:35.177 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:35.177 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-rados-plugin=jerasure-k=2-m=1.yaml").st_ino) 2024-04-25T19:24:35.177 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:35.352 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628430 2024-04-25T19:24:35.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:35.365 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:35.365 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:35.365 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:35.365 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:35.365 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-rados-plugin=shec-k=4-m=3-c=2.yaml").st_ino) 2024-04-25T19:24:35.365 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:35.549 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628433 2024-04-25T19:24:35.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:35.563 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:35.563 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:35.563 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:35.563 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:35.563 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-feature-plugins-v3.yaml").st_ino) 2024-04-25T19:24:35.563 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:35.747 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628426 2024-04-25T19:24:35.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:35.761 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:35.761 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:35.761 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:35.761 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:35.761 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-rados-default.yaml").st_ino) 2024-04-25T19:24:35.761 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:35.943 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628427 2024-04-25T19:24:35.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:35.957 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:35.957 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:35.957 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:35.957 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:35.957 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-rados-sequential.yaml").st_ino) 2024-04-25T19:24:35.957 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:36.142 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628434 2024-04-25T19:24:36.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:36.155 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:36.155 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:36.155 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:36.155 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:36.155 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-rados-parallel.yaml").st_ino) 2024-04-25T19:24:36.155 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:36.300 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:24:36.308 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:24:36.328 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628428 2024-04-25T19:24:36.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:36.342 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:36.342 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:36.342 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:36.342 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:36.342 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-feature-plugins-v2.yaml").st_ino) 2024-04-25T19:24:36.342 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:36.518 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628425 2024-04-25T19:24:36.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:36.531 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:36.531 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:36.531 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:36.531 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:36.531 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/releases").st_ino) 2024-04-25T19:24:36.531 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:36.669 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628459 2024-04-25T19:24:36.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:36.683 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:36.683 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:36.683 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:36.683 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:36.683 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/releases/jewel.yaml").st_ino) 2024-04-25T19:24:36.683 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:36.868 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628461 2024-04-25T19:24:36.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:36.882 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:36.882 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:36.882 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:36.882 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:36.882 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/releases/kraken.yaml").st_ino) 2024-04-25T19:24:36.883 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:37.064 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628462 2024-04-25T19:24:37.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:37.078 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:37.078 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:37.078 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:37.078 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:37.078 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/releases/infernalis.yaml").st_ino) 2024-04-25T19:24:37.078 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:37.261 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628460 2024-04-25T19:24:37.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:37.275 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:37.275 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:37.275 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:37.275 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:37.276 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tox.ini").st_ino) 2024-04-25T19:24:37.276 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:37.460 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630231 2024-04-25T19:24:37.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:37.474 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:37.475 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:37.475 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:37.475 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:37.475 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/ceph-deploy-overrides").st_ino) 2024-04-25T19:24:37.475 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:37.648 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628345 2024-04-25T19:24:37.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:37.662 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:37.662 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:37.662 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:37.662 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:37.662 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/ceph-deploy-overrides/enable_dmcrypt_diff_journal_disk.yaml").st_ino) 2024-04-25T19:24:37.662 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:37.845 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628349 2024-04-25T19:24:37.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:37.858 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:37.858 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:37.859 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:37.859 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:37.859 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/ceph-deploy-overrides/ceph_deploy_dmcrypt.yaml").st_ino) 2024-04-25T19:24:37.859 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:38.031 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628346 2024-04-25T19:24:38.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:38.044 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:38.044 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:38.044 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:38.044 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:38.044 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/ceph-deploy-overrides/enable_diff_journal_disk.yaml").st_ino) 2024-04-25T19:24:38.045 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:38.234 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628348 2024-04-25T19:24:38.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:38.246 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:38.246 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:38.246 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:38.246 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:38.246 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/ceph-deploy-overrides/disable_diff_journal_disk.yaml").st_ino) 2024-04-25T19:24:38.246 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:38.428 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628347 2024-04-25T19:24:38.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:38.443 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:38.443 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:38.443 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:38.443 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:38.443 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/nightlies").st_ino) 2024-04-25T19:24:38.443 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:38.625 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628446 2024-04-25T19:24:38.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:38.639 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:38.639 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:38.640 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:38.640 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:38.640 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/nightlies/cron_wrapper").st_ino) 2024-04-25T19:24:38.640 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:38.824 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628447 2024-04-25T19:24:38.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:38.838 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:38.838 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:38.838 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:38.838 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:38.838 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/overrides").st_ino) 2024-04-25T19:24:38.838 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:39.019 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628451 2024-04-25T19:24:39.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:39.032 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:39.032 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:39.032 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:39.032 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:39.033 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/overrides/3-size-2-min-size.yaml").st_ino) 2024-04-25T19:24:39.033 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:39.217 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628454 2024-04-25T19:24:39.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:39.231 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:39.231 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:39.231 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:39.231 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:39.232 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-04-25T19:24:39.232 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:39.410 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628456 2024-04-25T19:24:39.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:39.423 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:39.423 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:39.423 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:39.423 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:39.423 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/overrides/2-size-2-min-size.yaml").st_ino) 2024-04-25T19:24:39.424 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:39.611 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628453 2024-04-25T19:24:39.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:39.624 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:39.624 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:39.624 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:39.624 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:39.624 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/overrides/2-size-1-min-size.yaml").st_ino) 2024-04-25T19:24:39.624 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:39.804 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628452 2024-04-25T19:24:39.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:39.817 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:39.817 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:39.817 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:39.817 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:39.817 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/overrides/short_pg_log.yaml").st_ino) 2024-04-25T19:24:39.817 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:40.000 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628455 2024-04-25T19:24:40.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:40.017 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:40.017 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:40.017 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:40.017 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:40.018 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/packages").st_ino) 2024-04-25T19:24:40.018 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:40.174 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628457 2024-04-25T19:24:40.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:40.187 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:40.188 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:40.188 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:40.188 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:40.188 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/packages/packages.yaml").st_ino) 2024-04-25T19:24:40.188 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:40.367 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628458 2024-04-25T19:24:40.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:40.379 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:40.380 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:40.380 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:40.380 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:40.380 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/clusters").st_ino) 2024-04-25T19:24:40.380 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:40.561 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628375 2024-04-25T19:24:40.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:40.575 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:40.575 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:40.575 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:40.575 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:40.575 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/clusters/extra-client.yaml").st_ino) 2024-04-25T19:24:40.575 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:40.757 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628376 2024-04-25T19:24:40.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:40.771 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:40.771 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:40.771 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:40.771 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:40.771 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/clusters/fixed-2.yaml").st_ino) 2024-04-25T19:24:40.771 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:40.943 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628378 2024-04-25T19:24:40.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:40.956 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:40.956 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:40.956 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:40.956 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:40.957 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/clusters/fixed-3.yaml").st_ino) 2024-04-25T19:24:40.957 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:41.139 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628380 2024-04-25T19:24:41.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:41.152 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:41.153 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:41.153 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:41.153 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:41.153 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/clusters/fixed-3-cephfs.yaml").st_ino) 2024-04-25T19:24:41.153 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:41.335 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628379 2024-04-25T19:24:41.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:41.349 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:41.349 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:41.349 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:41.349 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:41.349 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/clusters/fixed-4.yaml").st_ino) 2024-04-25T19:24:41.349 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:41.534 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628381 2024-04-25T19:24:41.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:41.548 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:41.548 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:41.548 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:41.548 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:41.548 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/clusters/fixed-1.yaml").st_ino) 2024-04-25T19:24:41.548 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:41.735 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628377 2024-04-25T19:24:41.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:41.749 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:41.749 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:41.749 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:41.749 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:41.749 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs").st_ino) 2024-04-25T19:24:41.749 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:41.932 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628350 2024-04-25T19:24:41.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:41.947 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:41.947 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:41.947 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:41.947 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:41.947 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides").st_ino) 2024-04-25T19:24:41.948 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:42.126 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628359 2024-04-25T19:24:42.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:42.140 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:42.140 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:42.140 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:42.140 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:42.140 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-04-25T19:24:42.140 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:42.313 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628367 2024-04-25T19:24:42.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:42.327 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:42.327 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:42.327 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:42.327 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:42.327 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides/debug.yaml").st_ino) 2024-04-25T19:24:42.327 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:42.509 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628360 2024-04-25T19:24:42.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:42.523 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:42.523 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:42.523 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:42.523 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:42.523 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides/fuse").st_ino) 2024-04-25T19:24:42.524 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:42.706 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628362 2024-04-25T19:24:42.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:42.721 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:42.721 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:42.721 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:42.721 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:42.721 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides/fuse/default-perm").st_ino) 2024-04-25T19:24:42.721 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:42.903 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628363 2024-04-25T19:24:42.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:42.917 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:42.917 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:42.917 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:42.917 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:42.917 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides/fuse/default-perm/yes.yaml").st_ino) 2024-04-25T19:24:42.917 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:43.107 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628366 2024-04-25T19:24:43.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:43.121 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:43.121 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:43.121 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:43.121 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:43.121 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides/fuse/default-perm/no.yaml").st_ino) 2024-04-25T19:24:43.121 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:43.306 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628365 2024-04-25T19:24:43.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:43.320 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:43.320 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:43.321 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:43.321 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:43.321 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides/fuse/default-perm/%").st_ino) 2024-04-25T19:24:43.321 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:43.501 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628364 2024-04-25T19:24:43.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:43.515 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:43.515 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:43.516 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:43.516 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:43.516 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides/frag_enable.yaml").st_ino) 2024-04-25T19:24:43.516 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:43.701 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628361 2024-04-25T19:24:43.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:43.714 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:43.715 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:43.715 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:43.715 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:43.715 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/clusters").st_ino) 2024-04-25T19:24:43.715 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:43.898 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628352 2024-04-25T19:24:43.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:43.912 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:43.912 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:43.912 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:43.912 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:43.912 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/clusters/9-mds.yaml").st_ino) 2024-04-25T19:24:43.912 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:44.093 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628354 2024-04-25T19:24:44.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:44.107 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:44.107 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:44.107 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:44.108 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:44.108 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/clusters/3-mds.yaml").st_ino) 2024-04-25T19:24:44.108 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:44.290 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628353 2024-04-25T19:24:44.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:44.304 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:44.304 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:44.305 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:44.305 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:44.305 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/clusters/fixed-2-ucephfs.yaml").st_ino) 2024-04-25T19:24:44.305 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:44.487 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628355 2024-04-25T19:24:44.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:44.501 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:44.501 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:44.501 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:44.501 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:44.501 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/mount").st_ino) 2024-04-25T19:24:44.501 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:44.684 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628356 2024-04-25T19:24:44.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:44.698 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:44.698 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:44.698 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:44.698 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:44.698 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/mount/kclient.yaml").st_ino) 2024-04-25T19:24:44.698 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:44.871 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628358 2024-04-25T19:24:44.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:44.885 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:44.885 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:44.885 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:44.885 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:44.885 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/mount/fuse.yaml").st_ino) 2024-04-25T19:24:44.886 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:45.068 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628357 2024-04-25T19:24:45.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:45.081 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:45.081 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:45.081 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:45.081 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:45.081 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/begin.yaml").st_ino) 2024-04-25T19:24:45.082 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:45.265 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628351 2024-04-25T19:24:45.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:45.279 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:45.279 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:45.279 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:45.279 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:45.279 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/tasks").st_ino) 2024-04-25T19:24:45.279 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:45.451 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628368 2024-04-25T19:24:45.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:45.465 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:45.465 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:45.465 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:45.465 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:45.465 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/tasks/libcephfs_interface_tests.yaml").st_ino) 2024-04-25T19:24:45.465 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:45.648 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628374 2024-04-25T19:24:45.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:45.662 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:45.662 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:45.662 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:45.662 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:45.662 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/tasks/cfuse_workunit_trivial_sync.yaml").st_ino) 2024-04-25T19:24:45.662 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:45.844 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628373 2024-04-25T19:24:45.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:45.858 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:45.858 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:45.858 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:45.858 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:45.859 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/tasks/cfuse_workunit_suites_ffsb.yaml").st_ino) 2024-04-25T19:24:45.859 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:46.063 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628371 2024-04-25T19:24:46.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:46.090 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:46.091 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:46.091 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:46.091 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:46.091 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/tasks/cfuse_workunit_suites_blogbench.yaml").st_ino) 2024-04-25T19:24:46.091 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:46.311 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628369 2024-04-25T19:24:46.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:46.323 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:46.323 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:46.323 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:46.323 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:46.323 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/tasks/cfuse_workunit_suites_fsstress.yaml").st_ino) 2024-04-25T19:24:46.323 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:46.476 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628372 2024-04-25T19:24:46.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:46.488 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:46.488 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:46.489 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:46.489 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:46.489 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/tasks/cfuse_workunit_suites_dbench.yaml").st_ino) 2024-04-25T19:24:46.489 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:46.664 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628370 2024-04-25T19:24:46.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:46.678 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:46.678 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:46.678 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:46.678 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:46.679 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/objectstore").st_ino) 2024-04-25T19:24:46.679 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:46.837 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628448 2024-04-25T19:24:46.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:46.849 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:46.849 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:46.849 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:46.849 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:46.849 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/objectstore/bluestore.yaml").st_ino) 2024-04-25T19:24:46.849 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:47.028 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628449 2024-04-25T19:24:47.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:47.042 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:47.042 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:47.042 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:47.042 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:47.042 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/objectstore/filestore.yaml").st_ino) 2024-04-25T19:24:47.042 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:47.218 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628450 2024-04-25T19:24:47.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:47.231 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:47.231 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:47.231 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:47.231 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:47.231 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/config").st_ino) 2024-04-25T19:24:47.231 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:47.407 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628382 2024-04-25T19:24:47.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:47.419 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:47.419 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:47.419 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:47.419 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:47.420 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/config/rados.yaml").st_ino) 2024-04-25T19:24:47.420 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:47.601 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628383 2024-04-25T19:24:47.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:47.615 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:47.615 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:47.615 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:47.615 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:47.616 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/archs").st_ino) 2024-04-25T19:24:47.616 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:47.798 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628340 2024-04-25T19:24:47.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:47.811 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:47.811 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:47.811 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:47.811 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:47.811 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/archs/armv7.yaml").st_ino) 2024-04-25T19:24:47.811 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:47.983 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628342 2024-04-25T19:24:47.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:47.997 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:47.997 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:47.997 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:47.997 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:47.998 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/archs/i686.yaml").st_ino) 2024-04-25T19:24:47.998 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:48.183 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628343 2024-04-25T19:24:48.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:48.196 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:48.196 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:48.196 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:48.196 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:48.197 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/archs/aarch64.yaml").st_ino) 2024-04-25T19:24:48.197 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:48.374 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628341 2024-04-25T19:24:48.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:48.388 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:48.388 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:48.388 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:48.388 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:48.388 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/archs/x86_64.yaml").st_ino) 2024-04-25T19:24:48.388 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:48.570 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628344 2024-04-25T19:24:48.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:48.584 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:48.584 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:48.584 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:48.585 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:48.585 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/fs").st_ino) 2024-04-25T19:24:48.585 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:48.765 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628435 2024-04-25T19:24:48.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:48.779 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:48.780 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:48.780 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:48.780 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:48.780 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/fs/btrfs.yaml").st_ino) 2024-04-25T19:24:48.780 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:48.969 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628436 2024-04-25T19:24:48.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:48.983 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:48.983 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:48.983 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:48.983 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:48.983 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/fs/xfs.yaml").st_ino) 2024-04-25T19:24:48.983 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:49.168 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628438 2024-04-25T19:24:49.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:49.183 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:49.183 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:49.183 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:49.183 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:49.183 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/fs/ext4.yaml").st_ino) 2024-04-25T19:24:49.184 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:49.357 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628437 2024-04-25T19:24:49.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:49.371 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:49.371 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:49.371 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:49.371 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:49.372 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/rgw_pool_type").st_ino) 2024-04-25T19:24:49.372 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:49.556 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628463 2024-04-25T19:24:49.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:49.569 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:49.570 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:49.570 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:49.570 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:49.570 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/rgw_pool_type/ec-profile.yaml").st_ino) 2024-04-25T19:24:49.570 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:49.752 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628465 2024-04-25T19:24:49.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:49.766 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:49.766 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:49.766 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:49.766 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:49.766 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/rgw_pool_type/ec.yaml").st_ino) 2024-04-25T19:24:49.766 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:49.954 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628466 2024-04-25T19:24:49.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:49.969 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:49.969 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:49.969 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:49.969 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:49.969 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/rgw_pool_type/ec-cache.yaml").st_ino) 2024-04-25T19:24:49.969 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:50.150 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628464 2024-04-25T19:24:50.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:50.164 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:50.164 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:50.164 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:50.164 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:50.164 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/rgw_pool_type/replicated.yaml").st_ino) 2024-04-25T19:24:50.164 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:50.345 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628467 2024-04-25T19:24:50.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:50.360 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:50.360 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:50.360 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:50.361 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:50.361 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git").st_ino) 2024-04-25T19:24:50.361 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:50.531 INFO:teuthology.orchestra.run.smithi131.stdout:1099511627777 2024-04-25T19:24:50.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:50.545 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:50.545 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:50.545 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:50.545 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:50.545 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/HEAD").st_ino) 2024-04-25T19:24:50.545 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:50.727 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628328 2024-04-25T19:24:50.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:50.742 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:50.742 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:50.742 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:50.742 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:50.742 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/description").st_ino) 2024-04-25T19:24:50.742 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:50.924 INFO:teuthology.orchestra.run.smithi131.stdout:1099511627778 2024-04-25T19:24:50.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:50.938 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:50.938 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:50.938 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:50.938 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:50.938 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/index").st_ino) 2024-04-25T19:24:50.938 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:51.103 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628337 2024-04-25T19:24:51.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:51.116 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:51.116 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:51.116 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:51.116 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:51.116 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/objects").st_ino) 2024-04-25T19:24:51.116 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:51.298 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628307 2024-04-25T19:24:51.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:51.312 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:51.312 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:51.312 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:51.312 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:51.313 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/objects/info").st_ino) 2024-04-25T19:24:51.313 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:51.495 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628309 2024-04-25T19:24:51.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:51.508 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:51.508 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:51.508 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:51.508 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:51.508 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/objects/pack").st_ino) 2024-04-25T19:24:51.508 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:51.691 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628308 2024-04-25T19:24:51.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:51.704 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:51.704 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:51.704 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:51.704 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:51.704 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/objects/pack/pack-ac547ca4f300164f23b0bf1b8b1e66d5a7352309.idx").st_ino) 2024-04-25T19:24:51.704 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:51.890 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628315 2024-04-25T19:24:51.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:51.904 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:51.904 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:51.904 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:51.904 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:51.905 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/objects/pack/pack-ac547ca4f300164f23b0bf1b8b1e66d5a7352309.rev").st_ino) 2024-04-25T19:24:51.905 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:52.091 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628316 2024-04-25T19:24:52.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:52.105 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:52.105 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:52.105 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:52.105 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:52.105 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/objects/pack/pack-ac547ca4f300164f23b0bf1b8b1e66d5a7352309.pack").st_ino) 2024-04-25T19:24:52.105 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:52.290 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628314 2024-04-25T19:24:52.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:52.303 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:52.303 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:52.303 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:52.303 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:52.303 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks").st_ino) 2024-04-25T19:24:52.303 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:52.487 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628282 2024-04-25T19:24:52.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:52.500 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:52.501 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:52.501 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:52.501 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:52.501 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/pre-merge-commit.sample").st_ino) 2024-04-25T19:24:52.501 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:52.683 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628287 2024-04-25T19:24:52.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:52.697 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:52.697 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:52.697 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:52.697 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:52.697 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/pre-commit.sample").st_ino) 2024-04-25T19:24:52.697 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:52.879 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628286 2024-04-25T19:24:52.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:52.893 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:52.893 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:52.893 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:52.893 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:52.894 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/fsmonitor-watchman.sample").st_ino) 2024-04-25T19:24:52.894 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:53.075 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628291 2024-04-25T19:24:53.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:53.090 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:53.090 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:53.090 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:53.090 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:53.090 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/commit-msg.sample").st_ino) 2024-04-25T19:24:53.090 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:53.261 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628294 2024-04-25T19:24:53.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:53.274 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:53.274 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:53.274 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:53.274 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:53.274 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/pre-rebase.sample").st_ino) 2024-04-25T19:24:53.274 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:53.458 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628296 2024-04-25T19:24:53.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:53.472 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:53.472 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:53.472 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:53.472 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:53.473 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/pre-receive.sample").st_ino) 2024-04-25T19:24:53.473 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:53.656 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628290 2024-04-25T19:24:53.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:53.669 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:53.669 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:53.669 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:53.669 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:53.670 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/prepare-commit-msg.sample").st_ino) 2024-04-25T19:24:53.670 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:53.852 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628289 2024-04-25T19:24:53.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:53.866 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:53.866 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:53.866 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:53.866 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:53.866 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/update.sample").st_ino) 2024-04-25T19:24:53.866 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:54.049 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628288 2024-04-25T19:24:54.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:54.063 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:54.063 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:54.063 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:54.063 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:54.063 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/pre-push.sample").st_ino) 2024-04-25T19:24:54.063 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:54.247 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628292 2024-04-25T19:24:54.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:54.261 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:54.261 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:54.262 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:54.262 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:54.262 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/sendemail-validate.sample").st_ino) 2024-04-25T19:24:54.262 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:54.444 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628285 2024-04-25T19:24:54.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:54.457 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:54.457 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:54.457 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:54.457 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:54.457 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/pre-applypatch.sample").st_ino) 2024-04-25T19:24:54.457 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:54.641 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628293 2024-04-25T19:24:54.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:54.655 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:54.655 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:54.655 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:54.655 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:54.656 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/push-to-checkout.sample").st_ino) 2024-04-25T19:24:54.656 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:54.834 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628283 2024-04-25T19:24:54.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:54.847 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:54.847 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:54.847 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:54.848 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:54.848 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/post-update.sample").st_ino) 2024-04-25T19:24:54.848 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:55.055 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628284 2024-04-25T19:24:55.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:55.074 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:55.074 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:55.074 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:55.074 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:55.074 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/applypatch-msg.sample").st_ino) 2024-04-25T19:24:55.074 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:55.230 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628295 2024-04-25T19:24:55.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:55.244 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:55.244 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:55.244 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:55.244 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:55.244 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/logs").st_ino) 2024-04-25T19:24:55.244 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:55.424 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628323 2024-04-25T19:24:55.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:55.438 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:55.438 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:55.438 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:55.438 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:55.438 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/logs/HEAD").st_ino) 2024-04-25T19:24:55.439 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:55.620 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628331 2024-04-25T19:24:55.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:55.633 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:55.634 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:55.634 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:55.634 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:55.634 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/logs/refs").st_ino) 2024-04-25T19:24:55.634 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:55.817 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628324 2024-04-25T19:24:55.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:55.831 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:55.831 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:55.831 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:55.831 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:55.831 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/logs/refs/heads").st_ino) 2024-04-25T19:24:55.831 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:56.014 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628332 2024-04-25T19:24:56.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:56.027 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:56.027 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:56.027 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:56.027 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:56.027 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/logs/refs/heads/master").st_ino) 2024-04-25T19:24:56.027 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:56.214 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628333 2024-04-25T19:24:56.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:56.229 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:56.229 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:56.229 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:56.229 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:56.229 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/logs/refs/remotes").st_ino) 2024-04-25T19:24:56.229 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:56.398 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628325 2024-04-25T19:24:56.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:56.412 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:56.412 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:56.412 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:56.412 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:56.412 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/logs/refs/remotes/origin").st_ino) 2024-04-25T19:24:56.412 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:56.597 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628326 2024-04-25T19:24:56.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:56.611 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:56.611 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:56.611 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:56.611 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:56.611 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/logs/refs/remotes/origin/HEAD").st_ino) 2024-04-25T19:24:56.611 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:56.795 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628327 2024-04-25T19:24:56.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:56.809 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:56.809 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:56.809 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:56.809 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:56.809 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/packed-refs").st_ino) 2024-04-25T19:24:56.809 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:56.992 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628319 2024-04-25T19:24:56.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:57.005 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:57.005 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:57.005 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:57.005 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:57.005 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/config").st_ino) 2024-04-25T19:24:57.005 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:57.187 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628336 2024-04-25T19:24:57.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:57.201 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:57.201 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:57.201 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:57.201 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:57.201 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/info").st_ino) 2024-04-25T19:24:57.201 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:57.388 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628279 2024-04-25T19:24:57.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:57.403 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:57.403 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:57.403 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:57.403 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:57.403 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/info/exclude").st_ino) 2024-04-25T19:24:57.403 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:57.586 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628280 2024-04-25T19:24:57.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:57.599 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:57.599 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:57.599 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:57.599 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:57.599 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/refs").st_ino) 2024-04-25T19:24:57.599 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:57.771 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628297 2024-04-25T19:24:57.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:57.787 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:57.787 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:57.787 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:57.787 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:57.787 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/refs/tags").st_ino) 2024-04-25T19:24:57.787 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:57.957 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628299 2024-04-25T19:24:57.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:57.970 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:57.971 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:57.971 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:57.971 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:57.971 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/refs/heads").st_ino) 2024-04-25T19:24:57.971 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:58.153 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628298 2024-04-25T19:24:58.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:58.167 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:58.167 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:58.167 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:58.167 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:58.167 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/refs/heads/master").st_ino) 2024-04-25T19:24:58.167 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:58.348 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628330 2024-04-25T19:24:58.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:58.362 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:58.362 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:58.362 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:58.362 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:58.362 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/refs/remotes").st_ino) 2024-04-25T19:24:58.362 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:58.543 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628320 2024-04-25T19:24:58.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:58.556 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:58.556 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:58.556 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:58.557 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:58.557 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/refs/remotes/origin").st_ino) 2024-04-25T19:24:58.557 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:58.736 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628321 2024-04-25T19:24:58.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:58.749 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:58.750 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:58.750 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:58.750 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:58.750 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/refs/remotes/origin/HEAD").st_ino) 2024-04-25T19:24:58.750 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:58.935 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628322 2024-04-25T19:24:58.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:58.948 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:58.948 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:58.948 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:58.948 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:58.948 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/branches").st_ino) 2024-04-25T19:24:58.948 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:59.132 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628281 2024-04-25T19:24:59.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:59.145 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:59.145 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:59.145 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:59.145 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:59.145 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/config_options").st_ino) 2024-04-25T19:24:59.145 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:59.321 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628384 2024-04-25T19:24:59.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:59.337 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:59.337 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:59.337 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:59.337 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:59.337 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/config_options/cephdeploy_conf.yaml").st_ino) 2024-04-25T19:24:59.337 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:59.507 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628385 2024-04-25T19:24:59.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:59.520 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:59.521 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:59.521 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:59.521 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:59.521 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros").st_ino) 2024-04-25T19:24:59.521 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:59.702 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628391 2024-04-25T19:24:59.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:59.716 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:59.717 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:59.717 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:59.717 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:59.717 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/a-supported-distro.yaml").st_ino) 2024-04-25T19:24:59.717 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:24:59.900 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628392 2024-04-25T19:24:59.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:24:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:24:59.915 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:24:59.915 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:24:59.915 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:24:59.915 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:24:59.915 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/supported").st_ino) 2024-04-25T19:24:59.916 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:00.100 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628420 2024-04-25T19:25:00.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:00.114 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:00.114 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:00.114 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:00.114 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:00.114 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/supported/ubuntu_16.04.yaml").st_ino) 2024-04-25T19:25:00.114 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:00.298 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628423 2024-04-25T19:25:00.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:00.311 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:00.311 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:00.311 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:00.311 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:00.311 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/supported/centos_7.2.yaml").st_ino) 2024-04-25T19:25:00.311 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:00.495 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628421 2024-04-25T19:25:00.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:00.508 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:00.508 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:00.508 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:00.509 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:00.509 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/supported/ubuntu_14.04.yaml").st_ino) 2024-04-25T19:25:00.509 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:00.692 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628422 2024-04-25T19:25:00.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:00.705 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:00.706 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:00.706 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:00.706 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:00.706 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all").st_ino) 2024-04-25T19:25:00.706 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:00.884 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628393 2024-04-25T19:25:00.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:00.897 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:00.897 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:00.897 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:00.897 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:00.897 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/fedora_17.yaml").st_ino) 2024-04-25T19:25:00.897 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:01.080 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628403 2024-04-25T19:25:01.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:01.094 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:01.094 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:01.094 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:01.094 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:01.094 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/centos_6.4.yaml").st_ino) 2024-04-25T19:25:01.094 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:01.274 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628395 2024-04-25T19:25:01.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:01.287 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:01.287 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:01.287 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:01.287 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:01.287 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/debian_7.0.yaml").st_ino) 2024-04-25T19:25:01.287 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:01.473 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628401 2024-04-25T19:25:01.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:01.487 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:01.487 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:01.487 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:01.487 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:01.487 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/debian_6.0.yaml").st_ino) 2024-04-25T19:25:01.487 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:01.669 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628400 2024-04-25T19:25:01.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:01.682 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:01.682 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:01.682 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:01.682 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:01.682 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/fedora_19.yaml").st_ino) 2024-04-25T19:25:01.682 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:01.864 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628405 2024-04-25T19:25:01.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:01.879 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:01.879 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:01.879 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:01.879 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:01.879 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/ubuntu_16.04.yaml").st_ino) 2024-04-25T19:25:01.879 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:02.061 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628419 2024-04-25T19:25:02.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:02.075 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:02.075 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:02.075 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:02.075 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:02.075 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/opensuse_13.2.yaml").st_ino) 2024-04-25T19:25:02.076 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:02.261 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628407 2024-04-25T19:25:02.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:02.274 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:02.274 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:02.274 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:02.274 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:02.275 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/opensuse_12.2.yaml").st_ino) 2024-04-25T19:25:02.275 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:02.458 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628406 2024-04-25T19:25:02.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:02.472 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:02.472 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:02.472 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:02.472 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:02.472 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/rhel_6.3.yaml").st_ino) 2024-04-25T19:25:02.472 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:02.657 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628409 2024-04-25T19:25:02.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:02.671 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:02.671 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:02.671 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:02.671 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:02.671 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/sles_11-sp2.yaml").st_ino) 2024-04-25T19:25:02.671 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:02.855 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628413 2024-04-25T19:25:02.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:02.869 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:02.869 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:02.869 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:02.869 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:02.869 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/centos_7.2.yaml").st_ino) 2024-04-25T19:25:02.869 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:03.052 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628399 2024-04-25T19:25:03.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:03.066 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:03.066 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:03.066 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:03.066 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:03.066 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/rhel_6.4.yaml").st_ino) 2024-04-25T19:25:03.066 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:03.252 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628410 2024-04-25T19:25:03.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:03.265 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:03.266 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:03.266 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:03.266 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:03.266 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/centos_7.0.yaml").st_ino) 2024-04-25T19:25:03.266 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:03.450 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628397 2024-04-25T19:25:03.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:03.464 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:03.464 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:03.464 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:03.464 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:03.464 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/ubuntu_14.04_i686.yaml").st_ino) 2024-04-25T19:25:03.464 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:03.644 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628418 2024-04-25T19:25:03.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:03.657 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:03.657 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:03.657 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:03.657 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:03.657 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/opensuse_42.1.yaml").st_ino) 2024-04-25T19:25:03.657 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:03.840 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628408 2024-04-25T19:25:03.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:03.854 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:03.854 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:03.854 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:03.854 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:03.854 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/debian_8.0.yaml").st_ino) 2024-04-25T19:25:03.854 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:04.041 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628402 2024-04-25T19:25:04.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:04.055 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:04.055 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:04.055 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:04.055 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:04.055 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/fedora_18.yaml").st_ino) 2024-04-25T19:25:04.055 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:04.246 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628404 2024-04-25T19:25:04.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:04.258 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:04.258 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:04.258 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:04.258 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:04.258 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/rhel_7.0.yaml").st_ino) 2024-04-25T19:25:04.258 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:04.443 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628412 2024-04-25T19:25:04.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:04.457 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:04.457 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:04.457 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:04.457 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:04.457 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/ubuntu_14.04.yaml").st_ino) 2024-04-25T19:25:04.457 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:04.642 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628416 2024-04-25T19:25:04.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:04.656 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:04.656 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:04.656 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:04.656 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:04.656 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/centos_7.1.yaml").st_ino) 2024-04-25T19:25:04.656 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:04.839 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628398 2024-04-25T19:25:04.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:04.853 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:04.853 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:04.853 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:04.853 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:04.853 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/ubuntu_12.10.yaml").st_ino) 2024-04-25T19:25:04.854 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:05.044 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628415 2024-04-25T19:25:05.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:05.058 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:05.058 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:05.058 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:05.058 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:05.058 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/ubuntu_12.04.yaml").st_ino) 2024-04-25T19:25:05.058 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:05.233 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628414 2024-04-25T19:25:05.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:05.247 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:05.247 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:05.247 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:05.247 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:05.247 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/centos_6.3.yaml").st_ino) 2024-04-25T19:25:05.247 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:05.431 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628394 2024-04-25T19:25:05.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:05.445 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:05.445 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:05.445 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:05.445 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:05.445 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/rhel_6.5.yaml").st_ino) 2024-04-25T19:25:05.445 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:05.629 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628411 2024-04-25T19:25:05.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:05.643 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:05.643 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:05.643 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:05.643 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:05.643 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/ubuntu_14.04_aarch64.yaml").st_ino) 2024-04-25T19:25:05.643 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:05.827 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628417 2024-04-25T19:25:05.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:05.841 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:05.842 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:05.842 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:05.842 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:05.842 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/centos_6.5.yaml").st_ino) 2024-04-25T19:25:05.842 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:06.019 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628396 2024-04-25T19:25:06.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:06.032 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:06.032 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:06.033 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:06.033 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:06.033 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites").st_ino) 2024-04-25T19:25:06.033 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:06.217 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628468 2024-04-25T19:25:06.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:06.232 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:06.232 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:06.232 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:06.232 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:06.233 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress").st_ino) 2024-04-25T19:25:06.233 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:06.415 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629780 2024-04-25T19:25:06.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:06.430 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:06.430 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:06.431 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:06.431 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:06.431 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/bench").st_ino) 2024-04-25T19:25:06.431 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:06.439 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:25:06.484 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:25:06.597 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630283 2024-04-25T19:25:06.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:06.610 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:06.610 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:06.611 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:06.611 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:06.611 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/bench/clusters").st_ino) 2024-04-25T19:25:06.611 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:06.793 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629783 2024-04-25T19:25:06.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:06.807 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:06.807 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:06.807 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:06.807 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:06.807 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/bench/clusters/fixed-3-cephfs.yaml").st_ino) 2024-04-25T19:25:06.807 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:06.993 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629784 2024-04-25T19:25:06.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:07.007 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:07.007 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:07.007 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:07.007 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:07.007 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/bench/%").st_ino) 2024-04-25T19:25:07.007 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:07.182 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629782 2024-04-25T19:25:07.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:07.195 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:07.195 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:07.195 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:07.195 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:07.195 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/bench/tasks").st_ino) 2024-04-25T19:25:07.195 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:07.379 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629785 2024-04-25T19:25:07.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:07.392 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:07.392 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:07.392 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:07.392 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:07.392 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/bench/tasks/kclient_workunit_suites_fsx.yaml").st_ino) 2024-04-25T19:25:07.392 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:07.574 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629787 2024-04-25T19:25:07.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:07.588 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:07.588 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:07.588 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:07.588 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:07.588 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/bench/tasks/cfuse_workunit_snaps.yaml").st_ino) 2024-04-25T19:25:07.588 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:07.773 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629786 2024-04-25T19:25:07.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:07.787 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:07.787 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:07.787 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:07.787 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:07.787 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash").st_ino) 2024-04-25T19:25:07.787 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:07.967 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629788 2024-04-25T19:25:07.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:07.982 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:07.982 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:07.982 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:07.982 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:07.982 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/clusters").st_ino) 2024-04-25T19:25:07.982 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:08.167 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629790 2024-04-25T19:25:08.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:08.181 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:08.181 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:08.181 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:08.181 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:08.181 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/clusters/16-osd.yaml").st_ino) 2024-04-25T19:25:08.181 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:08.366 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629791 2024-04-25T19:25:08.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:08.380 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:08.380 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:08.380 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:08.380 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:08.380 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/clusters/3-osd-1-machine.yaml").st_ino) 2024-04-25T19:25:08.380 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:08.563 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629792 2024-04-25T19:25:08.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:08.577 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:08.577 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:08.577 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:08.578 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:08.578 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/clusters/8-osd.yaml").st_ino) 2024-04-25T19:25:08.578 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:08.759 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629793 2024-04-25T19:25:08.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:08.773 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:08.773 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:08.773 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:08.773 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:08.773 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/fs").st_ino) 2024-04-25T19:25:08.773 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:08.958 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629794 2024-04-25T19:25:08.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:08.972 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:08.972 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:08.972 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:08.972 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:08.972 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/fs/none.yaml").st_ino) 2024-04-25T19:25:08.972 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:09.143 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629796 2024-04-25T19:25:09.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:09.156 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:09.156 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:09.156 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:09.156 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:09.156 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/fs/btrfs.yaml").st_ino) 2024-04-25T19:25:09.156 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:09.336 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629795 2024-04-25T19:25:09.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:09.352 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:09.352 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:09.352 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:09.352 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:09.352 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/fs/xfs.yaml").st_ino) 2024-04-25T19:25:09.352 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:09.536 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629797 2024-04-25T19:25:09.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:09.550 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:09.550 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:09.550 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:09.550 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:09.550 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/workloads").st_ino) 2024-04-25T19:25:09.550 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:09.733 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629802 2024-04-25T19:25:09.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:09.747 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:09.747 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:09.747 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:09.747 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:09.747 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/workloads/readwrite.yaml").st_ino) 2024-04-25T19:25:09.747 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:09.933 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629806 2024-04-25T19:25:09.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:09.947 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:09.947 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:09.947 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:09.947 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:09.947 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/workloads/radosbench.yaml").st_ino) 2024-04-25T19:25:09.947 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:10.120 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629805 2024-04-25T19:25:10.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:10.133 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:10.133 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:10.133 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:10.133 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:10.134 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/workloads/iozone_cfuse.yaml").st_ino) 2024-04-25T19:25:10.134 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:10.315 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629804 2024-04-25T19:25:10.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:10.329 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:10.329 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:10.329 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:10.329 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:10.329 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/workloads/bonnie_cfuse.yaml").st_ino) 2024-04-25T19:25:10.329 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:10.513 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629803 2024-04-25T19:25:10.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:10.527 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:10.527 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:10.527 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:10.527 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:10.527 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/%").st_ino) 2024-04-25T19:25:10.527 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:10.711 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629789 2024-04-25T19:25:10.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:10.724 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:10.724 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:10.724 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:10.724 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:10.724 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/thrashers").st_ino) 2024-04-25T19:25:10.725 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:10.906 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629798 2024-04-25T19:25:10.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:10.919 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:10.919 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:10.919 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:10.919 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:10.919 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/thrashers/default.yaml").st_ino) 2024-04-25T19:25:10.919 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:11.103 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629799 2024-04-25T19:25:11.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:11.117 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:11.117 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:11.117 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:11.117 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:11.117 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/thrashers/more-down.yaml").st_ino) 2024-04-25T19:25:11.117 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:11.305 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629801 2024-04-25T19:25:11.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:11.318 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:11.318 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:11.319 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:11.319 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:11.319 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/thrashers/fast.yaml").st_ino) 2024-04-25T19:25:11.319 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:11.503 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629800 2024-04-25T19:25:11.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:11.516 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:11.516 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:11.516 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:11.517 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:11.517 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr").st_ino) 2024-04-25T19:25:11.517 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:11.700 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629041 2024-04-25T19:25:11.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:11.714 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:11.714 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:11.714 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:11.714 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:11.714 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic").st_ino) 2024-04-25T19:25:11.714 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:11.900 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629042 2024-04-25T19:25:11.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:11.914 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:11.914 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:11.914 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:11.914 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:11.914 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/clusters").st_ino) 2024-04-25T19:25:11.914 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:12.092 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629044 2024-04-25T19:25:12.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:12.106 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:12.106 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:12.107 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:12.107 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:12.107 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/clusters/2-node-mgr.yaml").st_ino) 2024-04-25T19:25:12.107 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:12.298 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629045 2024-04-25T19:25:12.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:12.313 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:12.313 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:12.313 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:12.313 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:12.313 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/fs").st_ino) 2024-04-25T19:25:12.313 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:12.496 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629048 2024-04-25T19:25:12.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:12.510 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:12.510 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:12.510 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:12.510 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:12.510 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/fs/xfs.yaml").st_ino) 2024-04-25T19:25:12.510 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:12.694 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629049 2024-04-25T19:25:12.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:12.708 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:12.708 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:12.708 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:12.708 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:12.708 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/%").st_ino) 2024-04-25T19:25:12.708 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:12.890 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629043 2024-04-25T19:25:12.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:12.903 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:12.903 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:12.904 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:12.904 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:12.904 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/tasks").st_ino) 2024-04-25T19:25:12.904 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:13.087 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629050 2024-04-25T19:25:13.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:13.101 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:13.101 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:13.101 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:13.101 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:13.101 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/tasks/failover.yaml").st_ino) 2024-04-25T19:25:13.101 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:13.286 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629051 2024-04-25T19:25:13.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:13.299 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:13.300 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:13.300 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:13.300 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:13.300 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/debug").st_ino) 2024-04-25T19:25:13.300 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:13.483 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629046 2024-04-25T19:25:13.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:13.497 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:13.497 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:13.497 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:13.497 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:13.497 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/debug/mgr.yaml").st_ino) 2024-04-25T19:25:13.497 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:13.674 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629047 2024-04-25T19:25:13.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:13.685 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:13.686 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:13.686 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:13.686 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:13.686 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle").st_ino) 2024-04-25T19:25:13.686 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:13.867 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629094 2024-04-25T19:25:13.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:13.881 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:13.881 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:13.881 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:13.881 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:13.881 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd").st_ino) 2024-04-25T19:25:13.881 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:14.069 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629095 2024-04-25T19:25:14.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:14.083 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:14.083 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:14.083 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:14.083 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:14.083 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/powercycle").st_ino) 2024-04-25T19:25:14.085 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:14.256 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629103 2024-04-25T19:25:14.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:14.269 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:14.269 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:14.269 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:14.269 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:14.269 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/powercycle/default.yaml").st_ino) 2024-04-25T19:25:14.269 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:14.453 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629104 2024-04-25T19:25:14.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:14.467 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:14.467 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:14.467 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:14.467 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:14.467 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/clusters").st_ino) 2024-04-25T19:25:14.467 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:14.649 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629097 2024-04-25T19:25:14.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:14.663 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:14.663 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:14.663 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:14.663 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:14.664 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/clusters/3osd-1per-target.yaml").st_ino) 2024-04-25T19:25:14.664 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:14.853 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629098 2024-04-25T19:25:14.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:14.866 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:14.867 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:14.867 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:14.867 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:14.867 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/objectstore").st_ino) 2024-04-25T19:25:14.867 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:15.049 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629102 2024-04-25T19:25:15.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:15.062 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:15.063 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:15.063 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:15.063 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:15.063 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/fs").st_ino) 2024-04-25T19:25:15.063 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:15.247 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629099 2024-04-25T19:25:15.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:15.260 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:15.261 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:15.261 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:15.261 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:15.261 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/fs/btrfs.yaml").st_ino) 2024-04-25T19:25:15.261 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:15.446 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629100 2024-04-25T19:25:15.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:15.461 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:15.461 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:15.462 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:15.462 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:15.462 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/fs/xfs.yaml").st_ino) 2024-04-25T19:25:15.462 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:15.635 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629101 2024-04-25T19:25:15.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:15.648 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:15.648 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:15.648 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:15.648 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:15.648 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/%").st_ino) 2024-04-25T19:25:15.648 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:15.833 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629096 2024-04-25T19:25:15.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:15.846 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:15.846 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:15.846 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:15.846 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:15.846 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks").st_ino) 2024-04-25T19:25:15.847 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:16.032 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629105 2024-04-25T19:25:16.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:16.046 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:16.046 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:16.046 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:16.046 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:16.046 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/readwrite.yaml").st_ino) 2024-04-25T19:25:16.046 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:16.229 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629117 2024-04-25T19:25:16.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:16.243 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:16.244 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:16.244 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:16.244 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:16.244 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_fsync.yaml").st_ino) 2024-04-25T19:25:16.244 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:16.425 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629112 2024-04-25T19:25:16.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:16.439 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:16.439 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:16.439 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:16.439 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:16.439 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/radosbench.yaml").st_ino) 2024-04-25T19:25:16.439 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:16.622 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629116 2024-04-25T19:25:16.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:16.635 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:16.636 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:16.636 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:16.636 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:16.636 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_pjd.yaml").st_ino) 2024-04-25T19:25:16.636 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:16.819 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629113 2024-04-25T19:25:16.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:16.832 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:16.833 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:16.833 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:16.833 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:16.833 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_ffsb.yaml").st_ino) 2024-04-25T19:25:16.833 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:17.014 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629109 2024-04-25T19:25:17.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:17.028 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:17.028 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:17.028 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:17.028 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:17.028 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_fsx.yaml").st_ino) 2024-04-25T19:25:17.028 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:17.213 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629111 2024-04-25T19:25:17.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:17.226 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:17.227 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:17.227 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:17.227 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:17.227 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/snaps-few-objects.yaml").st_ino) 2024-04-25T19:25:17.227 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:17.409 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629118 2024-04-25T19:25:17.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:17.423 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:17.423 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:17.423 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:17.423 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:17.423 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_misc.yaml").st_ino) 2024-04-25T19:25:17.423 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:17.610 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629108 2024-04-25T19:25:17.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:17.624 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:17.624 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:17.624 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:17.624 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:17.624 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/admin_socket_objecter_requests.yaml").st_ino) 2024-04-25T19:25:17.624 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:17.805 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629106 2024-04-25T19:25:17.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:17.818 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:17.818 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:17.818 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:17.818 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:17.818 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_truncate_delay.yaml").st_ino) 2024-04-25T19:25:17.818 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:18.001 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629114 2024-04-25T19:25:18.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:18.015 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:18.015 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:18.015 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:18.015 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:18.015 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/snaps-many-objects.yaml").st_ino) 2024-04-25T19:25:18.015 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:18.198 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629119 2024-04-25T19:25:18.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:18.212 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:18.212 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:18.212 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:18.212 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:18.212 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_kernel_untar_build.yaml").st_ino) 2024-04-25T19:25:18.212 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:18.394 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629107 2024-04-25T19:25:18.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:18.408 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:18.408 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:18.408 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:18.408 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:18.408 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/rados_api_tests.yaml").st_ino) 2024-04-25T19:25:18.408 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:18.592 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629115 2024-04-25T19:25:18.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:18.605 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:18.605 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:18.605 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:18.606 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:18.606 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_fsstress.yaml").st_ino) 2024-04-25T19:25:18.606 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:18.789 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629110 2024-04-25T19:25:18.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:18.803 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:18.803 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:18.803 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:18.803 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:18.803 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd").st_ino) 2024-04-25T19:25:18.804 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:18.989 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629435 2024-04-25T19:25:18.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:19.003 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:19.003 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:19.003 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:19.003 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:19.003 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli").st_ino) 2024-04-25T19:25:19.003 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:19.185 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629459 2024-04-25T19:25:19.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:19.199 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:19.200 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:19.200 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:19.200 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:19.200 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/features").st_ino) 2024-04-25T19:25:19.200 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:19.380 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629464 2024-04-25T19:25:19.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:19.393 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:19.393 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:19.393 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:19.393 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:19.393 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/features/defaults.yaml").st_ino) 2024-04-25T19:25:19.393 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:19.576 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629465 2024-04-25T19:25:19.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:19.590 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:19.590 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:19.590 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:19.590 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:19.590 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/features/journaling.yaml").st_ino) 2024-04-25T19:25:19.590 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:19.772 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629467 2024-04-25T19:25:19.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:19.786 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:19.786 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:19.787 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:19.787 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:19.787 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/features/layering.yaml").st_ino) 2024-04-25T19:25:19.787 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:19.970 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629468 2024-04-25T19:25:19.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:19.984 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:19.984 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:19.984 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:19.984 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:19.984 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/features/format-1.yaml").st_ino) 2024-04-25T19:25:19.984 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:20.169 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629466 2024-04-25T19:25:20.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:20.183 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:20.183 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:20.183 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:20.183 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:20.183 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/base").st_ino) 2024-04-25T19:25:20.183 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:20.367 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629461 2024-04-25T19:25:20.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:20.380 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:20.380 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:20.380 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:20.380 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:20.381 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/base/install.yaml").st_ino) 2024-04-25T19:25:20.381 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:20.564 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629462 2024-04-25T19:25:20.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:20.578 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:20.578 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:20.578 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:20.578 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:20.578 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/pool").st_ino) 2024-04-25T19:25:20.578 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:20.760 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629474 2024-04-25T19:25:20.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:20.773 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:20.773 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:20.773 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:20.773 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:20.773 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/pool/small-cache-pool.yaml").st_ino) 2024-04-25T19:25:20.774 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:20.956 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629478 2024-04-25T19:25:20.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:20.969 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:20.969 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:20.969 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:20.969 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:20.969 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/pool/replicated-data-pool.yaml").st_ino) 2024-04-25T19:25:20.969 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:21.153 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629477 2024-04-25T19:25:21.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:21.167 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:21.167 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:21.167 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:21.167 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:21.167 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/pool/ec-data-pool.yaml").st_ino) 2024-04-25T19:25:21.167 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:21.338 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629475 2024-04-25T19:25:21.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:21.351 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:21.351 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:21.351 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:21.351 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:21.351 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/pool/none.yaml").st_ino) 2024-04-25T19:25:21.351 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:21.535 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629476 2024-04-25T19:25:21.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:21.548 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:21.548 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:21.548 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:21.548 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:21.549 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/clusters").st_ino) 2024-04-25T19:25:21.549 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:21.731 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629463 2024-04-25T19:25:21.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:21.746 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:21.746 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:21.746 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:21.746 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:21.746 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/msgr-failures").st_ino) 2024-04-25T19:25:21.747 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:21.935 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629470 2024-04-25T19:25:21.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:21.948 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:21.949 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:21.949 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:21.949 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:21.949 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/msgr-failures/many.yaml").st_ino) 2024-04-25T19:25:21.949 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:22.132 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629472 2024-04-25T19:25:22.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:22.145 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:22.145 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:22.146 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:22.146 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:22.146 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/msgr-failures/few.yaml").st_ino) 2024-04-25T19:25:22.146 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:22.328 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629471 2024-04-25T19:25:22.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:22.342 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:22.342 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:22.342 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:22.342 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:22.342 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/objectstore").st_ino) 2024-04-25T19:25:22.342 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:22.525 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629473 2024-04-25T19:25:22.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:22.538 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:22.539 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:22.539 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:22.539 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:22.539 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/fs").st_ino) 2024-04-25T19:25:22.539 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:22.724 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629469 2024-04-25T19:25:22.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:22.738 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:22.738 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:22.738 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:22.738 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:22.739 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/workloads").st_ino) 2024-04-25T19:25:22.739 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:22.911 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629479 2024-04-25T19:25:22.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:22.927 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:22.927 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:22.927 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:22.927 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:22.927 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/workloads/rbd_cli_import_export.yaml").st_ino) 2024-04-25T19:25:22.927 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:23.109 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629481 2024-04-25T19:25:23.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:23.123 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:23.123 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:23.123 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:23.123 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:23.123 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/workloads/rbd_cli_copy.yaml").st_ino) 2024-04-25T19:25:23.124 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:23.307 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629480 2024-04-25T19:25:23.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:23.321 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:23.321 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:23.321 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:23.321 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:23.321 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/%").st_ino) 2024-04-25T19:25:23.321 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:23.503 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629460 2024-04-25T19:25:23.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:23.517 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:23.517 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:23.517 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:23.517 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:23.517 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance").st_ino) 2024-04-25T19:25:23.517 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:23.702 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629514 2024-04-25T19:25:23.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:23.716 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:23.716 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:23.716 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:23.716 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:23.716 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/base").st_ino) 2024-04-25T19:25:23.716 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:23.897 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629516 2024-04-25T19:25:23.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:23.911 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:23.911 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:23.911 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:23.911 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:23.911 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/base/install.yaml").st_ino) 2024-04-25T19:25:23.911 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:24.082 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629517 2024-04-25T19:25:24.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:24.096 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:24.097 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:24.097 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:24.097 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:24.097 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/clusters").st_ino) 2024-04-25T19:25:24.097 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:24.266 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629518 2024-04-25T19:25:24.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:24.279 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:24.279 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:24.279 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:24.279 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:24.279 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/clusters/openstack.yaml").st_ino) 2024-04-25T19:25:24.279 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:24.459 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629521 2024-04-25T19:25:24.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:24.473 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:24.473 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:24.473 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:24.473 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:24.473 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/clusters/+").st_ino) 2024-04-25T19:25:24.473 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:24.645 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629519 2024-04-25T19:25:24.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:24.659 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:24.659 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:24.659 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:24.659 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:24.659 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/clusters/fixed-3.yaml").st_ino) 2024-04-25T19:25:24.659 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:24.841 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629520 2024-04-25T19:25:24.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:24.855 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:24.855 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:24.855 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:24.855 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:24.855 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/objectstore").st_ino) 2024-04-25T19:25:24.855 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:25.038 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629522 2024-04-25T19:25:25.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:25.053 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:25.053 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:25.053 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:25.053 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:25.053 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/workloads").st_ino) 2024-04-25T19:25:25.053 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:25.237 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629525 2024-04-25T19:25:25.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:25.251 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:25.251 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:25.251 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:25.251 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:25.251 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/workloads/dynamic_features.yaml").st_ino) 2024-04-25T19:25:25.251 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:25.436 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629526 2024-04-25T19:25:25.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:25.449 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:25.450 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:25.450 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:25.450 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:25.450 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/workloads/rebuild_object_map.yaml").st_ino) 2024-04-25T19:25:25.450 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:25.631 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629527 2024-04-25T19:25:25.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:25.644 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:25.644 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:25.644 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:25.644 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:25.644 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/%").st_ino) 2024-04-25T19:25:25.644 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:25.832 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629515 2024-04-25T19:25:25.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:25.845 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:25.845 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:25.845 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:25.845 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:25.845 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/xfs.yaml").st_ino) 2024-04-25T19:25:25.846 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:26.030 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629528 2024-04-25T19:25:26.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:26.044 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:26.044 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:26.044 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:26.044 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:26.044 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/qemu").st_ino) 2024-04-25T19:25:26.044 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:26.227 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629523 2024-04-25T19:25:26.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:26.242 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:26.242 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:26.242 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:26.242 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:26.242 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/qemu/xfstests.yaml").st_ino) 2024-04-25T19:25:26.242 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:26.423 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629524 2024-04-25T19:25:26.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:26.437 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:26.437 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:26.437 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:26.437 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:26.437 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton").st_ino) 2024-04-25T19:25:26.438 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:26.620 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629588 2024-04-25T19:25:26.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:26.633 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:26.633 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:26.633 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:26.633 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:26.633 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/openstack.yaml").st_ino) 2024-04-25T19:25:26.633 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:26.815 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629606 2024-04-25T19:25:26.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:26.829 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:26.829 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:26.829 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:26.829 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:26.829 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/objectstore").st_ino) 2024-04-25T19:25:26.829 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:27.011 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629605 2024-04-25T19:25:27.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:27.025 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:27.025 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:27.025 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:27.025 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:27.025 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/%").st_ino) 2024-04-25T19:25:27.025 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:27.199 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629589 2024-04-25T19:25:27.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:27.214 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:27.214 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:27.214 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:27.214 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:27.214 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all").st_ino) 2024-04-25T19:25:27.214 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:27.398 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629590 2024-04-25T19:25:27.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:27.413 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:27.413 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:27.413 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:27.413 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:27.413 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/rbd-vs-unmanaged-snaps.yaml").st_ino) 2024-04-25T19:25:27.413 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:27.586 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629598 2024-04-25T19:25:27.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:27.600 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:27.600 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:27.600 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:27.600 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:27.600 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/rbd_mirror.yaml").st_ino) 2024-04-25T19:25:27.600 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:27.782 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629599 2024-04-25T19:25:27.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:27.796 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:27.796 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:27.796 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:27.796 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:27.796 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/verify_pool.yaml").st_ino) 2024-04-25T19:25:27.796 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:27.981 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629604 2024-04-25T19:25:27.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:27.995 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:27.995 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:27.995 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:27.995 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:27.995 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/formatted-output.yaml").st_ino) 2024-04-25T19:25:27.995 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:28.175 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629592 2024-04-25T19:25:28.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:28.188 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:28.188 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:28.188 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:28.189 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:28.189 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/rbdmap_RBDMAPFILE.yaml").st_ino) 2024-04-25T19:25:28.189 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:28.366 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629600 2024-04-25T19:25:28.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:28.379 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:28.379 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:28.379 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:28.379 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:28.379 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/qemu-iotests-writeback.yaml").st_ino) 2024-04-25T19:25:28.379 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:28.562 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629596 2024-04-25T19:25:28.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:28.576 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:28.576 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:28.576 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:28.576 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:28.576 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/read-flags-writeback.yaml").st_ino) 2024-04-25T19:25:28.576 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:28.756 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629602 2024-04-25T19:25:28.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:28.769 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:28.770 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:28.770 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:28.770 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:28.770 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/permissions.yaml").st_ino) 2024-04-25T19:25:28.770 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:28.951 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629594 2024-04-25T19:25:28.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:28.964 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:28.964 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:28.964 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:28.964 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:28.964 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/read-flags-no-cache.yaml").st_ino) 2024-04-25T19:25:28.964 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:29.138 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629601 2024-04-25T19:25:29.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:29.152 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:29.152 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:29.152 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:29.152 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:29.152 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/qemu-iotests-no-cache.yaml").st_ino) 2024-04-25T19:25:29.153 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:29.337 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629595 2024-04-25T19:25:29.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:29.351 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:29.351 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:29.351 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:29.351 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:29.351 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/qemu-iotests-writethrough.yaml").st_ino) 2024-04-25T19:25:29.352 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:29.536 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629597 2024-04-25T19:25:29.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:29.549 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:29.549 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:29.549 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:29.549 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:29.549 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/read-flags-writethrough.yaml").st_ino) 2024-04-25T19:25:29.549 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:29.731 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629603 2024-04-25T19:25:29.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:29.746 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:29.746 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:29.746 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:29.746 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:29.747 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/admin_socket.yaml").st_ino) 2024-04-25T19:25:29.747 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:29.930 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629591 2024-04-25T19:25:29.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:29.943 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:29.943 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:29.943 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:29.943 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:29.943 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/merge_diff.yaml").st_ino) 2024-04-25T19:25:29.943 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:30.117 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629593 2024-04-25T19:25:30.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:30.130 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:30.131 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:30.131 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:30.131 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:30.131 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic").st_ino) 2024-04-25T19:25:30.131 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:30.315 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629436 2024-04-25T19:25:30.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:30.329 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:30.329 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:30.329 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:30.329 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:30.329 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/base").st_ino) 2024-04-25T19:25:30.329 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:30.516 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629438 2024-04-25T19:25:30.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:30.530 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:30.530 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:30.530 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:30.530 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:30.530 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/base/install.yaml").st_ino) 2024-04-25T19:25:30.530 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:30.713 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629439 2024-04-25T19:25:30.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:30.728 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:30.728 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:30.728 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:30.728 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:30.728 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/cachepool").st_ino) 2024-04-25T19:25:30.728 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:30.896 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629440 2024-04-25T19:25:30.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:30.910 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:30.910 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:30.910 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:30.910 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:30.910 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/cachepool/none.yaml").st_ino) 2024-04-25T19:25:30.910 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:31.093 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629441 2024-04-25T19:25:31.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:31.107 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:31.107 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:31.107 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:31.107 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:31.107 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/cachepool/small.yaml").st_ino) 2024-04-25T19:25:31.107 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:31.291 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629442 2024-04-25T19:25:31.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:31.305 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:31.306 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:31.306 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:31.306 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:31.306 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/clusters").st_ino) 2024-04-25T19:25:31.306 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:31.491 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629443 2024-04-25T19:25:31.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:31.504 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:31.504 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:31.504 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:31.504 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:31.505 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/clusters/openstack.yaml").st_ino) 2024-04-25T19:25:31.505 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:31.686 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629446 2024-04-25T19:25:31.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:31.700 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:31.700 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:31.700 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:31.700 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:31.700 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/clusters/+").st_ino) 2024-04-25T19:25:31.700 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:31.880 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629444 2024-04-25T19:25:31.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:31.893 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:31.893 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:31.893 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:31.893 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:31.893 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/clusters/fixed-1.yaml").st_ino) 2024-04-25T19:25:31.893 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:32.077 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629445 2024-04-25T19:25:32.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:32.091 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:32.091 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:32.091 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:32.091 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:32.091 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/msgr-failures").st_ino) 2024-04-25T19:25:32.092 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:32.277 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629449 2024-04-25T19:25:32.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:32.291 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:32.291 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:32.291 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:32.291 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:32.291 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/msgr-failures/many.yaml").st_ino) 2024-04-25T19:25:32.291 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:32.476 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629451 2024-04-25T19:25:32.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:32.489 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:32.489 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:32.489 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:32.489 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:32.489 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/msgr-failures/few.yaml").st_ino) 2024-04-25T19:25:32.489 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:32.673 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629450 2024-04-25T19:25:32.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:32.687 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:32.687 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:32.687 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:32.687 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:32.687 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/objectstore").st_ino) 2024-04-25T19:25:32.687 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:32.869 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629452 2024-04-25T19:25:32.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:32.883 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:32.883 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:32.883 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:32.883 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:32.884 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/fs").st_ino) 2024-04-25T19:25:32.884 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:33.067 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629447 2024-04-25T19:25:33.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:33.080 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:33.080 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:33.080 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:33.080 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:33.080 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/fs/xfs.yaml").st_ino) 2024-04-25T19:25:33.080 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:33.264 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629448 2024-04-25T19:25:33.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:33.278 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:33.278 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:33.278 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:33.278 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:33.278 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/%").st_ino) 2024-04-25T19:25:33.279 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:33.461 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629437 2024-04-25T19:25:33.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:33.475 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:33.475 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:33.475 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:33.475 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:33.475 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/tasks").st_ino) 2024-04-25T19:25:33.475 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:33.657 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629453 2024-04-25T19:25:33.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:33.671 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:33.671 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:33.671 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:33.671 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:33.671 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/tasks/rbd_lock_and_fence.yaml").st_ino) 2024-04-25T19:25:33.671 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:33.856 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629457 2024-04-25T19:25:33.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:33.869 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:33.870 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:33.870 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:33.870 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:33.870 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/tasks/rbd_cli_tests.yaml").st_ino) 2024-04-25T19:25:33.870 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:34.053 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629455 2024-04-25T19:25:34.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:34.066 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:34.066 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:34.066 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:34.066 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:34.066 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/tasks/rbd_api_tests_old_format.yaml").st_ino) 2024-04-25T19:25:34.066 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:34.232 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629454 2024-04-25T19:25:34.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:34.246 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:34.246 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:34.246 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:34.246 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:34.246 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/tasks/rbd_cls_tests.yaml").st_ino) 2024-04-25T19:25:34.246 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:34.427 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629456 2024-04-25T19:25:34.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:34.440 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:34.440 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:34.440 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:34.440 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:34.441 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/tasks/rbd_python_api_tests_old_format.yaml").st_ino) 2024-04-25T19:25:34.441 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:34.612 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629458 2024-04-25T19:25:34.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:34.624 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:34.624 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:34.624 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:34.624 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:34.624 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd").st_ino) 2024-04-25T19:25:34.624 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:34.807 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629482 2024-04-25T19:25:34.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:34.820 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:34.820 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:34.820 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:34.821 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:34.821 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/pool").st_ino) 2024-04-25T19:25:34.821 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:35.005 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629500 2024-04-25T19:25:35.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:35.017 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:35.017 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:35.018 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:35.018 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:35.018 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/pool/small-cache-pool.yaml").st_ino) 2024-04-25T19:25:35.018 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:35.200 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629504 2024-04-25T19:25:35.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:35.215 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:35.215 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:35.215 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:35.215 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:35.216 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/pool/replicated-data-pool.yaml").st_ino) 2024-04-25T19:25:35.216 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:35.397 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629503 2024-04-25T19:25:35.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:35.411 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:35.411 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:35.411 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:35.411 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:35.411 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/pool/ec-data-pool.yaml").st_ino) 2024-04-25T19:25:35.412 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:35.600 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629501 2024-04-25T19:25:35.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:35.615 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:35.615 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:35.615 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:35.615 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:35.615 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/pool/none.yaml").st_ino) 2024-04-25T19:25:35.617 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:35.801 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629502 2024-04-25T19:25:35.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:35.814 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:35.814 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:35.814 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:35.815 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:35.815 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/clusters").st_ino) 2024-04-25T19:25:35.815 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:35.996 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629488 2024-04-25T19:25:36.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:36.010 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:36.010 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:36.010 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:36.010 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:36.011 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/clusters/openstack.yaml").st_ino) 2024-04-25T19:25:36.011 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:36.195 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629491 2024-04-25T19:25:36.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:36.209 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:36.209 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:36.209 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:36.209 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:36.209 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/clusters/+").st_ino) 2024-04-25T19:25:36.210 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:36.390 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629489 2024-04-25T19:25:36.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:36.404 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:36.404 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:36.404 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:36.404 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:36.404 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/clusters/fixed-3.yaml").st_ino) 2024-04-25T19:25:36.404 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:36.589 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629490 2024-04-25T19:25:36.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:36.602 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:36.602 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:36.602 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:36.602 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:36.602 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/msgr-failures").st_ino) 2024-04-25T19:25:36.602 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:36.603 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:25:36.656 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:25:36.770 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629497 2024-04-25T19:25:36.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:36.783 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:36.783 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:36.783 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:36.783 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:36.783 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/msgr-failures/few.yaml").st_ino) 2024-04-25T19:25:36.783 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:36.963 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629498 2024-04-25T19:25:36.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:36.976 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:36.976 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:36.976 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:36.977 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:36.977 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/objectstore").st_ino) 2024-04-25T19:25:36.977 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:37.158 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629499 2024-04-25T19:25:37.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:37.172 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:37.172 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:37.172 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:37.172 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:37.172 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/config").st_ino) 2024-04-25T19:25:37.172 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:37.355 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629492 2024-04-25T19:25:37.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:37.368 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:37.368 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:37.368 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:37.368 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:37.369 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/config/skip-partial-discard.yaml").st_ino) 2024-04-25T19:25:37.369 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:37.552 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629495 2024-04-25T19:25:37.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:37.566 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:37.566 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:37.566 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:37.566 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:37.566 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/config/none.yaml").st_ino) 2024-04-25T19:25:37.567 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:37.751 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629494 2024-04-25T19:25:37.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:37.764 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:37.764 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:37.764 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:37.764 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:37.764 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/config/copy-on-read.yaml").st_ino) 2024-04-25T19:25:37.765 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:37.950 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629493 2024-04-25T19:25:37.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:37.964 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:37.965 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:37.965 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:37.965 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:37.965 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/fs").st_ino) 2024-04-25T19:25:37.965 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:38.136 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629496 2024-04-25T19:25:38.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:38.150 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:38.150 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:38.150 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:38.150 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:38.150 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads").st_ino) 2024-04-25T19:25:38.150 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:38.335 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629505 2024-04-25T19:25:38.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:38.348 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:38.348 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:38.348 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:38.348 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:38.349 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads/c_api_tests.yaml").st_ino) 2024-04-25T19:25:38.349 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:38.532 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629506 2024-04-25T19:25:38.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:38.546 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:38.546 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:38.546 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:38.546 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:38.546 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads/rbd_fio.yaml").st_ino) 2024-04-25T19:25:38.546 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:38.730 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629513 2024-04-25T19:25:38.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:38.743 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:38.744 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:38.744 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:38.744 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:38.744 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads/c_api_tests_with_defaults.yaml").st_ino) 2024-04-25T19:25:38.744 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:38.926 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629507 2024-04-25T19:25:38.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:38.940 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:38.940 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:38.940 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:38.940 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:38.940 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads/python_api_tests.yaml").st_ino) 2024-04-25T19:25:38.940 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:39.119 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629510 2024-04-25T19:25:39.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:39.132 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:39.132 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:39.132 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:39.132 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:39.133 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads/fsx.yaml").st_ino) 2024-04-25T19:25:39.133 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:39.315 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629509 2024-04-25T19:25:39.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:39.328 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:39.328 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:39.328 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:39.329 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:39.329 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads/python_api_tests_with_journaling.yaml").st_ino) 2024-04-25T19:25:39.329 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:39.513 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629512 2024-04-25T19:25:39.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:39.527 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:39.527 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:39.527 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:39.527 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:39.527 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads/c_api_tests_with_journaling.yaml").st_ino) 2024-04-25T19:25:39.527 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:39.698 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629508 2024-04-25T19:25:39.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:39.712 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:39.712 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:39.712 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:39.712 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:39.712 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads/python_api_tests_with_defaults.yaml").st_ino) 2024-04-25T19:25:39.713 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:39.895 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629511 2024-04-25T19:25:39.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:39.909 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:39.909 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:39.909 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:39.909 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:39.909 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/cache").st_ino) 2024-04-25T19:25:39.909 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:40.080 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629484 2024-04-25T19:25:40.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:40.093 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:40.093 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:40.093 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:40.094 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:40.094 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/cache/writeback.yaml").st_ino) 2024-04-25T19:25:40.094 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:40.278 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629486 2024-04-25T19:25:40.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:40.291 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:40.291 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:40.291 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:40.291 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:40.291 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/cache/writethrough.yaml").st_ino) 2024-04-25T19:25:40.292 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:40.465 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629487 2024-04-25T19:25:40.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:40.479 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:40.479 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:40.479 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:40.479 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:40.479 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/cache/none.yaml").st_ino) 2024-04-25T19:25:40.479 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:40.659 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629485 2024-04-25T19:25:40.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:40.673 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:40.673 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:40.673 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:40.673 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:40.673 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/%").st_ino) 2024-04-25T19:25:40.673 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:40.856 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629483 2024-04-25T19:25:40.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:40.870 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:40.870 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:40.870 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:40.870 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:40.870 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind").st_ino) 2024-04-25T19:25:40.870 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:41.054 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629634 2024-04-25T19:25:41.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:41.067 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:41.067 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:41.067 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:41.067 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:41.068 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/base").st_ino) 2024-04-25T19:25:41.068 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:41.252 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629636 2024-04-25T19:25:41.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:41.266 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:41.266 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:41.266 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:41.266 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:41.266 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/base/install.yaml").st_ino) 2024-04-25T19:25:41.266 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:41.450 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629637 2024-04-25T19:25:41.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:41.465 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:41.465 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:41.465 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:41.465 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:41.465 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/clusters").st_ino) 2024-04-25T19:25:41.465 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:41.646 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629638 2024-04-25T19:25:41.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:41.659 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:41.659 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:41.659 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:41.659 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:41.659 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/objectstore").st_ino) 2024-04-25T19:25:41.660 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:41.843 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629640 2024-04-25T19:25:41.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:41.857 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:41.857 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:41.857 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:41.857 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:41.858 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/fs").st_ino) 2024-04-25T19:25:41.858 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:42.044 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629639 2024-04-25T19:25:42.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:42.058 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:42.058 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:42.058 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:42.058 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:42.058 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads").st_ino) 2024-04-25T19:25:42.058 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:42.240 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629643 2024-04-25T19:25:42.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:42.255 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:42.255 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:42.255 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:42.255 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:42.255 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads/rbd_mirror.yaml").st_ino) 2024-04-25T19:25:42.255 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:42.438 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629651 2024-04-25T19:25:42.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:42.451 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:42.451 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:42.451 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:42.451 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:42.451 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads/c_api_tests.yaml").st_ino) 2024-04-25T19:25:42.451 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:42.632 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629644 2024-04-25T19:25:42.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:42.646 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:42.646 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:42.646 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:42.646 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:42.646 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads/c_api_tests_with_defaults.yaml").st_ino) 2024-04-25T19:25:42.646 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:42.829 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629645 2024-04-25T19:25:42.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:42.843 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:42.843 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:42.843 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:42.843 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:42.843 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads/python_api_tests.yaml").st_ino) 2024-04-25T19:25:42.843 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:43.026 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629648 2024-04-25T19:25:43.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:43.040 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:43.040 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:43.040 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:43.040 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:43.040 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads/fsx.yaml").st_ino) 2024-04-25T19:25:43.040 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:43.226 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629647 2024-04-25T19:25:43.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:43.240 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:43.240 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:43.240 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:43.240 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:43.240 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads/python_api_tests_with_journaling.yaml").st_ino) 2024-04-25T19:25:43.241 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:43.413 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629650 2024-04-25T19:25:43.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:43.426 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:43.426 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:43.426 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:43.426 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:43.426 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads/c_api_tests_with_journaling.yaml").st_ino) 2024-04-25T19:25:43.426 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:43.611 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629646 2024-04-25T19:25:43.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:43.625 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:43.625 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:43.625 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:43.625 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:43.625 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads/python_api_tests_with_defaults.yaml").st_ino) 2024-04-25T19:25:43.625 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:43.808 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629649 2024-04-25T19:25:43.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:43.822 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:43.822 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:43.822 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:43.822 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:43.822 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/validator").st_ino) 2024-04-25T19:25:43.822 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:43.995 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629641 2024-04-25T19:25:43.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:44.007 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:44.007 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:44.008 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:44.008 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:44.008 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/validator/memcheck.yaml").st_ino) 2024-04-25T19:25:44.008 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:44.189 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629642 2024-04-25T19:25:44.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:44.203 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:44.203 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:44.203 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:44.203 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:44.203 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/%").st_ino) 2024-04-25T19:25:44.203 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:44.381 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629635 2024-04-25T19:25:44.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:44.394 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:44.394 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:44.394 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:44.394 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:44.394 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd").st_ino) 2024-04-25T19:25:44.395 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:44.575 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629545 2024-04-25T19:25:44.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:44.589 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:44.589 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:44.589 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:44.589 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:44.589 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/base").st_ino) 2024-04-25T19:25:44.590 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:44.772 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629547 2024-04-25T19:25:44.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:44.785 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:44.786 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:44.786 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:44.786 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:44.786 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/cluster").st_ino) 2024-04-25T19:25:44.786 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:44.969 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629548 2024-04-25T19:25:44.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:44.987 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:44.987 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:44.987 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:44.987 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:44.987 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/cluster/openstack.yaml").st_ino) 2024-04-25T19:25:44.987 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:45.149 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629551 2024-04-25T19:25:45.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:45.162 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:45.162 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:45.162 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:45.162 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:45.162 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/cluster/+").st_ino) 2024-04-25T19:25:45.162 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:45.341 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629549 2024-04-25T19:25:45.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:45.355 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:45.355 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:45.355 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:45.355 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:45.355 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/cluster/fixed-3.yaml").st_ino) 2024-04-25T19:25:45.355 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:45.538 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629550 2024-04-25T19:25:45.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:45.552 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:45.552 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:45.552 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:45.553 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:45.553 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/msgr-failures").st_ino) 2024-04-25T19:25:45.553 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:45.733 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629553 2024-04-25T19:25:45.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:45.746 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:45.746 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:45.746 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:45.746 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:45.746 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/objectstore").st_ino) 2024-04-25T19:25:45.746 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:45.927 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629554 2024-04-25T19:25:45.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:45.941 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:45.942 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:45.942 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:45.942 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:45.942 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/fs").st_ino) 2024-04-25T19:25:45.942 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:46.123 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629552 2024-04-25T19:25:46.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:46.137 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:46.137 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:46.137 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:46.137 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:46.137 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/workloads").st_ino) 2024-04-25T19:25:46.137 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:46.321 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629556 2024-04-25T19:25:46.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:46.334 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:46.335 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:46.335 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:46.335 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:46.335 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/workloads/rbd_nbd.yaml").st_ino) 2024-04-25T19:25:46.335 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:46.518 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629558 2024-04-25T19:25:46.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:46.532 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:46.532 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:46.532 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:46.532 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:46.532 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/workloads/rbd_fsx_nbd.yaml").st_ino) 2024-04-25T19:25:46.532 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:46.717 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629557 2024-04-25T19:25:46.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:46.730 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:46.731 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:46.731 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:46.731 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:46.731 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/%").st_ino) 2024-04-25T19:25:46.731 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:46.905 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629546 2024-04-25T19:25:46.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:46.918 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:46.918 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:46.918 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:46.918 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:46.919 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/thrashers").st_ino) 2024-04-25T19:25:46.919 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:47.105 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629555 2024-04-25T19:25:47.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:47.119 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:47.119 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:47.120 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:47.120 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:47.120 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash").st_ino) 2024-04-25T19:25:47.120 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:47.306 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629607 2024-04-25T19:25:47.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:47.317 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:47.317 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:47.317 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:47.317 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:47.318 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/base").st_ino) 2024-04-25T19:25:47.318 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:47.500 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629609 2024-04-25T19:25:47.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:47.514 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:47.514 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:47.514 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:47.514 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:47.514 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/base/install.yaml").st_ino) 2024-04-25T19:25:47.514 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:47.683 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629610 2024-04-25T19:25:47.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:47.696 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:47.696 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:47.696 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:47.696 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:47.697 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/clusters").st_ino) 2024-04-25T19:25:47.697 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:47.876 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629611 2024-04-25T19:25:47.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:47.890 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:47.890 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:47.890 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:47.890 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:47.890 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/clusters/openstack.yaml").st_ino) 2024-04-25T19:25:47.890 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:48.072 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629614 2024-04-25T19:25:48.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:48.086 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:48.086 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:48.086 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:48.086 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:48.086 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/clusters/fixed-2.yaml").st_ino) 2024-04-25T19:25:48.086 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:48.262 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629613 2024-04-25T19:25:48.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:48.276 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:48.276 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:48.276 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:48.276 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:48.276 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/clusters/+").st_ino) 2024-04-25T19:25:48.276 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:48.461 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629612 2024-04-25T19:25:48.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:48.475 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:48.476 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:48.476 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:48.476 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:48.476 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/msgr-failures").st_ino) 2024-04-25T19:25:48.476 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:48.660 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629617 2024-04-25T19:25:48.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:48.674 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:48.674 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:48.674 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:48.674 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:48.674 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/msgr-failures/few.yaml").st_ino) 2024-04-25T19:25:48.674 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:48.856 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629618 2024-04-25T19:25:48.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:48.870 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:48.870 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:48.870 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:48.871 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:48.871 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/objectstore").st_ino) 2024-04-25T19:25:48.871 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:49.053 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629619 2024-04-25T19:25:49.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:49.067 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:49.067 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:49.067 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:49.067 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:49.067 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/fs").st_ino) 2024-04-25T19:25:49.067 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:49.253 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629615 2024-04-25T19:25:49.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:49.267 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:49.267 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:49.267 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:49.267 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:49.267 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/fs/xfs.yaml").st_ino) 2024-04-25T19:25:49.268 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:49.451 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629616 2024-04-25T19:25:49.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:49.466 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:49.466 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:49.466 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:49.466 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:49.466 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads").st_ino) 2024-04-25T19:25:49.466 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:49.651 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629623 2024-04-25T19:25:49.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:49.664 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:49.664 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:49.664 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:49.665 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:49.665 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_cache_writeback.yaml").st_ino) 2024-04-25T19:25:49.665 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:49.837 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629629 2024-04-25T19:25:49.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:49.850 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:49.851 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:49.851 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:49.851 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:49.851 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_copy_on_read.yaml").st_ino) 2024-04-25T19:25:49.851 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:50.025 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629631 2024-04-25T19:25:50.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:50.038 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:50.038 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:50.039 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:50.039 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:50.039 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_journal.yaml").st_ino) 2024-04-25T19:25:50.039 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:50.220 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629632 2024-04-25T19:25:50.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:50.234 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:50.234 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:50.234 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:50.234 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:50.234 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_api_tests_journaling.yaml").st_ino) 2024-04-25T19:25:50.234 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:50.417 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629627 2024-04-25T19:25:50.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:50.431 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:50.431 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:50.431 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:50.431 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:50.431 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_nocache.yaml").st_ino) 2024-04-25T19:25:50.431 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:50.615 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629633 2024-04-25T19:25:50.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:50.628 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:50.628 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:50.628 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:50.628 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:50.628 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_api_tests.yaml").st_ino) 2024-04-25T19:25:50.628 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:50.814 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629625 2024-04-25T19:25:50.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:50.827 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:50.827 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:50.827 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:50.827 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:50.827 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/journal.yaml").st_ino) 2024-04-25T19:25:50.827 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:51.012 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629624 2024-04-25T19:25:51.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:51.025 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:51.025 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:51.026 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:51.026 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:51.026 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_api_tests_copy_on_read.yaml").st_ino) 2024-04-25T19:25:51.026 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:51.210 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629626 2024-04-25T19:25:51.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:51.225 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:51.225 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:51.225 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:51.225 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:51.225 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_api_tests_no_locking.yaml").st_ino) 2024-04-25T19:25:51.225 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:51.398 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629628 2024-04-25T19:25:51.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:51.412 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:51.412 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:51.412 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:51.412 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:51.412 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_cache_writethrough.yaml").st_ino) 2024-04-25T19:25:51.412 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:51.597 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629630 2024-04-25T19:25:51.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:51.610 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:51.610 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:51.610 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:51.611 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:51.611 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/%").st_ino) 2024-04-25T19:25:51.611 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:51.795 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629608 2024-04-25T19:25:51.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:51.808 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:51.808 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:51.809 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:51.809 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:51.809 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/thrashers").st_ino) 2024-04-25T19:25:51.809 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:51.994 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629620 2024-04-25T19:25:51.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:52.008 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:52.008 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:52.008 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:52.008 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:52.009 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/thrashers/default.yaml").st_ino) 2024-04-25T19:25:52.009 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:52.191 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629622 2024-04-25T19:25:52.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:52.205 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:52.205 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:52.206 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:52.206 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:52.206 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/thrashers/cache.yaml").st_ino) 2024-04-25T19:25:52.206 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:52.385 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629621 2024-04-25T19:25:52.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:52.398 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:52.398 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:52.398 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:52.399 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:52.399 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror").st_ino) 2024-04-25T19:25:52.399 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:52.583 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629529 2024-04-25T19:25:52.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:52.596 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:52.597 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:52.597 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:52.597 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:52.597 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/base").st_ino) 2024-04-25T19:25:52.597 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:52.768 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629531 2024-04-25T19:25:52.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:52.781 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:52.781 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:52.781 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:52.781 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:52.781 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/base/install.yaml").st_ino) 2024-04-25T19:25:52.781 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:52.965 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629532 2024-04-25T19:25:52.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:52.979 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:52.979 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:52.979 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:52.979 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:52.979 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/cluster").st_ino) 2024-04-25T19:25:52.979 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:53.161 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629533 2024-04-25T19:25:53.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:53.175 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:53.176 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:53.176 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:53.176 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:53.176 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/cluster/openstack.yaml").st_ino) 2024-04-25T19:25:53.176 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:53.358 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629536 2024-04-25T19:25:53.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:53.371 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:53.371 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:53.371 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:53.371 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:53.371 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/cluster/2-node.yaml").st_ino) 2024-04-25T19:25:53.371 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:53.544 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629535 2024-04-25T19:25:53.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:53.557 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:53.557 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:53.557 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:53.557 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:53.557 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/cluster/+").st_ino) 2024-04-25T19:25:53.557 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:53.741 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629534 2024-04-25T19:25:53.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:53.754 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:53.754 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:53.754 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:53.755 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:53.755 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/msgr-failures").st_ino) 2024-04-25T19:25:53.755 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:53.939 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629538 2024-04-25T19:25:53.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:53.953 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:53.953 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:53.954 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:53.954 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:53.954 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/objectstore").st_ino) 2024-04-25T19:25:53.954 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:54.133 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629539 2024-04-25T19:25:54.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:54.148 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:54.148 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:54.148 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:54.148 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:54.148 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/fs").st_ino) 2024-04-25T19:25:54.149 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:54.338 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629537 2024-04-25T19:25:54.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:54.352 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:54.352 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:54.352 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:54.352 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:54.353 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/workloads").st_ino) 2024-04-25T19:25:54.353 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:54.524 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629542 2024-04-25T19:25:54.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:54.537 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:54.537 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:54.537 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:54.537 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:54.537 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/workloads/rbd-mirror-stress-workunit.yaml").st_ino) 2024-04-25T19:25:54.537 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:54.715 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629543 2024-04-25T19:25:54.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:54.728 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:54.728 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:54.728 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:54.728 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:54.728 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/workloads/rbd-mirror-workunit.yaml").st_ino) 2024-04-25T19:25:54.728 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:54.912 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629544 2024-04-25T19:25:54.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:54.926 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:54.926 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:54.926 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:54.926 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:54.926 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/%").st_ino) 2024-04-25T19:25:54.926 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:55.101 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629530 2024-04-25T19:25:55.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:55.115 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:55.115 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:55.115 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:55.115 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:55.115 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/rbd-mirror").st_ino) 2024-04-25T19:25:55.116 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:55.299 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629540 2024-04-25T19:25:55.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:55.313 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:55.313 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:55.313 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:55.313 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:55.313 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/rbd-mirror/one-per-cluster.yaml").st_ino) 2024-04-25T19:25:55.313 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:55.499 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629541 2024-04-25T19:25:55.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:55.512 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:55.512 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:55.513 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:55.513 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:55.513 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu").st_ino) 2024-04-25T19:25:55.513 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:55.699 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629559 2024-04-25T19:25:55.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:55.713 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:55.713 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:55.713 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:55.713 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:55.713 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/features").st_ino) 2024-04-25T19:25:55.713 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:55.892 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629569 2024-04-25T19:25:55.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:55.906 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:55.906 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:55.906 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:55.906 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:55.906 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/features/defaults.yaml").st_ino) 2024-04-25T19:25:55.906 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:56.091 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629570 2024-04-25T19:25:56.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:56.104 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:56.104 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:56.104 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:56.104 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:56.104 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/features/journaling.yaml").st_ino) 2024-04-25T19:25:56.104 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:56.281 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629571 2024-04-25T19:25:56.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:56.294 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:56.294 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:56.294 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:56.295 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:56.295 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/pool").st_ino) 2024-04-25T19:25:56.295 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:56.476 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629576 2024-04-25T19:25:56.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:56.489 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:56.489 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:56.489 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:56.489 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:56.489 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/pool/small-cache-pool.yaml").st_ino) 2024-04-25T19:25:56.489 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:56.674 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629581 2024-04-25T19:25:56.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:56.687 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:56.687 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:56.687 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:56.687 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:56.687 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/pool/replicated-data-pool.yaml").st_ino) 2024-04-25T19:25:56.687 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:56.859 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629580 2024-04-25T19:25:56.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:56.873 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:56.873 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:56.873 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:56.873 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:56.873 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/pool/ec-cache-pool.yaml").st_ino) 2024-04-25T19:25:56.873 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:57.055 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629577 2024-04-25T19:25:57.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:57.069 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:57.069 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:57.069 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:57.069 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:57.070 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/pool/ec-data-pool.yaml").st_ino) 2024-04-25T19:25:57.070 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:57.257 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629578 2024-04-25T19:25:57.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:57.270 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:57.271 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:57.271 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:57.271 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:57.271 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/pool/none.yaml").st_ino) 2024-04-25T19:25:57.271 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:57.454 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629579 2024-04-25T19:25:57.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:57.467 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:57.467 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:57.467 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:57.467 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:57.467 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/clusters").st_ino) 2024-04-25T19:25:57.467 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:57.657 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629565 2024-04-25T19:25:57.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:57.671 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:57.671 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:57.671 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:57.671 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:57.671 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/clusters/openstack.yaml").st_ino) 2024-04-25T19:25:57.672 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:57.861 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629568 2024-04-25T19:25:57.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:57.875 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:57.875 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:57.875 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:57.875 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:57.875 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/clusters/+").st_ino) 2024-04-25T19:25:57.875 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:58.060 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629566 2024-04-25T19:25:58.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:58.074 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:58.074 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:58.074 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:58.074 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:58.074 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/clusters/fixed-3.yaml").st_ino) 2024-04-25T19:25:58.074 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:58.260 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629567 2024-04-25T19:25:58.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:58.274 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:58.274 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:58.274 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:58.274 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:58.274 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/msgr-failures").st_ino) 2024-04-25T19:25:58.274 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:58.460 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629573 2024-04-25T19:25:58.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:58.474 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:58.474 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:58.474 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:58.474 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:58.474 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/msgr-failures/few.yaml").st_ino) 2024-04-25T19:25:58.474 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:58.656 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629574 2024-04-25T19:25:58.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:58.669 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:58.670 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:58.670 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:58.670 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:58.670 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/objectstore").st_ino) 2024-04-25T19:25:58.670 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:58.848 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629575 2024-04-25T19:25:58.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:58.862 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:58.862 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:58.862 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:58.862 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:58.862 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/fs").st_ino) 2024-04-25T19:25:58.862 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:59.046 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629572 2024-04-25T19:25:59.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:59.060 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:59.060 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:59.060 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:59.060 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:59.060 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/workloads").st_ino) 2024-04-25T19:25:59.060 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:59.245 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629582 2024-04-25T19:25:59.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:59.258 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:59.259 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:59.259 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:59.259 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:59.259 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/workloads/qemu_iozone.yaml.disabled").st_ino) 2024-04-25T19:25:59.259 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:59.439 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629586 2024-04-25T19:25:59.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:59.453 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:59.453 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:59.453 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:59.453 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:59.453 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/workloads/#qemu_xfstests.yaml#").st_ino) 2024-04-25T19:25:59.453 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:59.639 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629583 2024-04-25T19:25:59.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:59.654 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:59.654 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:59.654 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:59.654 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:59.654 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/workloads/qemu_xfstests.yaml").st_ino) 2024-04-25T19:25:59.654 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:25:59.836 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629587 2024-04-25T19:25:59.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:25:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:25:59.850 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:25:59.850 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:25:59.850 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:25:59.850 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:25:59.850 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/workloads/qemu_fsstress.yaml").st_ino) 2024-04-25T19:25:59.850 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:00.033 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629585 2024-04-25T19:26:00.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:00.046 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:00.046 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:00.046 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:00.046 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:00.046 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/workloads/qemu_bonnie.yaml").st_ino) 2024-04-25T19:26:00.046 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:00.231 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629584 2024-04-25T19:26:00.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:00.245 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:00.246 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:00.246 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:00.246 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:00.246 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/cache").st_ino) 2024-04-25T19:26:00.246 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:00.424 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629561 2024-04-25T19:26:00.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:00.437 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:00.438 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:00.438 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:00.438 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:00.438 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/cache/writeback.yaml").st_ino) 2024-04-25T19:26:00.438 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:00.621 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629563 2024-04-25T19:26:00.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:00.635 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:00.635 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:00.636 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:00.636 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:00.636 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/cache/writethrough.yaml").st_ino) 2024-04-25T19:26:00.636 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:00.817 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629564 2024-04-25T19:26:00.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:00.831 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:00.831 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:00.831 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:00.831 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:00.831 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/cache/none.yaml").st_ino) 2024-04-25T19:26:00.831 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:01.015 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629562 2024-04-25T19:26:01.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:01.029 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:01.029 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:01.030 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:01.030 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:01.030 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/%").st_ino) 2024-04-25T19:26:01.030 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:01.201 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629560 2024-04-25T19:26:01.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:01.214 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:01.214 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:01.214 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:01.214 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:01.214 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rest").st_ino) 2024-04-25T19:26:01.214 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:01.396 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629652 2024-04-25T19:26:01.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:01.410 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:01.410 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:01.410 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:01.410 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:01.410 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rest/basic").st_ino) 2024-04-25T19:26:01.410 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:01.590 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629653 2024-04-25T19:26:01.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:01.604 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:01.604 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:01.604 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:01.604 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:01.604 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rest/basic/tasks").st_ino) 2024-04-25T19:26:01.604 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:01.789 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629654 2024-04-25T19:26:01.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:01.802 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:01.802 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:01.802 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:01.802 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:01.802 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rest/basic/tasks/rest_test.yaml").st_ino) 2024-04-25T19:26:01.802 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:01.986 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629655 2024-04-25T19:26:01.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:01.998 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:01.998 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:01.998 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:01.998 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:01.998 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw").st_ino) 2024-04-25T19:26:01.999 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:02.182 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629656 2024-04-25T19:26:02.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:02.196 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:02.196 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:02.196 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:02.196 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:02.196 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs").st_ino) 2024-04-25T19:26:02.196 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:02.378 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629657 2024-04-25T19:26:02.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:02.392 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:02.392 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:02.392 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:02.392 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:02.393 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/clusters").st_ino) 2024-04-25T19:26:02.393 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:02.576 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629659 2024-04-25T19:26:02.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:02.589 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:02.589 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:02.589 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:02.589 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:02.589 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/clusters/fixed-2.yaml").st_ino) 2024-04-25T19:26:02.589 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:02.767 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629660 2024-04-25T19:26:02.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:02.780 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:02.780 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:02.780 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:02.780 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:02.780 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/objectstore").st_ino) 2024-04-25T19:26:02.780 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:02.962 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629666 2024-04-25T19:26:02.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:02.975 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:02.975 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:02.975 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:02.975 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:02.975 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/fs").st_ino) 2024-04-25T19:26:02.976 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:03.156 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629664 2024-04-25T19:26:03.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:03.170 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:03.170 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:03.170 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:03.170 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:03.170 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/fs/xfs.yaml").st_ino) 2024-04-25T19:26:03.170 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:03.357 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629665 2024-04-25T19:26:03.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:03.370 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:03.370 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:03.370 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:03.370 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:03.370 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/rgw_pool_type").st_ino) 2024-04-25T19:26:03.370 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:03.549 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629668 2024-04-25T19:26:03.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:03.563 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:03.563 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:03.563 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:03.563 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:03.563 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/frontend").st_ino) 2024-04-25T19:26:03.563 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:03.746 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629661 2024-04-25T19:26:03.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:03.761 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:03.761 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:03.761 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:03.761 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:03.761 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/frontend/apache.yaml").st_ino) 2024-04-25T19:26:03.761 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:03.945 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629662 2024-04-25T19:26:03.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:03.959 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:03.959 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:03.959 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:03.959 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:03.959 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/frontend/civetweb.yaml").st_ino) 2024-04-25T19:26:03.959 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:04.143 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629663 2024-04-25T19:26:04.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:04.157 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:04.157 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:04.157 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:04.157 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:04.157 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/overrides.yaml").st_ino) 2024-04-25T19:26:04.157 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:04.343 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629667 2024-04-25T19:26:04.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:04.358 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:04.358 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:04.358 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:04.358 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:04.358 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/%").st_ino) 2024-04-25T19:26:04.358 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:04.541 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629658 2024-04-25T19:26:04.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:04.554 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:04.555 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:04.555 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:04.555 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:04.555 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/tasks").st_ino) 2024-04-25T19:26:04.555 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:04.737 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629669 2024-04-25T19:26:04.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:04.750 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:04.751 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:04.751 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:04.751 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:04.751 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_roundtrip.yaml").st_ino) 2024-04-25T19:26:04.751 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:04.935 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629673 2024-04-25T19:26:04.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:04.948 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:04.948 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:04.948 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:04.948 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:04.948 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_multipart_upload.yaml").st_ino) 2024-04-25T19:26:04.948 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:05.129 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629671 2024-04-25T19:26:05.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:05.142 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:05.142 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:05.142 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:05.142 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:05.142 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_user_quota.yaml").st_ino) 2024-04-25T19:26:05.142 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:05.324 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629676 2024-04-25T19:26:05.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:05.338 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:05.338 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:05.338 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:05.338 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:05.338 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_readwrite.yaml").st_ino) 2024-04-25T19:26:05.338 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:05.520 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629672 2024-04-25T19:26:05.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:05.534 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:05.534 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:05.534 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:05.534 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:05.534 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_swift.yaml").st_ino) 2024-04-25T19:26:05.534 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:05.717 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629675 2024-04-25T19:26:05.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:05.730 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:05.730 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:05.730 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:05.730 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:05.730 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_s3tests.yaml").st_ino) 2024-04-25T19:26:05.730 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:05.914 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629674 2024-04-25T19:26:05.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:05.927 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:05.927 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:05.927 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:05.927 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:05.927 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_bucket_quota.yaml").st_ino) 2024-04-25T19:26:05.927 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:06.110 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629670 2024-04-25T19:26:06.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:06.125 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:06.125 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:06.125 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:06.125 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:06.125 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton").st_ino) 2024-04-25T19:26:06.125 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:06.312 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629677 2024-04-25T19:26:06.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:06.325 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:06.325 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:06.325 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:06.325 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:06.326 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/objectstore").st_ino) 2024-04-25T19:26:06.326 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:06.509 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629689 2024-04-25T19:26:06.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:06.523 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:06.523 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:06.523 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:06.523 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:06.524 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/fs").st_ino) 2024-04-25T19:26:06.524 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:06.698 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629687 2024-04-25T19:26:06.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:06.712 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:06.712 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:06.712 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:06.712 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:06.712 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/fs/xfs.yaml").st_ino) 2024-04-25T19:26:06.712 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:06.774 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:26:06.782 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:26:06.883 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629688 2024-04-25T19:26:06.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:06.896 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:06.896 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:06.896 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:06.896 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:06.896 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/rgw_pool_type").st_ino) 2024-04-25T19:26:06.896 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:07.082 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629691 2024-04-25T19:26:07.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:07.096 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:07.096 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:07.096 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:07.096 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:07.096 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/frontend").st_ino) 2024-04-25T19:26:07.096 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:07.280 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629684 2024-04-25T19:26:07.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:07.294 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:07.294 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:07.294 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:07.294 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:07.295 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/frontend/apache.yaml").st_ino) 2024-04-25T19:26:07.295 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:07.478 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629685 2024-04-25T19:26:07.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:07.492 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:07.492 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:07.492 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:07.492 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:07.492 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/frontend/civetweb.yaml").st_ino) 2024-04-25T19:26:07.492 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:07.679 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629686 2024-04-25T19:26:07.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:07.692 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:07.692 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:07.692 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:07.692 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:07.693 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/overrides.yaml").st_ino) 2024-04-25T19:26:07.693 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:07.876 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629690 2024-04-25T19:26:07.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:07.889 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:07.889 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:07.889 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:07.890 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:07.890 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/%").st_ino) 2024-04-25T19:26:07.890 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:08.063 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629678 2024-04-25T19:26:08.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:08.077 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:08.077 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:08.077 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:08.077 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:08.077 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/xfs.yaml").st_ino) 2024-04-25T19:26:08.077 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:08.254 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629692 2024-04-25T19:26:09.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:09.196 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:09.196 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:09.196 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:09.196 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:09.196 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/all").st_ino) 2024-04-25T19:26:09.196 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:09.379 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629679 2024-04-25T19:26:09.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:09.392 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:09.393 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:09.393 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:09.393 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:09.393 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/all/radosgw-admin-multi-region.yaml").st_ino) 2024-04-25T19:26:09.393 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:09.575 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629681 2024-04-25T19:26:09.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:09.589 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:09.589 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:09.589 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:09.589 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:09.589 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/all/radosgw-admin.yaml").st_ino) 2024-04-25T19:26:09.589 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:09.771 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629682 2024-04-25T19:26:09.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:09.785 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:09.785 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:09.785 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:09.785 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:09.785 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/all/radosgw-admin-data-sync.yaml").st_ino) 2024-04-25T19:26:09.785 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:09.971 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629680 2024-04-25T19:26:09.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:09.985 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:09.985 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:09.985 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:09.985 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:09.985 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/all/radosgw-convert-to-region.yaml").st_ino) 2024-04-25T19:26:09.985 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:10.168 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629683 2024-04-25T19:26:10.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:10.182 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:10.182 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:10.182 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:10.182 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:10.182 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify").st_ino) 2024-04-25T19:26:10.182 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:10.367 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629693 2024-04-25T19:26:10.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:10.380 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:10.380 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:10.380 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:10.380 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:10.380 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/validater").st_ino) 2024-04-25T19:26:10.381 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:10.562 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629711 2024-04-25T19:26:10.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:10.577 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:10.577 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:10.577 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:10.577 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:10.577 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/validater/valgrind.yaml").st_ino) 2024-04-25T19:26:10.577 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:10.760 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629713 2024-04-25T19:26:10.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:10.774 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:10.774 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:10.774 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:10.774 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:10.774 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/validater/lockdep.yaml").st_ino) 2024-04-25T19:26:10.774 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:10.957 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629712 2024-04-25T19:26:10.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:10.970 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:10.970 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:10.971 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:10.971 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:10.971 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/clusters").st_ino) 2024-04-25T19:26:10.971 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:11.155 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629695 2024-04-25T19:26:11.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:11.168 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:11.168 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:11.168 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:11.168 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:11.168 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/clusters/fixed-2.yaml").st_ino) 2024-04-25T19:26:11.168 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:11.353 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629696 2024-04-25T19:26:11.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:11.367 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:11.367 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:11.367 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:11.367 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:11.367 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/msgr-failures").st_ino) 2024-04-25T19:26:11.367 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:11.552 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629702 2024-04-25T19:26:11.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:11.565 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:11.566 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:11.566 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:11.566 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:11.566 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/msgr-failures/few.yaml").st_ino) 2024-04-25T19:26:11.566 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:11.747 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629703 2024-04-25T19:26:11.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:11.760 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:11.761 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:11.761 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:11.761 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:11.761 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/objectstore").st_ino) 2024-04-25T19:26:11.761 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:11.932 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629704 2024-04-25T19:26:11.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:11.945 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:11.945 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:11.945 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:11.945 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:11.945 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/fs").st_ino) 2024-04-25T19:26:11.945 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:12.126 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629700 2024-04-25T19:26:12.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:12.140 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:12.140 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:12.140 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:12.140 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:12.141 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/fs/xfs.yaml").st_ino) 2024-04-25T19:26:12.141 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:12.325 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629701 2024-04-25T19:26:12.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:12.338 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:12.338 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:12.338 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:12.338 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:12.338 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/rgw_pool_type").st_ino) 2024-04-25T19:26:12.339 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:12.522 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629706 2024-04-25T19:26:12.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:12.536 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:12.536 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:12.536 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:12.536 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:12.536 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/frontend").st_ino) 2024-04-25T19:26:12.536 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:12.720 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629697 2024-04-25T19:26:12.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:12.735 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:12.735 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:12.735 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:12.735 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:12.735 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/frontend/apache.yaml").st_ino) 2024-04-25T19:26:12.736 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:12.918 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629698 2024-04-25T19:26:12.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:12.932 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:12.932 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:12.932 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:12.933 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:12.933 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/frontend/civetweb.yaml").st_ino) 2024-04-25T19:26:12.933 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:13.117 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629699 2024-04-25T19:26:13.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:13.131 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:13.131 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:13.131 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:13.131 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:13.131 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/overrides.yaml").st_ino) 2024-04-25T19:26:13.131 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:13.314 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629705 2024-04-25T19:26:13.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:13.328 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:13.328 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:13.328 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:13.328 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:13.328 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/%").st_ino) 2024-04-25T19:26:13.328 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:13.513 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629694 2024-04-25T19:26:13.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:13.531 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:13.531 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:13.531 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:13.531 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:13.531 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/tasks").st_ino) 2024-04-25T19:26:13.531 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:13.715 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629707 2024-04-25T19:26:13.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:13.728 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:13.729 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:13.729 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:13.729 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:13.729 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/tasks/rgw_s3tests_multiregion.yaml").st_ino) 2024-04-25T19:26:13.729 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:13.914 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629709 2024-04-25T19:26:13.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:13.927 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:13.928 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:13.928 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:13.928 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:13.928 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/tasks/rgw_swift.yaml").st_ino) 2024-04-25T19:26:13.928 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:14.113 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629710 2024-04-25T19:26:14.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:14.127 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:14.127 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:14.127 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:14.127 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:14.127 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/tasks/rgw_s3tests.yaml").st_ino) 2024-04-25T19:26:14.127 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:14.314 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629708 2024-04-25T19:26:14.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:14.328 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:14.328 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:14.328 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:14.328 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:14.328 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy").st_ino) 2024-04-25T19:26:14.328 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:14.511 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628523 2024-04-25T19:26:14.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:14.525 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:14.525 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:14.525 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:14.525 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:14.525 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic").st_ino) 2024-04-25T19:26:14.525 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:14.711 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628524 2024-04-25T19:26:14.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:14.724 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:14.724 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:14.724 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:14.725 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:14.725 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/ceph-deploy-overrides").st_ino) 2024-04-25T19:26:14.725 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:14.906 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628526 2024-04-25T19:26:14.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:14.920 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:14.920 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:14.920 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:14.920 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:14.920 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/python_versions").st_ino) 2024-04-25T19:26:14.921 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:15.103 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628529 2024-04-25T19:26:15.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:15.116 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:15.117 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:15.117 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:15.117 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:15.117 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/python_versions/python_3.yaml").st_ino) 2024-04-25T19:26:15.117 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:15.300 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628531 2024-04-25T19:26:15.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:15.314 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:15.314 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:15.314 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:15.314 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:15.314 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/python_versions/python_2.yaml").st_ino) 2024-04-25T19:26:15.314 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:15.500 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628530 2024-04-25T19:26:15.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:15.515 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:15.515 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:15.515 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:15.515 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:15.515 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/config_options").st_ino) 2024-04-25T19:26:15.515 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:15.700 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628527 2024-04-25T19:26:15.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:15.714 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:15.714 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:15.714 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:15.714 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:15.714 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/distros").st_ino) 2024-04-25T19:26:15.714 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:15.894 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628528 2024-04-25T19:26:15.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:15.907 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:15.907 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:15.908 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:15.908 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:15.908 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/%").st_ino) 2024-04-25T19:26:15.908 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:16.080 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628525 2024-04-25T19:26:16.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:16.093 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:16.093 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:16.093 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:16.093 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:16.093 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/tasks").st_ino) 2024-04-25T19:26:16.093 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:16.279 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628532 2024-04-25T19:26:16.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:16.293 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:16.293 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:16.293 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:16.293 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:16.293 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/tasks/ceph-admin-commands.yaml").st_ino) 2024-04-25T19:26:16.293 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:16.476 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628533 2024-04-25T19:26:16.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:16.490 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:16.491 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:16.491 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:16.491 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:16.491 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt").st_ino) 2024-04-25T19:26:16.491 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:16.672 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629851 2024-04-25T19:26:16.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:16.686 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:16.686 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:16.686 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:16.686 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:16.686 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic").st_ino) 2024-04-25T19:26:16.686 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:16.870 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629852 2024-04-25T19:26:16.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:16.884 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:16.884 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:16.884 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:16.884 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:16.884 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/clusters").st_ino) 2024-04-25T19:26:16.884 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:17.069 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629854 2024-04-25T19:26:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:17.083 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:17.083 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:17.083 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:17.083 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:17.083 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/clusters/fixed-3.yaml").st_ino) 2024-04-25T19:26:17.083 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:17.271 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629855 2024-04-25T19:26:17.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:17.284 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:17.284 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:17.284 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:17.284 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:17.285 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/msgr-failures").st_ino) 2024-04-25T19:26:17.285 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:17.471 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629858 2024-04-25T19:26:17.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:17.486 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:17.486 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:17.486 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:17.486 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:17.486 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/msgr-failures/many.yaml").st_ino) 2024-04-25T19:26:17.486 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:17.668 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629860 2024-04-25T19:26:17.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:17.682 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:17.682 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:17.682 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:17.682 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:17.682 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/msgr-failures/few.yaml").st_ino) 2024-04-25T19:26:17.682 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:17.865 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629859 2024-04-25T19:26:17.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:17.879 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:17.879 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:17.879 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:17.879 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:17.879 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/fs").st_ino) 2024-04-25T19:26:17.879 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:18.051 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629856 2024-04-25T19:26:18.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:18.064 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:18.065 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:18.065 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:18.065 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:18.065 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/fs/btrfs.yaml").st_ino) 2024-04-25T19:26:18.065 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:18.248 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629857 2024-04-25T19:26:18.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:18.262 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:18.262 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:18.262 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:18.262 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:18.262 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/%").st_ino) 2024-04-25T19:26:18.262 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:18.445 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629853 2024-04-25T19:26:18.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:18.459 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:18.459 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:18.459 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:18.460 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:18.460 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks").st_ino) 2024-04-25T19:26:18.460 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:18.645 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629861 2024-04-25T19:26:18.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:18.659 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:18.659 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:18.659 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:18.659 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:18.659 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/iozone-sync.yaml").st_ino) 2024-04-25T19:26:18.659 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:18.829 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629872 2024-04-25T19:26:18.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:18.842 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:18.843 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:18.843 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:18.843 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:18.843 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/dbench-short.yaml").st_ino) 2024-04-25T19:26:18.843 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:19.026 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629864 2024-04-25T19:26:19.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:19.040 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:19.040 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:19.040 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:19.040 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:19.040 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/blogbench.yaml").st_ino) 2024-04-25T19:26:19.040 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:19.224 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629862 2024-04-25T19:26:19.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:19.239 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:19.239 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:19.239 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:19.239 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:19.239 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/ffsb.yaml").st_ino) 2024-04-25T19:26:19.239 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:19.424 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629866 2024-04-25T19:26:19.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:19.439 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:19.439 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:19.439 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:19.439 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:19.439 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/pjd.yaml").st_ino) 2024-04-25T19:26:19.439 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:19.612 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629874 2024-04-25T19:26:19.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:19.626 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:19.626 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:19.626 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:19.626 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:19.626 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/fsync-tester.yaml").st_ino) 2024-04-25T19:26:19.626 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:19.809 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629870 2024-04-25T19:26:19.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:19.823 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:19.823 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:19.823 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:19.823 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:19.823 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/iogen.yaml").st_ino) 2024-04-25T19:26:19.823 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:20.009 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629871 2024-04-25T19:26:20.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:20.023 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:20.023 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:20.023 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:20.023 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:20.023 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/fsx.yaml").st_ino) 2024-04-25T19:26:20.024 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:20.197 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629869 2024-04-25T19:26:20.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:20.211 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:20.211 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:20.211 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:20.211 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:20.211 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/bonnie.yaml").st_ino) 2024-04-25T19:26:20.211 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:20.395 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629863 2024-04-25T19:26:20.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:20.409 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:20.409 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:20.409 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:20.409 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:20.409 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/fio.yaml").st_ino) 2024-04-25T19:26:20.409 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:20.596 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629867 2024-04-25T19:26:20.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:20.610 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:20.610 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:20.610 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:20.610 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:20.610 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/iozone.yaml").st_ino) 2024-04-25T19:26:20.610 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:20.781 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629873 2024-04-25T19:26:20.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:20.794 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:20.794 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:20.794 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:20.794 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:20.794 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/dbench.yaml").st_ino) 2024-04-25T19:26:20.794 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:20.974 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629865 2024-04-25T19:26:20.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:20.988 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:20.988 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:20.988 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:20.988 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:20.988 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/fsstress.yaml").st_ino) 2024-04-25T19:26:20.988 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:21.172 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629868 2024-04-25T19:26:21.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:21.186 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:21.186 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:21.186 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:21.186 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:21.186 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba").st_ino) 2024-04-25T19:26:21.186 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:21.367 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629714 2024-04-25T19:26:21.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:21.381 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:21.381 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:21.381 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:21.381 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:21.381 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/install").st_ino) 2024-04-25T19:26:21.381 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:21.564 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629720 2024-04-25T19:26:21.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:21.577 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:21.577 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:21.577 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:21.577 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:21.578 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/install/install.yaml").st_ino) 2024-04-25T19:26:21.578 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:21.763 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629721 2024-04-25T19:26:21.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:21.777 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:21.777 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:21.777 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:21.777 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:21.777 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/clusters").st_ino) 2024-04-25T19:26:21.777 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:21.956 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629716 2024-04-25T19:26:21.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:21.970 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:21.970 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:21.970 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:21.970 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:21.970 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/clusters/samba-basic.yaml").st_ino) 2024-04-25T19:26:21.970 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:22.154 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629717 2024-04-25T19:26:22.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:22.167 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:22.167 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:22.167 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:22.167 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:22.167 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/workload").st_ino) 2024-04-25T19:26:22.167 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:22.344 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629727 2024-04-25T19:26:22.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:22.357 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:22.357 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:22.357 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:22.357 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:22.357 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/workload/cifs-kernel-build.yaml.disabled").st_ino) 2024-04-25T19:26:22.357 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:22.529 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629730 2024-04-25T19:26:22.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:22.543 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:22.543 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:22.543 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:22.543 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:22.543 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/workload/cifs-fsstress.yaml").st_ino) 2024-04-25T19:26:22.544 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:22.714 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629729 2024-04-25T19:26:22.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:22.728 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:22.728 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:22.728 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:22.728 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:22.728 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/workload/smbtorture.yaml").st_ino) 2024-04-25T19:26:22.728 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:22.912 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629731 2024-04-25T19:26:22.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:22.926 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:22.926 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:22.926 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:22.926 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:22.926 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/workload/cifs-dbench.yaml").st_ino) 2024-04-25T19:26:22.926 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:23.108 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629728 2024-04-25T19:26:23.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:23.122 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:23.122 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:23.123 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:23.123 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:23.123 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/fs").st_ino) 2024-04-25T19:26:23.123 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:23.298 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629718 2024-04-25T19:26:23.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:23.312 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:23.312 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:23.312 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:23.312 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:23.312 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/fs/xfs.yaml").st_ino) 2024-04-25T19:26:23.312 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:23.496 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629719 2024-04-25T19:26:23.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:23.509 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:23.509 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:23.509 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:23.509 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:23.509 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/mount").st_ino) 2024-04-25T19:26:23.510 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:23.683 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629722 2024-04-25T19:26:23.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:23.696 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:23.696 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:23.696 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:23.696 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:23.696 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/mount/noceph.yaml").st_ino) 2024-04-25T19:26:23.696 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:23.882 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629726 2024-04-25T19:26:23.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:23.895 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:23.896 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:23.896 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:23.896 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:23.896 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/mount/kclient.yaml").st_ino) 2024-04-25T19:26:23.896 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:24.078 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629724 2024-04-25T19:26:24.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:24.092 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:24.092 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:24.092 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:24.092 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:24.092 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/mount/fuse.yaml").st_ino) 2024-04-25T19:26:24.092 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:24.283 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629723 2024-04-25T19:26:24.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:24.296 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:24.296 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:24.296 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:24.296 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:24.296 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/mount/native.yaml").st_ino) 2024-04-25T19:26:24.296 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:24.479 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629725 2024-04-25T19:26:24.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:24.492 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:24.492 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:24.492 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:24.492 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:24.492 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/%").st_ino) 2024-04-25T19:26:24.492 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:24.672 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629715 2024-04-25T19:26:24.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:24.686 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:24.686 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:24.686 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:24.686 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:24.686 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible").st_ino) 2024-04-25T19:26:24.687 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:24.871 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628496 2024-04-25T19:26:24.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:24.885 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:24.885 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:24.885 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:24.885 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:24.885 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke").st_ino) 2024-04-25T19:26:24.885 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:25.070 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628497 2024-04-25T19:26:25.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:25.084 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:25.084 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:25.084 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:25.084 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:25.084 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests").st_ino) 2024-04-25T19:26:25.084 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:25.267 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628518 2024-04-25T19:26:25.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:25.281 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:25.281 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:25.281 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:25.281 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:25.281 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests/cls.yaml").st_ino) 2024-04-25T19:26:25.282 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:25.462 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628520 2024-04-25T19:26:25.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:25.475 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:25.475 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:25.476 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:25.476 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:25.476 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests/rbd_cli_tests.yaml.disabled").st_ino) 2024-04-25T19:26:25.476 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:25.659 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628521 2024-04-25T19:26:25.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:25.673 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:25.673 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:25.673 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:25.673 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:25.673 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests/rbd_import_export.yaml").st_ino) 2024-04-25T19:26:25.673 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:25.854 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628522 2024-04-25T19:26:25.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:25.867 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:25.867 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:25.867 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:25.867 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:25.867 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests/ceph-admin-commands.yaml").st_ino) 2024-04-25T19:26:25.867 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:26.050 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628519 2024-04-25T19:26:26.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:26.064 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:26.064 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:26.064 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:26.065 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:26.065 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/1-distros").st_ino) 2024-04-25T19:26:26.065 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:26.248 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628502 2024-04-25T19:26:26.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:26.262 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:26.262 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:26.262 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:26.262 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:26.262 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/0-clusters").st_ino) 2024-04-25T19:26:26.262 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:26.444 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628499 2024-04-25T19:26:26.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:26.457 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:26.457 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:26.457 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:26.457 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:26.457 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/0-clusters/single_mon_osd.yaml").st_ino) 2024-04-25T19:26:26.458 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:26.631 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628501 2024-04-25T19:26:26.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:26.645 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:26.645 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:26.645 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:26.645 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:26.645 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/0-clusters/3-node.yaml").st_ino) 2024-04-25T19:26:26.645 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:26.830 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628500 2024-04-25T19:26:26.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:26.845 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:26.845 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:26.845 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:26.845 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:26.845 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/3-common").st_ino) 2024-04-25T19:26:26.845 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:27.026 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628505 2024-04-25T19:26:27.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:27.040 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:27.040 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:27.040 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:27.040 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:27.040 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/os_tuning").st_ino) 2024-04-25T19:26:27.040 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:27.224 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628507 2024-04-25T19:26:27.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:27.238 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:27.238 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:27.238 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:27.238 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:27.238 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/os_tuning/vm_friendly.yaml").st_ino) 2024-04-25T19:26:27.238 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:27.409 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628508 2024-04-25T19:26:27.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:27.422 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:27.422 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:27.422 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:27.422 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:27.422 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/source").st_ino) 2024-04-25T19:26:27.422 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:27.606 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628509 2024-04-25T19:26:27.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:27.619 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:27.619 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:27.619 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:27.619 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:27.619 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/source/upstream_stable.yaml").st_ino) 2024-04-25T19:26:27.619 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:27.807 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628510 2024-04-25T19:26:27.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:27.821 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:27.821 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:27.821 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:27.821 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:27.821 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/%").st_ino) 2024-04-25T19:26:27.821 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:28.004 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628506 2024-04-25T19:26:28.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:28.018 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:28.018 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:28.018 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:28.018 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:28.018 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/%").st_ino) 2024-04-25T19:26:28.018 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:28.202 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628498 2024-04-25T19:26:28.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:28.215 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:28.215 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:28.216 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:28.216 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:28.216 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd").st_ino) 2024-04-25T19:26:28.216 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:28.398 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628511 2024-04-25T19:26:28.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:28.411 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:28.411 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:28.411 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:28.411 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:28.411 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/journal").st_ino) 2024-04-25T19:26:28.411 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:28.594 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628516 2024-04-25T19:26:28.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:28.608 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:28.608 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:28.608 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:28.608 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:28.609 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/journal/collocated.yaml").st_ino) 2024-04-25T19:26:28.609 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:28.803 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628517 2024-04-25T19:26:28.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:28.815 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:28.815 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:28.815 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:28.816 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:28.816 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/%").st_ino) 2024-04-25T19:26:28.816 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:29.007 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628512 2024-04-25T19:26:29.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:29.022 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:29.023 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:29.024 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:29.024 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:29.024 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/devices").st_ino) 2024-04-25T19:26:29.024 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:29.197 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628513 2024-04-25T19:26:29.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:29.211 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:29.211 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:29.211 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:29.211 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:29.211 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/devices/osd_auto_discovery.yaml").st_ino) 2024-04-25T19:26:29.211 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:29.394 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628515 2024-04-25T19:26:29.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:29.408 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:29.408 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:29.408 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:29.408 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:29.408 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/devices/from_teuthology.yaml").st_ino) 2024-04-25T19:26:29.408 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:29.590 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628514 2024-04-25T19:26:29.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:29.603 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:29.604 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:29.604 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:29.604 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:29.604 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/2-setup").st_ino) 2024-04-25T19:26:29.604 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:29.784 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628503 2024-04-25T19:26:29.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:29.797 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:29.797 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:29.798 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:29.798 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:29.798 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/2-setup/ceph_ansible.yaml").st_ino) 2024-04-25T19:26:29.798 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:29.980 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628504 2024-04-25T19:26:29.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:29.993 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:29.993 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:29.993 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:29.993 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:29.993 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big").st_ino) 2024-04-25T19:26:29.994 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:30.177 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628469 2024-04-25T19:26:30.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:30.192 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:30.192 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:30.192 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:30.192 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:30.192 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash").st_ino) 2024-04-25T19:26:30.192 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:30.376 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628470 2024-04-25T19:26:30.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:30.391 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:30.391 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:30.391 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:30.391 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:30.391 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/clusters").st_ino) 2024-04-25T19:26:30.391 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:30.574 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628474 2024-04-25T19:26:30.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:30.587 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:30.587 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:30.587 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:30.587 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:30.587 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/clusters/medium.yaml").st_ino) 2024-04-25T19:26:30.587 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:30.772 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628476 2024-04-25T19:26:30.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:30.785 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:30.785 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:30.786 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:30.786 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:30.786 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/clusters/big.yaml").st_ino) 2024-04-25T19:26:30.786 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:30.969 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628475 2024-04-25T19:26:30.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:30.982 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:30.982 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:30.982 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:30.982 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:30.982 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/clusters/small.yaml").st_ino) 2024-04-25T19:26:30.983 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:31.164 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628477 2024-04-25T19:26:31.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:31.178 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:31.178 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:31.178 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:31.178 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:31.178 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/fs").st_ino) 2024-04-25T19:26:31.178 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:31.363 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628478 2024-04-25T19:26:31.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:31.377 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:31.377 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:31.377 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:31.378 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:31.378 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/fs/btrfs.yaml").st_ino) 2024-04-25T19:26:31.378 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:31.561 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628479 2024-04-25T19:26:31.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:31.574 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:31.574 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:31.574 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:31.574 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:31.574 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/fs/xfs.yaml").st_ino) 2024-04-25T19:26:31.574 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:31.760 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628480 2024-04-25T19:26:31.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:31.774 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:31.774 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:31.774 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:31.774 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:31.774 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/workloads").st_ino) 2024-04-25T19:26:31.774 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:31.959 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628483 2024-04-25T19:26:31.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:31.972 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:31.972 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:31.972 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:31.972 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:31.972 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/workloads/snaps-few-objects.yaml").st_ino) 2024-04-25T19:26:31.972 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:32.155 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628484 2024-04-25T19:26:32.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:32.169 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:32.169 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:32.169 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:32.169 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:32.169 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/ceph").st_ino) 2024-04-25T19:26:32.169 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:32.358 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628472 2024-04-25T19:26:32.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:32.372 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:32.372 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:32.372 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:32.372 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:32.372 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/ceph/ceph.yaml").st_ino) 2024-04-25T19:26:32.372 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:32.554 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628473 2024-04-25T19:26:32.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:32.567 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:32.567 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:32.567 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:32.568 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:32.568 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/%").st_ino) 2024-04-25T19:26:32.568 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:32.753 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628471 2024-04-25T19:26:32.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:32.766 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:32.766 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:32.766 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:32.766 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:32.766 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/thrashers").st_ino) 2024-04-25T19:26:32.767 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:32.946 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628481 2024-04-25T19:26:32.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:32.960 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:32.960 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:32.960 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:32.960 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:32.960 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/thrashers/default.yaml").st_ino) 2024-04-25T19:26:32.960 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:33.143 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628482 2024-04-25T19:26:33.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:33.156 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:33.156 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:33.156 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:33.156 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:33.156 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients").st_ino) 2024-04-25T19:26:33.156 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:33.329 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629052 2024-04-25T19:26:33.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:33.342 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:33.342 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:33.343 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:33.343 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:33.343 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients/basic").st_ino) 2024-04-25T19:26:33.343 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:33.526 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629053 2024-04-25T19:26:33.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:33.539 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:33.540 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:33.540 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:33.540 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:33.540 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients/basic/clusters").st_ino) 2024-04-25T19:26:33.540 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:33.722 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629054 2024-04-25T19:26:33.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:33.735 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:33.736 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:33.736 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:33.736 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:33.736 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients/basic/clusters/fixed-3.yaml").st_ino) 2024-04-25T19:26:33.736 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:33.916 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629055 2024-04-25T19:26:33.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:33.929 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:33.930 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:33.930 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:33.930 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:33.930 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients/basic/fs").st_ino) 2024-04-25T19:26:33.930 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:34.109 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629056 2024-04-25T19:26:34.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:34.123 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:34.123 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:34.123 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:34.123 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:34.123 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients/basic/fs/btrfs.yaml").st_ino) 2024-04-25T19:26:34.123 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:34.307 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629057 2024-04-25T19:26:34.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:34.320 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:34.320 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:34.320 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:34.320 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:34.320 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients/basic/tasks").st_ino) 2024-04-25T19:26:34.320 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:34.503 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629058 2024-04-25T19:26:34.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:34.516 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:34.516 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:34.516 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:34.516 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:34.516 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients/basic/tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml").st_ino) 2024-04-25T19:26:34.516 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:34.700 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629060 2024-04-25T19:26:34.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:34.714 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:34.714 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:34.715 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:34.715 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:34.715 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients/basic/tasks/kernel_cfuse_workunits_dbench_iozone.yaml").st_ino) 2024-04-25T19:26:34.715 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:34.896 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629059 2024-04-25T19:26:34.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:34.910 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:34.910 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:34.910 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:34.910 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:34.910 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs").st_ino) 2024-04-25T19:26:34.910 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:35.093 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628551 2024-04-25T19:26:35.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:35.107 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:35.107 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:35.107 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:35.107 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:35.107 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless").st_ino) 2024-04-25T19:26:35.108 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:35.288 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628764 2024-04-25T19:26:35.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:35.302 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:35.302 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:35.302 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:35.303 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:35.303 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/traceless").st_ino) 2024-04-25T19:26:35.303 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:35.484 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628784 2024-04-25T19:26:35.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:35.498 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:35.498 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:35.498 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:35.498 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:35.498 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/traceless/50pc.yaml").st_ino) 2024-04-25T19:26:35.498 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:35.683 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628785 2024-04-25T19:26:35.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:35.699 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:35.699 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:35.699 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:35.699 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:35.699 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/overrides").st_ino) 2024-04-25T19:26:35.699 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:35.882 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628774 2024-04-25T19:26:35.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:35.895 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:35.895 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:35.896 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:35.896 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:35.896 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-04-25T19:26:35.896 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:36.078 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628778 2024-04-25T19:26:36.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:36.091 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:36.091 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:36.091 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:36.091 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:36.091 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/overrides/debug.yaml").st_ino) 2024-04-25T19:26:36.091 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:36.278 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628776 2024-04-25T19:26:36.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:36.291 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:36.291 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:36.292 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:36.292 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:36.292 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/overrides/+").st_ino) 2024-04-25T19:26:36.292 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:36.476 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628775 2024-04-25T19:26:36.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:36.490 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:36.490 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:36.490 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:36.490 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:36.490 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/overrides/frag_enable.yaml").st_ino) 2024-04-25T19:26:36.490 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:36.673 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628777 2024-04-25T19:26:36.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:36.686 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:36.686 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:36.686 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:36.686 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:36.686 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/clusters").st_ino) 2024-04-25T19:26:36.686 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:36.871 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628767 2024-04-25T19:26:36.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:36.884 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:36.884 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:36.884 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:36.884 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:36.884 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/clusters/fixed-2-ucephfs.yaml").st_ino) 2024-04-25T19:26:36.885 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:36.905 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:26:36.938 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:26:37.053 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628768 2024-04-25T19:26:37.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:37.067 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:37.067 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:37.067 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:37.067 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:37.067 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/objectstore").st_ino) 2024-04-25T19:26:37.067 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:37.248 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628773 2024-04-25T19:26:37.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:37.262 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:37.262 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:37.262 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:37.262 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:37.262 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/fs").st_ino) 2024-04-25T19:26:37.262 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:37.448 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628769 2024-04-25T19:26:37.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:37.461 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:37.461 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:37.461 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:37.461 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:37.461 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/fs/xfs.yaml").st_ino) 2024-04-25T19:26:37.461 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:37.645 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628770 2024-04-25T19:26:37.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:37.659 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:37.659 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:37.660 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:37.660 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:37.660 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/mount").st_ino) 2024-04-25T19:26:37.660 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:37.840 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628771 2024-04-25T19:26:37.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:37.858 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:37.858 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:37.858 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:37.858 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:37.858 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/mount/fuse.yaml").st_ino) 2024-04-25T19:26:37.858 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:38.042 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628772 2024-04-25T19:26:38.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:38.055 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:38.055 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:38.056 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:38.056 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:38.056 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/begin.yaml").st_ino) 2024-04-25T19:26:38.056 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:38.240 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628766 2024-04-25T19:26:38.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:38.253 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:38.253 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:38.253 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:38.253 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:38.253 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/%").st_ino) 2024-04-25T19:26:38.253 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:38.439 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628765 2024-04-25T19:26:38.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:38.453 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:38.453 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:38.453 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:38.453 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:38.453 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/tasks").st_ino) 2024-04-25T19:26:38.453 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:38.637 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628779 2024-04-25T19:26:38.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:38.650 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:38.650 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:38.650 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:38.650 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:38.651 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/tasks/cfuse_workunit_suites_ffsb.yaml").st_ino) 2024-04-25T19:26:38.651 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:38.830 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628782 2024-04-25T19:26:38.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:38.842 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:38.842 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:38.843 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:38.843 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:38.843 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/tasks/cfuse_workunit_suites_blogbench.yaml").st_ino) 2024-04-25T19:26:38.843 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:39.021 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628780 2024-04-25T19:26:39.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:39.035 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:39.035 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:39.035 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:39.035 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:39.035 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/tasks/cfuse_workunit_suites_fsstress.yaml").st_ino) 2024-04-25T19:26:39.035 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:39.219 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628783 2024-04-25T19:26:39.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:39.234 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:39.234 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:39.235 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:39.235 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:39.235 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/tasks/cfuse_workunit_suites_dbench.yaml").st_ino) 2024-04-25T19:26:39.235 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:39.418 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628781 2024-04-25T19:26:39.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:39.431 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:39.431 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:39.431 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:39.432 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:39.432 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs").st_ino) 2024-04-25T19:26:39.432 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:39.614 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628634 2024-04-25T19:26:39.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:39.627 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:39.627 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:39.627 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:39.627 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:39.627 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/overrides").st_ino) 2024-04-25T19:26:39.627 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:39.811 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628644 2024-04-25T19:26:39.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:39.825 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:39.825 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:39.825 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:39.826 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:39.826 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-04-25T19:26:39.826 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:40.006 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628649 2024-04-25T19:26:40.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:40.021 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:40.021 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:40.021 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:40.021 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:40.021 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/overrides/mon-debug.yaml").st_ino) 2024-04-25T19:26:40.021 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:40.201 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628648 2024-04-25T19:26:40.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:40.216 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:40.216 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:40.216 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:40.216 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:40.217 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/overrides/debug.yaml").st_ino) 2024-04-25T19:26:40.217 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:40.402 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628646 2024-04-25T19:26:40.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:40.415 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:40.415 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:40.415 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:40.415 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:40.415 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/overrides/+").st_ino) 2024-04-25T19:26:40.416 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:40.604 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628645 2024-04-25T19:26:40.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:40.618 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:40.618 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:40.618 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:40.619 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:40.619 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/overrides/frag_enable.yaml").st_ino) 2024-04-25T19:26:40.619 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:40.792 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628647 2024-04-25T19:26:40.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:40.805 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:40.805 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:40.805 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:40.805 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:40.805 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/clusters").st_ino) 2024-04-25T19:26:40.806 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:40.989 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628637 2024-04-25T19:26:40.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:41.002 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:41.002 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:41.003 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:41.003 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:41.003 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/clusters/2-remote-clients.yaml").st_ino) 2024-04-25T19:26:41.003 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:41.187 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628638 2024-04-25T19:26:41.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:41.201 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:41.201 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:41.202 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:41.202 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:41.202 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/objectstore").st_ino) 2024-04-25T19:26:41.202 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:41.385 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628643 2024-04-25T19:26:41.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:41.399 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:41.402 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:41.402 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:41.402 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:41.402 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/fs").st_ino) 2024-04-25T19:26:41.402 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:41.585 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628639 2024-04-25T19:26:41.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:41.598 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:41.598 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:41.599 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:41.599 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:41.599 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/fs/xfs.yaml").st_ino) 2024-04-25T19:26:41.599 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:41.780 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628640 2024-04-25T19:26:41.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:41.793 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:41.793 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:41.793 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:41.793 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:41.794 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/mount").st_ino) 2024-04-25T19:26:41.794 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:41.977 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628641 2024-04-25T19:26:41.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:41.991 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:41.991 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:41.991 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:41.991 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:41.991 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/mount/fuse.yaml").st_ino) 2024-04-25T19:26:41.991 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:42.177 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628642 2024-04-25T19:26:42.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:42.190 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:42.190 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:42.190 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:42.190 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:42.190 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/begin.yaml").st_ino) 2024-04-25T19:26:42.191 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:42.373 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628636 2024-04-25T19:26:42.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:42.387 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:42.387 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:42.388 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:42.388 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:42.388 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/%").st_ino) 2024-04-25T19:26:42.388 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:42.567 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628635 2024-04-25T19:26:42.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:42.580 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:42.580 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:42.580 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:42.580 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:42.581 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/tasks").st_ino) 2024-04-25T19:26:42.581 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:42.761 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628650 2024-04-25T19:26:42.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:42.774 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:42.774 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:42.774 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:42.775 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:42.775 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/tasks/failover.yaml").st_ino) 2024-04-25T19:26:42.775 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:42.949 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628651 2024-04-25T19:26:42.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:42.962 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:42.962 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:42.962 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:42.962 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:42.962 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps").st_ino) 2024-04-25T19:26:42.962 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:43.146 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628705 2024-04-25T19:26:43.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:43.160 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:43.160 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:43.160 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:43.160 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:43.160 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/overrides").st_ino) 2024-04-25T19:26:43.160 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:43.339 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628715 2024-04-25T19:26:43.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:43.353 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:43.353 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:43.353 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:43.353 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:43.353 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-04-25T19:26:43.353 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:43.538 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628719 2024-04-25T19:26:43.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:43.551 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:43.551 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:43.551 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:43.551 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:43.551 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/overrides/debug.yaml").st_ino) 2024-04-25T19:26:43.551 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:43.725 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628717 2024-04-25T19:26:43.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:43.739 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:43.739 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:43.739 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:43.739 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:43.739 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/overrides/+").st_ino) 2024-04-25T19:26:43.739 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:43.919 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628716 2024-04-25T19:26:43.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:43.933 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:43.933 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:43.933 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:43.933 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:43.933 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/overrides/frag_enable.yaml").st_ino) 2024-04-25T19:26:43.933 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:44.122 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628718 2024-04-25T19:26:44.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:44.137 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:44.137 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:44.137 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:44.137 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:44.137 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/clusters").st_ino) 2024-04-25T19:26:44.137 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:44.318 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628708 2024-04-25T19:26:44.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:44.332 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:44.332 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:44.332 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:44.332 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:44.332 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/clusters/fixed-2-ucephfs.yaml").st_ino) 2024-04-25T19:26:44.332 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:44.514 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628709 2024-04-25T19:26:44.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:44.527 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:44.527 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:44.527 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:44.527 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:44.528 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/objectstore").st_ino) 2024-04-25T19:26:44.528 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:44.711 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628714 2024-04-25T19:26:44.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:44.726 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:44.726 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:44.727 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:44.727 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:44.727 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/fs").st_ino) 2024-04-25T19:26:44.727 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:44.910 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628710 2024-04-25T19:26:44.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:44.925 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:44.925 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:44.925 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:44.925 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:44.925 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/fs/xfs.yaml").st_ino) 2024-04-25T19:26:44.925 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:45.107 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628711 2024-04-25T19:26:45.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:45.121 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:45.121 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:45.121 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:45.121 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:45.121 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/mount").st_ino) 2024-04-25T19:26:45.121 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:45.303 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628712 2024-04-25T19:26:45.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:45.317 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:45.317 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:45.317 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:45.317 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:45.317 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/mount/fuse.yaml").st_ino) 2024-04-25T19:26:45.317 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:45.494 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628713 2024-04-25T19:26:45.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:45.507 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:45.507 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:45.507 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:45.507 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:45.508 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/begin.yaml").st_ino) 2024-04-25T19:26:45.508 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:45.690 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628707 2024-04-25T19:26:45.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:45.705 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:45.705 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:45.705 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:45.705 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:45.705 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/%").st_ino) 2024-04-25T19:26:45.705 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:45.886 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628706 2024-04-25T19:26:45.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:45.900 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:45.900 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:45.900 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:45.900 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:45.900 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/tasks").st_ino) 2024-04-25T19:26:45.900 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:46.088 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628720 2024-04-25T19:26:46.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:46.101 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:46.102 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:46.102 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:46.102 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:46.102 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/tasks/snaptests.yaml").st_ino) 2024-04-25T19:26:46.102 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:46.285 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628721 2024-04-25T19:26:46.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:46.298 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:46.298 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:46.298 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:46.298 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:46.299 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic").st_ino) 2024-04-25T19:26:46.299 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:46.481 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628571 2024-04-25T19:26:46.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:46.495 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:46.495 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:46.495 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:46.495 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:46.495 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/overrides").st_ino) 2024-04-25T19:26:46.495 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:46.677 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628584 2024-04-25T19:26:46.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:46.691 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:46.691 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:46.691 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:46.691 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:46.691 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-04-25T19:26:46.691 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:46.873 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628588 2024-04-25T19:26:46.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:46.888 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:46.888 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:46.888 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:46.888 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:46.888 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/overrides/debug.yaml").st_ino) 2024-04-25T19:26:46.888 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:47.070 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628586 2024-04-25T19:26:47.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:47.083 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:47.083 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:47.083 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:47.083 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:47.083 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/overrides/+").st_ino) 2024-04-25T19:26:47.084 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:47.269 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628585 2024-04-25T19:26:47.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:47.282 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:47.282 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:47.282 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:47.282 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:47.283 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/overrides/frag_enable.yaml").st_ino) 2024-04-25T19:26:47.283 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:47.466 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628587 2024-04-25T19:26:47.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:47.480 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:47.480 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:47.480 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:47.480 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:47.480 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/clusters").st_ino) 2024-04-25T19:26:47.480 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:47.664 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628574 2024-04-25T19:26:47.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:47.678 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:47.678 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:47.678 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:47.678 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:47.678 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/clusters/fixed-2-ucephfs.yaml").st_ino) 2024-04-25T19:26:47.678 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:47.860 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628575 2024-04-25T19:26:47.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:47.874 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:47.874 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:47.874 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:47.874 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:47.874 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/objectstore").st_ino) 2024-04-25T19:26:47.874 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:48.060 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628583 2024-04-25T19:26:48.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:48.074 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:48.074 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:48.074 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:48.074 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:48.074 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/fs").st_ino) 2024-04-25T19:26:48.074 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:48.262 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628576 2024-04-25T19:26:48.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:48.276 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:48.276 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:48.276 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:48.276 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:48.276 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/fs/xfs.yaml").st_ino) 2024-04-25T19:26:48.276 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:48.463 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628577 2024-04-25T19:26:48.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:48.477 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:48.477 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:48.478 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:48.478 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:48.478 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/mount").st_ino) 2024-04-25T19:26:48.478 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:48.660 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628581 2024-04-25T19:26:48.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:48.674 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:48.674 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:48.674 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:48.674 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:48.674 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/mount/fuse.yaml").st_ino) 2024-04-25T19:26:48.674 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:48.855 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628582 2024-04-25T19:26:48.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:48.869 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:48.869 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:48.869 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:48.869 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:48.869 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/inline").st_ino) 2024-04-25T19:26:48.869 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:49.049 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628578 2024-04-25T19:26:49.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:49.064 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:49.064 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:49.064 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:49.064 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:49.064 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/inline/yes.yaml").st_ino) 2024-04-25T19:26:49.064 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:49.248 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628580 2024-04-25T19:26:49.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:49.261 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:49.261 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:49.261 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:49.261 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:49.261 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/inline/no.yaml").st_ino) 2024-04-25T19:26:49.261 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:49.446 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628579 2024-04-25T19:26:49.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:49.460 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:49.460 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:49.460 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:49.461 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:49.461 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/begin.yaml").st_ino) 2024-04-25T19:26:49.461 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:49.642 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628573 2024-04-25T19:26:49.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:49.656 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:49.656 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:49.656 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:49.656 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:49.656 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/%").st_ino) 2024-04-25T19:26:49.656 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:49.824 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628572 2024-04-25T19:26:49.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:49.837 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:49.837 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:49.837 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:49.837 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:49.838 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks").st_ino) 2024-04-25T19:26:49.838 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:50.020 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628589 2024-04-25T19:26:50.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:50.033 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:50.034 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:50.034 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:50.034 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:50.034 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_fsync.yaml").st_ino) 2024-04-25T19:26:50.034 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:50.216 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628602 2024-04-25T19:26:50.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:50.230 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:50.230 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:50.230 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:50.230 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:50.230 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/libcephfs_interface_tests.yaml").st_ino) 2024-04-25T19:26:50.230 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:50.412 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628608 2024-04-25T19:26:50.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:50.426 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:50.426 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:50.426 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:50.426 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:50.426 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_pjd.yaml").st_ino) 2024-04-25T19:26:50.426 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:50.608 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628605 2024-04-25T19:26:50.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:50.622 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:50.622 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:50.622 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:50.622 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:50.622 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_norstats.yaml").st_ino) 2024-04-25T19:26:50.622 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:50.796 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628595 2024-04-25T19:26:50.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:50.809 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:50.809 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:50.809 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:50.809 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:50.809 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_trivial_sync.yaml").st_ino) 2024-04-25T19:26:50.809 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:50.992 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628607 2024-04-25T19:26:50.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:51.005 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:51.005 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:51.005 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:51.005 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:51.005 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_ffsb.yaml").st_ino) 2024-04-25T19:26:51.005 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:51.189 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628599 2024-04-25T19:26:51.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:51.203 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:51.203 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:51.203 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:51.203 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:51.203 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_fsx.yaml").st_ino) 2024-04-25T19:26:51.203 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:51.386 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628601 2024-04-25T19:26:51.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:51.400 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:51.401 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:51.401 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:51.401 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:51.401 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/libcephfs_java.yaml").st_ino) 2024-04-25T19:26:51.401 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:51.584 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628609 2024-04-25T19:26:51.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:51.597 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:51.597 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:51.597 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:51.597 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:51.597 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_misc.yaml").st_ino) 2024-04-25T19:26:51.597 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:51.782 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628593 2024-04-25T19:26:51.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:51.795 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:51.795 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:51.795 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:51.795 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:51.795 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_misc_test_o_trunc.yaml").st_ino) 2024-04-25T19:26:51.795 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:51.978 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628594 2024-04-25T19:26:51.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:51.992 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:51.992 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:51.992 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:51.992 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:51.992 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/mds_creation_retry.yaml").st_ino) 2024-04-25T19:26:51.992 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:52.176 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628611 2024-04-25T19:26:52.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:52.189 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:52.189 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:52.189 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:52.189 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:52.190 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/asok_dump_tree.yaml").st_ino) 2024-04-25T19:26:52.190 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:52.372 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628590 2024-04-25T19:26:52.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:52.385 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:52.385 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:52.385 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:52.385 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:52.385 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_quota.yaml").st_ino) 2024-04-25T19:26:52.385 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:52.567 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628596 2024-04-25T19:26:52.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:52.582 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:52.582 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:52.582 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:52.582 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:52.582 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_truncate_delay.yaml").st_ino) 2024-04-25T19:26:52.583 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:52.764 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628606 2024-04-25T19:26:52.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:52.777 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:52.777 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:52.777 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:52.777 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:52.778 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_kernel_untar_build.yaml").st_ino) 2024-04-25T19:26:52.778 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:52.960 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628592 2024-04-25T19:26:52.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:52.974 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:52.974 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:52.974 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:52.974 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:52.974 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_blogbench.yaml").st_ino) 2024-04-25T19:26:52.974 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:53.158 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628597 2024-04-25T19:26:53.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:53.172 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:53.172 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:53.172 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:53.172 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:53.172 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/libcephfs_python.yaml").st_ino) 2024-04-25T19:26:53.172 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:53.354 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628610 2024-04-25T19:26:53.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:53.368 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:53.368 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:53.368 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:53.368 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:53.368 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_fsstress.yaml").st_ino) 2024-04-25T19:26:53.368 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:53.551 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628600 2024-04-25T19:26:53.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:53.565 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:53.565 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:53.565 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:53.565 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:53.565 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cephfs_scrub_tests.yaml").st_ino) 2024-04-25T19:26:53.565 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:53.747 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628591 2024-04-25T19:26:53.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:53.761 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:53.761 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:53.761 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:53.761 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:53.761 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_iogen.yaml").st_ino) 2024-04-25T19:26:53.761 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:53.944 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628603 2024-04-25T19:26:53.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:53.958 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:53.958 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:53.958 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:53.958 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:53.958 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_dbench.yaml").st_ino) 2024-04-25T19:26:53.958 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:54.140 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628598 2024-04-25T19:26:54.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:54.155 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:54.155 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:54.155 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:54.155 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:54.155 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_iozone.yaml").st_ino) 2024-04-25T19:26:54.156 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:54.338 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628604 2024-04-25T19:26:54.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:54.352 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:54.352 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:54.353 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:54.353 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:54.353 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery").st_ino) 2024-04-25T19:26:54.353 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:54.537 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628670 2024-04-25T19:26:54.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:54.550 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:54.551 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:54.551 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:54.551 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:54.551 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/overrides").st_ino) 2024-04-25T19:26:54.551 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:54.738 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628680 2024-04-25T19:26:54.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:54.752 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:54.752 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:54.752 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:54.752 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:54.752 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-04-25T19:26:54.752 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:54.934 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628685 2024-04-25T19:26:54.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:54.948 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:54.948 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:54.948 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:54.948 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:54.948 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/overrides/fuse-unmounted.yaml").st_ino) 2024-04-25T19:26:54.948 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:55.120 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628684 2024-04-25T19:26:55.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:55.135 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:55.135 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:55.135 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:55.135 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:55.135 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/overrides/debug.yaml").st_ino) 2024-04-25T19:26:55.135 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:55.318 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628682 2024-04-25T19:26:55.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:55.332 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:55.332 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:55.332 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:55.332 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:55.332 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/overrides/+").st_ino) 2024-04-25T19:26:55.332 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:55.519 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628681 2024-04-25T19:26:55.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:55.533 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:55.533 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:55.533 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:55.533 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:55.533 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/overrides/frag_enable.yaml").st_ino) 2024-04-25T19:26:55.533 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:55.717 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628683 2024-04-25T19:26:55.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:55.731 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:55.731 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:55.731 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:55.731 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:55.731 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/clusters").st_ino) 2024-04-25T19:26:55.731 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:55.916 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628673 2024-04-25T19:26:55.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:55.929 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:55.929 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:55.929 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:55.929 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:55.929 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/clusters/4-remote-clients.yaml").st_ino) 2024-04-25T19:26:55.930 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:56.105 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628674 2024-04-25T19:26:56.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:56.118 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:56.118 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:56.118 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:56.118 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:56.118 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/objectstore").st_ino) 2024-04-25T19:26:56.118 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:56.307 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628679 2024-04-25T19:26:56.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:56.319 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:56.319 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:56.319 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:56.319 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:56.319 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/fs").st_ino) 2024-04-25T19:26:56.319 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:56.503 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628675 2024-04-25T19:26:56.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:56.517 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:56.517 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:56.517 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:56.517 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:56.517 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/fs/xfs.yaml").st_ino) 2024-04-25T19:26:56.517 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:56.701 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628676 2024-04-25T19:26:56.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:56.715 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:56.715 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:56.715 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:56.715 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:56.715 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/mount").st_ino) 2024-04-25T19:26:56.715 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:56.895 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628677 2024-04-25T19:26:56.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:56.909 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:56.910 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:56.910 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:56.910 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:56.910 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/mount/fuse.yaml").st_ino) 2024-04-25T19:26:56.910 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:57.096 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628678 2024-04-25T19:26:57.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:57.110 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:57.110 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:57.110 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:57.110 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:57.110 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/begin.yaml").st_ino) 2024-04-25T19:26:57.110 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:57.284 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628672 2024-04-25T19:26:57.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:57.297 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:57.297 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:57.297 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:57.297 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:57.297 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/%").st_ino) 2024-04-25T19:26:57.297 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:57.481 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628671 2024-04-25T19:26:57.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:57.494 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:57.495 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:57.495 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:57.495 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:57.495 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks").st_ino) 2024-04-25T19:26:57.495 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:57.678 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628686 2024-04-25T19:26:57.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:57.692 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:57.692 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:57.692 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:57.692 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:57.692 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/backtrace.yaml").st_ino) 2024-04-25T19:26:57.692 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:57.874 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628688 2024-04-25T19:26:57.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:57.888 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:57.889 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:57.889 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:57.889 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:57.889 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/forward-scrub.yaml").st_ino) 2024-04-25T19:26:57.889 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:58.075 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628696 2024-04-25T19:26:58.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:58.089 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:58.089 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:58.089 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:58.089 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:58.089 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/client-readahad.yaml").st_ino) 2024-04-25T19:26:58.089 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:58.263 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628691 2024-04-25T19:26:58.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:58.277 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:58.277 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:58.277 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:58.277 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:58.277 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/volume-client.yaml").st_ino) 2024-04-25T19:26:58.277 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:58.459 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628704 2024-04-25T19:26:58.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:58.472 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:58.472 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:58.472 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:58.472 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:58.472 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/config-commands.yaml").st_ino) 2024-04-25T19:26:58.472 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:58.655 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628693 2024-04-25T19:26:58.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:58.669 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:58.669 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:58.669 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:58.669 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:58.669 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/mds-full.yaml").st_ino) 2024-04-25T19:26:58.669 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:58.852 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628700 2024-04-25T19:26:58.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:58.865 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:58.865 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:58.865 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:58.865 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:58.865 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/sessionmap.yaml").st_ino) 2024-04-25T19:26:58.865 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:59.050 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628702 2024-04-25T19:26:59.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:59.064 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:59.064 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:59.064 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:59.064 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:59.064 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/data-scan.yaml").st_ino) 2024-04-25T19:26:59.064 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:59.247 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628695 2024-04-25T19:26:59.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:59.261 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:59.261 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:59.261 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:59.261 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:59.261 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/cap-flush.yaml").st_ino) 2024-04-25T19:26:59.261 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:59.443 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628689 2024-04-25T19:26:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:59.457 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:59.457 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:59.457 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:59.458 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:59.458 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/mds-flush.yaml").st_ino) 2024-04-25T19:26:59.458 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:59.642 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628699 2024-04-25T19:26:59.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:59.653 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:59.653 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:59.653 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:59.654 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:59.654 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/auto-repair.yaml").st_ino) 2024-04-25T19:26:59.654 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:26:59.836 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628687 2024-04-25T19:26:59.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:26:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:26:59.850 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:26:59.850 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:26:59.850 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:26:59.850 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:26:59.850 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/damage.yaml").st_ino) 2024-04-25T19:26:59.850 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:00.038 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628694 2024-04-25T19:27:00.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:00.049 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:00.049 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:00.049 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:00.049 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:00.049 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/client-recovery.yaml").st_ino) 2024-04-25T19:27:00.049 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:00.231 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628692 2024-04-25T19:27:00.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:00.244 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:00.244 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:00.244 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:00.244 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:00.244 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/journal-repair.yaml").st_ino) 2024-04-25T19:27:00.244 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:00.426 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628698 2024-04-25T19:27:00.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:00.440 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:00.440 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:00.440 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:00.440 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:00.440 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/client-limits.yaml").st_ino) 2024-04-25T19:27:00.440 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:00.625 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628690 2024-04-25T19:27:00.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:00.639 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:00.639 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:00.639 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:00.639 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:00.639 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/strays.yaml").st_ino) 2024-04-25T19:27:00.639 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:00.826 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628703 2024-04-25T19:27:00.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:00.840 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:00.840 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:00.840 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:00.840 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:00.840 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/fragment.yaml").st_ino) 2024-04-25T19:27:00.840 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:01.024 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628697 2024-04-25T19:27:01.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:01.038 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:01.038 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:01.038 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:01.038 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:01.038 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/pool-perm.yaml").st_ino) 2024-04-25T19:27:01.038 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:01.222 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628701 2024-04-25T19:27:01.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:01.236 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:01.236 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:01.236 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:01.236 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:01.236 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission").st_ino) 2024-04-25T19:27:01.236 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:01.421 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628652 2024-04-25T19:27:01.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:01.434 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:01.434 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:01.434 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:01.435 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:01.435 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/overrides").st_ino) 2024-04-25T19:27:01.435 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:01.616 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628662 2024-04-25T19:27:01.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:01.630 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:01.630 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:01.630 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:01.630 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:01.630 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-04-25T19:27:01.630 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:01.799 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628666 2024-04-25T19:27:01.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:01.811 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:01.812 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:01.812 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:01.812 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:01.812 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/overrides/debug.yaml").st_ino) 2024-04-25T19:27:01.812 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:01.996 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628664 2024-04-25T19:27:01.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:02.009 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:02.009 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:02.009 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:02.009 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:02.009 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/overrides/+").st_ino) 2024-04-25T19:27:02.010 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:02.197 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628663 2024-04-25T19:27:02.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:02.211 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:02.211 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:02.211 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:02.211 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:02.211 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/overrides/frag_enable.yaml").st_ino) 2024-04-25T19:27:02.211 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:02.393 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628665 2024-04-25T19:27:02.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:02.407 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:02.407 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:02.407 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:02.407 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:02.407 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/clusters").st_ino) 2024-04-25T19:27:02.407 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:02.592 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628655 2024-04-25T19:27:02.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:02.606 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:02.606 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:02.606 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:02.606 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:02.606 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/clusters/fixed-2-ucephfs.yaml").st_ino) 2024-04-25T19:27:02.607 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:02.790 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628656 2024-04-25T19:27:02.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:02.803 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:02.803 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:02.803 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:02.803 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:02.803 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/objectstore").st_ino) 2024-04-25T19:27:02.803 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:02.989 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628661 2024-04-25T19:27:02.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:03.002 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:03.002 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:03.002 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:03.003 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:03.003 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/fs").st_ino) 2024-04-25T19:27:03.003 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:03.186 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628657 2024-04-25T19:27:03.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:03.199 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:03.199 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:03.199 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:03.199 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:03.199 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/fs/xfs.yaml").st_ino) 2024-04-25T19:27:03.199 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:03.382 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628658 2024-04-25T19:27:03.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:03.396 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:03.396 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:03.396 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:03.396 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:03.396 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/mount").st_ino) 2024-04-25T19:27:03.396 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:03.579 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628659 2024-04-25T19:27:03.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:03.592 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:03.592 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:03.592 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:03.592 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:03.592 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/mount/fuse.yaml").st_ino) 2024-04-25T19:27:03.593 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:03.774 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628660 2024-04-25T19:27:03.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:03.788 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:03.788 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:03.788 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:03.788 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:03.788 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/begin.yaml").st_ino) 2024-04-25T19:27:03.788 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:03.971 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628654 2024-04-25T19:27:03.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:03.984 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:03.984 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:03.984 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:03.984 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:03.984 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/%").st_ino) 2024-04-25T19:27:03.985 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:04.168 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628653 2024-04-25T19:27:04.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:04.182 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:04.182 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:04.182 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:04.182 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:04.182 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/tasks").st_ino) 2024-04-25T19:27:04.182 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:04.364 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628667 2024-04-25T19:27:04.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:04.377 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:04.377 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:04.377 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:04.378 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:04.378 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/tasks/cfuse_workunit_suites_pjd.yaml").st_ino) 2024-04-25T19:27:04.378 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:04.563 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628669 2024-04-25T19:27:04.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:04.574 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:04.574 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:04.574 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:04.574 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:04.574 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/tasks/cfuse_workunit_misc.yaml").st_ino) 2024-04-25T19:27:04.574 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:04.765 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628668 2024-04-25T19:27:04.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:04.779 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:04.779 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:04.779 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:04.779 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:04.779 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay").st_ino) 2024-04-25T19:27:04.779 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:04.962 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628722 2024-04-25T19:27:04.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:04.975 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:04.976 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:04.976 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:04.976 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:04.976 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/overrides").st_ino) 2024-04-25T19:27:04.976 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:05.162 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628732 2024-04-25T19:27:05.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:05.177 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:05.178 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:05.178 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:05.178 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:05.178 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-04-25T19:27:05.178 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:05.360 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628736 2024-04-25T19:27:05.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:05.373 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:05.373 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:05.373 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:05.373 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:05.373 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/overrides/debug.yaml").st_ino) 2024-04-25T19:27:05.373 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:05.557 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628734 2024-04-25T19:27:05.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:05.571 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:05.571 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:05.571 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:05.571 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:05.571 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/overrides/+").st_ino) 2024-04-25T19:27:05.571 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:05.755 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628733 2024-04-25T19:27:05.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:05.768 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:05.769 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:05.769 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:05.769 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:05.769 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/overrides/frag_enable.yaml").st_ino) 2024-04-25T19:27:05.769 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:05.933 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628735 2024-04-25T19:27:05.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:05.946 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:05.946 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:05.946 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:05.946 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:05.946 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/clusters").st_ino) 2024-04-25T19:27:05.946 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:06.126 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628725 2024-04-25T19:27:06.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:06.140 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:06.140 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:06.140 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:06.140 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:06.140 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/clusters/standby-replay.yaml").st_ino) 2024-04-25T19:27:06.140 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:06.326 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628726 2024-04-25T19:27:06.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:06.339 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:06.339 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:06.339 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:06.339 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:06.339 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/objectstore").st_ino) 2024-04-25T19:27:06.339 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:06.521 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628731 2024-04-25T19:27:06.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:06.535 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:06.535 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:06.535 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:06.535 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:06.536 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/fs").st_ino) 2024-04-25T19:27:06.536 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:06.718 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628727 2024-04-25T19:27:06.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:06.732 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:06.732 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:06.732 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:06.732 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:06.732 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/fs/xfs.yaml").st_ino) 2024-04-25T19:27:06.732 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:06.906 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628728 2024-04-25T19:27:06.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:06.920 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:06.920 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:06.920 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:06.920 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:06.920 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/mount").st_ino) 2024-04-25T19:27:06.920 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:07.087 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:27:07.095 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:27:07.095 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628729 2024-04-25T19:27:07.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:07.106 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:07.106 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:07.106 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:07.106 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:07.106 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/mount/fuse.yaml").st_ino) 2024-04-25T19:27:07.106 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:07.286 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628730 2024-04-25T19:27:07.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:07.300 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:07.300 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:07.300 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:07.300 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:07.300 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/begin.yaml").st_ino) 2024-04-25T19:27:07.301 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:07.444 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628724 2024-04-25T19:27:07.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:07.458 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:07.458 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:07.458 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:07.458 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:07.458 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/%").st_ino) 2024-04-25T19:27:07.458 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:07.645 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628723 2024-04-25T19:27:07.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:07.659 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:07.659 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:07.659 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:07.659 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:07.659 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/tasks").st_ino) 2024-04-25T19:27:07.659 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:07.842 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628737 2024-04-25T19:27:07.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:07.856 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:07.857 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:07.857 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:07.857 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:07.857 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/tasks/migration.yaml").st_ino) 2024-04-25T19:27:07.857 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:08.041 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628738 2024-04-25T19:27:08.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:08.055 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:08.055 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:08.055 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:08.055 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:08.055 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits").st_ino) 2024-04-25T19:27:08.055 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:08.237 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628552 2024-04-25T19:27:08.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:08.252 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:08.252 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:08.252 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:08.252 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:08.252 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/overrides").st_ino) 2024-04-25T19:27:08.252 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:08.427 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628562 2024-04-25T19:27:08.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:08.441 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:08.441 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:08.441 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:08.441 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:08.441 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-04-25T19:27:08.441 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:08.622 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628567 2024-04-25T19:27:08.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:08.636 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:08.636 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:08.636 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:08.636 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:08.636 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/overrides/debug.yaml").st_ino) 2024-04-25T19:27:08.636 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:08.822 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628564 2024-04-25T19:27:08.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:08.836 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:08.836 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:08.836 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:08.836 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:08.836 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/overrides/+").st_ino) 2024-04-25T19:27:08.836 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:09.015 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628563 2024-04-25T19:27:09.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:09.029 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:09.029 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:09.029 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:09.029 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:09.029 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/overrides/faked-ino.yaml").st_ino) 2024-04-25T19:27:09.029 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:09.215 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628565 2024-04-25T19:27:09.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:09.228 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:09.228 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:09.228 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:09.229 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:09.229 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/overrides/frag_enable.yaml").st_ino) 2024-04-25T19:27:09.229 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:09.413 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628566 2024-04-25T19:27:09.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:09.427 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:09.427 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:09.427 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:09.427 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:09.427 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/clusters").st_ino) 2024-04-25T19:27:09.428 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:09.599 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628555 2024-04-25T19:27:09.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:09.612 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:09.612 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:09.612 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:09.612 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:09.612 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/clusters/fixed-2-ucephfs.yaml").st_ino) 2024-04-25T19:27:09.612 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:09.797 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628556 2024-04-25T19:27:09.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:09.811 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:09.811 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:09.811 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:09.811 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:09.811 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/objectstore").st_ino) 2024-04-25T19:27:09.812 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:09.994 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628561 2024-04-25T19:27:09.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:10.007 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:10.007 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:10.007 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:10.007 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:10.007 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/fs").st_ino) 2024-04-25T19:27:10.007 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:10.192 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628557 2024-04-25T19:27:10.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:10.207 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:10.207 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:10.207 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:10.207 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:10.207 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/fs/xfs.yaml").st_ino) 2024-04-25T19:27:10.207 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:10.390 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628558 2024-04-25T19:27:10.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:10.405 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:10.405 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:10.405 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:10.405 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:10.405 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/mount").st_ino) 2024-04-25T19:27:10.405 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:10.589 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628559 2024-04-25T19:27:10.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:10.603 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:10.603 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:10.603 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:10.604 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:10.604 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/mount/fuse.yaml").st_ino) 2024-04-25T19:27:10.604 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:10.774 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628560 2024-04-25T19:27:10.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:10.787 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:10.787 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:10.787 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:10.787 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:10.787 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/begin.yaml").st_ino) 2024-04-25T19:27:10.787 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:10.973 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628554 2024-04-25T19:27:10.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:10.987 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:10.987 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:10.987 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:10.987 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:10.987 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/%").st_ino) 2024-04-25T19:27:10.987 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:11.172 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628553 2024-04-25T19:27:11.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:11.185 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:11.185 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:11.185 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:11.185 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:11.185 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/tasks").st_ino) 2024-04-25T19:27:11.186 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:11.365 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628568 2024-04-25T19:27:11.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:11.378 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:11.379 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:11.379 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:11.379 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:11.379 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/tasks/cfuse_workunit_suites_pjd.yaml").st_ino) 2024-04-25T19:27:11.379 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:11.561 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628570 2024-04-25T19:27:11.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:11.575 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:11.575 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:11.575 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:11.575 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:11.575 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/tasks/cfuse_workunit_suites_fsstress.yaml").st_ino) 2024-04-25T19:27:11.575 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:11.760 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628569 2024-04-25T19:27:11.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:11.773 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:11.773 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:11.773 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:11.773 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:11.773 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash").st_ino) 2024-04-25T19:27:11.773 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:11.955 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628739 2024-04-25T19:27:11.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:11.968 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:11.968 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:11.969 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:11.969 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:11.969 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/ceph-thrash").st_ino) 2024-04-25T19:27:11.969 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:12.151 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628742 2024-04-25T19:27:12.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:12.164 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:12.164 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:12.164 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:12.164 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:12.164 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/ceph-thrash/default.yaml").st_ino) 2024-04-25T19:27:12.164 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:12.351 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628743 2024-04-25T19:27:12.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:12.363 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:12.363 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:12.363 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:12.363 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:12.363 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/overrides").st_ino) 2024-04-25T19:27:12.363 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:12.536 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628754 2024-04-25T19:27:12.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:12.549 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:12.549 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:12.550 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:12.550 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:12.550 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-04-25T19:27:12.550 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:12.734 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628758 2024-04-25T19:27:12.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:12.747 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:12.747 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:12.748 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:12.748 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:12.748 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/overrides/debug.yaml").st_ino) 2024-04-25T19:27:12.748 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:12.929 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628756 2024-04-25T19:27:12.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:12.943 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:12.943 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:12.943 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:12.943 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:12.943 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/overrides/+").st_ino) 2024-04-25T19:27:12.943 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:13.126 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628755 2024-04-25T19:27:13.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:13.140 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:13.140 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:13.140 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:13.140 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:13.140 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/overrides/frag_enable.yaml").st_ino) 2024-04-25T19:27:13.140 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:13.323 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628757 2024-04-25T19:27:13.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:13.336 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:13.337 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:13.337 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:13.337 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:13.337 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/clusters").st_ino) 2024-04-25T19:27:13.337 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:13.521 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628744 2024-04-25T19:27:13.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:13.534 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:13.534 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:13.534 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:13.534 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:13.534 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/clusters/mds-1active-1standby.yaml").st_ino) 2024-04-25T19:27:13.534 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:13.704 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628745 2024-04-25T19:27:13.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:13.717 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:13.717 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:13.717 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:13.717 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:13.717 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/msgr-failures").st_ino) 2024-04-25T19:27:13.717 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:13.902 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628750 2024-04-25T19:27:13.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:13.916 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:13.916 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:13.916 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:13.916 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:13.916 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/msgr-failures/osd-mds-delay.yaml").st_ino) 2024-04-25T19:27:13.916 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:14.098 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628752 2024-04-25T19:27:14.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:14.111 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:14.111 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:14.111 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:14.112 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:14.112 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/msgr-failures/none.yaml").st_ino) 2024-04-25T19:27:14.112 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:14.295 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628751 2024-04-25T19:27:14.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:14.309 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:14.309 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:14.309 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:14.309 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:14.309 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/objectstore").st_ino) 2024-04-25T19:27:14.309 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:14.490 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628753 2024-04-25T19:27:14.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:14.504 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:14.504 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:14.504 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:14.504 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:14.504 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/fs").st_ino) 2024-04-25T19:27:14.504 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:14.686 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628746 2024-04-25T19:27:14.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:14.700 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:14.701 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:14.701 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:14.701 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:14.701 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/fs/xfs.yaml").st_ino) 2024-04-25T19:27:14.701 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:14.882 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628747 2024-04-25T19:27:14.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:14.895 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:14.896 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:14.896 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:14.896 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:14.896 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/mount").st_ino) 2024-04-25T19:27:14.896 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:15.083 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628748 2024-04-25T19:27:15.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:15.097 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:15.097 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:15.097 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:15.097 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:15.097 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/mount/fuse.yaml").st_ino) 2024-04-25T19:27:15.097 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:15.282 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628749 2024-04-25T19:27:15.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:15.297 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:15.297 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:15.297 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:15.297 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:15.297 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/begin.yaml").st_ino) 2024-04-25T19:27:15.297 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:15.480 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628741 2024-04-25T19:27:15.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:15.493 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:15.493 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:15.493 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:15.493 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:15.494 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/%").st_ino) 2024-04-25T19:27:15.494 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:15.677 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628740 2024-04-25T19:27:15.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:15.691 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:15.691 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:15.691 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:15.691 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:15.691 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/tasks").st_ino) 2024-04-25T19:27:15.691 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:15.876 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628759 2024-04-25T19:27:15.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:15.889 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:15.890 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:15.890 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:15.890 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:15.890 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/tasks/cfuse_workunit_suites_pjd.yaml").st_ino) 2024-04-25T19:27:15.890 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:16.076 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628762 2024-04-25T19:27:16.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:16.091 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:16.091 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:16.091 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:16.091 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:16.091 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/tasks/cfuse_workunit_trivial_sync.yaml").st_ino) 2024-04-25T19:27:16.091 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:16.275 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628763 2024-04-25T19:27:16.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:16.288 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:16.289 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:16.289 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:16.289 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:16.289 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/tasks/cfuse_workunit_snaptests.yaml").st_ino) 2024-04-25T19:27:16.289 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:16.475 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628760 2024-04-25T19:27:16.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:16.488 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:16.488 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:16.488 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:16.488 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:16.489 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/tasks/cfuse_workunit_suites_fsstress.yaml").st_ino) 2024-04-25T19:27:16.489 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:16.670 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628761 2024-04-25T19:27:16.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:16.684 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:16.684 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:16.684 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:16.684 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:16.684 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify").st_ino) 2024-04-25T19:27:16.684 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:16.870 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628786 2024-04-25T19:27:16.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:16.884 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:16.884 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:16.884 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:16.884 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:16.884 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/validater").st_ino) 2024-04-25T19:27:16.884 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:17.069 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628806 2024-04-25T19:27:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:17.082 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:17.082 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:17.082 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:17.082 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:17.082 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml").st_ino) 2024-04-25T19:27:17.082 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:17.264 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628808 2024-04-25T19:27:17.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:17.278 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:17.278 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:17.278 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:17.278 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:17.278 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/validater/lockdep.yaml").st_ino) 2024-04-25T19:27:17.278 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:17.460 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628807 2024-04-25T19:27:17.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:17.474 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:17.474 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:17.474 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:17.474 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:17.474 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/overrides").st_ino) 2024-04-25T19:27:17.474 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:17.657 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628796 2024-04-25T19:27:17.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:17.671 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:17.671 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:17.671 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:17.671 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:17.671 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-04-25T19:27:17.671 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:17.856 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628801 2024-04-25T19:27:17.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:17.870 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:17.870 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:17.870 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:17.870 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:17.870 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/overrides/mon-debug.yaml").st_ino) 2024-04-25T19:27:17.870 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:18.052 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628800 2024-04-25T19:27:18.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:18.066 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:18.066 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:18.066 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:18.066 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:18.067 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/overrides/debug.yaml").st_ino) 2024-04-25T19:27:18.067 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:18.250 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628798 2024-04-25T19:27:18.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:18.264 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:18.264 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:18.264 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:18.264 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:18.264 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/overrides/+").st_ino) 2024-04-25T19:27:18.264 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:18.446 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628797 2024-04-25T19:27:18.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:18.461 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:18.461 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:18.461 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:18.461 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:18.461 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/overrides/frag_enable.yaml").st_ino) 2024-04-25T19:27:18.461 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:18.643 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628799 2024-04-25T19:27:18.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:18.656 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:18.656 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:18.656 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:18.657 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:18.657 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/clusters").st_ino) 2024-04-25T19:27:18.657 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:18.840 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628789 2024-04-25T19:27:18.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:18.854 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:18.854 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:18.854 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:18.854 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:18.854 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/clusters/fixed-2-ucephfs.yaml").st_ino) 2024-04-25T19:27:18.854 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:19.036 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628790 2024-04-25T19:27:19.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:19.049 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:19.049 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:19.050 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:19.050 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:19.050 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/objectstore").st_ino) 2024-04-25T19:27:19.050 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:19.231 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628795 2024-04-25T19:27:19.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:19.244 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:19.244 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:19.244 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:19.244 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:19.244 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/fs").st_ino) 2024-04-25T19:27:19.244 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:19.427 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628791 2024-04-25T19:27:19.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:19.442 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:19.442 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:19.442 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:19.442 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:19.442 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/fs/xfs.yaml").st_ino) 2024-04-25T19:27:19.442 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:19.627 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628792 2024-04-25T19:27:19.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:19.640 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:19.640 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:19.641 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:19.641 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:19.641 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/mount").st_ino) 2024-04-25T19:27:19.641 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:19.824 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628793 2024-04-25T19:27:19.829 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:19.838 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:19.838 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:19.838 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:19.839 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:19.839 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/mount/fuse.yaml").st_ino) 2024-04-25T19:27:19.839 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:20.023 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628794 2024-04-25T19:27:20.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:20.038 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:20.038 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:20.038 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:20.038 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:20.038 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/begin.yaml").st_ino) 2024-04-25T19:27:20.038 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:20.220 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628788 2024-04-25T19:27:20.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:20.237 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:20.237 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:20.237 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:20.237 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:20.237 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/%").st_ino) 2024-04-25T19:27:20.237 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:20.422 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628787 2024-04-25T19:27:20.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:20.436 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:20.436 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:20.436 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:20.436 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:20.436 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/tasks").st_ino) 2024-04-25T19:27:20.436 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:20.619 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628802 2024-04-25T19:27:20.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:20.632 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:20.632 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:20.632 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:20.632 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:20.633 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/tasks/libcephfs_interface_tests.yaml").st_ino) 2024-04-25T19:27:20.633 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:20.817 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628805 2024-04-25T19:27:20.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:20.831 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:20.831 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:20.831 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:20.831 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:20.831 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/tasks/cfuse_workunit_suites_fsstress.yaml").st_ino) 2024-04-25T19:27:20.831 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:21.011 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628804 2024-04-25T19:27:21.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:21.025 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:21.025 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:21.025 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:21.025 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:21.025 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/tasks/cfuse_workunit_suites_dbench.yaml").st_ino) 2024-04-25T19:27:21.025 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:21.210 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628803 2024-04-25T19:27:21.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:21.224 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:21.224 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:21.224 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:21.224 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:21.224 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient").st_ino) 2024-04-25T19:27:21.224 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:21.409 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628612 2024-04-25T19:27:21.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:21.423 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:21.423 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:21.423 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:21.423 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:21.423 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/overrides").st_ino) 2024-04-25T19:27:21.423 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:21.607 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628624 2024-04-25T19:27:21.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:21.621 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:21.621 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:21.622 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:21.622 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:21.622 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-04-25T19:27:21.622 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:21.804 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628628 2024-04-25T19:27:21.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:21.817 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:21.817 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:21.817 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:21.817 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:21.817 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/overrides/debug.yaml").st_ino) 2024-04-25T19:27:21.817 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:22.004 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628626 2024-04-25T19:27:22.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:22.019 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:22.019 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:22.019 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:22.020 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:22.020 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/overrides/+").st_ino) 2024-04-25T19:27:22.020 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:22.204 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628625 2024-04-25T19:27:22.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:22.218 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:22.218 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:22.218 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:22.218 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:22.218 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/overrides/frag_enable.yaml").st_ino) 2024-04-25T19:27:22.218 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:22.403 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628627 2024-04-25T19:27:22.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:22.416 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:22.416 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:22.416 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:22.416 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:22.416 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/clusters").st_ino) 2024-04-25T19:27:22.416 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:22.600 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628615 2024-04-25T19:27:22.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:22.613 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:22.613 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:22.613 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:22.613 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:22.613 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/clusters/three_clients.yaml").st_ino) 2024-04-25T19:27:22.613 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:22.797 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628616 2024-04-25T19:27:22.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:22.810 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:22.810 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:22.811 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:22.811 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:22.811 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/clusters/two_clients.yaml").st_ino) 2024-04-25T19:27:22.811 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:22.994 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628617 2024-04-25T19:27:22.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:23.007 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:23.007 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:23.007 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:23.007 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:23.008 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/objectstore").st_ino) 2024-04-25T19:27:23.008 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:23.190 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628623 2024-04-25T19:27:23.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:23.203 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:23.203 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:23.203 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:23.203 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:23.203 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/fs").st_ino) 2024-04-25T19:27:23.203 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:23.391 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628618 2024-04-25T19:27:23.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:23.403 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:23.403 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:23.403 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:23.403 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:23.403 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/fs/xfs.yaml").st_ino) 2024-04-25T19:27:23.403 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:23.585 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628619 2024-04-25T19:27:23.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:23.599 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:23.599 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:23.599 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:23.599 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:23.599 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/mount").st_ino) 2024-04-25T19:27:23.599 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:23.782 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628620 2024-04-25T19:27:23.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:23.797 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:23.797 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:23.797 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:23.798 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:23.798 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/mount/fuse.yaml").st_ino) 2024-04-25T19:27:23.798 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:23.981 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628621 2024-04-25T19:27:23.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:23.995 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:23.995 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:23.995 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:23.995 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:23.995 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/mount/kclient.yaml.disabled").st_ino) 2024-04-25T19:27:23.995 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:24.177 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628622 2024-04-25T19:27:24.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:24.190 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:24.190 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:24.190 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:24.190 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:24.190 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/begin.yaml").st_ino) 2024-04-25T19:27:24.190 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:24.374 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628614 2024-04-25T19:27:24.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:24.387 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:24.388 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:24.388 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:24.388 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:24.388 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/%").st_ino) 2024-04-25T19:27:24.388 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:24.581 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628613 2024-04-25T19:27:24.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:24.596 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:24.596 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:24.596 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:24.596 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:24.596 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/tasks").st_ino) 2024-04-25T19:27:24.596 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:24.783 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628629 2024-04-25T19:27:24.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:24.798 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:24.798 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:24.798 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:24.798 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:24.798 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/tasks/fsx-mpi.yaml.disabled").st_ino) 2024-04-25T19:27:24.798 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:24.968 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628631 2024-04-25T19:27:24.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:24.982 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:24.982 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:24.982 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:24.982 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:24.982 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/tasks/ior-shared-file.yaml").st_ino) 2024-04-25T19:27:24.982 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:25.164 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628632 2024-04-25T19:27:25.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:25.178 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:25.178 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:25.178 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:25.178 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:25.178 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/tasks/cephfs_misc_tests.yaml").st_ino) 2024-04-25T19:27:25.179 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:25.351 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628630 2024-04-25T19:27:25.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:25.365 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:25.365 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:25.365 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:25.365 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:25.365 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/tasks/mdtest.yaml").st_ino) 2024-04-25T19:27:25.365 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:25.549 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628633 2024-04-25T19:27:25.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:25.563 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:25.563 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:25.563 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:25.563 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:25.563 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-disk").st_ino) 2024-04-25T19:27:25.563 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:25.747 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628534 2024-04-25T19:27:25.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:25.760 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:25.760 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:25.761 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:25.761 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:25.761 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-disk/basic").st_ino) 2024-04-25T19:27:25.761 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:25.940 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628535 2024-04-25T19:27:25.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:25.954 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:25.954 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:25.954 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:25.954 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:25.954 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-disk/basic/distros").st_ino) 2024-04-25T19:27:25.955 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:26.137 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628537 2024-04-25T19:27:26.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:26.150 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:26.151 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:26.151 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:26.151 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:26.151 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-disk/basic/%").st_ino) 2024-04-25T19:27:26.151 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:26.332 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628536 2024-04-25T19:27:26.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:26.346 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:26.346 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:26.346 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:26.346 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:26.346 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-disk/basic/tasks").st_ino) 2024-04-25T19:27:26.346 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:26.518 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628538 2024-04-25T19:27:26.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:26.531 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:26.531 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:26.531 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:26.531 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:26.531 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-disk/basic/tasks/ceph-disk.yaml").st_ino) 2024-04-25T19:27:26.531 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:26.715 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628539 2024-04-25T19:27:26.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:26.728 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:26.728 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:26.728 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:26.728 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:26.728 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd").st_ino) 2024-04-25T19:27:26.729 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:26.909 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628915 2024-04-25T19:27:26.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:26.923 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:26.923 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:26.923 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:26.923 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:26.923 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap").st_ino) 2024-04-25T19:27:26.924 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:27.109 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628982 2024-04-25T19:27:27.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:27.123 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:27.123 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:27.123 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:27.123 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:27.123 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/clusters").st_ino) 2024-04-25T19:27:27.123 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:27.308 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628986 2024-04-25T19:27:27.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:27.321 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:27.321 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:27.322 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:27.322 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:27.322 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/clusters/separate-client.yaml").st_ino) 2024-04-25T19:27:27.322 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:27.502 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628987 2024-04-25T19:27:27.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:27.516 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:27.516 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:27.517 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:27.517 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:27.517 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/ceph").st_ino) 2024-04-25T19:27:27.517 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:27.700 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628984 2024-04-25T19:27:27.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:27.714 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:27.715 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:27.715 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:27.715 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:27.715 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/ceph/ceph.yaml").st_ino) 2024-04-25T19:27:27.715 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:27.898 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628985 2024-04-25T19:27:27.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:27.912 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:27.912 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:27.912 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:27.912 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:27.912 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/kernels").st_ino) 2024-04-25T19:27:27.913 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:28.098 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628989 2024-04-25T19:27:28.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:28.112 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:28.112 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:28.113 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:28.113 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:28.113 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/kernels/pre-single-major.yaml").st_ino) 2024-04-25T19:27:28.113 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:28.298 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628990 2024-04-25T19:27:28.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:28.312 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:28.312 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:28.312 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:28.312 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:28.312 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/kernels/single-major-on.yaml").st_ino) 2024-04-25T19:27:28.312 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:28.497 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628992 2024-04-25T19:27:28.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:28.510 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:28.510 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:28.510 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:28.510 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:28.510 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/kernels/single-major-off.yaml").st_ino) 2024-04-25T19:27:28.510 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:28.683 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628991 2024-04-25T19:27:28.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:28.696 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:28.696 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:28.696 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:28.697 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:28.697 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/conf.yaml").st_ino) 2024-04-25T19:27:28.697 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:28.872 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628988 2024-04-25T19:27:28.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:28.885 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:28.885 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:28.885 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:28.885 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:28.885 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/%").st_ino) 2024-04-25T19:27:28.885 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:29.058 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628983 2024-04-25T19:27:29.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:29.071 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:29.071 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:29.071 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:29.071 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:29.071 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/xfs.yaml").st_ino) 2024-04-25T19:27:29.071 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:29.255 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628995 2024-04-25T19:27:29.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:29.269 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:29.269 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:29.269 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:29.269 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:29.269 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/tasks").st_ino) 2024-04-25T19:27:29.269 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:29.453 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628993 2024-04-25T19:27:29.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:29.466 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:29.467 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:29.467 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:29.467 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:29.467 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/tasks/unmap.yaml").st_ino) 2024-04-25T19:27:29.467 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:29.649 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628994 2024-04-25T19:27:29.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:29.662 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:29.662 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:29.662 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:29.662 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:29.662 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd").st_ino) 2024-04-25T19:27:29.662 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:29.851 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628937 2024-04-25T19:27:29.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:29.865 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:29.865 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:29.865 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:29.865 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:29.866 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/clusters").st_ino) 2024-04-25T19:27:29.866 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:30.045 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628939 2024-04-25T19:27:30.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:30.059 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:30.059 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:30.059 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:30.059 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:30.059 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/clusters/fixed-3.yaml").st_ino) 2024-04-25T19:27:30.059 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:30.242 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628940 2024-04-25T19:27:30.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:30.256 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:30.256 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:30.256 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:30.256 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:30.256 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/msgr-failures").st_ino) 2024-04-25T19:27:30.256 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:30.439 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628944 2024-04-25T19:27:30.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:30.453 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:30.453 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:30.453 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:30.453 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:30.453 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/msgr-failures/many.yaml").st_ino) 2024-04-25T19:27:30.453 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:30.626 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628946 2024-04-25T19:27:30.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:30.639 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:30.639 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:30.639 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:30.640 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:30.640 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/msgr-failures/few.yaml").st_ino) 2024-04-25T19:27:30.640 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:30.826 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628945 2024-04-25T19:27:30.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:30.840 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:30.840 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:30.840 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:30.840 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:30.840 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/fs").st_ino) 2024-04-25T19:27:30.840 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:31.020 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628942 2024-04-25T19:27:31.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:31.034 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:31.034 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:31.034 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:31.034 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:31.034 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/fs/btrfs.yaml").st_ino) 2024-04-25T19:27:31.034 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:31.214 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628943 2024-04-25T19:27:31.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:31.227 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:31.227 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:31.227 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:31.227 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:31.227 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/conf.yaml").st_ino) 2024-04-25T19:27:31.228 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:31.411 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628941 2024-04-25T19:27:31.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:31.424 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:31.425 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:31.425 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:31.425 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:31.425 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/%").st_ino) 2024-04-25T19:27:31.425 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:31.607 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628938 2024-04-25T19:27:31.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:31.621 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:31.621 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:31.621 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:31.621 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:31.621 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks").st_ino) 2024-04-25T19:27:31.621 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:31.804 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628947 2024-04-25T19:27:31.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:31.818 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:31.818 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:31.818 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:31.818 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:31.818 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_fsstress.yaml").st_ino) 2024-04-25T19:27:31.818 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:32.001 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628952 2024-04-25T19:27:32.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:32.015 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:32.015 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:32.015 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:32.016 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:32.016 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_fio.yaml").st_ino) 2024-04-25T19:27:32.016 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:32.197 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628948 2024-04-25T19:27:32.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:32.211 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:32.211 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:32.211 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:32.211 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:32.211 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_ffsb.yaml").st_ino) 2024-04-25T19:27:32.211 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:32.393 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628951 2024-04-25T19:27:32.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:32.407 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:32.408 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:32.408 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:32.408 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:32.408 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_fsstress_ext4.yaml").st_ino) 2024-04-25T19:27:32.408 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:32.589 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628954 2024-04-25T19:27:32.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:32.603 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:32.603 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:32.603 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:32.603 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:32.603 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_iozone.yaml").st_ino) 2024-04-25T19:27:32.603 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:32.785 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628956 2024-04-25T19:27:32.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:32.798 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:32.798 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:32.799 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:32.799 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:32.799 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_dbench.yaml").st_ino) 2024-04-25T19:27:32.799 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:32.981 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628950 2024-04-25T19:27:32.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:32.996 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:32.996 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:32.996 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:32.996 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:32.996 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_kernel_untar_build.yaml").st_ino) 2024-04-25T19:27:32.996 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:33.178 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628949 2024-04-25T19:27:33.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:33.191 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:33.191 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:33.191 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:33.191 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:33.191 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_trivial_sync.yaml").st_ino) 2024-04-25T19:27:33.192 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:33.374 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628957 2024-04-25T19:27:33.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:33.388 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:33.388 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:33.388 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:33.388 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:33.389 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_fsstress_btrfs.yaml").st_ino) 2024-04-25T19:27:33.389 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:33.566 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628953 2024-04-25T19:27:33.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:33.579 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:33.579 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:33.579 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:33.579 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:33.579 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_fsx.yaml").st_ino) 2024-04-25T19:27:33.580 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:33.761 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628955 2024-04-25T19:27:33.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:33.774 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:33.774 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:33.774 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:33.774 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:33.774 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton").st_ino) 2024-04-25T19:27:33.775 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:33.957 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628958 2024-04-25T19:27:33.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:33.971 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:33.971 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:33.971 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:33.971 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:33.971 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/msgr-failures").st_ino) 2024-04-25T19:27:33.971 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:34.163 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628963 2024-04-25T19:27:34.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:34.177 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:34.177 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:34.177 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:34.177 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:34.177 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/msgr-failures/many.yaml").st_ino) 2024-04-25T19:27:34.177 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:34.363 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628965 2024-04-25T19:27:34.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:34.376 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:34.376 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:34.376 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:34.377 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:34.377 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/msgr-failures/few.yaml").st_ino) 2024-04-25T19:27:34.377 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:34.558 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628964 2024-04-25T19:27:34.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:34.571 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:34.571 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:34.571 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:34.571 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:34.571 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/fs").st_ino) 2024-04-25T19:27:34.571 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:34.755 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628961 2024-04-25T19:27:34.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:34.769 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:34.769 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:34.769 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:34.769 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:34.769 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/fs/btrfs.yaml").st_ino) 2024-04-25T19:27:34.769 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:34.957 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628962 2024-04-25T19:27:34.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:34.971 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:34.971 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:34.971 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:34.971 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:34.971 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/conf.yaml").st_ino) 2024-04-25T19:27:34.971 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:35.158 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628960 2024-04-25T19:27:35.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:35.171 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:35.171 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:35.171 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:35.171 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:35.171 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/%").st_ino) 2024-04-25T19:27:35.171 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:35.343 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628959 2024-04-25T19:27:35.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:35.356 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:35.356 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:35.356 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:35.356 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:35.356 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/tasks").st_ino) 2024-04-25T19:27:35.356 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:35.537 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628966 2024-04-25T19:27:35.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:35.550 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:35.550 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:35.550 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:35.550 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:35.550 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/tasks/rbd_xfstests.yaml").st_ino) 2024-04-25T19:27:35.550 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:35.732 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628967 2024-04-25T19:27:35.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:35.745 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:35.746 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:35.746 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:35.746 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:35.746 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount").st_ino) 2024-04-25T19:27:35.746 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:35.931 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628916 2024-04-25T19:27:35.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:35.944 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:35.944 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:35.944 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:35.944 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:35.944 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/install").st_ino) 2024-04-25T19:27:35.944 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:36.128 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628923 2024-04-25T19:27:36.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:36.141 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:36.141 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:36.141 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:36.141 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:36.141 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/install/ceph.yaml").st_ino) 2024-04-25T19:27:36.141 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:36.326 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628924 2024-04-25T19:27:36.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:36.339 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:36.339 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:36.339 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:36.339 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:36.339 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/clusters").st_ino) 2024-04-25T19:27:36.339 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:36.522 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628918 2024-04-25T19:27:36.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:36.535 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:36.535 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:36.535 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:36.535 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:36.535 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/clusters/fixed-3.yaml").st_ino) 2024-04-25T19:27:36.535 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:36.720 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628919 2024-04-25T19:27:36.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:36.733 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:36.733 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:36.734 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:36.734 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:36.734 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/msgr-failures").st_ino) 2024-04-25T19:27:36.734 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:36.918 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628925 2024-04-25T19:27:36.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:36.932 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:36.932 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:36.932 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:36.932 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:36.932 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/msgr-failures/many.yaml").st_ino) 2024-04-25T19:27:36.932 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:37.116 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628927 2024-04-25T19:27:37.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:37.131 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:37.131 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:37.131 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:37.131 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:37.131 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/msgr-failures/few.yaml").st_ino) 2024-04-25T19:27:37.131 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:37.224 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:27:37.230 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:27:37.313 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628926 2024-04-25T19:27:37.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:37.326 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:37.326 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:37.326 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:37.326 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:37.326 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/fs").st_ino) 2024-04-25T19:27:37.326 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:37.461 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628921 2024-04-25T19:27:37.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:37.474 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:37.475 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:37.475 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:37.475 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:37.475 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/fs/btrfs.yaml").st_ino) 2024-04-25T19:27:37.475 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:37.611 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628922 2024-04-25T19:27:37.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:37.624 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:37.624 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:37.624 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:37.624 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:37.624 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/conf.yaml").st_ino) 2024-04-25T19:27:37.625 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:37.795 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628920 2024-04-25T19:27:37.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:37.808 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:37.808 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:37.808 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:37.808 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:37.808 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/%").st_ino) 2024-04-25T19:27:37.809 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:37.982 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628917 2024-04-25T19:27:37.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:37.996 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:37.996 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:37.996 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:37.996 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:37.996 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks").st_ino) 2024-04-25T19:27:37.996 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:38.180 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628928 2024-04-25T19:27:38.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:38.193 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:38.194 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:38.194 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:38.194 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:38.194 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_map_unmap.yaml").st_ino) 2024-04-25T19:27:38.194 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:38.365 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628935 2024-04-25T19:27:38.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:38.378 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:38.378 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:38.378 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:38.378 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:38.378 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_kfsx.yaml").st_ino) 2024-04-25T19:27:38.378 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:38.551 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628933 2024-04-25T19:27:38.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:38.565 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:38.565 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:38.565 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:38.565 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:38.565 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_image_read.yaml").st_ino) 2024-04-25T19:27:38.565 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:38.749 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628931 2024-04-25T19:27:38.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:38.762 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:38.762 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:38.762 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:38.762 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:38.762 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_simple_big.yaml").st_ino) 2024-04-25T19:27:38.762 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:38.945 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628936 2024-04-25T19:27:38.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:38.959 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:38.959 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:38.959 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:38.959 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:38.959 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_concurrent.yaml").st_ino) 2024-04-25T19:27:38.959 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:39.141 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628929 2024-04-25T19:27:39.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:39.155 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:39.155 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:39.155 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:39.155 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:39.155 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_map_snapshot_io.yaml").st_ino) 2024-04-25T19:27:39.155 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:39.341 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628934 2024-04-25T19:27:39.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:39.354 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:39.354 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:39.355 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:39.355 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:39.355 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_huge_tickets.yaml").st_ino) 2024-04-25T19:27:39.355 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:39.538 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628930 2024-04-25T19:27:39.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:39.548 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:39.549 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:39.549 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:39.549 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:39.549 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_kernel.yaml").st_ino) 2024-04-25T19:27:39.549 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:39.734 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628932 2024-04-25T19:27:39.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:39.747 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:39.747 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:39.747 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:39.747 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:39.748 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash").st_ino) 2024-04-25T19:27:39.748 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:39.933 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628968 2024-04-25T19:27:39.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:39.947 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:39.947 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:39.947 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:39.947 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:39.947 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/clusters").st_ino) 2024-04-25T19:27:39.947 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:40.134 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628970 2024-04-25T19:27:40.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:40.148 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:40.148 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:40.148 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:40.148 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:40.148 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/clusters/fixed-3.yaml").st_ino) 2024-04-25T19:27:40.148 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:40.335 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628971 2024-04-25T19:27:40.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:40.348 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:40.348 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:40.348 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:40.348 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:40.348 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/fs").st_ino) 2024-04-25T19:27:40.348 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:40.531 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628973 2024-04-25T19:27:40.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:40.545 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:40.545 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:40.545 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:40.545 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:40.545 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/fs/btrfs.yaml").st_ino) 2024-04-25T19:27:40.545 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:40.726 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628974 2024-04-25T19:27:40.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:40.739 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:40.739 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:40.739 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:40.739 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:40.739 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/workloads").st_ino) 2024-04-25T19:27:40.739 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:40.918 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628978 2024-04-25T19:27:40.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:40.931 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:40.931 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:40.931 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:40.931 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:40.931 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/workloads/rbd_fio.yaml").st_ino) 2024-04-25T19:27:40.932 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:41.122 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628979 2024-04-25T19:27:41.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:41.136 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:41.136 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:41.136 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:41.136 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:41.136 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/workloads/rbd_workunit_suites_ffsb.yaml").st_ino) 2024-04-25T19:27:41.136 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:41.321 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628980 2024-04-25T19:27:41.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:41.335 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:41.335 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:41.335 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:41.335 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:41.335 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/workloads/rbd_workunit_suites_iozone.yaml.disabled").st_ino) 2024-04-25T19:27:41.335 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:41.518 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628981 2024-04-25T19:27:41.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:41.532 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:41.532 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:41.532 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:41.532 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:41.532 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/conf.yaml").st_ino) 2024-04-25T19:27:41.532 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:41.702 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628972 2024-04-25T19:27:41.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:41.716 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:41.716 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:41.716 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:41.716 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:41.716 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/%").st_ino) 2024-04-25T19:27:41.716 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:41.897 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628969 2024-04-25T19:27:41.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:41.910 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:41.910 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:41.910 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:41.911 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:41.911 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/thrashers").st_ino) 2024-04-25T19:27:41.911 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:42.091 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628975 2024-04-25T19:27:42.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:42.105 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:42.105 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:42.105 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:42.105 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:42.105 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/thrashers/default.yaml").st_ino) 2024-04-25T19:27:42.105 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:42.287 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628976 2024-04-25T19:27:42.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:42.302 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:42.302 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:42.302 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:42.303 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:42.303 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/thrashers/mon-thrasher.yaml").st_ino) 2024-04-25T19:27:42.303 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:42.486 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628977 2024-04-25T19:27:42.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:42.500 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:42.500 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:42.500 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:42.500 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:42.500 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages").st_ino) 2024-04-25T19:27:42.500 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:42.682 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628485 2024-04-25T19:27:42.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:42.696 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:42.696 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:42.696 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:42.696 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:42.696 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/tests").st_ino) 2024-04-25T19:27:42.696 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:42.878 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628491 2024-04-25T19:27:42.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:42.891 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:42.891 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:42.892 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:42.892 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:42.892 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/tests/distros").st_ino) 2024-04-25T19:27:42.892 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:43.072 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628493 2024-04-25T19:27:43.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:43.085 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:43.086 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:43.086 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:43.086 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:43.086 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/tests/%").st_ino) 2024-04-25T19:27:43.086 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:43.266 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628492 2024-04-25T19:27:43.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:43.280 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:43.280 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:43.280 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:43.280 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:43.280 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/tests/tasks").st_ino) 2024-04-25T19:27:43.280 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:43.464 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628494 2024-04-25T19:27:43.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:43.478 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:43.478 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:43.478 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:43.478 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:43.479 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/tests/tasks/release.yaml").st_ino) 2024-04-25T19:27:43.479 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:43.650 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628495 2024-04-25T19:27:43.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:43.663 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:43.663 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:43.663 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:43.663 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:43.663 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/any").st_ino) 2024-04-25T19:27:43.663 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:43.850 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628486 2024-04-25T19:27:43.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:43.865 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:43.865 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:43.865 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:43.865 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:43.865 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/any/distros").st_ino) 2024-04-25T19:27:43.865 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:44.049 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628488 2024-04-25T19:27:44.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:44.063 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:44.063 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:44.063 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:44.063 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:44.063 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/any/%").st_ino) 2024-04-25T19:27:44.063 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:44.245 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628487 2024-04-25T19:27:44.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:44.258 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:44.258 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:44.258 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:44.258 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:44.258 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/any/tasks").st_ino) 2024-04-25T19:27:44.258 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:44.438 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628489 2024-04-25T19:27:44.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:44.451 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:44.451 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:44.451 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:44.451 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:44.452 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/any/tasks/release.yaml").st_ino) 2024-04-25T19:27:44.452 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:44.631 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628490 2024-04-25T19:27:44.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:44.645 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:44.645 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:44.645 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:44.645 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:44.645 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados").st_ino) 2024-04-25T19:27:44.645 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:44.825 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629120 2024-04-25T19:27:44.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:44.837 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:44.838 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:44.838 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:44.838 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:44.838 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore").st_ino) 2024-04-25T19:27:44.838 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:45.021 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629201 2024-04-25T19:27:45.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:45.035 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:45.035 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:45.035 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:45.035 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:45.035 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/filestore-idempotent-aio-journal.yaml").st_ino) 2024-04-25T19:27:45.035 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:45.218 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629205 2024-04-25T19:27:45.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:45.232 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:45.232 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:45.232 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:45.232 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:45.232 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/ceph_objectstore_tool.yaml").st_ino) 2024-04-25T19:27:45.232 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:45.414 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629203 2024-04-25T19:27:45.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:45.428 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:45.428 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:45.429 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:45.429 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:45.429 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/fusestore.yaml").st_ino) 2024-04-25T19:27:45.429 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:45.611 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629207 2024-04-25T19:27:45.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:45.625 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:45.625 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:45.625 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:45.625 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:45.625 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/keyvaluedb.yaml").st_ino) 2024-04-25T19:27:45.625 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:45.813 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629208 2024-04-25T19:27:45.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:45.827 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:45.827 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:45.827 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:45.827 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:45.827 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/objectstore.yaml").st_ino) 2024-04-25T19:27:45.828 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:46.001 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629210 2024-04-25T19:27:46.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:46.014 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:46.014 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:46.014 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:46.014 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:46.014 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/alloc-hint.yaml").st_ino) 2024-04-25T19:27:46.014 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:46.196 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629202 2024-04-25T19:27:46.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:46.209 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:46.209 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:46.210 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:46.210 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:46.210 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/filejournal.yaml").st_ino) 2024-04-25T19:27:46.210 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:46.391 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629204 2024-04-25T19:27:46.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:46.405 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:46.405 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:46.405 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:46.405 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:46.405 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/objectcacher-stress.yaml").st_ino) 2024-04-25T19:27:46.405 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:46.588 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629209 2024-04-25T19:27:46.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:46.601 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:46.601 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:46.601 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:46.601 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:46.601 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/filestore-idempotent.yaml").st_ino) 2024-04-25T19:27:46.602 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:46.785 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629206 2024-04-25T19:27:46.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:46.798 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:46.798 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:46.799 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:46.799 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:46.799 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton").st_ino) 2024-04-25T19:27:46.799 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:46.975 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629222 2024-04-25T19:27:46.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:46.989 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:46.989 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:46.989 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:46.989 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:46.989 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/msgr").st_ino) 2024-04-25T19:27:46.989 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:47.173 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629252 2024-04-25T19:27:47.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:47.186 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:47.186 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:47.186 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:47.187 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:47.187 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/msgr-failures").st_ino) 2024-04-25T19:27:47.187 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:47.373 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629253 2024-04-25T19:27:47.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:47.387 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:47.387 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:47.387 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:47.387 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:47.387 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/msgr-failures/many.yaml").st_ino) 2024-04-25T19:27:47.387 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:47.569 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629255 2024-04-25T19:27:47.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:47.582 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:47.583 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:47.583 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:47.583 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:47.583 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/msgr-failures/few.yaml").st_ino) 2024-04-25T19:27:47.583 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:47.766 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629254 2024-04-25T19:27:47.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:47.780 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:47.780 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:47.780 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:47.780 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:47.780 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/objectstore").st_ino) 2024-04-25T19:27:47.780 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:47.964 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629256 2024-04-25T19:27:47.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:47.978 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:47.978 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:47.978 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:47.978 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:47.978 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/fs").st_ino) 2024-04-25T19:27:47.978 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:48.160 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629250 2024-04-25T19:27:48.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:48.173 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:48.173 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:48.173 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:48.173 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:48.173 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/fs/xfs.yaml").st_ino) 2024-04-25T19:27:48.173 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:48.355 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629251 2024-04-25T19:27:48.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:48.369 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:48.369 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:48.369 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:48.369 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:48.369 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/%").st_ino) 2024-04-25T19:27:48.369 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:48.552 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629223 2024-04-25T19:27:48.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:48.565 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:48.565 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:48.565 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:48.566 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:48.566 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all").st_ino) 2024-04-25T19:27:48.566 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:48.746 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629224 2024-04-25T19:27:48.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:48.759 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:48.760 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:48.760 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:48.760 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:48.760 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/divergent_priors.yaml").st_ino) 2024-04-25T19:27:48.760 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:48.940 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629227 2024-04-25T19:27:48.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:48.954 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:48.954 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:48.954 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:48.955 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:48.955 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/watch-notify-same-primary.yaml").st_ino) 2024-04-25T19:27:48.955 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:49.138 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629249 2024-04-25T19:27:49.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:49.153 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:49.153 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:49.153 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:49.153 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:49.153 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/ec-lost-unfound.yaml").st_ino) 2024-04-25T19:27:49.153 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:49.335 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629230 2024-04-25T19:27:49.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:49.349 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:49.350 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:49.350 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:49.350 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:49.350 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/rest-api.yaml").st_ino) 2024-04-25T19:27:49.350 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:49.522 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629245 2024-04-25T19:27:49.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:49.535 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:49.535 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:49.535 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:49.535 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:49.535 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/mon-config-keys.yaml").st_ino) 2024-04-25T19:27:49.535 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:49.718 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629233 2024-04-25T19:27:49.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:49.731 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:49.731 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:49.731 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:49.731 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:49.731 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/mon-thrasher.yaml").st_ino) 2024-04-25T19:27:49.731 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:49.919 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629235 2024-04-25T19:27:49.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:49.933 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:49.933 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:49.933 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:49.933 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:49.933 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/osd-recovery-incomplete.yaml").st_ino) 2024-04-25T19:27:49.933 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:50.105 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629237 2024-04-25T19:27:50.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:50.118 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:50.118 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:50.119 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:50.119 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:50.119 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/osd-recovery.yaml").st_ino) 2024-04-25T19:27:50.119 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:50.302 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629238 2024-04-25T19:27:50.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:50.317 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:50.317 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:50.317 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:50.317 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:50.317 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/admin-socket.yaml").st_ino) 2024-04-25T19:27:50.317 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:50.500 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629225 2024-04-25T19:27:50.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:50.514 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:50.514 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:50.514 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:50.514 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:50.514 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/reg11184.yaml").st_ino) 2024-04-25T19:27:50.514 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:50.696 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629243 2024-04-25T19:27:50.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:50.710 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:50.710 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:50.710 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:50.710 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:50.710 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/mon-seesaw.yaml").st_ino) 2024-04-25T19:27:50.710 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:50.892 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629234 2024-04-25T19:27:50.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:50.906 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:50.906 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:50.906 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:50.906 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:50.906 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/radostool.yaml").st_ino) 2024-04-25T19:27:50.906 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:51.088 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629241 2024-04-25T19:27:51.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:51.102 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:51.102 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:51.102 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:51.102 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:51.102 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/thrash_cache_writeback_proxy_none.yaml").st_ino) 2024-04-25T19:27:51.102 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:51.283 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629248 2024-04-25T19:27:51.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:51.297 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:51.297 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:51.297 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:51.297 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:51.297 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/dump-stuck.yaml").st_ino) 2024-04-25T19:27:51.297 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:51.478 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629229 2024-04-25T19:27:51.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:51.492 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:51.493 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:51.493 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:51.493 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:51.493 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/resolve_stuck_peering.yaml").st_ino) 2024-04-25T19:27:51.493 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:51.676 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629244 2024-04-25T19:27:51.680 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:51.690 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:51.690 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:51.690 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:51.690 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:51.690 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/osd-backfill.yaml").st_ino) 2024-04-25T19:27:51.690 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:51.875 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629236 2024-04-25T19:27:51.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:51.888 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:51.889 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:51.889 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:51.889 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:51.889 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/divergent_priors2.yaml").st_ino) 2024-04-25T19:27:51.889 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:52.072 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629228 2024-04-25T19:27:52.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:52.085 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:52.085 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:52.085 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:52.086 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:52.086 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/peer.yaml").st_ino) 2024-04-25T19:27:52.086 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:52.271 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629239 2024-04-25T19:27:52.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:52.285 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:52.285 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:52.285 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:52.285 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:52.285 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/test_envlibrados_for_rocksdb.yaml").st_ino) 2024-04-25T19:27:52.285 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:52.455 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629246 2024-04-25T19:27:52.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:52.468 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:52.469 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:52.469 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:52.469 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:52.469 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/thrash-rados.yaml").st_ino) 2024-04-25T19:27:52.469 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:52.651 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629247 2024-04-25T19:27:52.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:52.665 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:52.665 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:52.665 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:52.665 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:52.665 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/lost-unfound.yaml").st_ino) 2024-04-25T19:27:52.665 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:52.839 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629232 2024-04-25T19:27:52.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:52.852 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:52.852 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:52.852 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:52.852 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:52.852 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/cephtool.yaml").st_ino) 2024-04-25T19:27:52.853 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:53.039 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629226 2024-04-25T19:27:53.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:53.053 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:53.053 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:53.053 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:53.053 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:53.053 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/pg-removal-interruption.yaml").st_ino) 2024-04-25T19:27:53.053 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:53.237 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629240 2024-04-25T19:27:53.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:53.251 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:53.251 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:53.251 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:53.251 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:53.251 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/rebuild-mondb.yaml").st_ino) 2024-04-25T19:27:53.251 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:53.438 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629242 2024-04-25T19:27:53.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:53.448 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:53.448 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:53.448 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:53.448 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:53.448 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/lost-unfound-delete.yaml").st_ino) 2024-04-25T19:27:53.448 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:53.631 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629231 2024-04-25T19:27:53.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:53.645 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:53.645 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:53.645 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:53.645 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:53.645 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/rados.yaml").st_ino) 2024-04-25T19:27:53.645 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:53.828 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629257 2024-04-25T19:27:53.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:53.842 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:53.842 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:53.842 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:53.842 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:53.842 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic").st_ino) 2024-04-25T19:27:53.842 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:54.023 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629121 2024-04-25T19:27:54.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:54.036 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:54.036 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:54.036 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:54.036 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:54.036 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/msgr").st_ino) 2024-04-25T19:27:54.036 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:54.219 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629134 2024-04-25T19:27:54.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:54.232 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:54.232 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:54.232 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:54.232 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:54.232 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/msgr/async.yaml").st_ino) 2024-04-25T19:27:54.232 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:54.414 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629135 2024-04-25T19:27:54.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:54.427 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:54.427 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:54.427 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:54.427 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:54.427 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/msgr/simple.yaml").st_ino) 2024-04-25T19:27:54.427 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:54.610 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629137 2024-04-25T19:27:54.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:54.624 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:54.624 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:54.624 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:54.624 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:54.624 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/msgr/random.yaml").st_ino) 2024-04-25T19:27:54.624 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:54.797 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629136 2024-04-25T19:27:54.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:54.810 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:54.810 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:54.810 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:54.810 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:54.810 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/clusters").st_ino) 2024-04-25T19:27:54.811 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:54.992 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629123 2024-04-25T19:27:54.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:55.006 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:55.006 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:55.006 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:55.007 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:55.007 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/clusters/openstack.yaml").st_ino) 2024-04-25T19:27:55.007 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:55.187 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629126 2024-04-25T19:27:55.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:55.201 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:55.201 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:55.201 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:55.201 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:55.201 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/clusters/fixed-2.yaml").st_ino) 2024-04-25T19:27:55.201 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:55.376 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629125 2024-04-25T19:27:55.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:55.388 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:55.388 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:55.389 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:55.389 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:55.389 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/clusters/+").st_ino) 2024-04-25T19:27:55.389 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:55.571 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629124 2024-04-25T19:27:55.575 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:55.585 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:55.585 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:55.585 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:55.585 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:55.585 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/msgr-failures").st_ino) 2024-04-25T19:27:55.585 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:55.768 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629131 2024-04-25T19:27:55.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:55.782 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:55.782 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:55.782 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:55.782 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:55.782 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/msgr-failures/many.yaml").st_ino) 2024-04-25T19:27:55.782 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:55.958 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629133 2024-04-25T19:27:55.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:55.971 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:55.972 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:55.972 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:55.972 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:55.972 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/msgr-failures/few.yaml").st_ino) 2024-04-25T19:27:55.972 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:56.149 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629132 2024-04-25T19:27:56.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:56.163 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:56.163 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:56.163 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:56.163 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:56.163 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/objectstore").st_ino) 2024-04-25T19:27:56.163 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:56.332 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629138 2024-04-25T19:27:56.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:56.345 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:56.345 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:56.345 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:56.346 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:56.346 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/fs").st_ino) 2024-04-25T19:27:56.346 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:56.527 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629127 2024-04-25T19:27:56.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:56.541 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:56.541 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:56.541 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:56.541 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:56.541 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/fs/btrfs.yaml").st_ino) 2024-04-25T19:27:56.541 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:56.723 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629128 2024-04-25T19:27:56.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:56.737 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:56.737 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:56.737 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:56.737 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:56.737 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/fs/xfs.yaml").st_ino) 2024-04-25T19:27:56.737 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:56.917 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629129 2024-04-25T19:27:56.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:56.932 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:56.932 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:56.932 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:56.932 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:56.932 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/%").st_ino) 2024-04-25T19:27:56.932 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:57.114 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629122 2024-04-25T19:27:57.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:57.128 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:57.128 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:57.128 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:57.128 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:57.128 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/mon_kv_backend").st_ino) 2024-04-25T19:27:57.128 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:57.312 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629130 2024-04-25T19:27:57.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:57.325 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:57.325 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:57.325 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:57.326 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:57.326 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks").st_ino) 2024-04-25T19:27:57.326 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:57.510 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629140 2024-04-25T19:27:57.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:57.523 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:57.524 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:57.524 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:57.524 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:57.524 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/readwrite.yaml").st_ino) 2024-04-25T19:27:57.524 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:57.708 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629149 2024-04-25T19:27:57.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:57.722 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:57.722 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:57.722 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:57.722 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:57.722 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rados_cls_all.yaml").st_ino) 2024-04-25T19:27:57.722 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:57.902 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629142 2024-04-25T19:27:57.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:57.916 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:57.916 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:57.916 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:57.916 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:57.916 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rados_workunit_loadgen_mostlyread.yaml").st_ino) 2024-04-25T19:27:57.916 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:58.098 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629148 2024-04-25T19:27:58.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:58.111 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:58.111 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:58.112 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:58.112 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:58.112 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rados_stress_watch.yaml").st_ino) 2024-04-25T19:27:58.112 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:58.299 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629144 2024-04-25T19:27:58.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:58.312 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:58.312 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:58.312 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:58.313 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:58.313 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rados_workunit_loadgen_big.yaml").st_ino) 2024-04-25T19:27:58.313 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:58.494 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629146 2024-04-25T19:27:58.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:58.507 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:58.507 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:58.507 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:58.507 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:58.507 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/scrub_test.yaml").st_ino) 2024-04-25T19:27:58.507 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:58.685 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629152 2024-04-25T19:27:58.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:58.699 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:58.699 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:58.699 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:58.699 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:58.699 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rados_workunit_loadgen_mix.yaml").st_ino) 2024-04-25T19:27:58.699 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:58.881 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629147 2024-04-25T19:27:58.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:58.895 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:58.895 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:58.895 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:58.895 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:58.895 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rados_python.yaml").st_ino) 2024-04-25T19:27:58.895 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:59.076 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629143 2024-04-25T19:27:59.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:59.089 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:59.089 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:59.089 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:59.089 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:59.090 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/repair_test.yaml").st_ino) 2024-04-25T19:27:59.090 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:59.274 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629150 2024-04-25T19:27:59.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:59.288 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:59.288 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:59.288 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:59.288 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:59.289 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rados_api_tests.yaml").st_ino) 2024-04-25T19:27:59.289 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:59.470 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629141 2024-04-25T19:27:59.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:59.484 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:59.484 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:59.484 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:59.484 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:59.484 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rgw_snaps.yaml").st_ino) 2024-04-25T19:27:59.484 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:59.668 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629151 2024-04-25T19:27:59.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:59.682 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:59.682 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:59.682 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:59.682 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:59.682 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rados_striper.yaml").st_ino) 2024-04-25T19:27:59.682 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:27:59.864 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629145 2024-04-25T19:27:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:27:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:27:59.877 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:27:59.877 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:27:59.877 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:27:59.877 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:27:59.877 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/rados.yaml").st_ino) 2024-04-25T19:27:59.878 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:00.061 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629139 2024-04-25T19:28:00.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:00.074 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:00.074 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:00.074 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:00.074 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:00.074 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec").st_ino) 2024-04-25T19:28:00.074 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:00.258 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629290 2024-04-25T19:28:00.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:00.272 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:00.272 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:00.272 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:00.272 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:00.272 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/leveldb.yaml").st_ino) 2024-04-25T19:28:00.272 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:00.446 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629298 2024-04-25T19:28:00.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:00.459 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:00.459 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:00.459 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:00.459 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:00.459 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/clusters").st_ino) 2024-04-25T19:28:00.460 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:00.644 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629292 2024-04-25T19:28:00.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:00.657 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:00.657 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:00.657 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:00.657 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:00.657 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/clusters/openstack.yaml").st_ino) 2024-04-25T19:28:00.657 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:00.841 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629295 2024-04-25T19:28:00.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:00.856 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:00.856 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:00.856 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:00.856 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:00.856 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/clusters/+").st_ino) 2024-04-25T19:28:00.856 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:01.030 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629293 2024-04-25T19:28:01.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:01.044 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:01.044 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:01.044 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:01.044 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:01.045 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/clusters/fixed-4.yaml").st_ino) 2024-04-25T19:28:01.045 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:01.231 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629294 2024-04-25T19:28:01.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:01.243 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:01.244 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:01.244 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:01.244 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:01.244 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/msgr-failures").st_ino) 2024-04-25T19:28:01.244 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:01.415 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629299 2024-04-25T19:28:01.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:01.429 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:01.429 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:01.429 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:01.429 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:01.429 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/objectstore").st_ino) 2024-04-25T19:28:01.429 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:01.612 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629300 2024-04-25T19:28:01.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:01.626 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:01.627 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:01.627 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:01.627 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:01.627 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/fs").st_ino) 2024-04-25T19:28:01.627 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:01.808 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629296 2024-04-25T19:28:01.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:01.821 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:01.821 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:01.821 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:01.821 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:01.821 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/fs/xfs.yaml").st_ino) 2024-04-25T19:28:01.821 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:02.005 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629297 2024-04-25T19:28:02.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:02.019 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:02.019 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:02.019 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:02.019 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:02.019 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/workloads").st_ino) 2024-04-25T19:28:02.019 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:02.204 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629304 2024-04-25T19:28:02.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:02.217 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:02.217 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:02.218 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:02.218 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:02.218 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml").st_ino) 2024-04-25T19:28:02.218 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:02.400 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629305 2024-04-25T19:28:02.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:02.413 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:02.414 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:02.414 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:02.414 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:02.414 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/%").st_ino) 2024-04-25T19:28:02.414 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:02.596 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629291 2024-04-25T19:28:02.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:02.610 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:02.610 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:02.610 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:02.610 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:02.611 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/thrashers").st_ino) 2024-04-25T19:28:02.611 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:02.793 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629302 2024-04-25T19:28:02.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:02.806 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:02.806 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:02.806 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:02.807 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:02.807 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/thrashers/default.yaml").st_ino) 2024-04-25T19:28:02.807 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:02.989 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629303 2024-04-25T19:28:02.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:03.002 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:03.003 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:03.003 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:03.003 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:03.003 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/rados.yaml").st_ino) 2024-04-25T19:28:03.003 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:03.186 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629301 2024-04-25T19:28:03.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:03.199 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:03.200 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:03.200 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:03.200 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:03.200 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code").st_ino) 2024-04-25T19:28:03.200 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:03.383 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629306 2024-04-25T19:28:03.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:03.397 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:03.397 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:03.397 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:03.397 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:03.397 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/fast").st_ino) 2024-04-25T19:28:03.397 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:03.580 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629309 2024-04-25T19:28:03.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:03.594 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:03.594 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:03.594 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:03.594 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:03.594 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/fast/normal.yaml").st_ino) 2024-04-25T19:28:03.594 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:03.778 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629311 2024-04-25T19:28:03.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:03.792 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:03.792 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:03.792 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:03.792 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:03.792 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/fast/fast.yaml").st_ino) 2024-04-25T19:28:03.792 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:03.979 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629310 2024-04-25T19:28:03.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:03.992 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:03.993 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:03.993 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:03.993 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:03.993 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/leveldb.yaml").st_ino) 2024-04-25T19:28:03.993 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:04.176 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629313 2024-04-25T19:28:04.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:04.190 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:04.190 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:04.190 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:04.190 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:04.190 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/clusters").st_ino) 2024-04-25T19:28:04.190 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:04.376 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629308 2024-04-25T19:28:04.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:04.390 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:04.390 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:04.390 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:04.390 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:04.390 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/msgr-failures").st_ino) 2024-04-25T19:28:04.391 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:04.568 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629314 2024-04-25T19:28:04.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:04.582 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:04.582 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:04.582 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:04.583 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:04.583 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/objectstore").st_ino) 2024-04-25T19:28:04.583 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:04.764 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629315 2024-04-25T19:28:04.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:04.778 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:04.779 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:04.779 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:04.779 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:04.779 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/fs").st_ino) 2024-04-25T19:28:04.779 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:04.959 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629312 2024-04-25T19:28:04.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:04.973 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:04.973 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:04.974 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:04.974 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:04.974 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads").st_ino) 2024-04-25T19:28:04.974 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:05.156 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629323 2024-04-25T19:28:05.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:05.170 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:05.170 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:05.170 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:05.170 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:05.170 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-small-objects-fast-read-overwrites.yaml").st_ino) 2024-04-25T19:28:05.170 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:05.343 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629328 2024-04-25T19:28:05.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:05.358 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:05.358 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:05.358 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:05.358 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:05.358 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-small-objects-overwrites.yaml").st_ino) 2024-04-25T19:28:05.359 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:05.543 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629330 2024-04-25T19:28:05.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:05.556 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:05.556 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:05.557 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:05.557 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:05.557 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml").st_ino) 2024-04-25T19:28:05.557 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:05.741 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629326 2024-04-25T19:28:05.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:05.755 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:05.755 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:05.755 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:05.755 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:05.755 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-snaps-few-objects-overwrites.yaml").st_ino) 2024-04-25T19:28:05.755 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:05.938 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629332 2024-04-25T19:28:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:05.951 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:05.952 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:05.952 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:05.952 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:05.952 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-radosbench.yaml").st_ino) 2024-04-25T19:28:05.952 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:06.134 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629327 2024-04-25T19:28:06.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:06.148 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:06.148 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:06.148 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:06.148 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:06.148 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-rados-plugin=jerasure-k=2-m=1.yaml").st_ino) 2024-04-25T19:28:06.148 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:06.333 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629325 2024-04-25T19:28:06.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:06.347 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:06.347 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:06.347 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:06.347 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:06.347 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-small-objects.yaml").st_ino) 2024-04-25T19:28:06.347 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:06.528 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629331 2024-04-25T19:28:06.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:06.542 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:06.542 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:06.542 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:06.542 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:06.542 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-small-objects-fast-read.yaml").st_ino) 2024-04-25T19:28:06.542 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:06.726 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629329 2024-04-25T19:28:06.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:06.739 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:06.739 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:06.739 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:06.739 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:06.740 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-pool-snaps-few-objects-overwrites.yaml").st_ino) 2024-04-25T19:28:06.740 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:06.922 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629324 2024-04-25T19:28:06.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:06.936 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:06.936 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:06.936 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:06.936 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:06.936 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/%").st_ino) 2024-04-25T19:28:06.936 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:07.119 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629307 2024-04-25T19:28:07.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:07.133 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:07.133 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:07.133 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:07.133 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:07.133 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers").st_ino) 2024-04-25T19:28:07.133 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:07.318 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629317 2024-04-25T19:28:07.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:07.332 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:07.332 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:07.332 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:07.332 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:07.332 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/default.yaml").st_ino) 2024-04-25T19:28:07.332 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:07.355 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:28:07.385 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:28:07.496 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629318 2024-04-25T19:28:07.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:07.509 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:07.509 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:07.509 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:07.509 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:07.509 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/fastread.yaml").st_ino) 2024-04-25T19:28:07.509 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:07.638 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629319 2024-04-25T19:28:07.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:07.651 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:07.651 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:07.651 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:07.651 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:07.652 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/morepggrow.yaml").st_ino) 2024-04-25T19:28:07.652 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:07.831 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629321 2024-04-25T19:28:07.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:07.844 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:07.844 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:07.844 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:07.844 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:07.844 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/pggrow.yaml").st_ino) 2024-04-25T19:28:07.844 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:08.029 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629322 2024-04-25T19:28:08.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:08.045 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:08.045 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:08.045 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:08.045 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:08.045 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/mapgap.yaml").st_ino) 2024-04-25T19:28:08.045 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:08.230 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629320 2024-04-25T19:28:08.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:08.245 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:08.246 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:08.246 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:08.246 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:08.246 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/rados.yaml").st_ino) 2024-04-25T19:28:08.246 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:08.425 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629316 2024-04-25T19:28:08.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:08.439 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:08.439 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:08.439 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:08.439 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:08.439 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr").st_ino) 2024-04-25T19:28:08.439 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:08.625 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629211 2024-04-25T19:28:08.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:08.638 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:08.638 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:08.638 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:08.638 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:08.638 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/%").st_ino) 2024-04-25T19:28:08.638 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:08.820 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629212 2024-04-25T19:28:08.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:08.834 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:08.834 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:08.834 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:08.834 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:08.834 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/all").st_ino) 2024-04-25T19:28:08.834 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:09.013 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629213 2024-04-25T19:28:09.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:09.026 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:09.026 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:09.026 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:09.026 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:09.026 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/all/multi-backfill-reject.yaml").st_ino) 2024-04-25T19:28:09.026 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:09.199 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629219 2024-04-25T19:28:09.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:09.214 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:09.214 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:09.214 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:09.214 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:09.214 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/all/full-tiering.yaml").st_ino) 2024-04-25T19:28:09.214 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:09.400 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629217 2024-04-25T19:28:09.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:09.414 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:09.414 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:09.414 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:09.414 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:09.414 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/all/cache-fs-trunc.yaml").st_ino) 2024-04-25T19:28:09.414 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:09.596 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629214 2024-04-25T19:28:09.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:09.609 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:09.609 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:09.609 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:09.609 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:09.609 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/all/msgr.yaml").st_ino) 2024-04-25T19:28:09.609 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:09.793 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629218 2024-04-25T19:28:09.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:09.807 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:09.807 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:09.807 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:09.807 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:09.807 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/all/ceph-post-file.yaml").st_ino) 2024-04-25T19:28:09.808 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:09.993 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629215 2024-04-25T19:28:09.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:10.007 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:10.007 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:10.007 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:10.007 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:10.007 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/all/export-after-evict.yaml").st_ino) 2024-04-25T19:28:10.007 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:10.190 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629216 2024-04-25T19:28:10.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:10.204 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:10.204 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:10.204 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:10.204 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:10.204 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/all/valgrind-leaks.yaml").st_ino) 2024-04-25T19:28:10.204 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:10.385 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629220 2024-04-25T19:28:10.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:10.400 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:10.400 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:10.400 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:10.400 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:10.400 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/rados.yaml").st_ino) 2024-04-25T19:28:10.400 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:10.586 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629221 2024-04-25T19:28:10.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:10.600 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:10.600 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:10.600 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:10.600 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:10.600 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade").st_ino) 2024-04-25T19:28:10.601 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:10.783 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629377 2024-04-25T19:28:10.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:10.796 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:10.797 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:10.797 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:10.797 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:10.797 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton").st_ino) 2024-04-25T19:28:10.797 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:10.980 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629378 2024-04-25T19:28:10.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:10.995 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:10.995 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:10.995 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:10.995 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:10.995 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/6-next-mon").st_ino) 2024-04-25T19:28:10.995 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:11.179 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629398 2024-04-25T19:28:11.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:11.193 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:11.193 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:11.193 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:11.193 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:11.193 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/6-next-mon/monb.yaml").st_ino) 2024-04-25T19:28:11.193 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:11.378 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629399 2024-04-25T19:28:11.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:11.392 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:11.392 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:11.392 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:11.392 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:11.392 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/8-next-mon").st_ino) 2024-04-25T19:28:11.392 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:11.580 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629404 2024-04-25T19:28:11.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:11.594 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:11.594 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:11.594 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:11.594 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:11.594 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/8-next-mon/monc.yaml").st_ino) 2024-04-25T19:28:11.594 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:11.776 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629405 2024-04-25T19:28:11.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:11.790 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:11.790 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:11.790 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:11.790 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:11.790 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/1-jewel-install").st_ino) 2024-04-25T19:28:11.790 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:11.975 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629384 2024-04-25T19:28:11.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:11.989 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:11.989 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:11.989 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:11.989 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:11.990 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/1-jewel-install/jewel.yaml").st_ino) 2024-04-25T19:28:11.990 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:12.174 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629385 2024-04-25T19:28:12.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:12.187 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:12.188 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:12.188 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:12.188 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:12.188 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload").st_ino) 2024-04-25T19:28:12.188 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:12.372 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629392 2024-04-25T19:28:12.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:12.386 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:12.386 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:12.386 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:12.386 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:12.386 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/readwrite.yaml").st_ino) 2024-04-25T19:28:12.386 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:12.569 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629396 2024-04-25T19:28:12.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:12.583 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:12.583 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:12.583 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:12.583 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:12.583 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/snaps-few-objects.yaml").st_ino) 2024-04-25T19:28:12.583 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:12.768 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629397 2024-04-25T19:28:12.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:12.782 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:12.782 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:12.782 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:12.782 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:12.782 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/rbd-cls.yaml").st_ino) 2024-04-25T19:28:12.782 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:12.965 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629394 2024-04-25T19:28:12.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:12.978 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:12.979 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:12.979 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:12.979 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:12.979 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/rbd-import-export.yaml").st_ino) 2024-04-25T19:28:12.979 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:13.159 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629395 2024-04-25T19:28:13.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:13.173 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:13.173 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:13.173 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:13.173 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:13.173 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/+").st_ino) 2024-04-25T19:28:13.173 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:13.356 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629393 2024-04-25T19:28:13.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:13.371 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:13.371 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:13.371 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:13.371 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:13.371 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/4-mon").st_ino) 2024-04-25T19:28:13.371 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:13.556 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629390 2024-04-25T19:28:13.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:13.570 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:13.570 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:13.570 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:13.570 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:13.570 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/4-mon/mona.yaml").st_ino) 2024-04-25T19:28:13.570 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:13.754 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629391 2024-04-25T19:28:13.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:13.769 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:13.769 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:13.769 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:13.769 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:13.769 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/%").st_ino) 2024-04-25T19:28:13.769 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:13.949 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629379 2024-04-25T19:28:13.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:13.962 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:13.962 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:13.962 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:13.962 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:13.962 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload").st_ino) 2024-04-25T19:28:13.962 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:14.146 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629406 2024-04-25T19:28:14.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:14.159 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:14.159 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:14.160 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:14.160 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:14.160 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload/rbd-python.yaml").st_ino) 2024-04-25T19:28:14.160 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:14.343 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629408 2024-04-25T19:28:14.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:14.356 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:14.356 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:14.356 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:14.356 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:14.356 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload/rgw-swift.yaml").st_ino) 2024-04-25T19:28:14.356 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:14.539 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629409 2024-04-25T19:28:14.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:14.553 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:14.553 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:14.553 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:14.553 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:14.553 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload/snaps-many-objects.yaml").st_ino) 2024-04-25T19:28:14.553 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:14.735 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629410 2024-04-25T19:28:14.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:14.749 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:14.749 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:14.749 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:14.749 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:14.749 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload/+").st_ino) 2024-04-25T19:28:14.749 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:14.930 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629407 2024-04-25T19:28:14.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:14.944 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:14.944 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:14.944 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:14.944 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:14.944 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/2-partial-upgrade").st_ino) 2024-04-25T19:28:14.944 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:15.130 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629386 2024-04-25T19:28:15.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:15.144 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:15.144 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:15.144 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:15.144 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:15.144 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/2-partial-upgrade/firsthalf.yaml").st_ino) 2024-04-25T19:28:15.144 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:15.327 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629387 2024-04-25T19:28:15.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:15.340 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:15.340 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:15.340 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:15.340 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:15.340 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/3-thrash").st_ino) 2024-04-25T19:28:15.340 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:15.523 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629388 2024-04-25T19:28:15.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:15.537 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:15.537 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:15.537 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:15.537 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:15.537 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/3-thrash/default.yaml").st_ino) 2024-04-25T19:28:15.537 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:15.722 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629389 2024-04-25T19:28:15.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:15.736 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:15.736 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:15.736 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:15.736 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:15.736 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/7-workload").st_ino) 2024-04-25T19:28:15.736 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:15.921 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629400 2024-04-25T19:28:15.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:15.935 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:15.935 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:15.935 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:15.935 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:15.935 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/7-workload/radosbench.yaml").st_ino) 2024-04-25T19:28:15.935 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:16.119 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629402 2024-04-25T19:28:16.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:16.132 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:16.132 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:16.133 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:16.133 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:16.133 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/7-workload/rbd_api.yaml").st_ino) 2024-04-25T19:28:16.133 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:16.319 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629403 2024-04-25T19:28:16.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:16.332 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:16.332 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:16.332 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:16.332 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:16.332 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/7-workload/+").st_ino) 2024-04-25T19:28:16.332 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:16.516 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629401 2024-04-25T19:28:16.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:16.530 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:16.530 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:16.530 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:16.530 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:16.530 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/0-cluster").st_ino) 2024-04-25T19:28:16.530 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:16.712 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629380 2024-04-25T19:28:16.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:16.726 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:16.726 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:16.726 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:16.726 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:16.727 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/0-cluster/openstack.yaml").st_ino) 2024-04-25T19:28:16.727 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:16.910 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629382 2024-04-25T19:28:16.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:16.924 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:16.924 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:16.924 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:16.924 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:16.924 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/0-cluster/+").st_ino) 2024-04-25T19:28:16.924 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:17.109 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629381 2024-04-25T19:28:17.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:17.122 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:17.123 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:17.123 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:17.123 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:17.123 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/0-cluster/start.yaml").st_ino) 2024-04-25T19:28:17.123 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:17.306 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629383 2024-04-25T19:28:17.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:17.321 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:17.321 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:17.321 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:17.321 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:17.321 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash").st_ino) 2024-04-25T19:28:17.321 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:17.504 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629153 2024-04-25T19:28:17.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:17.519 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:17.519 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:17.520 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:17.520 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:17.520 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/msgr").st_ino) 2024-04-25T19:28:17.520 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:17.702 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629163 2024-04-25T19:28:17.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:17.716 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:17.716 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:17.716 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:17.716 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:17.716 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/clusters").st_ino) 2024-04-25T19:28:17.717 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:17.902 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629157 2024-04-25T19:28:17.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:17.916 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:17.916 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:17.916 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:17.916 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:17.916 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/clusters/3-mons.yaml").st_ino) 2024-04-25T19:28:17.916 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:18.101 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629158 2024-04-25T19:28:18.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:18.114 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:18.114 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:18.115 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:18.115 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:18.115 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/clusters/9-mons.yaml").st_ino) 2024-04-25T19:28:18.115 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:18.302 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629159 2024-04-25T19:28:18.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:18.316 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:18.316 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:18.316 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:18.316 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:18.316 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/msgr-failures").st_ino) 2024-04-25T19:28:18.316 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:18.501 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629164 2024-04-25T19:28:18.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:18.514 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:18.514 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:18.514 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:18.514 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:18.515 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/msgr-failures/mon-delay.yaml").st_ino) 2024-04-25T19:28:18.515 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:18.700 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629166 2024-04-25T19:28:18.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:18.713 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:18.714 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:18.714 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:18.714 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:18.714 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/msgr-failures/few.yaml").st_ino) 2024-04-25T19:28:18.714 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:18.895 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629165 2024-04-25T19:28:18.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:18.909 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:18.909 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:18.909 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:18.909 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:18.910 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/objectstore").st_ino) 2024-04-25T19:28:18.910 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:19.098 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629167 2024-04-25T19:28:19.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:19.111 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:19.112 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:19.112 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:19.112 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:19.112 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/fs").st_ino) 2024-04-25T19:28:19.112 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:19.292 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629160 2024-04-25T19:28:19.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:19.305 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:19.305 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:19.305 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:19.305 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:19.305 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/fs/xfs.yaml").st_ino) 2024-04-25T19:28:19.305 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:19.488 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629161 2024-04-25T19:28:19.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:19.501 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:19.501 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:19.501 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:19.501 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:19.501 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/workloads").st_ino) 2024-04-25T19:28:19.501 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:19.686 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629175 2024-04-25T19:28:19.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:19.699 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:19.699 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:19.699 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:19.699 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:19.699 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/workloads/pool-create-delete.yaml").st_ino) 2024-04-25T19:28:19.699 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:19.885 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629176 2024-04-25T19:28:19.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:19.899 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:19.899 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:19.899 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:19.899 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:19.899 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/workloads/snaps-few-objects.yaml").st_ino) 2024-04-25T19:28:19.899 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:20.086 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629180 2024-04-25T19:28:20.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:20.100 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:20.100 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:20.100 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:20.100 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:20.100 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/workloads/rados_mon_workunits.yaml").st_ino) 2024-04-25T19:28:20.100 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:20.284 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629179 2024-04-25T19:28:20.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:20.298 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:20.298 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:20.298 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:20.298 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:20.298 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/workloads/rados_5925.yaml").st_ino) 2024-04-25T19:28:20.298 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:20.483 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629177 2024-04-25T19:28:20.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:20.496 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:20.496 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:20.496 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:20.496 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:20.496 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/workloads/rados_api_tests.yaml").st_ino) 2024-04-25T19:28:20.497 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:20.674 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629178 2024-04-25T19:28:20.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:20.687 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:20.687 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:20.687 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:20.687 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:20.687 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/ceph").st_ino) 2024-04-25T19:28:20.688 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:20.877 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629155 2024-04-25T19:28:20.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:20.890 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:20.890 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:20.890 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:20.890 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:20.890 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/ceph/ceph.yaml").st_ino) 2024-04-25T19:28:20.891 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:21.075 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629156 2024-04-25T19:28:21.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:21.089 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:21.089 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:21.089 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:21.089 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:21.089 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/%").st_ino) 2024-04-25T19:28:21.090 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:21.270 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629154 2024-04-25T19:28:21.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:21.286 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:21.286 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:21.286 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:21.286 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:21.287 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/mon_kv_backend").st_ino) 2024-04-25T19:28:21.287 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:21.467 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629162 2024-04-25T19:28:21.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:21.480 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:21.480 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:21.480 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:21.480 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:21.481 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/thrashers").st_ino) 2024-04-25T19:28:21.481 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:21.663 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629169 2024-04-25T19:28:21.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:21.677 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:21.677 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:21.677 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:21.677 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:21.677 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/thrashers/many.yaml").st_ino) 2024-04-25T19:28:21.678 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:21.863 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629171 2024-04-25T19:28:21.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:21.876 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:21.877 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:21.877 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:21.877 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:21.877 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/thrashers/one.yaml").st_ino) 2024-04-25T19:28:21.877 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:22.059 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629172 2024-04-25T19:28:22.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:22.073 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:22.073 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:22.073 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:22.073 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:22.073 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/thrashers/sync.yaml").st_ino) 2024-04-25T19:28:22.074 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:22.262 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629174 2024-04-25T19:28:22.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:22.276 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:22.276 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:22.276 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:22.276 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:22.276 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/thrashers/sync-many.yaml").st_ino) 2024-04-25T19:28:22.276 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:22.458 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629173 2024-04-25T19:28:22.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:22.470 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:22.470 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:22.470 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:22.470 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:22.471 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/thrashers/force-sync-many.yaml").st_ino) 2024-04-25T19:28:22.471 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:22.654 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629170 2024-04-25T19:28:22.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:22.667 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:22.667 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:22.667 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:22.667 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:22.667 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/rados.yaml").st_ino) 2024-04-25T19:28:22.667 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:22.851 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629168 2024-04-25T19:28:22.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:22.865 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:22.865 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:22.865 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:22.865 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:22.865 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash").st_ino) 2024-04-25T19:28:22.865 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:23.050 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629333 2024-04-25T19:28:23.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:23.064 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:23.064 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:23.064 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:23.064 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:23.064 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/msgr").st_ino) 2024-04-25T19:28:23.064 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:23.251 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629350 2024-04-25T19:28:23.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:23.265 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:23.265 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:23.265 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:23.265 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:23.265 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/clusters").st_ino) 2024-04-25T19:28:23.265 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:23.451 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629342 2024-04-25T19:28:23.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:23.465 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:23.465 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:23.465 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:23.466 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:23.466 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/clusters/openstack.yaml").st_ino) 2024-04-25T19:28:23.466 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:23.649 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629345 2024-04-25T19:28:23.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:23.663 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:23.663 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:23.663 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:23.663 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:23.663 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/clusters/fixed-2.yaml").st_ino) 2024-04-25T19:28:23.664 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:23.843 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629344 2024-04-25T19:28:23.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:23.857 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:23.857 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:23.857 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:23.857 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:23.857 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/clusters/+").st_ino) 2024-04-25T19:28:23.857 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:24.041 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629343 2024-04-25T19:28:24.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:24.055 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:24.055 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:24.055 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:24.055 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:24.055 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/1-pg-log-overrides").st_ino) 2024-04-25T19:28:24.055 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:24.242 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629339 2024-04-25T19:28:24.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:24.256 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:24.256 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:24.256 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:24.256 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:24.256 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/1-pg-log-overrides/normal_pg_log.yaml").st_ino) 2024-04-25T19:28:24.256 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:24.439 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629340 2024-04-25T19:28:24.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:24.453 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:24.453 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:24.453 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:24.453 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:24.454 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/1-pg-log-overrides/short_pg_log.yaml").st_ino) 2024-04-25T19:28:24.454 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:24.628 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629341 2024-04-25T19:28:24.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:24.642 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:24.642 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:24.642 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:24.642 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:24.643 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/msgr-failures").st_ino) 2024-04-25T19:28:24.643 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:24.825 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629351 2024-04-25T19:28:24.829 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:24.839 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:24.839 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:24.839 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:24.839 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:24.839 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/msgr-failures/few.yaml").st_ino) 2024-04-25T19:28:24.839 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:25.023 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629353 2024-04-25T19:28:25.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:25.037 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:25.038 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:25.038 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:25.038 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:25.038 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/msgr-failures/fastclose.yaml").st_ino) 2024-04-25T19:28:25.038 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:25.220 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629352 2024-04-25T19:28:25.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:25.233 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:25.233 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:25.233 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:25.233 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:25.233 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/msgr-failures/osd-delay.yaml").st_ino) 2024-04-25T19:28:25.233 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:25.417 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629354 2024-04-25T19:28:25.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:25.432 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:25.432 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:25.432 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:25.432 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:25.432 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/0-size-min-size-overrides").st_ino) 2024-04-25T19:28:25.432 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:25.613 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629335 2024-04-25T19:28:25.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:25.627 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:25.627 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:25.627 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:25.627 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:25.627 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/0-size-min-size-overrides/3-size-2-min-size.yaml").st_ino) 2024-04-25T19:28:25.627 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:25.813 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629338 2024-04-25T19:28:25.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:25.826 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:25.826 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:25.826 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:25.826 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:25.826 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/0-size-min-size-overrides/2-size-2-min-size.yaml").st_ino) 2024-04-25T19:28:25.827 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:26.009 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629337 2024-04-25T19:28:26.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:26.022 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:26.022 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:26.022 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:26.023 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:26.023 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/0-size-min-size-overrides/2-size-1-min-size.yaml").st_ino) 2024-04-25T19:28:26.023 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:26.204 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629336 2024-04-25T19:28:26.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:26.217 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:26.217 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:26.217 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:26.217 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:26.218 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/objectstore").st_ino) 2024-04-25T19:28:26.218 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:26.400 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629355 2024-04-25T19:28:26.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:26.415 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:26.415 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:26.415 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:26.415 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:26.415 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/fs").st_ino) 2024-04-25T19:28:26.415 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:26.595 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629346 2024-04-25T19:28:26.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:26.609 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:26.610 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:26.610 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:26.610 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:26.610 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/fs/btrfs.yaml").st_ino) 2024-04-25T19:28:26.610 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:26.793 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629347 2024-04-25T19:28:26.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:26.806 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:26.806 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:26.806 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:26.806 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:26.806 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/fs/xfs.yaml").st_ino) 2024-04-25T19:28:26.806 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:26.986 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629348 2024-04-25T19:28:26.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:26.999 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:26.999 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:26.999 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:26.999 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:26.999 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads").st_ino) 2024-04-25T19:28:26.999 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:27.183 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629363 2024-04-25T19:28:27.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:27.196 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:27.196 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:27.196 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:27.196 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:27.196 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/radosbench.yaml").st_ino) 2024-04-25T19:28:27.196 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:27.383 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629373 2024-04-25T19:28:27.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:27.398 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:27.398 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:27.398 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:27.398 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:27.398 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/cache-agent-big.yaml").st_ino) 2024-04-25T19:28:27.398 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:27.580 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629365 2024-04-25T19:28:27.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:27.593 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:27.593 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:27.593 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:27.593 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:27.593 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/cache.yaml").st_ino) 2024-04-25T19:28:27.593 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:27.768 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629370 2024-04-25T19:28:27.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:27.781 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:27.781 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:27.781 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:27.781 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:27.781 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/cache-agent-small.yaml").st_ino) 2024-04-25T19:28:27.781 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:27.965 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629366 2024-04-25T19:28:27.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:27.979 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:27.980 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:27.980 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:27.980 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:27.980 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/snaps-few-objects.yaml").st_ino) 2024-04-25T19:28:27.980 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:28.153 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629375 2024-04-25T19:28:28.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:28.166 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:28.166 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:28.166 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:28.166 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:28.166 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/write_fadvise_dontneed.yaml").st_ino) 2024-04-25T19:28:28.166 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:28.351 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629376 2024-04-25T19:28:28.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:28.364 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:28.365 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:28.365 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:28.365 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:28.365 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/cache-pool-snaps.yaml").st_ino) 2024-04-25T19:28:28.365 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:28.551 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629368 2024-04-25T19:28:28.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:28.564 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:28.564 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:28.564 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:28.564 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:28.564 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/admin_socket_objecter_requests.yaml").st_ino) 2024-04-25T19:28:28.564 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:28.738 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629364 2024-04-25T19:28:28.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:28.751 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:28.751 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:28.751 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:28.751 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:28.751 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/cache-pool-snaps-readproxy.yaml").st_ino) 2024-04-25T19:28:28.751 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:28.936 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629367 2024-04-25T19:28:28.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:28.950 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:28.950 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:28.950 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:28.950 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:28.950 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/cache-snaps.yaml").st_ino) 2024-04-25T19:28:28.950 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:29.133 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629369 2024-04-25T19:28:29.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:29.146 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:29.147 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:29.147 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:29.147 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:29.147 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/pool-snaps-few-objects.yaml").st_ino) 2024-04-25T19:28:29.147 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:29.323 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629371 2024-04-25T19:28:29.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:29.337 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:29.337 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:29.337 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:29.337 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:29.337 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/rados_api_tests.yaml").st_ino) 2024-04-25T19:28:29.337 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:29.520 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629372 2024-04-25T19:28:29.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:29.533 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:29.533 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:29.533 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:29.533 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:29.533 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/small-objects.yaml").st_ino) 2024-04-25T19:28:29.533 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:29.702 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629374 2024-04-25T19:28:29.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:29.716 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:29.716 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:29.716 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:29.716 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:29.716 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/hobj-sort.yaml").st_ino) 2024-04-25T19:28:29.716 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:29.896 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629349 2024-04-25T19:28:29.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:29.910 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:29.911 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:29.911 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:29.911 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:29.911 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/%").st_ino) 2024-04-25T19:28:29.911 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:30.083 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629334 2024-04-25T19:28:30.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:30.095 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:30.096 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:30.096 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:30.096 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:30.096 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/thrashers").st_ino) 2024-04-25T19:28:30.096 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:30.281 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629358 2024-04-25T19:28:30.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:30.295 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:30.295 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:30.295 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:30.295 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:30.295 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/thrashers/default.yaml").st_ino) 2024-04-25T19:28:30.295 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:30.482 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629359 2024-04-25T19:28:30.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:30.492 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:30.492 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:30.492 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:30.493 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:30.493 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/thrashers/morepggrow.yaml").st_ino) 2024-04-25T19:28:30.493 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:30.677 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629361 2024-04-25T19:28:30.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:30.691 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:30.691 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:30.691 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:30.691 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:30.691 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/thrashers/pggrow.yaml").st_ino) 2024-04-25T19:28:30.691 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:30.875 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629362 2024-04-25T19:28:30.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:30.889 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:30.889 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:30.889 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:30.889 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:30.889 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/thrashers/mapgap.yaml").st_ino) 2024-04-25T19:28:30.889 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:31.072 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629360 2024-04-25T19:28:31.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:31.085 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:31.085 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:31.085 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:31.085 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:31.085 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/rocksdb.yaml").st_ino) 2024-04-25T19:28:31.085 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:31.272 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629357 2024-04-25T19:28:31.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:31.285 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:31.285 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:31.285 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:31.285 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:31.285 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/rados.yaml").st_ino) 2024-04-25T19:28:31.285 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:31.467 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629356 2024-04-25T19:28:31.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:31.481 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:31.481 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:31.481 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:31.481 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:31.481 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify").st_ino) 2024-04-25T19:28:31.481 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:31.668 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629411 2024-04-25T19:28:31.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:31.682 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:31.682 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:31.682 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:31.682 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:31.682 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/msgr").st_ino) 2024-04-25T19:28:31.682 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:31.866 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629423 2024-04-25T19:28:31.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:31.880 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:31.880 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:31.880 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:31.880 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:31.880 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/validater").st_ino) 2024-04-25T19:28:31.880 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:32.064 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629432 2024-04-25T19:28:32.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:32.077 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:32.077 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:32.077 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:32.077 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:32.077 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/validater/valgrind.yaml").st_ino) 2024-04-25T19:28:32.077 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:32.263 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629434 2024-04-25T19:28:32.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:32.277 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:32.277 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:32.277 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:32.277 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:32.277 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/validater/lockdep.yaml").st_ino) 2024-04-25T19:28:32.277 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:32.459 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629433 2024-04-25T19:28:32.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:32.473 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:32.473 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:32.473 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:32.473 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:32.473 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/clusters").st_ino) 2024-04-25T19:28:32.473 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:32.658 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629416 2024-04-25T19:28:32.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:32.672 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:32.672 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:32.672 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:32.672 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:32.672 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/clusters/openstack.yaml").st_ino) 2024-04-25T19:28:32.672 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:32.854 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629419 2024-04-25T19:28:32.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:32.868 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:32.869 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:32.869 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:32.869 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:32.869 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/clusters/fixed-2.yaml").st_ino) 2024-04-25T19:28:32.869 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:33.052 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629418 2024-04-25T19:28:33.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:33.066 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:33.067 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:33.067 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:33.067 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:33.067 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/clusters/+").st_ino) 2024-04-25T19:28:33.067 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:33.250 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629417 2024-04-25T19:28:33.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:33.264 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:33.264 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:33.264 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:33.264 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:33.264 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/msgr-failures").st_ino) 2024-04-25T19:28:33.264 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:33.448 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629424 2024-04-25T19:28:33.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:33.462 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:33.462 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:33.462 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:33.462 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:33.462 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/msgr-failures/few.yaml").st_ino) 2024-04-25T19:28:33.462 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:33.645 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629425 2024-04-25T19:28:33.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:33.658 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:33.658 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:33.659 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:33.659 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:33.659 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/objectstore").st_ino) 2024-04-25T19:28:33.659 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:33.841 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629426 2024-04-25T19:28:33.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:33.855 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:33.855 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:33.855 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:33.855 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:33.855 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/fs").st_ino) 2024-04-25T19:28:33.855 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:34.039 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629420 2024-04-25T19:28:34.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:34.053 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:34.054 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:34.054 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:34.054 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:34.054 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/fs/btrfs.yaml").st_ino) 2024-04-25T19:28:34.054 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:34.236 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629421 2024-04-25T19:28:34.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:34.250 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:34.250 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:34.250 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:34.250 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:34.250 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/1thrash").st_ino) 2024-04-25T19:28:34.250 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:34.432 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629413 2024-04-25T19:28:34.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:34.445 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:34.446 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:34.446 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:34.446 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:34.446 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/1thrash/default.yaml").st_ino) 2024-04-25T19:28:34.446 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:34.628 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629414 2024-04-25T19:28:34.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:34.642 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:34.642 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:34.642 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:34.642 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:34.642 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/1thrash/none.yaml").st_ino) 2024-04-25T19:28:34.642 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:34.825 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629415 2024-04-25T19:28:34.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:34.839 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:34.839 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:34.839 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:34.839 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:34.839 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/%").st_ino) 2024-04-25T19:28:34.839 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:35.021 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629412 2024-04-25T19:28:35.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:35.035 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:35.035 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:35.035 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:35.035 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:35.035 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/mon_kv_backend").st_ino) 2024-04-25T19:28:35.035 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:35.216 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629422 2024-04-25T19:28:35.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:35.230 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:35.230 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:35.230 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:35.230 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:35.230 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/tasks").st_ino) 2024-04-25T19:28:35.230 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:35.403 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629428 2024-04-25T19:28:35.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:35.416 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:35.417 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:35.417 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:35.417 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:35.417 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/tasks/rados_cls_all.yaml").st_ino) 2024-04-25T19:28:35.418 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:35.598 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629431 2024-04-25T19:28:35.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:35.611 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:35.612 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:35.612 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:35.612 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:35.612 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/tasks/mon_recovery.yaml").st_ino) 2024-04-25T19:28:35.612 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:35.795 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629429 2024-04-25T19:28:35.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:35.809 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:35.809 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:35.809 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:35.809 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:35.809 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/tasks/rados_api_tests.yaml").st_ino) 2024-04-25T19:28:35.809 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:35.990 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629430 2024-04-25T19:28:35.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:36.006 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:36.006 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:36.006 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:36.006 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:36.007 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/rados.yaml").st_ino) 2024-04-25T19:28:36.007 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:36.191 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629427 2024-04-25T19:28:36.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:36.205 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:36.205 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:36.205 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:36.206 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:36.206 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon").st_ino) 2024-04-25T19:28:36.206 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:36.389 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629181 2024-04-25T19:28:36.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:36.402 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:36.402 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:36.403 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:36.403 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:36.403 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/msgr").st_ino) 2024-04-25T19:28:36.403 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:36.587 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629191 2024-04-25T19:28:36.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:36.601 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:36.601 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:36.601 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:36.601 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:36.601 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/clusters").st_ino) 2024-04-25T19:28:36.601 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:36.785 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629183 2024-04-25T19:28:36.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:36.802 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:36.802 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:36.802 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:36.802 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:36.802 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/clusters/21.yaml").st_ino) 2024-04-25T19:28:36.802 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:36.982 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629184 2024-04-25T19:28:36.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:36.995 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:36.995 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:36.995 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:36.995 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:36.995 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/clusters/9.yaml").st_ino) 2024-04-25T19:28:36.995 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:37.178 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629187 2024-04-25T19:28:37.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:37.191 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:37.192 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:37.192 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:37.192 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:37.192 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/clusters/3.yaml").st_ino) 2024-04-25T19:28:37.192 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:37.376 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629185 2024-04-25T19:28:37.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:37.390 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:37.390 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:37.390 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:37.390 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:37.391 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/clusters/6.yaml").st_ino) 2024-04-25T19:28:37.391 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:37.511 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:28:37.519 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:28:37.571 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629186 2024-04-25T19:28:37.575 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:37.587 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:37.587 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:37.587 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:37.587 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:37.587 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/msgr-failures").st_ino) 2024-04-25T19:28:37.587 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:37.722 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629192 2024-04-25T19:28:37.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:37.735 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:37.735 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:37.736 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:37.736 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:37.736 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/msgr-failures/many.yaml").st_ino) 2024-04-25T19:28:37.736 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:37.859 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629194 2024-04-25T19:28:37.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:37.872 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:37.872 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:37.872 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:37.872 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:37.872 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/msgr-failures/few.yaml").st_ino) 2024-04-25T19:28:37.872 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:38.054 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629193 2024-04-25T19:28:38.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:38.069 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:38.069 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:38.069 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:38.069 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:38.069 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/objectstore").st_ino) 2024-04-25T19:28:38.070 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:38.258 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629195 2024-04-25T19:28:38.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:38.268 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:38.268 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:38.268 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:38.268 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:38.268 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/fs").st_ino) 2024-04-25T19:28:38.268 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:38.451 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629188 2024-04-25T19:28:38.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:38.465 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:38.465 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:38.465 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:38.465 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:38.465 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/fs/xfs.yaml").st_ino) 2024-04-25T19:28:38.465 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:38.648 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629189 2024-04-25T19:28:38.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:38.662 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:38.662 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:38.662 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:38.662 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:38.662 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/%").st_ino) 2024-04-25T19:28:38.662 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:38.847 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629182 2024-04-25T19:28:38.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:38.861 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:38.861 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:38.862 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:38.862 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:38.862 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/mon_kv_backend").st_ino) 2024-04-25T19:28:38.862 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:39.044 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629190 2024-04-25T19:28:39.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:39.058 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:39.059 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:39.059 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:39.059 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:39.059 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/tasks").st_ino) 2024-04-25T19:28:39.059 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:39.245 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629197 2024-04-25T19:28:39.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:39.259 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:39.260 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:39.260 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:39.260 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:39.260 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/tasks/mon_clock_with_skews.yaml").st_ino) 2024-04-25T19:28:39.260 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:39.443 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629199 2024-04-25T19:28:39.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:39.457 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:39.458 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:39.458 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:39.458 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:39.458 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/tasks/mon_recovery.yaml").st_ino) 2024-04-25T19:28:39.458 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:39.641 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629200 2024-04-25T19:28:39.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:39.654 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:39.654 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:39.654 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:39.654 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:39.654 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/tasks/mon_clock_no_skews.yaml").st_ino) 2024-04-25T19:28:39.654 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:39.836 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629198 2024-04-25T19:28:39.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:39.849 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:39.849 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:39.849 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:39.849 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:39.849 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/rados.yaml").st_ino) 2024-04-25T19:28:39.849 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:40.031 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629196 2024-04-25T19:28:40.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:40.044 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:40.044 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:40.044 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:40.044 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:40.044 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa").st_ino) 2024-04-25T19:28:40.044 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:40.226 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629277 2024-04-25T19:28:40.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:40.240 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:40.240 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:40.240 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:40.241 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:40.241 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/leveldb.yaml").st_ino) 2024-04-25T19:28:40.241 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:40.425 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629282 2024-04-25T19:28:40.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:40.438 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:40.438 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:40.438 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:40.438 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:40.439 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/clusters").st_ino) 2024-04-25T19:28:40.439 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:40.612 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629280 2024-04-25T19:28:40.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:40.625 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:40.625 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:40.625 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:40.625 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:40.625 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/msgr-failures").st_ino) 2024-04-25T19:28:40.625 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:40.812 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629283 2024-04-25T19:28:40.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:40.826 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:40.826 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:40.826 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:40.826 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:40.827 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/objectstore").st_ino) 2024-04-25T19:28:40.827 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:41.008 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629284 2024-04-25T19:28:41.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:41.023 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:41.023 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:41.023 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:41.023 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:41.023 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/supported").st_ino) 2024-04-25T19:28:41.023 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:41.205 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629286 2024-04-25T19:28:41.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:41.220 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:41.220 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:41.220 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:41.220 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:41.220 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/fs").st_ino) 2024-04-25T19:28:41.220 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:41.396 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629281 2024-04-25T19:28:41.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:41.410 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:41.410 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:41.410 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:41.410 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:41.410 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/workloads").st_ino) 2024-04-25T19:28:41.410 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:41.594 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629288 2024-04-25T19:28:41.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:41.607 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:41.608 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:41.608 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:41.608 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:41.608 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/workloads/ec-rados-plugin=isa-k=2-m=1.yaml").st_ino) 2024-04-25T19:28:41.608 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:41.790 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629289 2024-04-25T19:28:41.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:41.805 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:41.805 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:41.805 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:41.805 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:41.805 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/arch").st_ino) 2024-04-25T19:28:41.805 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:41.990 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629279 2024-04-25T19:28:41.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:42.004 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:42.004 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:42.004 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:42.004 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:42.004 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/arch/x86_64.yaml").st_ino) 2024-04-25T19:28:42.004 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:42.186 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629781 2024-04-25T19:28:42.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:42.200 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:42.200 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:42.200 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:42.200 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:42.200 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/%").st_ino) 2024-04-25T19:28:42.200 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:42.388 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629278 2024-04-25T19:28:42.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:42.401 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:42.402 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:42.402 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:42.402 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:42.402 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/thrashers").st_ino) 2024-04-25T19:28:42.402 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:42.588 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629287 2024-04-25T19:28:42.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:42.601 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:42.601 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:42.602 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:42.602 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:42.602 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/rados.yaml").st_ino) 2024-04-25T19:28:42.602 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:42.784 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629285 2024-04-25T19:28:42.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:42.798 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:42.798 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:42.798 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:42.798 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:42.798 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big").st_ino) 2024-04-25T19:28:42.798 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:42.981 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629258 2024-04-25T19:28:42.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:42.995 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:42.996 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:42.996 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:42.996 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:42.996 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/cluster").st_ino) 2024-04-25T19:28:42.996 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:43.178 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629260 2024-04-25T19:28:43.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:43.191 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:43.192 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:43.192 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:43.192 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:43.192 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/cluster/openstack.yaml").st_ino) 2024-04-25T19:28:43.192 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:43.374 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629263 2024-04-25T19:28:43.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:43.388 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:43.388 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:43.388 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:43.388 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:43.388 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/cluster/12-osds.yaml").st_ino) 2024-04-25T19:28:43.388 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:43.561 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629262 2024-04-25T19:28:43.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:43.574 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:43.574 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:43.574 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:43.575 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:43.575 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/cluster/+").st_ino) 2024-04-25T19:28:43.575 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:43.759 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629261 2024-04-25T19:28:43.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:43.772 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:43.773 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:43.773 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:43.773 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:43.773 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/leveldb.yaml").st_ino) 2024-04-25T19:28:43.773 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:43.953 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629265 2024-04-25T19:28:43.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:43.967 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:43.967 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:43.967 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:43.967 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:43.967 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/msgr-failures").st_ino) 2024-04-25T19:28:43.967 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:44.151 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629266 2024-04-25T19:28:44.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:44.165 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:44.166 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:44.166 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:44.166 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:44.166 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/objectstore").st_ino) 2024-04-25T19:28:44.166 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:44.347 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629267 2024-04-25T19:28:44.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:44.361 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:44.361 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:44.361 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:44.361 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:44.361 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/fs").st_ino) 2024-04-25T19:28:44.361 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:44.544 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629264 2024-04-25T19:28:44.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:44.557 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:44.557 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:44.557 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:44.557 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:44.557 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/workloads").st_ino) 2024-04-25T19:28:44.557 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:44.746 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629275 2024-04-25T19:28:44.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:44.759 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:44.759 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:44.760 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:44.760 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:44.760 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml").st_ino) 2024-04-25T19:28:44.760 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:44.946 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629276 2024-04-25T19:28:44.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:44.959 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:44.959 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:44.960 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:44.960 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:44.960 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/%").st_ino) 2024-04-25T19:28:44.960 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:45.145 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629259 2024-04-25T19:28:45.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:45.159 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:45.160 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:45.160 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:45.160 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:45.160 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers").st_ino) 2024-04-25T19:28:45.160 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:45.345 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629269 2024-04-25T19:28:45.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:45.358 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:45.359 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:45.359 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:45.359 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:45.359 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/default.yaml").st_ino) 2024-04-25T19:28:45.359 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:45.543 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629270 2024-04-25T19:28:45.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:45.557 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:45.557 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:45.557 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:45.557 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:45.558 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/fastread.yaml").st_ino) 2024-04-25T19:28:45.558 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:45.744 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629271 2024-04-25T19:28:45.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:45.757 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:45.757 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:45.757 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:45.757 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:45.757 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/morepggrow.yaml").st_ino) 2024-04-25T19:28:45.757 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:45.939 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629273 2024-04-25T19:28:45.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:45.953 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:45.953 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:45.953 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:45.953 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:45.953 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/pggrow.yaml").st_ino) 2024-04-25T19:28:45.953 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:46.139 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629274 2024-04-25T19:28:46.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:46.153 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:46.153 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:46.153 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:46.153 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:46.153 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/mapgap.yaml").st_ino) 2024-04-25T19:28:46.153 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:46.342 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629272 2024-04-25T19:28:46.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:46.356 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:46.356 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:46.356 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:46.356 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:46.356 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/rados.yaml").st_ino) 2024-04-25T19:28:46.356 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:46.539 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629268 2024-04-25T19:28:46.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:46.554 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:46.554 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:46.554 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:46.554 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:46.554 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs").st_ino) 2024-04-25T19:28:46.554 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:46.736 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628895 2024-04-25T19:28:46.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:46.750 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:46.751 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:46.751 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:46.751 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:46.751 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic").st_ino) 2024-04-25T19:28:46.751 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:46.928 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628896 2024-04-25T19:28:46.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:46.942 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:46.942 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:46.942 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:46.942 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:46.942 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/clusters").st_ino) 2024-04-25T19:28:46.943 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:47.118 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628900 2024-04-25T19:28:47.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:47.131 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:47.131 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:47.131 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:47.131 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:47.131 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/clusters/extra-client.yaml").st_ino) 2024-04-25T19:28:47.131 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:47.314 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628901 2024-04-25T19:28:47.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:47.327 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:47.327 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:47.327 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:47.327 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:47.327 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/fs").st_ino) 2024-04-25T19:28:47.327 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:47.508 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628902 2024-04-25T19:28:47.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:47.522 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:47.522 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:47.522 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:47.522 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:47.522 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/fs/xfs.yaml").st_ino) 2024-04-25T19:28:47.522 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:47.696 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628903 2024-04-25T19:28:47.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:47.710 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:47.710 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:47.710 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:47.710 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:47.710 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/mount").st_ino) 2024-04-25T19:28:47.710 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:47.890 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628904 2024-04-25T19:28:47.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:47.905 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:47.905 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:47.905 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:47.905 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:47.905 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/mount/v4.yaml").st_ino) 2024-04-25T19:28:47.905 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:48.087 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628906 2024-04-25T19:28:48.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:48.102 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:48.102 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:48.103 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:48.103 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:48.103 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/mount/v3.yaml").st_ino) 2024-04-25T19:28:48.103 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:48.291 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628905 2024-04-25T19:28:48.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:48.306 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:48.306 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:48.306 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:48.306 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:48.306 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/ceph").st_ino) 2024-04-25T19:28:48.306 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:48.486 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628898 2024-04-25T19:28:48.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:48.499 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:48.500 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:48.500 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:48.500 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:48.500 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/ceph/base.yaml").st_ino) 2024-04-25T19:28:48.500 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:48.683 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628899 2024-04-25T19:28:48.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:48.697 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:48.697 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:48.697 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:48.697 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:48.697 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/%").st_ino) 2024-04-25T19:28:48.697 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:48.881 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628897 2024-04-25T19:28:48.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:48.895 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:48.895 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:48.895 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:48.895 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:48.895 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/tasks").st_ino) 2024-04-25T19:28:48.895 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:49.079 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628907 2024-04-25T19:28:49.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:49.093 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:49.093 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:49.093 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:49.093 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:49.093 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_dbench.yaml").st_ino) 2024-04-25T19:28:49.093 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:49.276 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628911 2024-04-25T19:28:49.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:49.291 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:49.291 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:49.291 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:49.291 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:49.291 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/tasks/nfs-workunit-kernel-untar-build.yaml").st_ino) 2024-04-25T19:28:49.291 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:49.473 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628908 2024-04-25T19:28:49.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:49.487 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:49.487 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:49.487 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:49.488 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:49.488 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_ffsb.yaml").st_ino) 2024-04-25T19:28:49.488 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:49.671 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628912 2024-04-25T19:28:49.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:49.684 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:49.685 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:49.685 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:49.685 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:49.685 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_blogbench.yaml").st_ino) 2024-04-25T19:28:49.685 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:49.866 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628910 2024-04-25T19:28:49.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:49.880 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:49.880 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:49.880 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:49.880 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:49.880 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_misc.yaml").st_ino) 2024-04-25T19:28:49.880 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:50.063 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628909 2024-04-25T19:28:50.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:50.076 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:50.076 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:50.076 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:50.077 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:50.077 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_fsstress.yaml").st_ino) 2024-04-25T19:28:50.077 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:50.261 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628913 2024-04-25T19:28:50.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:50.274 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:50.274 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:50.274 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:50.274 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:50.275 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_iozone.yaml").st_ino) 2024-04-25T19:28:50.275 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:50.459 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628914 2024-04-25T19:28:50.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:50.472 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:50.472 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:50.472 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:50.472 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:50.472 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/experimental").st_ino) 2024-04-25T19:28:50.472 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:50.654 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628544 2024-04-25T19:28:50.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:50.668 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:50.668 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:50.668 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:50.668 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:50.668 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/experimental/multimds").st_ino) 2024-04-25T19:28:50.668 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:50.850 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628545 2024-04-25T19:28:50.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:50.863 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:50.864 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:50.864 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:50.864 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:50.864 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/experimental/multimds/clusters").st_ino) 2024-04-25T19:28:50.864 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:51.048 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628547 2024-04-25T19:28:51.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:51.062 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:51.062 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:51.063 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:51.063 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:51.063 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/experimental/multimds/clusters/7-multimds.yaml").st_ino) 2024-04-25T19:28:51.063 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:51.244 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628548 2024-04-25T19:28:51.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:51.258 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:51.258 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:51.258 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:51.258 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:51.258 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/experimental/multimds/%").st_ino) 2024-04-25T19:28:51.258 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:51.450 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628546 2024-04-25T19:28:51.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:51.463 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:51.463 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:51.463 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:51.463 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:51.464 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/experimental/multimds/tasks").st_ino) 2024-04-25T19:28:51.464 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:51.637 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628549 2024-04-25T19:28:51.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:51.650 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:51.650 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:51.651 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:51.651 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:51.651 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/experimental/multimds/tasks/fsstress_thrash_subtrees.yaml").st_ino) 2024-04-25T19:28:51.651 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:51.830 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628550 2024-04-25T19:28:51.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:51.844 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:51.844 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:51.844 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:51.844 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:51.844 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal").st_ino) 2024-04-25T19:28:51.844 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:52.024 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628996 2024-04-25T19:28:52.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:52.038 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:52.039 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:52.039 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:52.039 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:52.039 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/fs-misc").st_ino) 2024-04-25T19:28:52.039 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:52.223 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629006 2024-04-25T19:28:52.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:52.236 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:52.236 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:52.237 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:52.237 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:52.237 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/fs-misc/clusters").st_ino) 2024-04-25T19:28:52.237 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:52.421 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629008 2024-04-25T19:28:52.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:52.435 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:52.435 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:52.435 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:52.436 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:52.436 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/fs-misc/clusters/two_clients.yaml").st_ino) 2024-04-25T19:28:52.436 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:52.618 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629009 2024-04-25T19:28:52.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:52.631 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:52.631 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:52.631 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:52.632 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:52.632 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/fs-misc/fs").st_ino) 2024-04-25T19:28:52.632 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:52.805 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629010 2024-04-25T19:28:52.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:52.818 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:52.818 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:52.818 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:52.818 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:52.819 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/fs-misc/fs/btrfs.yaml").st_ino) 2024-04-25T19:28:52.819 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:52.992 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629011 2024-04-25T19:28:52.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:53.007 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:53.007 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:53.007 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:53.007 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:53.007 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/fs-misc/%").st_ino) 2024-04-25T19:28:53.007 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:53.191 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629007 2024-04-25T19:28:53.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:53.205 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:53.205 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:53.205 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:53.205 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:53.206 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/fs-misc/tasks").st_ino) 2024-04-25T19:28:53.206 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:53.389 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629012 2024-04-25T19:28:53.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:53.402 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:53.402 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:53.403 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:53.403 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:53.403 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/fs-misc/tasks/locktest.yaml").st_ino) 2024-04-25T19:28:53.403 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:53.586 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629013 2024-04-25T19:28:53.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:53.599 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:53.599 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:53.599 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:53.599 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:53.599 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic").st_ino) 2024-04-25T19:28:53.599 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:53.783 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628997 2024-04-25T19:28:53.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:53.797 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:53.797 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:53.798 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:53.798 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:53.798 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic/clusters").st_ino) 2024-04-25T19:28:53.798 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:53.983 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628999 2024-04-25T19:28:53.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:53.996 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:53.997 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:53.997 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:53.997 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:53.997 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic/clusters/fixed-3.yaml").st_ino) 2024-04-25T19:28:53.997 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:54.181 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629000 2024-04-25T19:28:54.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:54.195 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:54.195 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:54.196 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:54.196 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:54.196 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic/fs").st_ino) 2024-04-25T19:28:54.196 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:54.379 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629001 2024-04-25T19:28:54.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:54.393 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:54.393 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:54.393 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:54.393 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:54.393 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic/fs/btrfs.yaml").st_ino) 2024-04-25T19:28:54.393 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:54.579 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629002 2024-04-25T19:28:54.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:54.594 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:54.594 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:54.594 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:54.594 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:54.594 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic/%").st_ino) 2024-04-25T19:28:54.595 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:54.775 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628998 2024-04-25T19:28:54.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:54.788 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:54.788 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:54.788 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:54.789 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:54.789 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic/tasks").st_ino) 2024-04-25T19:28:54.789 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:54.971 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629003 2024-04-25T19:28:54.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:54.985 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:54.985 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:54.985 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:54.985 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:54.985 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic/tasks/kclient_workunit_suites_blogbench.yaml").st_ino) 2024-04-25T19:28:54.985 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:55.171 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629004 2024-04-25T19:28:55.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:55.184 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:55.184 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:55.184 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:55.185 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:55.185 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic/tasks/kclient_workunit_suites_fsx.yaml").st_ino) 2024-04-25T19:28:55.185 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:55.364 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629005 2024-04-25T19:28:55.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:55.377 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:55.378 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:55.378 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:55.378 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:55.378 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/mds_restart").st_ino) 2024-04-25T19:28:55.378 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:55.560 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629014 2024-04-25T19:28:55.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:55.573 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:55.573 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:55.573 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:55.573 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:55.573 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/mds_restart/clusters").st_ino) 2024-04-25T19:28:55.573 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:55.755 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629016 2024-04-25T19:28:55.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:55.769 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:55.769 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:55.769 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:55.769 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:55.769 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/mds_restart/clusters/one_mds.yaml").st_ino) 2024-04-25T19:28:55.769 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:55.954 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629017 2024-04-25T19:28:55.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:55.967 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:55.967 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:55.967 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:55.967 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:55.967 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/mds_restart/%").st_ino) 2024-04-25T19:28:55.967 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:56.150 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629015 2024-04-25T19:28:56.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:56.164 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:56.164 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:56.164 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:56.164 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:56.164 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/mds_restart/tasks").st_ino) 2024-04-25T19:28:56.164 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:56.338 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629018 2024-04-25T19:28:56.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:56.351 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:56.351 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:56.351 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:56.351 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:56.351 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/mds_restart/tasks/restart-workunit-backtraces.yaml").st_ino) 2024-04-25T19:28:56.351 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:56.537 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629019 2024-04-25T19:28:56.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:56.551 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:56.551 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:56.551 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:56.551 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:56.551 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds").st_ino) 2024-04-25T19:28:56.552 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:56.733 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629020 2024-04-25T19:28:56.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:56.746 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:56.747 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:56.747 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:56.747 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:56.747 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/clusters").st_ino) 2024-04-25T19:28:56.747 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:56.928 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629022 2024-04-25T19:28:56.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:56.942 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:56.942 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:56.942 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:56.942 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:56.942 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/clusters/3-node-3-mds.yaml").st_ino) 2024-04-25T19:28:56.942 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:57.118 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629023 2024-04-25T19:28:57.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:57.131 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:57.131 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:57.131 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:57.131 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:57.131 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/clusters/3-node-9-mds.yaml").st_ino) 2024-04-25T19:28:57.131 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:57.306 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629024 2024-04-25T19:28:57.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:57.319 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:57.319 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:57.319 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:57.319 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:57.319 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/fs").st_ino) 2024-04-25T19:28:57.319 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:57.502 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629025 2024-04-25T19:28:57.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:57.516 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:57.516 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:57.516 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:57.516 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:57.516 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/fs/btrfs.yaml").st_ino) 2024-04-25T19:28:57.516 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:57.700 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629026 2024-04-25T19:28:57.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:57.714 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:57.714 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:57.714 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:57.714 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:57.715 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/%").st_ino) 2024-04-25T19:28:57.715 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:57.900 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629021 2024-04-25T19:28:57.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:57.914 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:57.914 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:57.914 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:57.914 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:57.914 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/mounts").st_ino) 2024-04-25T19:28:57.914 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:58.087 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629027 2024-04-25T19:28:58.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:58.100 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:58.100 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:58.100 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:58.100 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:58.100 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/mounts/ceph-fuse.yaml").st_ino) 2024-04-25T19:28:58.101 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:58.285 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629028 2024-04-25T19:28:58.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:58.298 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:58.298 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:58.298 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:58.298 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:58.298 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/mounts/kclient.yaml").st_ino) 2024-04-25T19:28:58.298 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:58.484 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629029 2024-04-25T19:28:58.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:58.498 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:58.498 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:58.498 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:58.498 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:58.498 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/tasks").st_ino) 2024-04-25T19:28:58.498 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:58.679 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629030 2024-04-25T19:28:58.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:58.693 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:58.693 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:58.693 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:58.693 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:58.693 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_pjd.yaml").st_ino) 2024-04-25T19:28:58.694 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:58.875 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629036 2024-04-25T19:28:58.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:58.889 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:58.889 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:58.889 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:58.889 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:58.889 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_fsstress.yaml").st_ino) 2024-04-25T19:28:58.889 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:59.064 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629034 2024-04-25T19:28:59.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:59.077 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:59.077 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:59.077 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:59.077 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:59.077 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_truncate_delay.yaml").st_ino) 2024-04-25T19:28:59.077 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:59.258 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629037 2024-04-25T19:28:59.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:59.272 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:59.272 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:59.272 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:59.272 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:59.272 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_misc.yaml").st_ino) 2024-04-25T19:28:59.272 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:59.454 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629031 2024-04-25T19:28:59.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:59.467 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:59.467 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:59.467 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:59.467 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:59.467 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_blogbench.yaml").st_ino) 2024-04-25T19:28:59.467 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:59.648 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629032 2024-04-25T19:28:59.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:59.662 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:59.662 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:59.662 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:59.662 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:59.662 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_fsync.yaml").st_ino) 2024-04-25T19:28:59.662 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:28:59.845 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629035 2024-04-25T19:28:59.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:28:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:28:59.858 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:28:59.858 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:28:59.858 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:28:59.858 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:28:59.859 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_dbench.yaml").st_ino) 2024-04-25T19:28:59.859 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:00.040 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629033 2024-04-25T19:29:00.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:00.054 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:00.054 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:00.054 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:00.054 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:00.054 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/thrash").st_ino) 2024-04-25T19:29:00.054 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:00.239 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629038 2024-04-25T19:29:00.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:00.252 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:00.253 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:00.253 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:00.253 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:00.253 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/thrash/normal.yaml").st_ino) 2024-04-25T19:29:00.253 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:00.435 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629040 2024-04-25T19:29:00.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:00.448 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:00.449 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:00.449 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:00.449 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:00.449 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/thrash/exports.yaml").st_ino) 2024-04-25T19:29:00.449 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:00.633 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629039 2024-04-25T19:29:00.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:00.647 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:00.647 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:00.647 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:00.647 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:00.647 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs").st_ino) 2024-04-25T19:29:00.647 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:00.831 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628819 2024-04-25T19:29:00.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:00.845 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:00.845 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:00.845 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:00.845 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:00.845 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs").st_ino) 2024-04-25T19:29:00.845 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:01.027 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628820 2024-04-25T19:29:01.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:01.041 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:01.041 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:01.041 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:01.041 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:01.041 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/clusters").st_ino) 2024-04-25T19:29:01.041 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:01.234 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628822 2024-04-25T19:29:01.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:01.248 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:01.248 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:01.248 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:01.248 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:01.248 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/clusters/fixed-3-cephfs.yaml").st_ino) 2024-04-25T19:29:01.248 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:01.434 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628823 2024-04-25T19:29:01.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:01.447 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:01.447 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:01.447 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:01.447 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:01.447 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/fs").st_ino) 2024-04-25T19:29:01.448 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:01.631 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628825 2024-04-25T19:29:01.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:01.645 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:01.645 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:01.645 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:01.645 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:01.645 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/fs/xfs.yaml").st_ino) 2024-04-25T19:29:01.645 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:01.835 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628826 2024-04-25T19:29:01.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:01.849 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:01.849 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:01.849 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:01.849 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:01.849 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/inline").st_ino) 2024-04-25T19:29:01.849 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:02.034 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628827 2024-04-25T19:29:02.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:02.048 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:02.048 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:02.048 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:02.048 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:02.048 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/inline/yes.yaml").st_ino) 2024-04-25T19:29:02.048 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:02.229 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628829 2024-04-25T19:29:02.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:02.243 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:02.243 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:02.243 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:02.244 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:02.244 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/inline/no.yaml").st_ino) 2024-04-25T19:29:02.244 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:02.426 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628828 2024-04-25T19:29:02.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:02.440 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:02.441 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:02.441 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:02.441 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:02.441 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/conf.yaml").st_ino) 2024-04-25T19:29:02.441 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:02.624 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628824 2024-04-25T19:29:02.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:02.638 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:02.638 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:02.638 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:02.638 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:02.638 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/%").st_ino) 2024-04-25T19:29:02.638 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:02.822 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628821 2024-04-25T19:29:02.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:02.835 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:02.836 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:02.836 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:02.836 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:02.836 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks").st_ino) 2024-04-25T19:29:02.836 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:03.020 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628830 2024-04-25T19:29:03.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:03.034 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:03.034 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:03.034 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:03.034 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:03.035 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_misc.yaml").st_ino) 2024-04-25T19:29:03.035 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:03.216 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628833 2024-04-25T19:29:03.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:03.232 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:03.232 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:03.232 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:03.232 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:03.232 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_fsstress.yaml").st_ino) 2024-04-25T19:29:03.232 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:03.412 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628838 2024-04-25T19:29:03.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:03.425 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:03.426 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:03.426 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:03.426 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:03.426 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_trivial_sync.yaml").st_ino) 2024-04-25T19:29:03.426 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:03.608 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628843 2024-04-25T19:29:03.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:03.622 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:03.622 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:03.622 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:03.622 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:03.622 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_snaps.yaml").st_ino) 2024-04-25T19:29:03.622 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:03.795 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628835 2024-04-25T19:29:03.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:03.808 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:03.808 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:03.808 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:03.808 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:03.809 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_direct_io.yaml").st_ino) 2024-04-25T19:29:03.809 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:03.990 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628831 2024-04-25T19:29:03.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:04.003 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:04.003 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:04.003 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:04.003 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:04.003 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_fsx.yaml").st_ino) 2024-04-25T19:29:04.003 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:04.186 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628839 2024-04-25T19:29:04.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:04.199 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:04.199 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:04.199 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:04.199 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:04.199 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_kernel_untar_build.yaml").st_ino) 2024-04-25T19:29:04.199 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:04.383 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628832 2024-04-25T19:29:04.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:04.396 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:04.397 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:04.397 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:04.397 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:04.397 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_ffsb.yaml").st_ino) 2024-04-25T19:29:04.397 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:04.577 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628837 2024-04-25T19:29:04.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:04.591 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:04.591 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:04.591 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:04.591 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:04.591 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_dbench.yaml").st_ino) 2024-04-25T19:29:04.591 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:04.773 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628836 2024-04-25T19:29:04.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:04.787 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:04.787 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:04.787 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:04.787 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:04.787 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_fsync.yaml").st_ino) 2024-04-25T19:29:04.787 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:04.968 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628840 2024-04-25T19:29:04.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:04.981 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:04.981 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:04.981 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:04.981 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:04.981 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_pjd.yaml").st_ino) 2024-04-25T19:29:04.982 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:05.164 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628842 2024-04-25T19:29:05.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:05.177 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:05.177 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:05.177 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:05.177 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:05.177 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_iozone.yaml").st_ino) 2024-04-25T19:29:05.177 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:05.361 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628841 2024-04-25T19:29:05.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:05.374 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:05.374 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:05.374 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:05.374 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:05.375 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_o_trunc.yaml").st_ino) 2024-04-25T19:29:05.375 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:05.556 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628834 2024-04-25T19:29:05.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:05.570 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:05.570 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:05.570 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:05.570 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:05.570 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients").st_ino) 2024-04-25T19:29:05.571 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:05.751 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628844 2024-04-25T19:29:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:05.764 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:05.764 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:05.765 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:05.765 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:05.765 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/clusters").st_ino) 2024-04-25T19:29:05.765 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:05.944 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628846 2024-04-25T19:29:05.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:05.958 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:05.958 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:05.958 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:05.958 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:05.958 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/clusters/2-clients.yaml").st_ino) 2024-04-25T19:29:05.958 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:06.140 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628847 2024-04-25T19:29:06.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:06.154 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:06.154 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:06.154 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:06.154 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:06.154 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/fs").st_ino) 2024-04-25T19:29:06.154 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:06.326 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628849 2024-04-25T19:29:06.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:06.340 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:06.340 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:06.340 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:06.340 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:06.340 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/fs/xfs.yaml").st_ino) 2024-04-25T19:29:06.340 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:06.521 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628850 2024-04-25T19:29:06.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:06.533 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:06.534 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:06.534 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:06.534 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:06.534 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/conf.yaml").st_ino) 2024-04-25T19:29:06.534 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:06.704 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628848 2024-04-25T19:29:06.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:06.717 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:06.717 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:06.718 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:06.718 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:06.718 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/%").st_ino) 2024-04-25T19:29:06.718 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:06.900 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628845 2024-04-25T19:29:06.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:06.914 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:06.914 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:06.914 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:06.914 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:06.914 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/tasks").st_ino) 2024-04-25T19:29:06.915 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:07.096 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628851 2024-04-25T19:29:07.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:07.110 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:07.110 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:07.110 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:07.110 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:07.110 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml").st_ino) 2024-04-25T19:29:07.110 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:07.291 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628853 2024-04-25T19:29:07.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:07.305 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:07.305 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:07.305 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:07.305 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:07.305 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/tasks/kernel_cfuse_workunits_dbench_iozone.yaml").st_ino) 2024-04-25T19:29:07.305 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:07.488 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628852 2024-04-25T19:29:07.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:07.503 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:07.503 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:07.503 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:07.503 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:07.503 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery").st_ino) 2024-04-25T19:29:07.503 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:07.675 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:29:07.685 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:29:07.687 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628854 2024-04-25T19:29:07.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:07.701 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:07.702 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:07.702 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:07.702 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:07.702 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/dirfrag").st_ino) 2024-04-25T19:29:07.702 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:07.877 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628860 2024-04-25T19:29:07.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:07.891 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:07.891 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:07.892 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:07.892 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:07.892 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/dirfrag/frag_enable.yaml").st_ino) 2024-04-25T19:29:07.892 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:08.034 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628861 2024-04-25T19:29:08.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:08.047 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:08.047 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:08.048 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:08.048 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:08.048 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/clusters").st_ino) 2024-04-25T19:29:08.048 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:08.230 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628856 2024-04-25T19:29:08.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:08.244 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:08.244 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:08.244 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:08.244 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:08.244 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/clusters/4-remote-clients.yaml").st_ino) 2024-04-25T19:29:08.244 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:08.427 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628857 2024-04-25T19:29:08.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:08.441 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:08.441 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:08.441 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:08.442 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:08.442 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/%").st_ino) 2024-04-25T19:29:08.442 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:08.626 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628855 2024-04-25T19:29:08.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:08.640 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:08.640 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:08.640 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:08.640 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:08.640 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/mounts").st_ino) 2024-04-25T19:29:08.640 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:08.822 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628862 2024-04-25T19:29:08.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:08.836 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:08.836 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:08.836 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:08.836 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:08.836 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/mounts/kmounts.yaml").st_ino) 2024-04-25T19:29:08.836 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:09.018 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628863 2024-04-25T19:29:09.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:09.031 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:09.032 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:09.032 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:09.032 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:09.032 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/xfs.yaml").st_ino) 2024-04-25T19:29:09.032 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:09.216 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628880 2024-04-25T19:29:09.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:09.229 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:09.229 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:09.229 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:09.229 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:09.229 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks").st_ino) 2024-04-25T19:29:09.230 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:09.411 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628864 2024-04-25T19:29:09.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:09.425 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:09.425 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:09.425 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:09.425 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:09.426 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/backtrace.yaml").st_ino) 2024-04-25T19:29:09.426 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:09.607 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628866 2024-04-25T19:29:09.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:09.621 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:09.621 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:09.621 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:09.621 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:09.621 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/forward-scrub.yaml").st_ino) 2024-04-25T19:29:09.621 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:09.804 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628873 2024-04-25T19:29:09.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:09.817 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:09.817 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:09.817 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:09.817 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:09.817 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/volume-client.yaml").st_ino) 2024-04-25T19:29:09.817 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:09.990 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628879 2024-04-25T19:29:09.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:10.003 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:10.003 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:10.003 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:10.003 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:10.003 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/config-commands.yaml").st_ino) 2024-04-25T19:29:10.003 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:10.185 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628869 2024-04-25T19:29:10.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:10.199 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:10.199 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:10.199 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:10.199 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:10.199 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/sessionmap.yaml").st_ino) 2024-04-25T19:29:10.199 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:10.381 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628877 2024-04-25T19:29:10.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:10.394 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:10.394 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:10.394 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:10.394 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:10.395 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/failover.yaml.disabled").st_ino) 2024-04-25T19:29:10.395 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:10.579 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628872 2024-04-25T19:29:10.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:10.593 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:10.593 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:10.593 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:10.593 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:10.593 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/data-scan.yaml").st_ino) 2024-04-25T19:29:10.593 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:10.775 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628871 2024-04-25T19:29:10.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:10.789 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:10.789 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:10.789 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:10.789 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:10.789 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/mds-flush.yaml").st_ino) 2024-04-25T19:29:10.789 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:10.971 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628875 2024-04-25T19:29:10.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:10.985 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:10.985 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:10.985 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:10.986 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:10.986 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/auto-repair.yaml").st_ino) 2024-04-25T19:29:10.986 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:11.166 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628865 2024-04-25T19:29:11.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:11.179 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:11.179 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:11.180 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:11.180 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:11.180 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/damage.yaml").st_ino) 2024-04-25T19:29:11.180 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:11.357 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628870 2024-04-25T19:29:11.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:11.370 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:11.370 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:11.370 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:11.370 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:11.370 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/client-recovery.yaml").st_ino) 2024-04-25T19:29:11.371 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:11.553 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628868 2024-04-25T19:29:11.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:11.568 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:11.568 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:11.568 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:11.568 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:11.568 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/journal-repair.yaml").st_ino) 2024-04-25T19:29:11.568 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:11.751 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628874 2024-04-25T19:29:11.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:11.764 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:11.764 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:11.764 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:11.764 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:11.764 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/client-limits.yaml").st_ino) 2024-04-25T19:29:11.765 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:11.946 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628867 2024-04-25T19:29:11.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:11.960 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:11.960 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:11.960 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:11.960 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:11.960 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/strays.yaml.disabled").st_ino) 2024-04-25T19:29:11.961 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:12.144 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628878 2024-04-25T19:29:12.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:12.158 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:12.158 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:12.158 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:12.158 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:12.158 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/pool-perm.yaml").st_ino) 2024-04-25T19:29:12.158 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:12.344 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628876 2024-04-25T19:29:12.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:12.357 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:12.357 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:12.357 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:12.357 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:12.357 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/debug").st_ino) 2024-04-25T19:29:12.357 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:12.541 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628858 2024-04-25T19:29:12.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:12.556 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:12.556 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:12.556 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:12.556 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:12.556 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/debug/mds_client.yaml").st_ino) 2024-04-25T19:29:12.556 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:12.737 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628859 2024-04-25T19:29:12.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:12.751 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:12.751 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:12.751 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:12.751 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:12.751 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash").st_ino) 2024-04-25T19:29:12.751 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:12.935 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628881 2024-04-25T19:29:12.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:12.949 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:12.949 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:12.949 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:12.949 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:12.949 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/clusters").st_ino) 2024-04-25T19:29:12.949 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:13.131 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628883 2024-04-25T19:29:13.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:13.145 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:13.145 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:13.145 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:13.145 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:13.145 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/clusters/fixed-3-cephfs.yaml").st_ino) 2024-04-25T19:29:13.145 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:13.327 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628884 2024-04-25T19:29:13.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:13.341 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:13.341 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:13.341 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:13.341 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:13.341 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/fs").st_ino) 2024-04-25T19:29:13.341 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:13.510 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628886 2024-04-25T19:29:13.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:13.524 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:13.524 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:13.524 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:13.524 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:13.524 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/fs/xfs.yaml").st_ino) 2024-04-25T19:29:13.524 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:13.707 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628887 2024-04-25T19:29:13.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:13.720 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:13.720 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:13.720 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:13.720 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:13.720 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/workloads").st_ino) 2024-04-25T19:29:13.721 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:13.907 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628892 2024-04-25T19:29:13.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:13.920 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:13.920 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:13.920 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:13.920 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:13.920 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/workloads/kclient_workunit_suites_ffsb.yaml").st_ino) 2024-04-25T19:29:13.920 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:14.102 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628893 2024-04-25T19:29:14.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:14.115 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:14.115 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:14.115 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:14.115 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:14.115 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/workloads/kclient_workunit_suites_iozone.yaml").st_ino) 2024-04-25T19:29:14.115 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:14.297 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628894 2024-04-25T19:29:14.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:14.310 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:14.310 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:14.311 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:14.311 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:14.311 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/conf.yaml").st_ino) 2024-04-25T19:29:14.311 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:14.494 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628885 2024-04-25T19:29:14.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:14.509 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:14.509 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:14.509 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:14.509 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:14.509 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/%").st_ino) 2024-04-25T19:29:14.509 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:14.694 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628882 2024-04-25T19:29:14.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:14.708 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:14.708 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:14.708 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:14.708 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:14.708 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/thrashers").st_ino) 2024-04-25T19:29:14.708 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:14.882 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628888 2024-04-25T19:29:14.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:14.896 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:14.896 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:14.896 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:14.896 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:14.896 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/thrashers/default.yaml").st_ino) 2024-04-25T19:29:14.896 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:15.080 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628889 2024-04-25T19:29:15.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:15.093 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:15.093 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:15.093 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:15.094 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:15.094 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/thrashers/mon.yaml").st_ino) 2024-04-25T19:29:15.094 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:15.274 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628891 2024-04-25T19:29:15.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:15.288 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:15.288 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:15.288 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:15.288 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:15.288 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/thrashers/mds.yaml").st_ino) 2024-04-25T19:29:15.289 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:15.471 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628890 2024-04-25T19:29:15.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:15.485 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:15.485 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:15.485 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:15.486 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:15.486 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade").st_ino) 2024-04-25T19:29:15.486 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:15.669 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629875 2024-04-25T19:29:15.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:15.683 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:15.683 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:15.683 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:15.683 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:15.683 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x").st_ino) 2024-04-25T19:29:15.683 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:15.864 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629972 2024-04-25T19:29:15.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:15.878 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:15.878 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:15.878 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:15.878 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:15.878 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x").st_ino) 2024-04-25T19:29:15.878 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:16.061 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630004 2024-04-25T19:29:16.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:16.074 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:16.075 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:16.075 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:16.075 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:16.075 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/point-to-point-upgrade.yaml").st_ino) 2024-04-25T19:29:16.075 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:16.258 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630009 2024-04-25T19:29:16.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:16.272 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:16.272 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:16.272 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:16.272 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:16.272 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/distros").st_ino) 2024-04-25T19:29:16.272 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:16.455 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630006 2024-04-25T19:29:16.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:16.468 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:16.468 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:16.468 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:16.468 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:16.468 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/distros/centos_7.2.yaml").st_ino) 2024-04-25T19:29:16.468 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:16.641 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630007 2024-04-25T19:29:16.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:16.655 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:16.655 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:16.655 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:16.655 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:16.656 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/distros/ubuntu_14.04.yaml").st_ino) 2024-04-25T19:29:16.656 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:16.838 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630008 2024-04-25T19:29:16.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:16.852 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:16.852 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:16.852 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:16.852 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:16.852 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/%").st_ino) 2024-04-25T19:29:16.852 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:17.035 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630005 2024-04-25T19:29:17.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:17.049 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:17.049 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:17.050 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:17.050 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:17.050 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel").st_ino) 2024-04-25T19:29:17.050 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:17.237 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629973 2024-04-25T19:29:17.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:17.251 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:17.251 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:17.251 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:17.251 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:17.251 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/kraken.yaml").st_ino) 2024-04-25T19:29:17.251 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:17.436 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630003 2024-04-25T19:29:17.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:17.450 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:17.450 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:17.450 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:17.450 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:17.450 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/1-jewel-install").st_ino) 2024-04-25T19:29:17.450 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:17.633 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629979 2024-04-25T19:29:17.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:17.647 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:17.647 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:17.647 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:17.647 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:17.647 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/1-jewel-install/jewel.yaml").st_ino) 2024-04-25T19:29:17.647 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:17.830 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629980 2024-04-25T19:29:17.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:17.845 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:17.845 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:17.845 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:17.845 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:17.845 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/4-kraken.yaml").st_ino) 2024-04-25T19:29:17.845 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:18.028 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629992 2024-04-25T19:29:18.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:18.042 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:18.042 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:18.042 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:18.042 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:18.042 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/3-upgrade-sequence").st_ino) 2024-04-25T19:29:18.043 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:18.225 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629989 2024-04-25T19:29:18.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:18.238 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:18.239 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:18.239 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:18.239 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:18.239 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/3-upgrade-sequence/upgrade-all.yaml").st_ino) 2024-04-25T19:29:18.239 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:18.423 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629990 2024-04-25T19:29:18.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:18.437 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:18.438 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:18.438 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:18.438 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:18.438 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/3-upgrade-sequence/upgrade-mon-osd-mds.yaml").st_ino) 2024-04-25T19:29:18.438 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:18.620 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629991 2024-04-25T19:29:18.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:18.633 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:18.634 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:18.634 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:18.634 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:18.634 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/distros").st_ino) 2024-04-25T19:29:18.634 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:18.818 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630002 2024-04-25T19:29:18.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:18.831 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:18.831 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:18.832 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:18.832 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:18.832 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/%").st_ino) 2024-04-25T19:29:18.832 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:19.016 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629974 2024-04-25T19:29:19.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:19.028 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:19.028 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:19.028 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:19.028 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:19.028 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload").st_ino) 2024-04-25T19:29:19.028 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:19.209 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629981 2024-04-25T19:29:19.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:19.224 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:19.224 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:19.225 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:19.225 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:19.225 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/test_rbd_python.yaml").st_ino) 2024-04-25T19:29:19.225 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:19.405 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629988 2024-04-25T19:29:19.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:19.419 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:19.419 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:19.419 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:19.419 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:19.419 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/blogbench.yaml").st_ino) 2024-04-25T19:29:19.419 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:19.601 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629983 2024-04-25T19:29:19.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:19.615 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:19.615 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:19.615 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:19.615 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:19.615 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/rados_api.yaml").st_ino) 2024-04-25T19:29:19.615 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:19.799 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629985 2024-04-25T19:29:19.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:19.813 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:19.813 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:19.813 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:19.813 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:19.814 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/rados_loadgenbig.yaml").st_ino) 2024-04-25T19:29:19.814 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:19.999 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629986 2024-04-25T19:29:20.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:20.012 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:20.012 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:20.012 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:20.012 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:20.012 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/ec-rados-default.yaml").st_ino) 2024-04-25T19:29:20.012 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:20.196 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629984 2024-04-25T19:29:20.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:20.209 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:20.209 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:20.209 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:20.209 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:20.209 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/+").st_ino) 2024-04-25T19:29:20.209 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:20.388 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629982 2024-04-25T19:29:20.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:20.402 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:20.402 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:20.402 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:20.402 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:20.402 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/test_rbd_api.yaml").st_ino) 2024-04-25T19:29:20.403 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:20.585 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629987 2024-04-25T19:29:20.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:20.598 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:20.598 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:20.599 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:20.599 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:20.599 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/0-cluster").st_ino) 2024-04-25T19:29:20.599 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:20.782 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629975 2024-04-25T19:29:20.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:20.795 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:20.795 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:20.796 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:20.796 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:20.796 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/0-cluster/openstack.yaml").st_ino) 2024-04-25T19:29:20.796 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:20.978 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629977 2024-04-25T19:29:20.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:20.991 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:20.991 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:20.991 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:20.991 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:20.991 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/0-cluster/+").st_ino) 2024-04-25T19:29:20.991 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:21.174 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629976 2024-04-25T19:29:21.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:21.187 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:21.187 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:21.187 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:21.187 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:21.188 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/0-cluster/start.yaml").st_ino) 2024-04-25T19:29:21.188 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:21.361 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629978 2024-04-25T19:29:21.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:21.375 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:21.375 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:21.375 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:21.375 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:21.376 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload").st_ino) 2024-04-25T19:29:21.376 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:21.557 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629993 2024-04-25T19:29:21.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:21.572 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:21.572 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:21.572 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:21.572 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:21.572 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/blogbench.yaml").st_ino) 2024-04-25T19:29:21.572 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:21.751 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629995 2024-04-25T19:29:21.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:21.765 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:21.765 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:21.765 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:21.765 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:21.765 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rados-snaps-few-objects.yaml").st_ino) 2024-04-25T19:29:21.765 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:21.947 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629996 2024-04-25T19:29:21.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:21.961 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:21.961 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:21.961 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:21.961 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:21.961 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/+").st_ino) 2024-04-25T19:29:21.961 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:22.150 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629994 2024-04-25T19:29:22.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:22.163 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:22.163 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:22.163 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:22.163 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:22.163 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rados_loadgenmix.yaml").st_ino) 2024-04-25T19:29:22.164 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:22.345 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629997 2024-04-25T19:29:22.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:22.359 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:22.359 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:22.359 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:22.359 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:22.359 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rbd_cls.yaml").st_ino) 2024-04-25T19:29:22.359 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:22.543 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629999 2024-04-25T19:29:22.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:22.556 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:22.556 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:22.556 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:22.556 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:22.557 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rados_mon_thrash.yaml").st_ino) 2024-04-25T19:29:22.557 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:22.740 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629998 2024-04-25T19:29:22.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:22.754 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:22.754 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:22.754 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:22.754 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:22.754 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rgw_swift.yaml").st_ino) 2024-04-25T19:29:22.754 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:22.929 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630001 2024-04-25T19:29:22.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:22.943 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:22.943 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:22.943 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:22.943 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:22.943 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rbd_import_export.yaml").st_ino) 2024-04-25T19:29:22.943 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:23.119 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630000 2024-04-25T19:29:23.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:23.133 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:23.133 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:23.133 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:23.133 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:23.133 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split").st_ino) 2024-04-25T19:29:23.133 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:23.319 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630040 2024-04-25T19:29:23.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:23.334 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:23.334 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:23.334 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:23.334 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:23.334 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/6-next-mon").st_ino) 2024-04-25T19:29:23.334 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:23.511 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630060 2024-04-25T19:29:23.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:23.521 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:23.521 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:23.521 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:23.521 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:23.521 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/6-next-mon/monb.yaml").st_ino) 2024-04-25T19:29:23.521 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:23.697 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630061 2024-04-25T19:29:23.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:23.710 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:23.710 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:23.710 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:23.710 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:23.710 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/8-next-mon").st_ino) 2024-04-25T19:29:23.711 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:23.880 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630066 2024-04-25T19:29:23.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:23.893 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:23.893 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:23.893 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:23.893 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:23.893 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/8-next-mon/monc.yaml").st_ino) 2024-04-25T19:29:23.894 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:24.075 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630067 2024-04-25T19:29:24.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:24.088 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:24.088 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:24.088 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:24.089 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:24.089 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/1-jewel-install").st_ino) 2024-04-25T19:29:24.089 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:24.273 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630046 2024-04-25T19:29:24.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:24.286 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:24.287 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:24.287 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:24.287 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:24.287 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/1-jewel-install/jewel.yaml").st_ino) 2024-04-25T19:29:24.287 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:24.462 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630047 2024-04-25T19:29:24.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:24.475 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:24.476 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:24.476 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:24.476 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:24.476 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload").st_ino) 2024-04-25T19:29:24.476 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:24.658 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630054 2024-04-25T19:29:24.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:24.672 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:24.672 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:24.672 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:24.672 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:24.672 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/readwrite.yaml").st_ino) 2024-04-25T19:29:24.672 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:24.858 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630058 2024-04-25T19:29:24.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:24.872 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:24.872 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:24.872 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:24.872 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:24.872 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/snaps-few-objects.yaml").st_ino) 2024-04-25T19:29:24.873 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:25.054 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630059 2024-04-25T19:29:25.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:25.067 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:25.067 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:25.067 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:25.067 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:25.067 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/rbd-cls.yaml").st_ino) 2024-04-25T19:29:25.067 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:25.252 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630056 2024-04-25T19:29:25.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:25.265 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:25.265 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:25.265 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:25.265 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:25.265 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/rbd-import-export.yaml").st_ino) 2024-04-25T19:29:25.265 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:25.450 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630057 2024-04-25T19:29:25.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:25.465 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:25.465 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:25.465 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:25.465 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:25.465 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/+").st_ino) 2024-04-25T19:29:25.465 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:25.640 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630055 2024-04-25T19:29:25.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:25.653 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:25.653 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:25.654 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:25.654 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:25.654 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/4-mon").st_ino) 2024-04-25T19:29:25.654 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:25.834 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630052 2024-04-25T19:29:25.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:25.848 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:25.848 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:25.848 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:25.848 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:25.848 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/4-mon/mona.yaml").st_ino) 2024-04-25T19:29:25.848 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:26.033 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630053 2024-04-25T19:29:26.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:26.047 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:26.047 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:26.047 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:26.047 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:26.047 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/distros").st_ino) 2024-04-25T19:29:26.048 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:26.221 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630073 2024-04-25T19:29:26.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:26.234 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:26.234 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:26.234 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:26.234 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:26.234 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/%").st_ino) 2024-04-25T19:29:26.234 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:26.410 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630041 2024-04-25T19:29:26.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:26.423 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:26.423 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:26.423 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:26.423 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:26.423 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload").st_ino) 2024-04-25T19:29:26.423 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:26.609 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630068 2024-04-25T19:29:26.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:26.623 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:26.623 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:26.623 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:26.623 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:26.623 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload/rbd-python.yaml").st_ino) 2024-04-25T19:29:26.623 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:26.807 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630070 2024-04-25T19:29:26.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:26.820 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:26.820 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:26.820 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:26.820 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:26.820 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload/rgw-swift.yaml").st_ino) 2024-04-25T19:29:26.820 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:27.003 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630071 2024-04-25T19:29:27.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:27.017 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:27.017 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:27.017 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:27.017 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:27.017 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload/snaps-many-objects.yaml").st_ino) 2024-04-25T19:29:27.017 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:27.202 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630072 2024-04-25T19:29:27.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:27.213 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:27.214 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:27.214 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:27.214 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:27.214 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload/+").st_ino) 2024-04-25T19:29:27.214 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:27.397 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630069 2024-04-25T19:29:27.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:27.411 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:27.411 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:27.411 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:27.411 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:27.411 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/2-partial-upgrade").st_ino) 2024-04-25T19:29:27.412 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:27.593 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630048 2024-04-25T19:29:27.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:27.606 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:27.606 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:27.606 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:27.606 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:27.606 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/2-partial-upgrade/firsthalf.yaml").st_ino) 2024-04-25T19:29:27.606 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:27.791 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630049 2024-04-25T19:29:27.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:27.805 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:27.805 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:27.805 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:27.805 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:27.805 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/3-thrash").st_ino) 2024-04-25T19:29:27.805 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:27.979 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630050 2024-04-25T19:29:27.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:27.993 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:27.993 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:27.993 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:27.993 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:27.993 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/3-thrash/default.yaml").st_ino) 2024-04-25T19:29:27.993 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:28.175 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630051 2024-04-25T19:29:28.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:28.188 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:28.189 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:28.189 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:28.189 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:28.189 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/7-workload").st_ino) 2024-04-25T19:29:28.189 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:28.362 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630062 2024-04-25T19:29:28.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:28.376 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:28.376 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:28.377 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:28.377 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:28.377 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/7-workload/radosbench.yaml").st_ino) 2024-04-25T19:29:28.377 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:28.560 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630064 2024-04-25T19:29:28.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:28.573 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:28.574 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:28.574 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:28.574 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:28.574 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/7-workload/rbd_api.yaml").st_ino) 2024-04-25T19:29:28.574 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:28.758 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630065 2024-04-25T19:29:28.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:28.771 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:28.772 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:28.772 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:28.772 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:28.772 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/7-workload/+").st_ino) 2024-04-25T19:29:28.772 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:28.953 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630063 2024-04-25T19:29:28.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:28.967 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:28.967 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:28.967 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:28.967 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:28.967 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/0-cluster").st_ino) 2024-04-25T19:29:28.967 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:29.147 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630042 2024-04-25T19:29:29.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:29.161 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:29.161 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:29.161 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:29.162 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:29.162 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/0-cluster/openstack.yaml").st_ino) 2024-04-25T19:29:29.162 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:29.342 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630044 2024-04-25T19:29:29.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:29.357 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:29.357 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:29.357 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:29.357 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:29.357 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/0-cluster/+").st_ino) 2024-04-25T19:29:29.357 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:29.541 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630043 2024-04-25T19:29:29.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:29.554 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:29.555 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:29.555 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:29.555 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:29.555 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/0-cluster/start.yaml").st_ino) 2024-04-25T19:29:29.555 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:29.741 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630045 2024-04-25T19:29:29.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:29.754 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:29.754 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:29.754 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:29.754 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:29.755 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64").st_ino) 2024-04-25T19:29:29.755 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:29.934 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630010 2024-04-25T19:29:29.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:29.947 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:29.947 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:29.948 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:29.948 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:29.948 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/6-next-mon").st_ino) 2024-04-25T19:29:29.948 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:30.119 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630021 2024-04-25T19:29:30.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:30.132 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:30.132 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:30.132 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:30.132 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:30.132 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/8-next-mon").st_ino) 2024-04-25T19:29:30.132 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:30.318 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630022 2024-04-25T19:29:30.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:30.332 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:30.332 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:30.332 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:30.332 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:30.332 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/1-jewel-install").st_ino) 2024-04-25T19:29:30.332 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:30.515 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630014 2024-04-25T19:29:30.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:30.529 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:30.529 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:30.529 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:30.529 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:30.529 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/5-workload").st_ino) 2024-04-25T19:29:30.529 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:30.710 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630019 2024-04-25T19:29:30.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:30.725 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:30.725 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:30.725 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:30.725 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:30.725 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/5-workload/ec-rados-default.yaml").st_ino) 2024-04-25T19:29:30.725 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:30.905 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630020 2024-04-25T19:29:30.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:30.918 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:30.918 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:30.918 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:30.918 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:30.919 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/4-mon").st_ino) 2024-04-25T19:29:30.919 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:31.100 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630018 2024-04-25T19:29:31.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:31.113 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:31.113 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:31.113 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:31.113 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:31.113 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/%").st_ino) 2024-04-25T19:29:31.113 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:31.282 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630011 2024-04-25T19:29:31.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:31.295 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:31.295 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:31.296 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:31.296 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:31.296 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/0-x86_64.yaml").st_ino) 2024-04-25T19:29:31.296 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:31.477 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630013 2024-04-25T19:29:31.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:31.491 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:31.491 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:31.491 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:31.491 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:31.491 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/9-workload").st_ino) 2024-04-25T19:29:31.491 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:31.674 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630023 2024-04-25T19:29:31.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:31.687 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:31.687 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:31.687 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:31.687 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:31.688 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/9-workload/ec-rados-plugin=jerasure-k=3-m=1.yaml").st_ino) 2024-04-25T19:29:31.688 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:31.870 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630024 2024-04-25T19:29:31.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:31.883 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:31.884 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:31.884 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:31.884 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:31.884 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/2-partial-upgrade").st_ino) 2024-04-25T19:29:31.884 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:32.063 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630015 2024-04-25T19:29:32.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:32.077 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:32.077 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:32.077 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:32.077 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:32.077 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/3-thrash").st_ino) 2024-04-25T19:29:32.077 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:32.259 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630016 2024-04-25T19:29:32.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:32.273 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:32.274 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:32.274 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:32.274 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:32.274 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/3-thrash/default.yaml").st_ino) 2024-04-25T19:29:32.274 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:32.457 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630017 2024-04-25T19:29:32.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:32.471 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:32.471 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:32.471 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:32.471 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:32.471 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/0-cluster").st_ino) 2024-04-25T19:29:32.471 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:32.645 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630012 2024-04-25T19:29:32.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:32.658 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:32.659 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:32.659 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:32.659 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:32.659 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code").st_ino) 2024-04-25T19:29:32.659 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:32.832 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630025 2024-04-25T19:29:32.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:32.846 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:32.846 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:32.846 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:32.846 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:32.846 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/6-next-mon").st_ino) 2024-04-25T19:29:32.846 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:33.032 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630035 2024-04-25T19:29:33.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:33.045 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:33.045 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:33.045 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:33.046 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:33.046 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/8-next-mon").st_ino) 2024-04-25T19:29:33.046 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:33.218 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630036 2024-04-25T19:29:33.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:33.274 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:33.274 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:33.274 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:33.274 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:33.274 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/1-jewel-install").st_ino) 2024-04-25T19:29:33.274 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:33.457 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630028 2024-04-25T19:29:33.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:33.471 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:33.471 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:33.471 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:33.471 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:33.471 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/5-workload").st_ino) 2024-04-25T19:29:33.471 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:33.654 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630033 2024-04-25T19:29:33.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:33.669 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:33.669 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:33.669 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:33.669 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:33.669 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/5-workload/ec-rados-default.yaml").st_ino) 2024-04-25T19:29:33.669 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:33.853 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630034 2024-04-25T19:29:33.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:33.866 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:33.866 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:33.866 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:33.866 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:33.867 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/4-mon").st_ino) 2024-04-25T19:29:33.867 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:34.050 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630032 2024-04-25T19:29:34.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:34.064 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:34.064 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:34.064 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:34.064 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:34.064 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/distros").st_ino) 2024-04-25T19:29:34.064 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:34.245 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630039 2024-04-25T19:29:34.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:34.259 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:34.259 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:34.259 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:34.259 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:34.259 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/%").st_ino) 2024-04-25T19:29:34.259 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:34.442 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630026 2024-04-25T19:29:34.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:34.456 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:34.456 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:34.456 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:34.456 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:34.456 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/9-workload").st_ino) 2024-04-25T19:29:34.456 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:34.639 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630037 2024-04-25T19:29:34.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:34.653 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:34.654 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:34.654 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:34.654 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:34.654 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/9-workload/ec-rados-plugin=jerasure-k=3-m=1.yaml").st_ino) 2024-04-25T19:29:34.654 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:34.837 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630038 2024-04-25T19:29:34.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:34.850 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:34.850 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:34.850 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:34.850 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:34.851 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/2-partial-upgrade").st_ino) 2024-04-25T19:29:34.851 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:35.033 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630029 2024-04-25T19:29:35.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:35.047 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:35.047 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:35.047 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:35.047 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:35.047 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/3-thrash").st_ino) 2024-04-25T19:29:35.047 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:35.231 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630030 2024-04-25T19:29:35.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:35.245 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:35.245 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:35.245 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:35.245 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:35.245 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/3-thrash/default.yaml").st_ino) 2024-04-25T19:29:35.245 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:35.417 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630031 2024-04-25T19:29:35.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:35.431 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:35.431 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:35.431 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:35.431 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:35.431 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/0-cluster").st_ino) 2024-04-25T19:29:35.431 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:35.613 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630027 2024-04-25T19:29:35.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:35.627 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:35.627 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:35.628 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:35.628 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:35.628 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x").st_ino) 2024-04-25T19:29:35.628 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:35.800 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629913 2024-04-25T19:29:35.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:35.814 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:35.814 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:35.814 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:35.814 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:35.814 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel").st_ino) 2024-04-25T19:29:35.814 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:35.997 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629914 2024-04-25T19:29:36.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:36.011 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:36.011 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:36.011 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:36.011 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:36.011 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/8-kraken.yaml").st_ino) 2024-04-25T19:29:36.011 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:36.196 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629944 2024-04-25T19:29:36.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:36.210 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:36.210 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:36.210 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:36.210 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:36.210 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/1-hammer-jewel-install").st_ino) 2024-04-25T19:29:36.210 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:36.387 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629918 2024-04-25T19:29:36.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:36.400 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:36.400 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:36.400 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:36.400 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:36.400 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/1-hammer-jewel-install/hammer-jewel.yaml").st_ino) 2024-04-25T19:29:36.400 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:36.584 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629919 2024-04-25T19:29:36.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:36.600 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:36.600 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:36.600 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:36.600 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:36.600 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/4-jewel.yaml").st_ino) 2024-04-25T19:29:36.600 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:36.781 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629931 2024-04-25T19:29:36.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:36.795 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:36.795 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:36.795 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:36.796 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:36.796 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/3.5-finish.yaml").st_ino) 2024-04-25T19:29:36.796 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:36.980 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629930 2024-04-25T19:29:36.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:36.993 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:36.993 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:36.994 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:36.994 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:36.994 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/3-upgrade-sequence").st_ino) 2024-04-25T19:29:36.994 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:37.179 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629927 2024-04-25T19:29:37.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:37.193 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:37.193 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:37.193 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:37.193 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:37.193 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/3-upgrade-sequence/upgrade-osd-mds-mon.yaml").st_ino) 2024-04-25T19:29:37.193 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:37.374 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629929 2024-04-25T19:29:37.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:37.389 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:37.389 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:37.389 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:37.389 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:37.389 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/3-upgrade-sequence/upgrade-all.yaml").st_ino) 2024-04-25T19:29:37.389 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:37.563 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629928 2024-04-25T19:29:37.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:37.577 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:37.577 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:37.577 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:37.577 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:37.577 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/7-upgrade-sequence").st_ino) 2024-04-25T19:29:37.577 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:37.761 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629941 2024-04-25T19:29:37.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:37.775 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:37.775 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:37.775 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:37.775 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:37.775 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/7-upgrade-sequence/upgrade-by-daemon.yaml").st_ino) 2024-04-25T19:29:37.775 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:37.805 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:29:37.828 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:29:37.941 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629943 2024-04-25T19:29:37.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:37.955 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:37.955 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:37.955 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:37.955 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:37.955 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/7-upgrade-sequence/upgrade-all.yaml").st_ino) 2024-04-25T19:29:37.955 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:38.130 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629942 2024-04-25T19:29:38.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:38.143 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:38.143 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:38.143 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:38.143 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:38.143 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/distros").st_ino) 2024-04-25T19:29:38.143 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:38.326 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629953 2024-04-25T19:29:38.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:38.339 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:38.340 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:38.340 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:38.340 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:38.340 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/distros/centos_7.2.yaml").st_ino) 2024-04-25T19:29:38.340 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:38.524 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629954 2024-04-25T19:29:38.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:38.539 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:38.539 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:38.539 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:38.539 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:38.539 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/distros/ubuntu_14.04.yaml").st_ino) 2024-04-25T19:29:38.539 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:38.724 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629955 2024-04-25T19:29:38.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:38.738 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:38.738 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:38.738 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:38.738 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:38.738 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/%").st_ino) 2024-04-25T19:29:38.738 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:38.920 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629915 2024-04-25T19:29:38.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:38.934 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:38.934 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:38.934 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:38.934 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:38.934 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload").st_ino) 2024-04-25T19:29:38.934 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:39.115 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629945 2024-04-25T19:29:39.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:39.129 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:39.129 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:39.129 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:39.129 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:39.129 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rados-snaps-few-objects.yaml").st_ino) 2024-04-25T19:29:39.129 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:39.313 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629947 2024-04-25T19:29:39.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:39.327 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:39.327 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:39.327 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:39.327 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:39.328 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/+").st_ino) 2024-04-25T19:29:39.328 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:39.511 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629946 2024-04-25T19:29:39.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:39.526 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:39.526 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:39.526 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:39.526 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:39.526 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rados_loadgenmix.yaml").st_ino) 2024-04-25T19:29:39.527 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:39.699 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629948 2024-04-25T19:29:39.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:39.712 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:39.712 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:39.712 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:39.712 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:39.712 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rbd_cls.yaml").st_ino) 2024-04-25T19:29:39.713 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:39.896 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629950 2024-04-25T19:29:39.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:39.909 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:39.910 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:39.910 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:39.910 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:39.910 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rados_mon_thrash.yaml").st_ino) 2024-04-25T19:29:39.910 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:40.096 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629949 2024-04-25T19:29:40.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:40.110 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:40.110 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:40.110 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:40.110 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:40.110 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rbd_import_export.yaml").st_ino) 2024-04-25T19:29:40.111 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:40.294 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629951 2024-04-25T19:29:40.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:40.308 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:40.308 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:40.308 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:40.308 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:40.308 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rgw_s3tests.yaml").st_ino) 2024-04-25T19:29:40.308 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:40.489 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629952 2024-04-25T19:29:40.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:40.504 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:40.504 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:40.504 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:40.504 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:40.504 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload").st_ino) 2024-04-25T19:29:40.504 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:40.688 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629920 2024-04-25T19:29:40.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:40.702 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:40.702 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:40.702 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:40.702 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:40.702 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/test_rbd_python.yaml").st_ino) 2024-04-25T19:29:40.703 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:40.883 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629926 2024-04-25T19:29:40.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:40.897 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:40.898 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:40.898 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:40.898 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:40.898 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/rados_api.yaml").st_ino) 2024-04-25T19:29:40.898 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:41.080 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629923 2024-04-25T19:29:41.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:41.094 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:41.094 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:41.094 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:41.094 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:41.094 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/rados_loadgenbig.yaml").st_ino) 2024-04-25T19:29:41.094 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:41.277 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629924 2024-04-25T19:29:41.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:41.290 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:41.290 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:41.290 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:41.291 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:41.291 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/ec-rados-default.yaml").st_ino) 2024-04-25T19:29:41.291 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:41.471 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629922 2024-04-25T19:29:41.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:41.484 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:41.484 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:41.485 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:41.485 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:41.485 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/+").st_ino) 2024-04-25T19:29:41.485 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:41.659 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629921 2024-04-25T19:29:41.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:41.672 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:41.672 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:41.672 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:41.672 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:41.672 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/test_rbd_api.yaml").st_ino) 2024-04-25T19:29:41.673 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:41.847 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629925 2024-04-25T19:29:41.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:41.861 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:41.861 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:41.861 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:41.861 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:41.861 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload").st_ino) 2024-04-25T19:29:41.861 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:42.045 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629934 2024-04-25T19:29:42.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:42.059 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:42.059 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:42.059 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:42.059 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:42.059 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/test_rbd_python.yaml").st_ino) 2024-04-25T19:29:42.059 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:42.241 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629940 2024-04-25T19:29:42.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:42.255 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:42.255 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:42.255 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:42.255 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:42.255 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/rados_api.yaml").st_ino) 2024-04-25T19:29:42.255 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:42.438 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629937 2024-04-25T19:29:42.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:42.452 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:42.452 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:42.452 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:42.452 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:42.452 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/rados_loadgenbig.yaml").st_ino) 2024-04-25T19:29:42.452 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:42.633 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629938 2024-04-25T19:29:42.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:42.646 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:42.646 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:42.647 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:42.647 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:42.647 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/ec-rados-default.yaml").st_ino) 2024-04-25T19:29:42.647 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:42.830 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629936 2024-04-25T19:29:42.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:42.843 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:42.843 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:42.843 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:42.843 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:42.843 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/+").st_ino) 2024-04-25T19:29:42.843 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:43.015 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629935 2024-04-25T19:29:43.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:43.028 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:43.028 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:43.028 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:43.028 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:43.028 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/test_rbd_api.yaml").st_ino) 2024-04-25T19:29:43.028 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:43.212 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629939 2024-04-25T19:29:43.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:43.227 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:43.227 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:43.227 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:43.227 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:43.227 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/5-hammer-jewel-x-upgrade").st_ino) 2024-04-25T19:29:43.227 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:43.399 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629932 2024-04-25T19:29:43.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:43.412 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:43.412 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:43.412 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:43.413 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:43.413 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/5-hammer-jewel-x-upgrade/hammer-jewel-x.yaml").st_ino) 2024-04-25T19:29:43.413 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:43.593 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629933 2024-04-25T19:29:43.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:43.607 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:43.607 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:43.607 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:43.607 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:43.607 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/0-cluster").st_ino) 2024-04-25T19:29:43.607 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:43.791 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629916 2024-04-25T19:29:43.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:43.805 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:43.805 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:43.805 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:43.805 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:43.805 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/0-cluster/start.yaml").st_ino) 2024-04-25T19:29:43.805 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:43.987 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629917 2024-04-25T19:29:43.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:44.001 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:44.001 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:44.001 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:44.001 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:44.001 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split").st_ino) 2024-04-25T19:29:44.002 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:44.184 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629956 2024-04-25T19:29:44.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:44.198 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:44.198 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:44.199 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:44.199 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:44.199 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/6-next-mon").st_ino) 2024-04-25T19:29:44.199 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:44.373 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629965 2024-04-25T19:29:44.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:44.386 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:44.386 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:44.386 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:44.386 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:44.386 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/8-next-mon").st_ino) 2024-04-25T19:29:44.387 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:44.568 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629967 2024-04-25T19:29:44.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:44.583 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:44.583 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:44.583 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:44.583 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:44.584 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/5-workload").st_ino) 2024-04-25T19:29:44.584 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:44.766 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629964 2024-04-25T19:29:44.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:44.780 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:44.780 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:44.780 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:44.780 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:44.780 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/4-mon").st_ino) 2024-04-25T19:29:44.780 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:44.963 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629963 2024-04-25T19:29:44.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:44.976 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:44.976 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:44.976 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:44.977 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:44.977 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/distros").st_ino) 2024-04-25T19:29:44.977 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:45.162 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629969 2024-04-25T19:29:45.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:45.175 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:45.175 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:45.175 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:45.175 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:45.176 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/distros/centos_7.2.yaml").st_ino) 2024-04-25T19:29:45.176 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:45.356 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629970 2024-04-25T19:29:45.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:45.371 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:45.371 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:45.371 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:45.372 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:45.372 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/distros/ubuntu_14.04.yaml").st_ino) 2024-04-25T19:29:45.372 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:45.558 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629971 2024-04-25T19:29:45.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:45.572 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:45.572 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:45.573 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:45.573 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:45.573 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/%").st_ino) 2024-04-25T19:29:45.573 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:45.755 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629957 2024-04-25T19:29:45.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:45.769 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:45.769 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:45.769 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:45.769 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:45.769 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/9-workload").st_ino) 2024-04-25T19:29:45.769 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:45.952 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629968 2024-04-25T19:29:45.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:45.967 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:45.967 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:45.967 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:45.968 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:45.968 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/1-hammer-install-and-upgrade-to-jewel").st_ino) 2024-04-25T19:29:45.968 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:46.150 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629959 2024-04-25T19:29:46.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:46.164 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:46.164 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:46.165 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:46.165 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:46.165 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/1-hammer-install-and-upgrade-to-jewel/hammer-to-jewel.yaml").st_ino) 2024-04-25T19:29:46.165 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:46.347 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629960 2024-04-25T19:29:46.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:46.361 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:46.361 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:46.361 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:46.361 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:46.362 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/2-partial-upgrade").st_ino) 2024-04-25T19:29:46.362 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:46.543 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629961 2024-04-25T19:29:46.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:46.556 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:46.557 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:46.557 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:46.557 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:46.557 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/3-thrash").st_ino) 2024-04-25T19:29:46.557 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:46.740 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629962 2024-04-25T19:29:46.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:46.753 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:46.753 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:46.753 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:46.753 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:46.753 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/7-workload").st_ino) 2024-04-25T19:29:46.754 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:46.935 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629966 2024-04-25T19:29:46.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:46.949 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:46.949 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:46.949 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:46.949 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:46.950 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/0-cluster").st_ino) 2024-04-25T19:29:46.950 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:47.132 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629958 2024-04-25T19:29:47.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:47.146 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:47.146 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:47.146 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:47.146 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:47.146 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade").st_ino) 2024-04-25T19:29:47.146 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:47.330 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629876 2024-04-25T19:29:47.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:47.344 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:47.344 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:47.344 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:47.344 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:47.345 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x").st_ino) 2024-04-25T19:29:47.345 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:47.526 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629877 2024-04-25T19:29:47.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:47.540 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:47.540 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:47.540 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:47.540 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:47.540 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd").st_ino) 2024-04-25T19:29:47.540 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:47.725 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629887 2024-04-25T19:29:47.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:47.739 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:47.739 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:47.739 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:47.739 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:47.739 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/1-install").st_ino) 2024-04-25T19:29:47.739 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:47.921 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629891 2024-04-25T19:29:47.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:47.935 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:47.935 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:47.935 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:47.935 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:47.935 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/1-install/hammer-client-x.yaml").st_ino) 2024-04-25T19:29:47.935 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:48.121 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629892 2024-04-25T19:29:48.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:48.134 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:48.134 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:48.134 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:48.134 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:48.134 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/%").st_ino) 2024-04-25T19:29:48.134 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:48.316 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629888 2024-04-25T19:29:48.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:48.330 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:48.330 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:48.330 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:48.331 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:48.331 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/2-workload").st_ino) 2024-04-25T19:29:48.331 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:48.514 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629893 2024-04-25T19:29:48.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:48.529 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:48.529 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:48.529 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:48.529 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:48.529 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/2-workload/rbd_notification_tests.yaml").st_ino) 2024-04-25T19:29:48.529 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:48.712 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629894 2024-04-25T19:29:48.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:48.725 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:48.726 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:48.726 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:48.726 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:48.726 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/0-cluster").st_ino) 2024-04-25T19:29:48.726 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:48.902 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629889 2024-04-25T19:29:48.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:48.914 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:48.914 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:48.914 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:48.915 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:48.915 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/0-cluster/start.yaml").st_ino) 2024-04-25T19:29:48.915 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:49.096 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629890 2024-04-25T19:29:49.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:49.109 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:49.109 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:49.109 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:49.109 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:49.110 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic").st_ino) 2024-04-25T19:29:49.110 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:49.293 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629878 2024-04-25T19:29:49.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:49.307 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:49.307 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:49.307 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:49.307 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:49.307 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/1-install").st_ino) 2024-04-25T19:29:49.307 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:49.489 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629882 2024-04-25T19:29:49.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:49.502 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:49.502 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:49.502 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:49.502 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:49.502 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/1-install/hammer-client-x.yaml").st_ino) 2024-04-25T19:29:49.502 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:49.685 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629883 2024-04-25T19:29:49.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:49.699 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:49.699 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:49.699 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:49.699 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:49.700 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/%").st_ino) 2024-04-25T19:29:49.700 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:49.882 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629879 2024-04-25T19:29:49.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:49.895 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:49.895 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:49.895 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:49.895 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:49.895 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/2-workload").st_ino) 2024-04-25T19:29:49.895 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:50.078 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629884 2024-04-25T19:29:50.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:50.091 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:50.091 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:50.091 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:50.091 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:50.091 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/2-workload/rbd_cli_import_export.yaml").st_ino) 2024-04-25T19:29:50.092 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:50.278 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629886 2024-04-25T19:29:50.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:50.291 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:50.291 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:50.292 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:50.292 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:50.292 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/2-workload/rbd_api_tests.yaml").st_ino) 2024-04-25T19:29:50.292 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:50.472 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629885 2024-04-25T19:29:50.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:50.485 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:50.485 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:50.486 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:50.486 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:50.486 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/0-cluster").st_ino) 2024-04-25T19:29:50.486 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:50.667 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629880 2024-04-25T19:29:50.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:50.681 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:50.681 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:50.681 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:50.682 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:50.682 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/0-cluster/start.yaml").st_ino) 2024-04-25T19:29:50.682 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:50.865 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629881 2024-04-25T19:29:50.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:50.878 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:50.879 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:50.879 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:50.879 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:50.879 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x").st_ino) 2024-04-25T19:29:50.879 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:51.063 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629895 2024-04-25T19:29:51.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:51.077 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:51.077 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:51.077 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:51.077 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:51.077 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd").st_ino) 2024-04-25T19:29:51.077 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:51.260 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629905 2024-04-25T19:29:51.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:51.273 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:51.273 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:51.273 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:51.273 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:51.273 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/1-install").st_ino) 2024-04-25T19:29:51.273 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:51.458 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629909 2024-04-25T19:29:51.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:51.473 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:51.473 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:51.473 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:51.473 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:51.473 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/1-install/jewel-client-x.yaml").st_ino) 2024-04-25T19:29:51.473 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:51.649 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629910 2024-04-25T19:29:51.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:51.662 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:51.662 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:51.662 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:51.662 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:51.662 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/%").st_ino) 2024-04-25T19:29:51.663 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:51.843 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629906 2024-04-25T19:29:51.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:51.857 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:51.857 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:51.857 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:51.857 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:51.857 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/2-workload").st_ino) 2024-04-25T19:29:51.857 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:52.040 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629911 2024-04-25T19:29:52.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:52.053 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:52.053 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:52.053 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:52.053 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:52.053 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/2-workload/rbd_notification_tests.yaml").st_ino) 2024-04-25T19:29:52.053 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:52.243 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629912 2024-04-25T19:29:52.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:52.257 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:52.258 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:52.258 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:52.258 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:52.258 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/0-cluster").st_ino) 2024-04-25T19:29:52.258 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:52.437 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629907 2024-04-25T19:29:52.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:52.451 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:52.451 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:52.451 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:52.451 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:52.451 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/0-cluster/start.yaml").st_ino) 2024-04-25T19:29:52.451 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:52.623 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629908 2024-04-25T19:29:52.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:52.637 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:52.637 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:52.637 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:52.637 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:52.637 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic").st_ino) 2024-04-25T19:29:52.637 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:52.804 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629896 2024-04-25T19:29:52.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:52.818 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:52.818 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:52.818 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:52.818 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:52.818 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/1-install").st_ino) 2024-04-25T19:29:52.818 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:53.003 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629900 2024-04-25T19:29:53.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:53.017 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:53.017 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:53.017 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:53.017 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:53.017 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/1-install/jewel-client-x.yaml").st_ino) 2024-04-25T19:29:53.017 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:53.201 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629901 2024-04-25T19:29:53.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:53.214 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:53.214 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:53.214 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:53.214 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:53.214 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/%").st_ino) 2024-04-25T19:29:53.214 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:53.397 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629897 2024-04-25T19:29:53.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:53.410 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:53.410 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:53.410 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:53.410 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:53.410 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/2-workload").st_ino) 2024-04-25T19:29:53.410 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:53.595 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629902 2024-04-25T19:29:53.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:53.609 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:53.609 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:53.609 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:53.609 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:53.609 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/2-workload/rbd_cli_import_export.yaml").st_ino) 2024-04-25T19:29:53.609 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:53.791 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629904 2024-04-25T19:29:53.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:53.804 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:53.804 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:53.804 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:53.804 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:53.804 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/2-workload/rbd_api_tests.yaml").st_ino) 2024-04-25T19:29:53.804 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:53.987 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629903 2024-04-25T19:29:53.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:54.001 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:54.001 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:54.001 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:54.001 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:54.001 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/0-cluster").st_ino) 2024-04-25T19:29:54.001 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:54.183 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629898 2024-04-25T19:29:54.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:54.196 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:54.196 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:54.197 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:54.197 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:54.197 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/0-cluster/start.yaml").st_ino) 2024-04-25T19:29:54.197 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:54.376 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629899 2024-04-25T19:29:54.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:54.390 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:54.390 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:54.390 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:54.390 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:54.390 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/dummy").st_ino) 2024-04-25T19:29:54.390 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:54.574 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628540 2024-04-25T19:29:54.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:54.588 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:54.588 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:54.588 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:54.588 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:54.589 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/dummy/%").st_ino) 2024-04-25T19:29:54.589 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:54.771 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628541 2024-04-25T19:29:54.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:54.786 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:54.786 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:54.786 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:54.786 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:54.786 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/dummy/all").st_ino) 2024-04-25T19:29:54.786 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:54.969 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628542 2024-04-25T19:29:54.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:54.983 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:54.983 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:54.983 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:54.983 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:54.983 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/dummy/all/nop.yaml").st_ino) 2024-04-25T19:29:54.983 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:55.164 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628543 2024-04-25T19:29:55.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:55.179 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:55.179 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:55.179 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:55.179 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:55.179 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop").st_ino) 2024-04-25T19:29:55.179 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:55.364 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628809 2024-04-25T19:29:55.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:55.377 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:55.377 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:55.378 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:55.378 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:55.378 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic").st_ino) 2024-04-25T19:29:55.378 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:55.561 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628810 2024-04-25T19:29:55.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:55.576 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:55.576 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:55.576 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:55.576 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:55.576 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic/clusters").st_ino) 2024-04-25T19:29:55.576 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:55.758 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628812 2024-04-25T19:29:55.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:55.773 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:55.773 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:55.773 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:55.773 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:55.773 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic/clusters/fixed-3.yaml").st_ino) 2024-04-25T19:29:55.773 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:55.956 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628813 2024-04-25T19:29:55.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:55.971 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:55.971 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:55.971 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:55.971 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:55.971 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic/%").st_ino) 2024-04-25T19:29:55.971 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:56.154 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628811 2024-04-25T19:29:56.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:56.168 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:56.168 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:56.168 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:56.168 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:56.168 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic/xfs.yaml").st_ino) 2024-04-25T19:29:56.168 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:56.351 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628818 2024-04-25T19:29:56.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:56.365 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:56.365 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:56.365 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:56.365 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:56.365 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic/tasks").st_ino) 2024-04-25T19:29:56.365 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:56.549 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628814 2024-04-25T19:29:56.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:56.563 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:56.563 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:56.563 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:56.563 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:56.563 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic/tasks/wordcount.yaml").st_ino) 2024-04-25T19:29:56.563 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:56.749 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628817 2024-04-25T19:29:56.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:56.763 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:56.763 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:56.763 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:56.763 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:56.763 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic/tasks/repl.yaml").st_ino) 2024-04-25T19:29:56.763 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:56.953 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628815 2024-04-25T19:29:56.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:56.967 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:56.967 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:56.967 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:56.968 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:56.968 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic/tasks/terasort.yaml").st_ino) 2024-04-25T19:29:56.968 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:57.150 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628816 2024-04-25T19:29:57.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:57.164 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:57.164 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:57.164 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:57.164 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:57.164 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology").st_ino) 2024-04-25T19:29:57.164 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:57.347 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629807 2024-04-25T19:29:57.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:57.361 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:57.361 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:57.361 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:57.361 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:57.361 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/integration.yaml").st_ino) 2024-04-25T19:29:57.361 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:57.544 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629822 2024-04-25T19:29:57.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:57.559 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:57.559 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:57.560 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:57.560 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:57.560 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/nop").st_ino) 2024-04-25T19:29:57.560 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:57.744 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629838 2024-04-25T19:29:57.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:57.757 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:57.757 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:57.757 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:57.757 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:57.758 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/nop/%").st_ino) 2024-04-25T19:29:57.758 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:57.938 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629839 2024-04-25T19:29:57.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:57.951 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:57.951 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:57.951 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:57.951 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:57.952 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/nop/all").st_ino) 2024-04-25T19:29:57.952 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:58.134 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629840 2024-04-25T19:29:58.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:58.148 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:58.148 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:58.148 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:58.148 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:58.148 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/nop/all/nop.yaml").st_ino) 2024-04-25T19:29:58.148 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:58.333 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629841 2024-04-25T19:29:58.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:58.348 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:58.348 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:58.348 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:58.349 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:58.349 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/rgw").st_ino) 2024-04-25T19:29:58.349 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:58.531 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629842 2024-04-25T19:29:58.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:58.544 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:58.544 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:58.544 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:58.544 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:58.544 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/rgw/distros").st_ino) 2024-04-25T19:29:58.544 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:58.726 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629844 2024-04-25T19:29:58.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:58.740 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:58.740 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:58.740 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:58.740 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:58.740 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/rgw/%").st_ino) 2024-04-25T19:29:58.740 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:58.922 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629843 2024-04-25T19:29:58.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:58.936 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:58.937 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:58.937 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:58.937 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:58.937 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/rgw/tasks").st_ino) 2024-04-25T19:29:58.937 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:59.118 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629845 2024-04-25T19:29:59.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:59.132 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:59.132 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:59.132 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:59.132 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:59.132 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/rgw/tasks/s3tests-fastcgi.yaml").st_ino) 2024-04-25T19:29:59.132 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:59.315 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629847 2024-04-25T19:29:59.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:59.329 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:59.329 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:59.329 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:59.329 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:59.329 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/rgw/tasks/s3tests-fcgi.yaml").st_ino) 2024-04-25T19:29:59.330 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:59.510 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629848 2024-04-25T19:29:59.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:59.524 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:59.524 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:59.524 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:59.524 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:59.524 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/rgw/tasks/s3tests-civetweb.yaml").st_ino) 2024-04-25T19:29:59.524 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:59.708 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629846 2024-04-25T19:29:59.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:59.721 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:59.721 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:59.721 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:59.721 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:59.721 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/no-ceph").st_ino) 2024-04-25T19:29:59.721 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:29:59.904 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629832 2024-04-25T19:29:59.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:29:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:29:59.918 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:29:59.918 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:29:59.918 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:29:59.918 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:29:59.918 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/no-ceph/clusters").st_ino) 2024-04-25T19:29:59.918 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:00.100 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629834 2024-04-25T19:30:00.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:00.114 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:00.114 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:00.114 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:00.114 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:00.114 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/no-ceph/clusters/single.yaml").st_ino) 2024-04-25T19:30:00.114 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:00.304 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629835 2024-04-25T19:30:00.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:00.318 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:00.318 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:00.318 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:00.318 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:00.318 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/no-ceph/%").st_ino) 2024-04-25T19:30:00.318 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:00.502 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629833 2024-04-25T19:30:00.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:00.516 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:00.516 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:00.516 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:00.516 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:00.516 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/no-ceph/tasks").st_ino) 2024-04-25T19:30:00.517 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:00.700 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629836 2024-04-25T19:30:00.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:00.714 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:00.714 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:00.714 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:00.714 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:00.714 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/no-ceph/tasks/teuthology.yaml").st_ino) 2024-04-25T19:30:00.714 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:00.897 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629837 2024-04-25T19:30:00.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:00.911 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:00.911 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:00.911 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:00.911 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:00.911 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/ceph").st_ino) 2024-04-25T19:30:00.911 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:01.095 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629815 2024-04-25T19:30:01.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:01.108 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:01.108 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:01.108 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:01.109 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:01.109 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/ceph/clusters").st_ino) 2024-04-25T19:30:01.109 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:01.293 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629817 2024-04-25T19:30:01.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:01.307 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:01.307 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:01.307 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:01.307 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:01.307 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/ceph/clusters/single.yaml").st_ino) 2024-04-25T19:30:01.307 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:01.490 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629818 2024-04-25T19:30:01.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:01.504 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:01.504 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:01.504 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:01.504 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:01.504 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/ceph/distros").st_ino) 2024-04-25T19:30:01.504 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:01.690 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629819 2024-04-25T19:30:01.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:01.704 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:01.704 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:01.705 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:01.705 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:01.705 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/ceph/%").st_ino) 2024-04-25T19:30:01.705 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:01.886 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629816 2024-04-25T19:30:01.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:01.900 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:01.900 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:01.900 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:01.900 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:01.900 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/ceph/tasks").st_ino) 2024-04-25T19:30:01.900 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:02.086 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629820 2024-04-25T19:30:02.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:02.099 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:02.099 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:02.100 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:02.100 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:02.100 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/ceph/tasks/teuthology.yaml").st_ino) 2024-04-25T19:30:02.100 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:02.282 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629821 2024-04-25T19:30:02.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:02.295 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:02.295 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:02.296 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:02.296 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:02.296 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/buildpackages").st_ino) 2024-04-25T19:30:02.296 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:02.475 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629808 2024-04-25T19:30:02.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:02.489 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:02.489 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:02.489 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:02.489 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:02.490 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/buildpackages/distros").st_ino) 2024-04-25T19:30:02.490 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:02.672 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629810 2024-04-25T19:30:02.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:02.686 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:02.686 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:02.686 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:02.686 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:02.686 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/buildpackages/%").st_ino) 2024-04-25T19:30:02.686 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:02.869 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629809 2024-04-25T19:30:02.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:02.882 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:02.883 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:02.883 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:02.883 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:02.883 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/buildpackages/tasks").st_ino) 2024-04-25T19:30:02.883 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:03.069 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629811 2024-04-25T19:30:03.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:03.082 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:03.082 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:03.082 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:03.082 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:03.082 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/buildpackages/tasks/default.yaml").st_ino) 2024-04-25T19:30:03.082 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:03.257 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629813 2024-04-25T19:30:03.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:03.270 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:03.270 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:03.270 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:03.270 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:03.270 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/buildpackages/tasks/tag.yaml").st_ino) 2024-04-25T19:30:03.270 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:03.451 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629814 2024-04-25T19:30:03.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:03.465 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:03.465 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:03.465 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:03.465 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:03.465 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/buildpackages/tasks/branch.yaml").st_ino) 2024-04-25T19:30:03.465 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:03.648 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629812 2024-04-25T19:30:03.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:03.661 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:03.661 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:03.661 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:03.661 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:03.661 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster").st_ino) 2024-04-25T19:30:03.662 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:03.844 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629823 2024-04-25T19:30:03.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:03.858 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:03.858 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:03.858 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:03.858 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:03.858 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster/fs").st_ino) 2024-04-25T19:30:03.858 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:04.040 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629830 2024-04-25T19:30:04.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:04.054 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:04.054 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:04.054 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:04.054 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:04.054 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster/fs/xfs.yaml").st_ino) 2024-04-25T19:30:04.054 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:04.238 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629831 2024-04-25T19:30:04.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:04.251 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:04.251 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:04.251 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:04.251 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:04.251 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster/%").st_ino) 2024-04-25T19:30:04.251 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:04.434 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629824 2024-04-25T19:30:04.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:04.448 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:04.448 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:04.448 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:04.448 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:04.448 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster/all").st_ino) 2024-04-25T19:30:04.448 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:04.631 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629825 2024-04-25T19:30:04.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:04.646 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:04.646 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:04.646 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:04.646 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:04.646 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster/all/thrashosds.yaml").st_ino) 2024-04-25T19:30:04.646 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:04.828 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629827 2024-04-25T19:30:04.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:04.842 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:04.842 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:04.842 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:04.842 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:04.842 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster/all/ceph.yaml").st_ino) 2024-04-25T19:30:04.842 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:05.026 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629826 2024-04-25T19:30:05.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:05.040 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:05.041 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:05.041 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:05.041 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:05.041 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster/all/upgrade.yaml").st_ino) 2024-04-25T19:30:05.041 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:05.224 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629828 2024-04-25T19:30:05.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:05.237 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:05.238 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:05.238 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:05.238 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:05.238 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster/all/workunit.yaml").st_ino) 2024-04-25T19:30:05.238 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:05.421 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629829 2024-04-25T19:30:05.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:05.435 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:05.435 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:05.435 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:05.435 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:05.435 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/workunits").st_ino) 2024-04-25T19:30:05.435 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:05.616 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629849 2024-04-25T19:30:05.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:05.629 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:05.630 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:05.630 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:05.630 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:05.630 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/workunits/yes.yaml").st_ino) 2024-04-25T19:30:05.630 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:05.813 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629850 2024-04-25T19:30:05.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:05.826 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:05.827 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:05.827 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:05.827 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:05.827 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds").st_ino) 2024-04-25T19:30:05.827 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:05.999 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629061 2024-04-25T19:30:06.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:06.012 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:06.012 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:06.012 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:06.012 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:06.012 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic").st_ino) 2024-04-25T19:30:06.012 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:06.196 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629062 2024-04-25T19:30:06.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:06.210 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:06.210 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:06.210 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:06.210 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:06.210 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/overrides").st_ino) 2024-04-25T19:30:06.210 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:06.394 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629073 2024-04-25T19:30:06.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:06.408 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:06.408 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:06.408 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:06.408 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:06.408 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/overrides/fuse-default-perm-no.yaml").st_ino) 2024-04-25T19:30:06.408 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:06.590 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629076 2024-04-25T19:30:06.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:06.604 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:06.605 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:06.605 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:06.605 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:06.605 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/overrides/basic").st_ino) 2024-04-25T19:30:06.605 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:06.787 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629075 2024-04-25T19:30:06.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:06.800 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:06.800 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:06.800 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:06.800 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:06.800 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/overrides/%").st_ino) 2024-04-25T19:30:06.800 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:06.987 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629074 2024-04-25T19:30:06.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:07.000 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:07.000 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:07.000 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:07.000 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:07.001 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/clusters").st_ino) 2024-04-25T19:30:07.001 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:07.182 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629065 2024-04-25T19:30:07.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:07.195 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:07.195 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:07.195 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:07.195 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:07.195 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/clusters/9-mds.yaml").st_ino) 2024-04-25T19:30:07.195 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:07.380 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629067 2024-04-25T19:30:07.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:07.393 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:07.393 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:07.393 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:07.393 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:07.393 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/clusters/3-mds.yaml").st_ino) 2024-04-25T19:30:07.393 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:07.577 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629066 2024-04-25T19:30:07.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:07.591 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:07.591 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:07.591 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:07.591 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:07.591 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/fs").st_ino) 2024-04-25T19:30:07.592 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:07.772 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629068 2024-04-25T19:30:07.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:07.787 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:07.787 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:07.787 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:07.787 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:07.787 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/mount").st_ino) 2024-04-25T19:30:07.787 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:07.951 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:30:07.959 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:30:07.970 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629070 2024-04-25T19:30:07.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:07.983 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:07.983 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:07.983 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:07.983 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:07.983 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/mount/kclient.yaml").st_ino) 2024-04-25T19:30:07.984 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:08.152 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629072 2024-04-25T19:30:08.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:08.165 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:08.166 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:08.166 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:08.166 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:08.166 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/mount/fuse.yaml").st_ino) 2024-04-25T19:30:08.166 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:08.299 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629071 2024-04-25T19:30:08.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:08.312 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:08.312 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:08.312 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:08.312 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:08.312 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/inline").st_ino) 2024-04-25T19:30:08.312 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:08.493 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629069 2024-04-25T19:30:08.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:08.507 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:08.507 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:08.507 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:08.507 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:08.507 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/begin.yaml").st_ino) 2024-04-25T19:30:08.507 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:08.689 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629064 2024-04-25T19:30:08.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:08.703 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:08.703 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:08.703 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:08.703 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:08.703 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/%").st_ino) 2024-04-25T19:30:08.703 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:08.887 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629063 2024-04-25T19:30:08.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:08.901 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:08.901 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:08.901 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:08.902 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:08.902 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/tasks").st_ino) 2024-04-25T19:30:08.902 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:09.084 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629077 2024-04-25T19:30:09.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:09.097 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:09.097 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:09.098 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:09.098 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:09.098 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify").st_ino) 2024-04-25T19:30:09.098 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:09.282 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629078 2024-04-25T19:30:09.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:09.296 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:09.297 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:09.297 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:09.297 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:09.297 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/validater").st_ino) 2024-04-25T19:30:09.297 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:09.483 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629093 2024-04-25T19:30:09.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:09.496 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:09.496 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:09.497 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:09.497 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:09.497 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/overrides").st_ino) 2024-04-25T19:30:09.497 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:09.678 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629088 2024-04-25T19:30:09.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:09.691 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:09.691 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:09.692 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:09.692 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:09.692 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/overrides/fuse-default-perm-no.yaml").st_ino) 2024-04-25T19:30:09.692 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:09.879 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629090 2024-04-25T19:30:09.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:09.892 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:09.893 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:09.893 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:09.893 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:09.893 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/overrides/%").st_ino) 2024-04-25T19:30:09.893 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:10.077 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629089 2024-04-25T19:30:10.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:10.090 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:10.091 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:10.091 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:10.091 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:10.091 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/overrides/verify").st_ino) 2024-04-25T19:30:10.091 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:10.274 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629091 2024-04-25T19:30:10.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:10.289 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:10.289 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:10.289 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:10.289 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:10.290 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/clusters").st_ino) 2024-04-25T19:30:10.290 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:10.473 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629081 2024-04-25T19:30:10.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:10.488 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:10.488 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:10.488 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:10.488 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:10.489 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/clusters/9-mds.yaml").st_ino) 2024-04-25T19:30:10.489 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:10.671 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629083 2024-04-25T19:30:10.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:10.685 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:10.685 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:10.685 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:10.685 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:10.685 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/clusters/3-mds.yaml").st_ino) 2024-04-25T19:30:10.685 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:10.869 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629082 2024-04-25T19:30:10.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:10.883 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:10.883 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:10.883 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:10.884 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:10.884 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/fs").st_ino) 2024-04-25T19:30:10.884 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:11.054 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629084 2024-04-25T19:30:11.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:11.067 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:11.068 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:11.068 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:11.068 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:11.068 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/mount").st_ino) 2024-04-25T19:30:11.068 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:11.254 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629085 2024-04-25T19:30:11.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:11.266 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:11.266 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:11.267 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:11.267 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:11.267 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/mount/kclient.yaml").st_ino) 2024-04-25T19:30:11.267 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:11.440 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629087 2024-04-25T19:30:11.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:11.454 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:11.454 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:11.454 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:11.454 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:11.454 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/mount/fuse.yaml").st_ino) 2024-04-25T19:30:11.454 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:11.636 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629086 2024-04-25T19:30:11.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:11.650 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:11.650 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:11.650 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:11.650 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:11.650 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/begin.yaml").st_ino) 2024-04-25T19:30:11.650 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:11.833 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629080 2024-04-25T19:30:11.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:11.847 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:11.848 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:11.848 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:11.848 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:11.848 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/%").st_ino) 2024-04-25T19:30:11.848 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:12.032 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629079 2024-04-25T19:30:12.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:12.046 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:12.046 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:12.046 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:12.046 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:12.046 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/tasks").st_ino) 2024-04-25T19:30:12.047 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:12.224 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629092 2024-04-25T19:30:12.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:12.238 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:12.238 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:12.238 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:12.238 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:12.238 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke").st_ino) 2024-04-25T19:30:12.238 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:12.422 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629732 2024-04-25T19:30:12.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:12.436 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:12.437 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:12.437 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:12.437 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:12.437 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/1node").st_ino) 2024-04-25T19:30:12.437 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:12.620 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629733 2024-04-25T19:30:12.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:12.634 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:12.634 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:12.634 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:12.634 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:12.634 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/1node/clusters").st_ino) 2024-04-25T19:30:12.634 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:12.815 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629735 2024-04-25T19:30:12.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:12.828 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:12.828 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:12.828 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:12.828 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:12.828 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/1node/clusters/openstack.yaml").st_ino) 2024-04-25T19:30:12.828 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:13.009 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629738 2024-04-25T19:30:13.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:13.022 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:13.022 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:13.022 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:13.022 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:13.022 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/1node/clusters/+").st_ino) 2024-04-25T19:30:13.022 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:13.204 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629736 2024-04-25T19:30:13.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:13.217 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:13.217 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:13.217 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:13.218 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:13.218 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/1node/clusters/fixed-1.yaml").st_ino) 2024-04-25T19:30:13.218 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:13.399 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629737 2024-04-25T19:30:13.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:13.413 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:13.413 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:13.413 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:13.413 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:13.413 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/1node/%").st_ino) 2024-04-25T19:30:13.413 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:13.596 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629734 2024-04-25T19:30:13.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:13.610 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:13.610 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:13.610 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:13.610 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:13.610 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/1node/tasks").st_ino) 2024-04-25T19:30:13.610 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:13.791 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629739 2024-04-25T19:30:13.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:13.804 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:13.804 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:13.804 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:13.804 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:13.804 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/1node/tasks/ceph-deploy.yaml").st_ino) 2024-04-25T19:30:13.805 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:13.985 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629740 2024-04-25T19:30:13.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:13.999 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:13.999 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:13.999 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:13.999 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:13.999 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/systemd").st_ino) 2024-04-25T19:30:13.999 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:14.184 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629773 2024-04-25T19:30:14.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:14.197 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:14.197 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:14.197 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:14.197 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:14.197 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/systemd/distro").st_ino) 2024-04-25T19:30:14.198 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:14.380 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629775 2024-04-25T19:30:14.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:14.394 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:14.394 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:14.394 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:14.394 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:14.395 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/systemd/distro/ubuntu_16.04.yaml").st_ino) 2024-04-25T19:30:14.395 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:14.576 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629777 2024-04-25T19:30:14.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:14.590 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:14.591 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:14.591 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:14.591 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:14.591 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/systemd/distro/centos_7.2.yaml").st_ino) 2024-04-25T19:30:14.591 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:14.774 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629776 2024-04-25T19:30:14.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:14.788 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:14.788 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:14.788 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:14.788 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:14.788 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/systemd/%").st_ino) 2024-04-25T19:30:14.789 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:14.976 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629774 2024-04-25T19:30:14.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:14.990 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:14.990 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:14.990 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:14.990 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:14.990 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/systemd/tasks").st_ino) 2024-04-25T19:30:14.990 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:15.172 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629778 2024-04-25T19:30:15.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:15.185 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:15.186 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:15.186 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:15.186 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:15.186 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/systemd/tasks/systemd.yaml").st_ino) 2024-04-25T19:30:15.186 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:15.366 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629779 2024-04-25T19:30:15.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:15.379 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:15.379 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:15.380 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:15.380 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:15.380 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic").st_ino) 2024-04-25T19:30:15.380 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:15.564 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629741 2024-04-25T19:30:15.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:15.579 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:15.579 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:15.579 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:15.579 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:15.579 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/clusters").st_ino) 2024-04-25T19:30:15.579 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:15.763 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629743 2024-04-25T19:30:15.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:15.777 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:15.778 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:15.778 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:15.778 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:15.778 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/clusters/fixed-3-cephfs.yaml").st_ino) 2024-04-25T19:30:15.778 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:15.963 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629744 2024-04-25T19:30:15.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:15.977 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:15.977 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:15.978 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:15.978 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:15.978 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/fs").st_ino) 2024-04-25T19:30:15.978 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:16.161 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629745 2024-04-25T19:30:16.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:16.175 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:16.175 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:16.175 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:16.175 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:16.175 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/fs/btrfs.yaml").st_ino) 2024-04-25T19:30:16.175 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:16.354 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629746 2024-04-25T19:30:16.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:16.367 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:16.367 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:16.367 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:16.367 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:16.368 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/%").st_ino) 2024-04-25T19:30:16.368 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:16.551 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629742 2024-04-25T19:30:16.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:16.564 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:16.564 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:16.564 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:16.564 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:16.564 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks").st_ino) 2024-04-25T19:30:16.564 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:16.745 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629747 2024-04-25T19:30:16.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:16.758 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:16.759 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:16.759 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:16.759 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:16.759 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/libcephfs_interface_tests.yaml").st_ino) 2024-04-25T19:30:16.759 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:16.946 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629756 2024-04-25T19:30:16.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:16.959 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:16.959 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:16.959 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:16.959 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:16.959 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rados_cache_snaps.yaml").st_ino) 2024-04-25T19:30:16.959 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:17.147 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629760 2024-04-25T19:30:17.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:17.161 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:17.161 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:17.161 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:17.161 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:17.161 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rados_cls_all.yaml").st_ino) 2024-04-25T19:30:17.161 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:17.332 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629761 2024-04-25T19:30:17.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:17.345 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:17.345 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:17.345 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:17.345 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:17.345 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rbd_cli_import_export.yaml").st_ino) 2024-04-25T19:30:17.346 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:17.537 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629766 2024-04-25T19:30:17.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:17.550 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:17.550 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:17.550 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:17.550 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:17.551 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/kclient_workunit_suites_fsstress.yaml").st_ino) 2024-04-25T19:30:17.551 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:17.734 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629754 2024-04-25T19:30:17.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:17.748 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:17.748 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:17.748 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:17.748 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:17.748 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/cfuse_workunit_suites_pjd.yaml").st_ino) 2024-04-25T19:30:17.748 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:17.929 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629751 2024-04-25T19:30:17.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:17.942 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:17.942 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:17.942 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:17.942 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:17.943 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/mon_thrash.yaml").st_ino) 2024-04-25T19:30:17.943 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:18.128 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629757 2024-04-25T19:30:18.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:18.141 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:18.141 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:18.141 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:18.141 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:18.141 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/kclient_workunit_direct_io.yaml").st_ino) 2024-04-25T19:30:18.141 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:18.327 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629752 2024-04-25T19:30:18.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:18.340 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:18.341 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:18.341 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:18.341 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:18.341 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rbd_fsx.yaml").st_ino) 2024-04-25T19:30:18.341 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:18.525 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629767 2024-04-25T19:30:18.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:18.539 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:18.539 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:18.539 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:18.539 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:18.539 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rbd_python_api_tests.yaml").st_ino) 2024-04-25T19:30:18.539 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:18.723 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629768 2024-04-25T19:30:18.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:18.736 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:18.737 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:18.737 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:18.737 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:18.737 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rbd_workunit_suites_iozone.yaml").st_ino) 2024-04-25T19:30:18.737 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:18.920 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629769 2024-04-25T19:30:18.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:18.934 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:18.934 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:18.934 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:18.934 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:18.934 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/kclient_workunit_suites_dbench.yaml").st_ino) 2024-04-25T19:30:18.935 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:19.115 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629753 2024-04-25T19:30:19.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:19.129 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:19.129 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:19.129 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:19.129 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:19.130 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rbd_api_tests.yaml").st_ino) 2024-04-25T19:30:19.130 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:19.310 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629765 2024-04-25T19:30:19.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:19.323 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:19.323 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:19.323 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:19.323 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:19.323 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/cfuse_workunit_suites_blogbench.yaml").st_ino) 2024-04-25T19:30:19.323 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:19.504 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629748 2024-04-25T19:30:19.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:19.518 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:19.518 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:19.518 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:19.518 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:19.518 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rados_ec_snaps.yaml").st_ino) 2024-04-25T19:30:19.518 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:19.705 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629762 2024-04-25T19:30:19.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:19.719 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:19.719 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:19.719 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:19.719 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:19.719 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rgw_ec_s3tests.yaml").st_ino) 2024-04-25T19:30:19.719 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:19.901 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629770 2024-04-25T19:30:19.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:19.916 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:19.917 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:19.917 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:19.917 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:19.917 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/kclient_workunit_suites_pjd.yaml").st_ino) 2024-04-25T19:30:19.917 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:20.104 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629755 2024-04-25T19:30:20.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:20.118 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:20.118 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:20.118 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:20.118 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:20.118 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rados_workunit_loadgen_mix.yaml").st_ino) 2024-04-25T19:30:20.118 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:20.302 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629764 2024-04-25T19:30:20.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:20.315 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:20.315 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:20.315 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:20.316 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:20.316 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rados_python.yaml").st_ino) 2024-04-25T19:30:20.316 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:20.503 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629763 2024-04-25T19:30:20.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:20.517 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:20.517 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:20.517 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:20.517 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:20.517 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rgw_swift.yaml").st_ino) 2024-04-25T19:30:20.517 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:20.701 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629772 2024-04-25T19:30:20.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:20.715 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:20.715 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:20.715 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:20.716 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:20.716 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rados_bench.yaml").st_ino) 2024-04-25T19:30:20.716 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:20.899 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629759 2024-04-25T19:30:20.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:20.912 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:20.913 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:20.913 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:20.913 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:20.913 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rados_api_tests.yaml").st_ino) 2024-04-25T19:30:20.913 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:21.102 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629758 2024-04-25T19:30:21.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:21.115 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:21.115 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:21.115 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:21.116 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:21.116 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/cfuse_workunit_suites_fsstress.yaml").st_ino) 2024-04-25T19:30:21.116 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:21.299 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629749 2024-04-25T19:30:21.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:21.312 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:21.312 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:21.312 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:21.312 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:21.312 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rgw_s3tests.yaml").st_ino) 2024-04-25T19:30:21.312 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:21.495 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629771 2024-04-25T19:30:21.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:21.509 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:21.509 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:21.509 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:21.509 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:21.509 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/cfuse_workunit_suites_iozone.yaml").st_ino) 2024-04-25T19:30:21.509 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:21.693 INFO:teuthology.orchestra.run.smithi131.stdout:1099511629750 2024-04-25T19:30:21.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:21.707 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:21.707 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:21.707 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:21.707 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:21.707 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/machine_types").st_ino) 2024-04-25T19:30:21.707 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:21.880 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628439 2024-04-25T19:30:21.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:21.893 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:21.893 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:21.894 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:21.894 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:21.894 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/machine_types/vps.yaml").st_ino) 2024-04-25T19:30:21.894 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:22.073 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628442 2024-04-25T19:30:22.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:22.087 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:22.087 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:22.087 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:22.087 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:22.087 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/machine_types/schedule_rados_ovh.sh").st_ino) 2024-04-25T19:30:22.087 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:22.259 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628441 2024-04-25T19:30:22.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:22.273 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:22.273 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:22.273 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:22.273 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:22.273 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/machine_types/schedule_rados.sh").st_ino) 2024-04-25T19:30:22.273 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:22.456 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628440 2024-04-25T19:30:22.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:22.469 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:22.469 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:22.469 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:22.469 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:22.469 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/mon_kv_backend").st_ino) 2024-04-25T19:30:22.469 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:22.652 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628443 2024-04-25T19:30:22.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:22.665 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:22.666 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:22.666 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:22.666 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:22.666 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/mon_kv_backend/leveldb.yaml").st_ino) 2024-04-25T19:30:22.666 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:22.853 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628444 2024-04-25T19:30:22.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:22.865 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:22.865 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:22.865 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:22.865 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:22.865 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/mon_kv_backend/rocksdb.yaml").st_ino) 2024-04-25T19:30:22.865 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:23.047 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628445 2024-04-25T19:30:23.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:23.060 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:23.060 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:23.060 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:23.060 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:23.061 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/README").st_ino) 2024-04-25T19:30:23.061 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:23.246 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628339 2024-04-25T19:30:23.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:23.260 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:23.260 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:23.260 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:23.260 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:23.260 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks").st_ino) 2024-04-25T19:30:23.260 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:23.442 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630074 2024-04-25T19:30:23.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:23.456 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:23.456 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:23.456 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:23.456 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:23.456 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rebuild_mondb.py").st_ino) 2024-04-25T19:30:23.456 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:23.643 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630188 2024-04-25T19:30:23.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:23.656 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:23.657 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:23.657 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:23.657 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:23.657 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/workunit.py").st_ino) 2024-04-25T19:30:23.657 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:23.839 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630226 2024-04-25T19:30:23.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:23.853 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:23.853 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:23.853 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:23.853 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:23.853 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/osd_backfill.py").st_ino) 2024-04-25T19:30:23.853 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:24.039 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630171 2024-04-25T19:30:24.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:24.052 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:24.052 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:24.052 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:24.052 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:24.052 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/calamari_setup.py").st_ino) 2024-04-25T19:30:24.053 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:24.239 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630099 2024-04-25T19:30:24.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:24.254 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:24.254 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:24.254 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:24.254 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:24.254 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/object_source_down.py").st_ino) 2024-04-25T19:30:24.254 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:24.436 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630169 2024-04-25T19:30:24.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:24.450 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:24.450 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:24.450 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:24.450 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:24.450 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/populate_rbd_pool.py").st_ino) 2024-04-25T19:30:24.450 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:24.626 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630176 2024-04-25T19:30:24.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:24.639 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:24.639 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:24.639 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:24.639 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:24.639 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/util").st_ino) 2024-04-25T19:30:24.639 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:24.820 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630216 2024-04-25T19:30:24.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:24.835 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:24.835 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:24.835 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:24.835 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:24.835 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/util/rgw.py").st_ino) 2024-04-25T19:30:24.835 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:25.020 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630219 2024-04-25T19:30:25.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:25.033 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:25.033 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:25.033 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:25.033 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:25.033 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/util/__init__.py").st_ino) 2024-04-25T19:30:25.033 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:25.219 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630217 2024-04-25T19:30:25.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:25.233 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:25.233 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:25.233 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:25.233 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:25.233 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/util/rados.py").st_ino) 2024-04-25T19:30:25.233 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:25.416 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630218 2024-04-25T19:30:25.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:25.429 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:25.430 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:25.430 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:25.430 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:25.430 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/util/test").st_ino) 2024-04-25T19:30:25.430 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:25.611 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630220 2024-04-25T19:30:25.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:25.625 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:25.625 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:25.625 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:25.625 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:25.625 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/util/test/__init__.py").st_ino) 2024-04-25T19:30:25.625 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:25.806 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630221 2024-04-25T19:30:25.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:25.820 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:25.821 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:25.821 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:25.821 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:25.821 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/util/test/test_rados.py").st_ino) 2024-04-25T19:30:25.821 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:26.002 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630222 2024-04-25T19:30:26.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:26.016 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:26.016 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:26.016 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:26.016 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:26.016 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/osd_failsafe_enospc.py").st_ino) 2024-04-25T19:30:26.016 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:26.201 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630172 2024-04-25T19:30:26.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:26.215 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:26.215 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:26.215 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:26.215 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:26.215 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/osd_recovery.py").st_ino) 2024-04-25T19:30:26.215 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:26.398 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630173 2024-04-25T19:30:26.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:26.412 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:26.412 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:26.412 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:26.412 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:26.413 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/die_on_err.py").st_ino) 2024-04-25T19:30:26.413 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:26.588 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630143 2024-04-25T19:30:26.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:26.601 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:26.601 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:26.601 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:26.601 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:26.602 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/calamari_nosetests.py").st_ino) 2024-04-25T19:30:26.602 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:26.782 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630098 2024-04-25T19:30:26.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:26.796 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:26.797 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:26.797 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:26.797 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:26.797 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/admin_socket.py").st_ino) 2024-04-25T19:30:26.797 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:26.985 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630076 2024-04-25T19:30:26.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:26.999 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:26.999 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:26.999 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:26.999 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:26.999 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mgr").st_ino) 2024-04-25T19:30:26.999 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:27.183 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630157 2024-04-25T19:30:27.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:27.196 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:27.197 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:27.197 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:27.197 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:27.197 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mgr/__init__.py").st_ino) 2024-04-25T19:30:27.197 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:27.383 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630158 2024-04-25T19:30:27.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:27.397 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:27.397 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:27.397 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:27.397 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:27.397 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mgr/test_failover.py").st_ino) 2024-04-25T19:30:27.397 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:27.588 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630160 2024-04-25T19:30:27.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:27.601 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:27.601 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:27.601 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:27.601 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:27.602 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mgr/mgr_test_case.py").st_ino) 2024-04-25T19:30:27.602 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:27.785 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630159 2024-04-25T19:30:27.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:27.798 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:27.799 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:27.799 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:27.799 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:27.799 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/thrash_pool_snaps.py").st_ino) 2024-04-25T19:30:27.799 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:27.982 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630212 2024-04-25T19:30:27.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:27.995 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:27.995 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:27.995 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:27.995 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:27.995 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/userdata_teardown.yaml").st_ino) 2024-04-25T19:30:27.995 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:28.179 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630215 2024-04-25T19:30:28.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:28.194 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:28.194 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:28.194 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:28.194 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:28.194 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/radosbenchsweep.py").st_ino) 2024-04-25T19:30:28.194 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:28.378 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630180 2024-04-25T19:30:28.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:28.392 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:28.392 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:28.392 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:28.392 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:28.392 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mds_thrash.py").st_ino) 2024-04-25T19:30:28.392 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:28.574 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630155 2024-04-25T19:30:28.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:28.588 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:28.588 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:28.588 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:28.588 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:28.588 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rbd.py").st_ino) 2024-04-25T19:30:28.588 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:28.775 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630184 2024-04-25T19:30:28.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:28.788 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:28.788 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:28.788 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:28.788 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:28.788 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rgw.py").st_ino) 2024-04-25T19:30:28.789 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:28.967 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630196 2024-04-25T19:30:28.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:28.981 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:28.981 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:28.981 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:28.981 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:28.981 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/teuthology_integration.py").st_ino) 2024-04-25T19:30:28.981 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:29.163 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630210 2024-04-25T19:30:29.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:29.177 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:29.177 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:29.177 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:29.177 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:29.177 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mon_seesaw.py").st_ino) 2024-04-25T19:30:29.177 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:29.360 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630166 2024-04-25T19:30:29.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:29.374 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:29.375 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:29.375 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:29.375 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:29.375 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/repair_test.py").st_ino) 2024-04-25T19:30:29.375 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:29.559 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630192 2024-04-25T19:30:29.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:29.573 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:29.573 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:29.573 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:29.573 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:29.574 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/watch_notify_same_primary.py").st_ino) 2024-04-25T19:30:29.574 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:29.760 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630224 2024-04-25T19:30:29.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:29.775 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:29.775 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:29.775 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:29.775 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:29.775 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/peer.py").st_ino) 2024-04-25T19:30:29.775 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:29.959 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630174 2024-04-25T19:30:29.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:29.973 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:29.973 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:29.973 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:29.974 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:29.974 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/restart.py").st_ino) 2024-04-25T19:30:29.974 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:30.157 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630195 2024-04-25T19:30:30.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:30.170 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:30.171 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:30.171 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:30.171 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:30.171 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/ceph.py").st_ino) 2024-04-25T19:30:30.171 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:30.357 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630100 2024-04-25T19:30:30.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:30.371 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:30.371 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:30.371 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:30.371 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:30.371 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/tests").st_ino) 2024-04-25T19:30:30.371 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:30.554 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630205 2024-04-25T19:30:30.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:30.567 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:30.567 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:30.567 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:30.567 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:30.567 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/tests/test_buildpackages.py").st_ino) 2024-04-25T19:30:30.567 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:30.752 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630207 2024-04-25T19:30:30.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:30.766 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:30.766 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:30.766 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:30.766 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:30.766 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/tests/test_radosgw_admin.py").st_ino) 2024-04-25T19:30:30.766 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:30.952 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630209 2024-04-25T19:30:30.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:30.967 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:30.967 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:30.967 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:30.967 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:30.967 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/tests/test_devstack.py").st_ino) 2024-04-25T19:30:30.967 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:31.157 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630208 2024-04-25T19:30:31.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:31.171 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:31.171 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:31.171 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:31.172 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:31.172 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/tests/__init__.py").st_ino) 2024-04-25T19:30:31.172 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:31.351 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630206 2024-04-25T19:30:31.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:31.364 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:31.364 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:31.364 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:31.364 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:31.364 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rgw_logsocket.py").st_ino) 2024-04-25T19:30:31.364 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:31.548 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630197 2024-04-25T19:30:31.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:31.561 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:31.561 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:31.561 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:31.561 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:31.561 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/radosgw_admin.py").st_ino) 2024-04-25T19:30:31.561 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:31.743 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630181 2024-04-25T19:30:31.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:31.757 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:31.757 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:31.757 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:31.757 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:31.757 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/ceph_client.py").st_ino) 2024-04-25T19:30:31.757 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:31.939 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630101 2024-04-25T19:30:31.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:31.952 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:31.953 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:31.953 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:31.953 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:31.953 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/__init__.py").st_ino) 2024-04-25T19:30:31.953 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:32.136 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630075 2024-04-25T19:30:32.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:32.150 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:32.150 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:32.151 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:32.151 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:32.151 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/aver.py").st_ino) 2024-04-25T19:30:32.151 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:32.331 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630079 2024-04-25T19:30:32.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:32.345 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:32.345 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:32.345 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:32.345 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:32.345 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cram.py").st_ino) 2024-04-25T19:30:32.345 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:32.529 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630140 2024-04-25T19:30:32.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:32.542 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:32.543 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:32.543 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:32.543 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:32.543 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs").st_ino) 2024-04-25T19:30:32.543 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:32.726 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630107 2024-04-25T19:30:32.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:32.739 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:32.739 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:32.739 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:32.739 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:32.739 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_misc.py").st_ino) 2024-04-25T19:30:32.739 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:32.921 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630131 2024-04-25T19:30:32.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:32.935 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:32.935 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:32.935 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:32.935 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:32.935 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_client_limits.py").st_ino) 2024-04-25T19:30:32.935 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:33.119 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630117 2024-04-25T19:30:33.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:33.132 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:33.132 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:33.132 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:33.132 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:33.132 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_pool_perm.py").st_ino) 2024-04-25T19:30:33.132 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:33.316 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630132 2024-04-25T19:30:33.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:33.329 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:33.329 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:33.329 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:33.330 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:33.330 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_data_scan.py").st_ino) 2024-04-25T19:30:33.330 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:33.515 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630121 2024-04-25T19:30:33.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:33.529 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:33.530 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:33.530 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:33.530 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:33.530 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_client_recovery.py").st_ino) 2024-04-25T19:30:33.530 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:33.712 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630118 2024-04-25T19:30:33.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:33.727 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:33.729 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:33.729 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:33.729 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:33.729 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_journal_migration.py").st_ino) 2024-04-25T19:30:33.729 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:33.914 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630128 2024-04-25T19:30:33.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:33.928 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:33.928 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:33.928 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:33.928 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:33.928 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_dump_tree.py").st_ino) 2024-04-25T19:30:33.928 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:34.114 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630122 2024-04-25T19:30:34.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:34.127 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:34.127 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:34.127 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:34.128 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:34.128 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_mantle.py").st_ino) 2024-04-25T19:30:34.128 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:34.311 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630130 2024-04-25T19:30:34.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:34.324 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:34.324 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:34.325 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:34.325 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:34.325 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_sessionmap.py").st_ino) 2024-04-25T19:30:34.325 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:34.509 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630135 2024-04-25T19:30:34.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:34.523 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:34.523 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:34.523 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:34.523 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:34.523 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/__init__.py").st_ino) 2024-04-25T19:30:34.523 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:34.703 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630108 2024-04-25T19:30:34.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:34.717 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:34.717 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:34.717 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:34.717 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:34.717 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_journal_repair.py").st_ino) 2024-04-25T19:30:34.717 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:34.902 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630129 2024-04-25T19:30:34.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:34.916 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:34.916 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:34.916 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:34.916 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:34.916 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/kernel_mount.py").st_ino) 2024-04-25T19:30:34.916 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:35.098 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630112 2024-04-25T19:30:35.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:35.111 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:35.111 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:35.111 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:35.111 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:35.111 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_cap_flush.py").st_ino) 2024-04-25T19:30:35.111 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:35.293 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630116 2024-04-25T19:30:35.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:35.307 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:35.307 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:35.307 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:35.307 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:35.307 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_readahead.py").st_ino) 2024-04-25T19:30:35.307 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:35.494 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630133 2024-04-25T19:30:35.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:35.508 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:35.508 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:35.508 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:35.508 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:35.508 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_backtrace.py").st_ino) 2024-04-25T19:30:35.508 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:35.682 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630115 2024-04-25T19:30:35.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:35.694 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:35.695 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:35.695 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:35.695 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:35.695 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_auto_repair.py").st_ino) 2024-04-25T19:30:35.695 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:35.880 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630114 2024-04-25T19:30:35.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:35.895 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:35.895 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:35.895 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:35.895 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:35.895 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_strays.py").st_ino) 2024-04-25T19:30:35.895 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:36.078 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630136 2024-04-25T19:30:36.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:36.093 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:36.093 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:36.093 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:36.093 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:36.093 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_volume_client.py").st_ino) 2024-04-25T19:30:36.093 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:36.267 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630137 2024-04-25T19:30:36.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:36.281 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:36.281 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:36.281 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:36.281 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:36.282 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/cephfs_test_case.py").st_ino) 2024-04-25T19:30:36.282 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:36.465 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630109 2024-04-25T19:30:36.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:36.478 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:36.478 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:36.478 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:36.478 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:36.478 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_fragment.py").st_ino) 2024-04-25T19:30:36.479 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:36.661 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630126 2024-04-25T19:30:36.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:36.675 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:36.675 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:36.675 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:36.675 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:36.675 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_failover.py").st_ino) 2024-04-25T19:30:36.675 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:36.859 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630123 2024-04-25T19:30:36.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:36.873 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:36.873 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:36.873 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:36.874 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:36.874 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_full.py").st_ino) 2024-04-25T19:30:36.874 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:37.056 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630127 2024-04-25T19:30:37.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:37.069 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:37.069 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:37.069 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:37.069 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:37.069 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/filesystem.py").st_ino) 2024-04-25T19:30:37.069 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:37.253 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630110 2024-04-25T19:30:37.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:37.267 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:37.267 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:37.267 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:37.267 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:37.267 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/mount.py").st_ino) 2024-04-25T19:30:37.268 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:37.453 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630113 2024-04-25T19:30:37.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:37.467 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:37.467 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:37.467 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:37.467 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:37.467 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_damage.py").st_ino) 2024-04-25T19:30:37.467 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:37.653 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630120 2024-04-25T19:30:37.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:37.667 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:37.667 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:37.667 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:37.667 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:37.667 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_scrub_checks.py").st_ino) 2024-04-25T19:30:37.667 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:37.851 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630134 2024-04-25T19:30:37.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:37.864 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:37.865 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:37.865 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:37.865 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:37.865 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_config_commands.py").st_ino) 2024-04-25T19:30:37.865 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:38.048 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630119 2024-04-25T19:30:38.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:38.062 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:38.062 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:38.062 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:38.062 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:38.062 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_flush.py").st_ino) 2024-04-25T19:30:38.062 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:38.107 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:30:38.116 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:30:38.224 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630124 2024-04-25T19:30:38.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:38.236 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:38.236 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:38.237 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:38.237 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:38.237 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/fuse_mount.py").st_ino) 2024-04-25T19:30:38.237 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:38.421 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630111 2024-04-25T19:30:38.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:38.435 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:38.436 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:38.436 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:38.436 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:38.436 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_forward_scrub.py").st_ino) 2024-04-25T19:30:38.436 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:38.621 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630125 2024-04-25T19:30:38.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:38.635 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:38.635 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:38.635 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:38.635 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:38.635 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/recovery_bench.py").st_ino) 2024-04-25T19:30:38.635 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:38.818 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630189 2024-04-25T19:30:38.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:38.833 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:38.833 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:38.833 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:38.833 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:38.833 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/multibench.py").st_ino) 2024-04-25T19:30:38.833 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:39.022 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630168 2024-04-25T19:30:39.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:39.035 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:39.035 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:39.035 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:39.035 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:39.035 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/devstack.py").st_ino) 2024-04-25T19:30:39.035 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:39.219 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630142 2024-04-25T19:30:39.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:39.233 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:39.234 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:39.234 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:39.234 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:39.234 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs_test_runner.py").st_ino) 2024-04-25T19:30:39.234 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:39.414 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630138 2024-04-25T19:30:39.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:39.428 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:39.428 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:39.428 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:39.428 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:39.428 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/filestore_idempotent.py").st_ino) 2024-04-25T19:30:39.428 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:39.611 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630148 2024-04-25T19:30:39.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:39.625 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:39.625 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:39.625 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:39.625 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:39.626 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mod_proxy_fcgi.tcp.conf.template").st_ino) 2024-04-25T19:30:39.626 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:39.799 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630162 2024-04-25T19:30:39.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:39.813 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:39.813 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:39.813 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:39.813 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:39.813 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/scrub.py").st_ino) 2024-04-25T19:30:39.813 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:39.994 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630202 2024-04-25T19:30:39.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:40.009 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:40.009 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:40.009 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:40.009 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:40.009 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/divergent_priors.py").st_ino) 2024-04-25T19:30:40.009 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:40.192 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630144 2024-04-25T19:30:40.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:40.205 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:40.205 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:40.205 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:40.205 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:40.205 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/samba.py").st_ino) 2024-04-25T19:30:40.205 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:40.390 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630201 2024-04-25T19:30:40.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:40.404 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:40.404 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:40.405 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:40.405 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:40.405 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/watch_notify_stress.py").st_ino) 2024-04-25T19:30:40.405 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:40.588 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630225 2024-04-25T19:30:40.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:40.601 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:40.601 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:40.601 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:40.601 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:40.601 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/boto.cfg.template").st_ino) 2024-04-25T19:30:40.601 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:40.776 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630081 2024-04-25T19:30:40.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:40.790 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:40.790 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:40.790 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:40.790 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:40.791 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages.py").st_ino) 2024-04-25T19:30:40.791 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:40.976 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630082 2024-04-25T19:30:40.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:40.990 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:40.990 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:40.990 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:40.990 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:40.991 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/ceph_test_case.py").st_ino) 2024-04-25T19:30:40.991 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:41.173 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630106 2024-04-25T19:30:41.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:41.187 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:41.188 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:41.188 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:41.188 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:41.188 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/s3roundtrip.py").st_ino) 2024-04-25T19:30:41.188 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:41.371 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630199 2024-04-25T19:30:41.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:41.385 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:41.385 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:41.385 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:41.385 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:41.385 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/qemu.py").st_ino) 2024-04-25T19:30:41.385 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:41.573 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630177 2024-04-25T19:30:41.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:41.587 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:41.587 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:41.587 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:41.587 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:41.587 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/locktest.py").st_ino) 2024-04-25T19:30:41.587 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:41.769 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630150 2024-04-25T19:30:41.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:41.783 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:41.783 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:41.783 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:41.783 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:41.783 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/manypools.py").st_ino) 2024-04-25T19:30:41.783 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:41.969 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630153 2024-04-25T19:30:41.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:41.984 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:41.984 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:41.984 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:41.984 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:41.984 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mds_creation_failure.py").st_ino) 2024-04-25T19:30:41.984 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:42.170 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630154 2024-04-25T19:30:42.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:42.182 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:42.182 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:42.182 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:42.182 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:42.182 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/apache.conf.template").st_ino) 2024-04-25T19:30:42.182 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:42.365 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630077 2024-04-25T19:30:42.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:42.379 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:42.379 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:42.379 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:42.379 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:42.379 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/ec_lost_unfound.py").st_ino) 2024-04-25T19:30:42.379 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:42.563 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630147 2024-04-25T19:30:42.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:42.576 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:42.576 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:42.577 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:42.577 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:42.577 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages").st_ino) 2024-04-25T19:30:42.577 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:42.747 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630083 2024-04-25T19:30:42.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:42.760 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:42.760 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:42.760 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:42.760 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:42.760 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/ubuntu-16.04-user-data.txt").st_ino) 2024-04-25T19:30:42.760 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:42.946 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630096 2024-04-25T19:30:42.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:42.960 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:42.960 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:42.960 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:42.960 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:42.960 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/ubuntu-14.04-user-data.txt").st_ino) 2024-04-25T19:30:42.960 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:43.144 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630095 2024-04-25T19:30:43.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:43.158 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:43.158 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:43.159 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:43.159 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:43.159 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/centos-6.5-user-data.txt").st_ino) 2024-04-25T19:30:43.159 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:43.330 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630085 2024-04-25T19:30:43.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:43.343 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:43.343 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:43.343 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:43.343 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:43.343 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/centos-7.1-user-data.txt").st_ino) 2024-04-25T19:30:43.343 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:43.527 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630087 2024-04-25T19:30:43.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:43.541 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:43.541 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:43.541 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:43.541 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:43.541 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/make-deb.sh").st_ino) 2024-04-25T19:30:43.541 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:43.724 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630091 2024-04-25T19:30:43.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:43.738 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:43.738 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:43.738 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:43.738 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:43.738 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/centos-7.0-user-data.txt").st_ino) 2024-04-25T19:30:43.738 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:43.920 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630086 2024-04-25T19:30:43.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:43.933 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:43.933 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:43.933 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:43.934 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:43.934 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/make-rpm.sh").st_ino) 2024-04-25T19:30:43.934 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:44.116 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630092 2024-04-25T19:30:44.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:44.130 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:44.130 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:44.130 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:44.130 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:44.130 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/opensuse-42.1-user-data.txt").st_ino) 2024-04-25T19:30:44.130 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:44.317 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630093 2024-04-25T19:30:44.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:44.330 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:44.331 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:44.331 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:44.331 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:44.331 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/Makefile").st_ino) 2024-04-25T19:30:44.331 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:44.515 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630084 2024-04-25T19:30:44.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:44.529 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:44.529 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:44.529 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:44.529 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:44.529 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/ubuntu-12.04-user-data.txt").st_ino) 2024-04-25T19:30:44.529 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:44.710 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630094 2024-04-25T19:30:44.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:44.724 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:44.724 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:44.724 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:44.724 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:44.725 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/common.sh").st_ino) 2024-04-25T19:30:44.725 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:44.905 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630089 2024-04-25T19:30:44.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:44.919 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:44.919 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:44.919 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:44.919 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:44.919 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/user-data.txt").st_ino) 2024-04-25T19:30:44.919 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:45.088 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630097 2024-04-25T19:30:45.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:45.101 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:45.101 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:45.101 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:45.101 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:45.101 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/debian-8.0-user-data.txt").st_ino) 2024-04-25T19:30:45.101 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:45.284 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630090 2024-04-25T19:30:45.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:45.297 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:45.298 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:45.298 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:45.298 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:45.298 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/centos-7.2-user-data.txt").st_ino) 2024-04-25T19:30:45.298 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:45.488 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630088 2024-04-25T19:30:45.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:45.501 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:45.501 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:45.501 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:45.501 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:45.501 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rbd_mirror.py").st_ino) 2024-04-25T19:30:45.501 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:45.684 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630187 2024-04-25T19:30:45.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:45.697 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:45.697 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:45.697 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:45.697 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:45.698 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/dump_stuck.py").st_ino) 2024-04-25T19:30:45.698 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:45.879 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630146 2024-04-25T19:30:45.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:45.892 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:45.893 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:45.893 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:45.893 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:45.893 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/ceph_objectstore_tool.py").st_ino) 2024-04-25T19:30:45.893 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:46.077 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630105 2024-04-25T19:30:46.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:46.091 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:46.091 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:46.091 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:46.091 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:46.091 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rbd_fsx.py").st_ino) 2024-04-25T19:30:46.091 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:46.273 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630186 2024-04-25T19:30:46.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:46.286 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:46.286 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:46.286 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:46.286 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:46.287 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/radosgw_agent.py").st_ino) 2024-04-25T19:30:46.287 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:46.468 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630183 2024-04-25T19:30:46.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:46.481 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:46.481 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:46.481 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:46.481 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:46.481 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/tgt.py").st_ino) 2024-04-25T19:30:46.481 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:46.665 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630211 2024-04-25T19:30:46.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:46.679 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:46.679 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:46.679 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:46.679 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:46.679 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/vstart_runner.py").st_ino) 2024-04-25T19:30:46.679 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:46.861 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630223 2024-04-25T19:30:46.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:46.875 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:46.875 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:46.875 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:46.875 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:46.875 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/resolve_stuck_peering.py").st_ino) 2024-04-25T19:30:46.875 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:47.048 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630193 2024-04-25T19:30:47.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:47.061 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:47.062 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:47.062 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:47.062 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:47.062 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rados.py").st_ino) 2024-04-25T19:30:47.062 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:47.239 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630178 2024-04-25T19:30:47.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:47.253 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:47.253 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:47.253 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:47.253 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:47.253 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/s3tests.py").st_ino) 2024-04-25T19:30:47.253 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:47.441 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630200 2024-04-25T19:30:47.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:47.454 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:47.454 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:47.454 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:47.454 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:47.454 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/userdata_setup.yaml").st_ino) 2024-04-25T19:30:47.455 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:47.628 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630214 2024-04-25T19:30:47.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:47.642 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:47.642 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:47.642 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:47.642 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:47.642 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/lost_unfound.py").st_ino) 2024-04-25T19:30:47.642 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:47.825 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630152 2024-04-25T19:30:47.829 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:47.838 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:47.838 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:47.838 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:47.838 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:47.838 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/s3readwrite.py").st_ino) 2024-04-25T19:30:47.838 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:48.021 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630198 2024-04-25T19:30:48.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:48.035 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:48.035 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:48.035 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:48.035 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:48.036 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/ceph_fuse.py").st_ino) 2024-04-25T19:30:48.036 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:48.218 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630103 2024-04-25T19:30:48.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:48.234 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:48.234 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:48.234 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:48.234 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:48.235 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rest_api.py").st_ino) 2024-04-25T19:30:48.235 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:48.414 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630194 2024-04-25T19:30:48.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:48.427 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:48.428 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:48.428 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:48.428 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:48.428 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/reg11184.py").st_ino) 2024-04-25T19:30:48.428 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:48.609 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630190 2024-04-25T19:30:48.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:48.622 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:48.623 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:48.623 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:48.623 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:48.623 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rep_lost_unfound_delete.py").st_ino) 2024-04-25T19:30:48.623 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:48.795 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630191 2024-04-25T19:30:48.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:48.809 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:48.809 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:48.809 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:48.809 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:48.809 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mod_proxy_fcgi.uds.conf.template").st_ino) 2024-04-25T19:30:48.809 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:48.988 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630163 2024-04-25T19:30:48.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:49.001 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:49.001 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:49.001 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:49.002 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:49.002 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/ceph_deploy.py").st_ino) 2024-04-25T19:30:49.002 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:49.184 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630102 2024-04-25T19:30:49.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:49.198 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:49.198 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:49.198 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:49.199 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:49.199 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/ceph_manager.py").st_ino) 2024-04-25T19:30:49.199 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:49.382 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630104 2024-04-25T19:30:49.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:49.396 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:49.396 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:49.396 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:49.396 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:49.397 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/radosbench.py").st_ino) 2024-04-25T19:30:49.397 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:49.579 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630179 2024-04-25T19:30:49.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:49.592 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:49.592 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:49.593 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:49.593 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:49.593 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/scrub_test.py").st_ino) 2024-04-25T19:30:49.593 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:49.777 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630203 2024-04-25T19:30:49.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:49.791 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:49.791 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:49.791 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:49.791 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:49.791 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mon_clock_skew_check.py").st_ino) 2024-04-25T19:30:49.791 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:49.974 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630164 2024-04-25T19:30:49.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:49.988 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:49.988 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:49.988 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:49.988 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:49.988 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/kclient.py").st_ino) 2024-04-25T19:30:49.988 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:50.172 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630149 2024-04-25T19:30:50.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:50.185 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:50.185 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:50.185 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:50.185 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:50.185 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/omapbench.py").st_ino) 2024-04-25T19:30:50.185 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:50.368 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630170 2024-04-25T19:30:50.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:50.382 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:50.382 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:50.382 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:50.382 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:50.382 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/autotest.py").st_ino) 2024-04-25T19:30:50.382 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:50.563 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630078 2024-04-25T19:30:50.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:50.577 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:50.578 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:50.578 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:50.578 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:50.578 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mod_fastcgi.conf.template").st_ino) 2024-04-25T19:30:50.578 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:50.761 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630161 2024-04-25T19:30:50.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:50.774 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:50.775 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:50.775 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:50.775 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:50.775 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/peering_speed_test.py").st_ino) 2024-04-25T19:30:50.775 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:50.956 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630175 2024-04-25T19:30:50.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:50.969 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:50.969 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:50.970 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:50.970 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:50.970 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mon_recovery.py").st_ino) 2024-04-25T19:30:50.970 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:51.159 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630165 2024-04-25T19:30:51.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:51.172 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:51.172 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:51.172 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:51.172 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:51.172 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cifs_mount.py").st_ino) 2024-04-25T19:30:51.172 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:51.354 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630139 2024-04-25T19:30:51.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:51.368 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:51.368 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:51.368 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:51.368 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:51.369 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rbd_fio.py").st_ino) 2024-04-25T19:30:51.369 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:51.542 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630185 2024-04-25T19:30:51.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:51.555 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:51.555 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:51.555 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:51.555 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:51.555 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/logrotate.conf").st_ino) 2024-04-25T19:30:51.556 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:51.737 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630151 2024-04-25T19:30:51.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:51.750 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:51.750 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:51.750 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:51.750 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:51.750 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mon_thrash.py").st_ino) 2024-04-25T19:30:51.751 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:51.933 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630167 2024-04-25T19:30:51.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:51.948 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:51.948 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:51.948 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:51.948 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:51.948 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/metadata.yaml").st_ino) 2024-04-25T19:30:51.949 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:52.131 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630156 2024-04-25T19:30:52.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:52.145 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:52.145 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:52.145 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:52.145 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:52.145 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/divergent_priors2.py").st_ino) 2024-04-25T19:30:52.145 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:52.333 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630145 2024-04-25T19:30:52.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:52.345 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:52.345 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:52.345 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:52.346 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:52.346 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/blktrace.py").st_ino) 2024-04-25T19:30:52.346 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:52.527 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630080 2024-04-25T19:30:52.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:52.540 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:52.540 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:52.540 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:52.540 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:52.540 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/thrashosds.py").st_ino) 2024-04-25T19:30:52.540 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:52.724 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630213 2024-04-25T19:30:52.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:52.737 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:52.737 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:52.737 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:52.737 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:52.737 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/systemd.py").st_ino) 2024-04-25T19:30:52.737 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:52.922 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630204 2024-04-25T19:30:52.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:52.935 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:52.935 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:52.935 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:52.935 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:52.935 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/radosgw_admin_rest.py").st_ino) 2024-04-25T19:30:52.935 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:53.109 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630182 2024-04-25T19:30:53.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:53.123 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:53.123 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:53.123 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:53.123 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:53.123 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/create_verify_lfn_objects.py").st_ino) 2024-04-25T19:30:53.123 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:53.306 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630141 2024-04-25T19:30:53.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:53.320 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:53.320 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:53.320 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:53.320 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:53.320 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/timezone").st_ino) 2024-04-25T19:30:53.320 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:53.508 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630227 2024-04-25T19:30:53.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:53.521 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:53.521 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:53.522 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:53.522 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:53.522 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/timezone/random.yaml").st_ino) 2024-04-25T19:30:53.522 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:53.703 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630230 2024-04-25T19:30:53.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:53.717 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:53.717 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:53.717 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:53.717 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:53.717 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/timezone/eastern.yaml").st_ino) 2024-04-25T19:30:53.718 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:53.902 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630228 2024-04-25T19:30:53.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:53.916 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:53.916 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:53.916 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:53.916 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:53.916 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/timezone/pacific.yaml").st_ino) 2024-04-25T19:30:53.916 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:54.101 INFO:teuthology.orchestra.run.smithi131.stdout:1099511630229 2024-04-25T19:30:54.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:54.115 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:54.115 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:54.115 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:54.115 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:54.115 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.gitignore").st_ino) 2024-04-25T19:30:54.115 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:54.300 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628338 2024-04-25T19:30:54.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:54.314 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:54.314 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:54.314 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:54.314 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:54.314 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/debug").st_ino) 2024-04-25T19:30:54.314 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:54.497 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628386 2024-04-25T19:30:54.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:54.510 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:54.511 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:54.511 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:54.511 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:54.511 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/debug/openstack-30G.yaml").st_ino) 2024-04-25T19:30:54.511 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:54.692 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628390 2024-04-25T19:30:54.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:54.707 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:54.707 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:54.707 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:54.707 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:54.707 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/debug/buildpackages.yaml").st_ino) 2024-04-25T19:30:54.707 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:54.892 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628387 2024-04-25T19:30:54.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:54.906 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:54.906 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:54.906 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:54.906 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:54.906 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/debug/mds_client.yaml").st_ino) 2024-04-25T19:30:54.906 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:55.088 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628388 2024-04-25T19:30:55.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:55.101 DEBUG:teuthology.orchestra.run.smithi131:> stdin-killer -- python3 -c ' 2024-04-25T19:30:55.101 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-25T19:30:55.101 DEBUG:teuthology.orchestra.run.smithi131:> import stat 2024-04-25T19:30:55.101 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-25T19:30:55.101 DEBUG:teuthology.orchestra.run.smithi131:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/debug/openstack-15G.yaml").st_ino) 2024-04-25T19:30:55.101 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-25T19:30:55.281 INFO:teuthology.orchestra.run.smithi131.stdout:1099511628389 2024-04-25T19:30:55.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T19:30:55.295 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:30:55.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.607+0000 7f43f0000640 1 Processor -- start 2024-04-25T19:30:55.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.608+0000 7f43f0000640 1 -- start start 2024-04-25T19:30:55.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.610+0000 7f43f0000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f43e80cf5e0 0x7f43e80cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:55.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.610+0000 7f43f0000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43e80cff30 con 0x7f43e806c5c0 2024-04-25T19:30:55.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.610+0000 7f43f0000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43e815f5f0 con 0x7f43e81443c0 2024-04-25T19:30:55.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.610+0000 7f43f0000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f43e80708d0 con 0x7f43e80cf5e0 2024-04-25T19:30:55.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.610+0000 7f43ee000640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f43e806c5c0 0x7f43e806c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:43196/0 (socket says 172.21.15.131:43196) 2024-04-25T19:30:55.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.610+0000 7f43ee000640 1 -- 172.21.15.131:0/1312189794 learned_addr learned my addr 172.21.15.131:0/1312189794 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:30:55.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.610+0000 7f43ecc00640 1 --2- 172.21.15.131:0/1312189794 >> v2:172.21.15.131:3300/0 conn(0x7f43e80cf5e0 0x7f43e80cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:55.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.611+0000 7f43e7e00640 1 -- 172.21.15.131:0/1312189794 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3562317271 0 0) 0x7f43e0001110 con 0x7f43e806c5c0 2024-04-25T19:30:55.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.611+0000 7f43e7e00640 1 -- 172.21.15.131:0/1312189794 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43d0003520 con 0x7f43e806c5c0 2024-04-25T19:30:55.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.611+0000 7f43ecc00640 1 -- 172.21.15.131:0/1312189794 >> v1:172.21.15.195:6789/0 conn(0x7f43e81443c0 legacy=0x7f43e806fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:55.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.611+0000 7f43ecc00640 1 -- 172.21.15.131:0/1312189794 >> v1:172.21.15.131:6789/0 conn(0x7f43e806c5c0 legacy=0x7f43e806c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:55.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.611+0000 7f43ecc00640 1 -- 172.21.15.131:0/1312189794 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e815e830 con 0x7f43e80cf5e0 2024-04-25T19:30:55.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.613+0000 7f43ecc00640 1 --2- 172.21.15.131:0/1312189794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43e80cf5e0 0x7f43e80cf9f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f43d8009d90 tx=0x7f43d802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eea87b2d33e30e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:30:55.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.613+0000 7f43e7e00640 1 -- 172.21.15.131:0/1312189794 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d8007740 con 0x7f43e80cf5e0 2024-04-25T19:30:55.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.613+0000 7f43e7e00640 1 -- 172.21.15.131:0/1312189794 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d80078e0 con 0x7f43e80cf5e0 2024-04-25T19:30:55.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.613+0000 7f43e7e00640 1 -- 172.21.15.131:0/1312189794 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d8007cb0 con 0x7f43e80cf5e0 2024-04-25T19:30:55.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.614+0000 7f43f0000640 1 -- 172.21.15.131:0/1312189794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43e80cf5e0 msgr2=0x7f43e80cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:55.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.614+0000 7f43f0000640 1 --2- 172.21.15.131:0/1312189794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43e80cf5e0 0x7f43e80cf9f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f43d8009d90 tx=0x7f43d802a6f0 comp rx=0 tx=0).stop 2024-04-25T19:30:55.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.614+0000 7f43f0000640 1 -- 172.21.15.131:0/1312189794 shutdown_connections 2024-04-25T19:30:55.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.614+0000 7f43f0000640 1 --2- 172.21.15.131:0/1312189794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43e80cf5e0 0x7f43e80cf9f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:55.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.614+0000 7f43f0000640 1 -- 172.21.15.131:0/1312189794 >> 172.21.15.131:0/1312189794 conn(0x7f43e80d1ae0 msgr2=0x7f43e80d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:30:55.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.614+0000 7f43f0000640 1 -- 172.21.15.131:0/1312189794 shutdown_connections 2024-04-25T19:30:55.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.614+0000 7f43f0000640 1 -- 172.21.15.131:0/1312189794 wait complete. 2024-04-25T19:30:55.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.616+0000 7f43f0000640 1 Processor -- start 2024-04-25T19:30:55.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.617+0000 7f43f0000640 1 -- start start 2024-04-25T19:30:55.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.618+0000 7f43f0000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43e806c5c0 0x7f43e813f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:55.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.618+0000 7f43f0000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43e80cf5e0 0x7f43e80b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:55.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.618+0000 7f43f0000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43e81443c0 0x7f43e815cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:55.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.618+0000 7f43f0000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f43e815edf0 con 0x7f43e806c5c0 2024-04-25T19:30:55.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.618+0000 7f43f0000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f43e815f160 con 0x7f43e80cf5e0 2024-04-25T19:30:55.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.618+0000 7f43f0000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f43e81447d0 con 0x7f43e81443c0 2024-04-25T19:30:55.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.618+0000 7f43ed600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43e806c5c0 0x7f43e813f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:55.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.618+0000 7f43ed600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43e806c5c0 0x7f43e813f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34322/0 (socket says 172.21.15.131:34322) 2024-04-25T19:30:55.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.618+0000 7f43ed600640 1 -- 172.21.15.131:0/1117445397 learned_addr learned my addr 172.21.15.131:0/1117445397 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:30:55.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.619+0000 7f43ecc00640 1 --2- 172.21.15.131:0/1117445397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43e80cf5e0 0x7f43e80b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:55.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.619+0000 7f43ed600640 1 -- 172.21.15.131:0/1117445397 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43e81443c0 msgr2=0x7f43e815cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:55.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.619+0000 7f43ed600640 1 --2- 172.21.15.131:0/1117445397 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43e81443c0 0x7f43e815cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:55.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.619+0000 7f43ed600640 1 -- 172.21.15.131:0/1117445397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43e80cf5e0 msgr2=0x7f43e80b62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:55.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.619+0000 7f43ed600640 1 --2- 172.21.15.131:0/1117445397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43e80cf5e0 0x7f43e80b62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:55.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.619+0000 7f43ed600640 1 -- 172.21.15.131:0/1117445397 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e80b4e50 con 0x7f43e806c5c0 2024-04-25T19:30:55.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.619+0000 7f43ed600640 1 --2- 172.21.15.131:0/1117445397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43e806c5c0 0x7f43e813f140 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00c440 tx=0x7f43dc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:30:55.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.619+0000 7f43e5600640 1 -- 172.21.15.131:0/1117445397 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc0052d0 con 0x7f43e806c5c0 2024-04-25T19:30:55.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.619+0000 7f43e5600640 1 -- 172.21.15.131:0/1117445397 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43dc005470 con 0x7f43e806c5c0 2024-04-25T19:30:55.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.619+0000 7f43e5600640 1 -- 172.21.15.131:0/1117445397 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc007260 con 0x7f43e806c5c0 2024-04-25T19:30:55.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.620+0000 7f43f0000640 1 -- 172.21.15.131:0/1117445397 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e80b5130 con 0x7f43e806c5c0 2024-04-25T19:30:55.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.620+0000 7f43f0000640 1 -- 172.21.15.131:0/1117445397 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e80b56f0 con 0x7f43e806c5c0 2024-04-25T19:30:55.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.621+0000 7f43f0000640 1 -- 172.21.15.131:0/1117445397 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43e8050740 con 0x7f43e806c5c0 2024-04-25T19:30:55.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.622+0000 7f43e5600640 1 -- 172.21.15.131:0/1117445397 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f43dc007400 con 0x7f43e806c5c0 2024-04-25T19:30:55.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.624+0000 7f43e5600640 1 --2- 172.21.15.131:0/1117445397 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f43cc0744e0 0x7f43cc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:55.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.624+0000 7f43e5600640 1 -- 172.21.15.131:0/1117445397 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f43dc094670 con 0x7f43e806c5c0 2024-04-25T19:30:55.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.624+0000 7f43ecc00640 1 --2- 172.21.15.131:0/1117445397 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f43cc0744e0 0x7f43cc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:55.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.626+0000 7f43ecc00640 1 --2- 172.21.15.131:0/1117445397 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f43cc0744e0 0x7f43cc0769f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f43d8034000 tx=0x7f43d8033040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:30:55.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.629+0000 7f43e5600640 1 -- 172.21.15.131:0/1117445397 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f43dc05ee40 con 0x7f43e806c5c0 2024-04-25T19:30:55.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.869+0000 7f43f0000640 1 -- 172.21.15.131:0/1117445397 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43e806f950 con 0x7f43e806c5c0 2024-04-25T19:30:55.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.870+0000 7f43e5600640 1 -- 172.21.15.131:0/1117445397 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5190 (secure 0 0 0) 0x7f43dc05e740 con 0x7f43e806c5c0 2024-04-25T19:30:55.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:30:55.872 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4706,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3512447940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":3512447940},{"type":"v1","addr":"172.21.15.195:6837","nonce":3512447940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2666088311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":2666088311},{"type":"v1","addr":"172.21.15.195:6836","nonce":2666088311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1450320216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1450320216},{"type":"v1","addr":"172.21.15.131:6834","nonce":1450320216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T19:24:15.727328+0000","modified":"2024-04-25T19:24:18.791952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/274211686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":274211686},{"type":"v1","addr":"172.21.15.131:6835","nonce":274211686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5481,"qdb_cluster":[5481]},"id":3}]} 2024-04-25T19:30:55.872 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 25 2024-04-25T19:30:55.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.873+0000 7f43f0000640 1 -- 172.21.15.131:0/1117445397 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f43cc0744e0 msgr2=0x7f43cc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:55.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.873+0000 7f43f0000640 1 --2- 172.21.15.131:0/1117445397 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f43cc0744e0 0x7f43cc0769f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f43d8034000 tx=0x7f43d8033040 comp rx=0 tx=0).stop 2024-04-25T19:30:55.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.873+0000 7f43f0000640 1 -- 172.21.15.131:0/1117445397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43e806c5c0 msgr2=0x7f43e813f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:55.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.873+0000 7f43f0000640 1 --2- 172.21.15.131:0/1117445397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43e806c5c0 0x7f43e813f140 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00c440 tx=0x7f43dc00c900 comp rx=0 tx=0).stop 2024-04-25T19:30:55.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.873+0000 7f43f0000640 1 -- 172.21.15.131:0/1117445397 shutdown_connections 2024-04-25T19:30:55.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.873+0000 7f43f0000640 1 --2- 172.21.15.131:0/1117445397 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f43cc0744e0 0x7f43cc0769f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:55.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.873+0000 7f43f0000640 1 --2- 172.21.15.131:0/1117445397 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43e81443c0 0x7f43e815cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:55.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.873+0000 7f43f0000640 1 --2- 172.21.15.131:0/1117445397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43e80cf5e0 0x7f43e80b62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:55.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.873+0000 7f43f0000640 1 --2- 172.21.15.131:0/1117445397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43e806c5c0 0x7f43e813f140 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:55.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.873+0000 7f43f0000640 1 -- 172.21.15.131:0/1117445397 >> 172.21.15.131:0/1117445397 conn(0x7f43e80d1ae0 msgr2=0x7f43e806c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:30:55.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.874+0000 7f43f0000640 1 -- 172.21.15.131:0/1117445397 shutdown_connections 2024-04-25T19:30:55.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:55.874+0000 7f43f0000640 1 -- 172.21.15.131:0/1117445397 wait complete. 2024-04-25T19:30:55.901 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump tree /ceph-qa-suite/suites/smoke/1node 2024-04-25T19:30:56.203 INFO:teuthology.orchestra.run.smithi131.stdout:[{"ino":1099511629738,"rdev":0,"ctime":"2024-04-25T19:24:31.580477+0000","btime":"2024-04-25T19:24:31.576477+0000","mode":33188,"uid":1000,"gid":1316,"nlink":1,"dir_layout":{"dir_hash":0,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":4194304,"stripe_count":1,"object_size":4194304,"pool_id":7,"pool_ns":""},"old_pools":[],"size":155,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-04-25T19:24:31.580477+0000","atime":"2024-04-25T19:24:31.576477+0000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":155,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"2024-04-25T19:24:31.580477+0000"},"accounted_rstat":{"version":0,"rbytes":155,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"2024-04-25T19:24:31.580477+0000"},"version":8,"file_data_version":0,"xattr_version":1,"backtrace_version":6,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"lock":0,"caps":1,"dirtyparent":1,"dirty":1,"authpin":0},"nref":3,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4751,"pending":"pAsLsXsFsc","issued":"pAsLsXsFsc","wanted":"-","last_sent":3}],"loner":4751,"want_loner":-1,"mds_caps_wanted":[],"dirfrags":[],"is_subvolume":false},{"ino":1099511629736,"rdev":0,"ctime":"2024-04-25T19:24:31.570477+0000","btime":"2024-04-25T19:24:31.570477+0000","mode":33188,"uid":1000,"gid":1316,"nlink":1,"dir_layout":{"dir_hash":0,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":4194304,"stripe_count":1,"object_size":4194304,"pool_id":7,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-04-25T19:24:31.570477+0000","atime":"2024-04-25T19:24:31.570477+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"0.000000"},"version":10,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"lock":0,"caps":1,"dirtyparent":1,"dirty":1,"authpin":0},"nref":3,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4751,"pending":"pAsLsXsFs","issued":"pAsLsXsFs","wanted":"-","last_sent":3}],"loner":4751,"want_loner":-1,"mds_caps_wanted":[],"dirfrags":[],"is_subvolume":false},{"ino":1099511629737,"rdev":0,"ctime":"2024-04-25T19:24:31.574477+0000","btime":"2024-04-25T19:24:31.574477+0000","mode":41471,"uid":1000,"gid":1316,"nlink":1,"dir_layout":{"dir_hash":0,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":4194304,"stripe_count":1,"object_size":4194304,"pool_id":7,"pool_ns":""},"old_pools":[],"size":33,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-04-25T19:24:31.574477+0000","atime":"2024-04-25T19:24:31.574477+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":33,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":33,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"0.000000"},"version":4,"file_data_version":0,"xattr_version":1,"backtrace_version":4,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"../../../../clusters/fixed-1.yaml","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"caps":1,"dirtyparent":1,"dirty":1},"nref":3,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4751,"pending":"pAsLsXsFscr","issued":"pAsLsXsFscr","wanted":"-","last_sent":2}],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"dirfrags":[],"is_subvolume":false},{"ino":1099511629735,"rdev":0,"ctime":"2024-04-25T19:24:31.576477+0000","btime":"2024-04-25T19:24:31.566477+0000","mode":16877,"uid":1000,"gid":1316,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-04-25T19:24:31.576477+0000","atime":"2024-04-25T19:24:31.566477+0000","time_warp_seq":0,"change_attr":3,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-04-25T19:24:31.576477+0000","num_files":3,"num_subdirs":0,"change_attr":3},"rstat":{"version":0,"rbytes":188,"rfiles":3,"rsubdirs":1,"rsnaps":0,"rctime":"2024-04-25T19:24:31.580477+0000"},"accounted_rstat":{"version":0,"rbytes":188,"rfiles":3,"rsubdirs":1,"rsnaps":0,"rctime":"2024-04-25T19:24:31.580477+0000"},"version":24,"file_data_version":0,"xattr_version":1,"backtrace_version":4,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"authpin":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4751,"pending":"pAsLsXsFsx","issued":"pAsLsXsFsx","wanted":"pAsLsXsFsxcral","last_sent":8}],"loner":4751,"want_loner":4751,"mds_caps_wanted":[],"dirfrags":[{"path":"/ceph-qa-suite/suites/smoke/1node/clusters","dirfrag":"0x100000007a7","snapid_first":2,"projected_version":"11","version":"11","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"dirty":1,"authpin":0},"nref":2,"dentries":[{"path":"ceph-qa-suite/suites/smoke/1node/clusters/openstack.yaml","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511629738,"remote_type":"","version":8,"projected_version":8,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]},{"path":"ceph-qa-suite/suites/smoke/1node/clusters/+","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511629736,"remote_type":"","version":10,"projected_version":10,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]},{"path":"ceph-qa-suite/suites/smoke/1node/clusters/fixed-1.yaml","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511629737,"remote_type":"","version":4,"projected_version":4,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}],"is_subvolume":false},{"ino":1099511629734,"rdev":0,"ctime":"2024-04-25T19:24:31.563477+0000","btime":"2024-04-25T19:24:31.563477+0000","mode":33188,"uid":1000,"gid":1316,"nlink":1,"dir_layout":{"dir_hash":0,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":4194304,"stripe_count":1,"object_size":4194304,"pool_id":7,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-04-25T19:24:31.563477+0000","atime":"2024-04-25T19:24:31.563477+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"0.000000"},"version":22,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"lock":0,"caps":1,"dirtyparent":1,"dirty":1,"authpin":0},"nref":3,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4751,"pending":"pAsLsXsFs","issued":"pAsLsXsFs","wanted":"-","last_sent":3}],"loner":4751,"want_loner":-1,"mds_caps_wanted":[],"dirfrags":[],"is_subvolume":false},{"ino":1099511629740,"rdev":0,"ctime":"2024-04-25T19:24:31.587477+0000","btime":"2024-04-25T19:24:31.584477+0000","mode":33188,"uid":1000,"gid":1316,"nlink":1,"dir_layout":{"dir_hash":0,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":4194304,"stripe_count":1,"object_size":4194304,"pool_id":7,"pool_ns":""},"old_pools":[],"size":216,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-04-25T19:24:31.587477+0000","atime":"2024-04-25T19:24:31.584477+0000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":216,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"2024-04-25T19:24:31.587477+0000"},"accounted_rstat":{"version":0,"rbytes":216,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"2024-04-25T19:24:31.587477+0000"},"version":4,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"lock":0,"caps":1,"dirtyparent":1,"dirty":1,"authpin":0},"nref":3,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4751,"pending":"pAsLsXsFsc","issued":"pAsLsXsFsc","wanted":"-","last_sent":3}],"loner":4751,"want_loner":-1,"mds_caps_wanted":[],"dirfrags":[],"is_subvolume":false},{"ino":1099511629739,"rdev":0,"ctime":"2024-04-25T19:24:31.584477+0000","btime":"2024-04-25T19:24:31.580477+0000","mode":16877,"uid":1000,"gid":1316,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-04-25T19:24:31.584477+0000","atime":"2024-04-25T19:24:31.580477+0000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-04-25T19:24:31.584477+0000","num_files":1,"num_subdirs":0,"change_attr":1},"rstat":{"version":0,"rbytes":216,"rfiles":1,"rsubdirs":1,"rsnaps":0,"rctime":"2024-04-25T19:24:31.587477+0000"},"accounted_rstat":{"version":0,"rbytes":216,"rfiles":1,"rsubdirs":1,"rsnaps":0,"rctime":"2024-04-25T19:24:31.587477+0000"},"version":19,"file_data_version":0,"xattr_version":1,"backtrace_version":12,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"authpin":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4751,"pending":"pAsLsXsFsx","issued":"pAsLsXsFsx","wanted":"pAsLsXsFsxcral","last_sent":6}],"loner":4751,"want_loner":4751,"mds_caps_wanted":[],"dirfrags":[{"path":"/ceph-qa-suite/suites/smoke/1node/tasks","dirfrag":"0x100000007ab","snapid_first":2,"projected_version":"5","version":"5","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"dirty":1,"authpin":0},"nref":2,"dentries":[{"path":"ceph-qa-suite/suites/smoke/1node/tasks/ceph-deploy.yaml","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511629740,"remote_type":"","version":4,"projected_version":4,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}],"is_subvolume":false},{"ino":1099511629733,"rdev":0,"ctime":"2024-04-25T19:24:31.580477+0000","btime":"2024-04-25T19:24:31.558477+0000","mode":16877,"uid":1000,"gid":1316,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-04-25T19:24:31.580477+0000","atime":"2024-04-25T19:24:31.558477+0000","time_warp_seq":0,"change_attr":3,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-04-25T19:24:31.580477+0000","num_files":1,"num_subdirs":2,"change_attr":3},"rstat":{"version":3,"rbytes":404,"rfiles":5,"rsubdirs":3,"rsnaps":0,"rctime":"2024-04-25T19:24:31.587477+0000"},"accounted_rstat":{"version":3,"rbytes":404,"rfiles":5,"rsubdirs":3,"rsnaps":0,"rctime":"2024-04-25T19:24:31.587477+0000"},"version":61,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dirtyscattered":0,"request":0,"lock":0,"dirfrag":1,"caps":1,"dirtyrstat":0,"dirtyparent":1,"dirty":1,"authpin":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4751,"pending":"pAsLsXsFsx","issued":"pAsLsXsFsx","wanted":"pAsLsXsFsxcral","last_sent":8}],"loner":4751,"want_loner":4751,"mds_caps_wanted":[],"dirfrags":[{"path":"/ceph-qa-suite/suites/smoke/1node","dirfrag":"0x100000007a5","snapid_first":2,"projected_version":"26","version":"26","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"dirty":1,"authpin":0},"nref":2,"dentries":[{"path":"ceph-qa-suite/suites/smoke/1node/clusters","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511629735,"remote_type":"","version":24,"projected_version":24,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]},{"path":"ceph-qa-suite/suites/smoke/1node/%","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511629734,"remote_type":"","version":22,"projected_version":22,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]},{"path":"ceph-qa-suite/suites/smoke/1node/tasks","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511629739,"remote_type":"","version":19,"projected_version":19,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}],"is_subvolume":false}] 2024-04-25T19:30:56.207 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "accounted_rstat": { "rbytes": 155, "rctime": "2024-04-25T19:24:31.580477+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "atime": "2024-04-25T19:24:31.576477+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 6, "btime": "2024-04-25T19:24:31.576477+0000", "change_attr": 1, "client_caps": [ { "client_id": 4751, "issued": "pAsLsXsFsc", "last_sent": 3, "pending": "pAsLsXsFsc", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-04-25T19:24:31.580477+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1316, "ino": 1099511629738, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 4194304, "pool_id": 7, "pool_ns": "", "stripe_count": 1, "stripe_unit": 4194304 }, "linklock": {}, "loner": 4751, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 33188, "mtime": "2024-04-25T19:24:31.580477+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirty": 1, "dirtyparent": 1, "lock": 0, "ptrwaiter": 0, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 155, "rctime": "2024-04-25T19:24:31.580477+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "size": 155, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 8, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] }, { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "atime": "2024-04-25T19:24:31.570477+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-04-25T19:24:31.570477+0000", "change_attr": 0, "client_caps": [ { "client_id": 4751, "issued": "pAsLsXsFs", "last_sent": 3, "pending": "pAsLsXsFs", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-04-25T19:24:31.570477+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1316, "ino": 1099511629736, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 4194304, "pool_id": 7, "pool_ns": "", "stripe_count": 1, "stripe_unit": 4194304 }, "linklock": {}, "loner": 4751, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 33188, "mtime": "2024-04-25T19:24:31.570477+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirty": 1, "dirtyparent": 1, "lock": 0, "ptrwaiter": 0, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 10, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] }, { "accounted_rstat": { "rbytes": 33, "rctime": "0.000000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "atime": "2024-04-25T19:24:31.574477+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 4, "btime": "2024-04-25T19:24:31.574477+0000", "change_attr": 0, "client_caps": [ { "client_id": 4751, "issued": "pAsLsXsFscr", "last_sent": 2, "pending": "pAsLsXsFscr", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-04-25T19:24:31.574477+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1316, "ino": 1099511629737, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 4194304, "pool_id": 7, "pool_ns": "", "stripe_count": 1, "stripe_unit": 4194304 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 41471, "mtime": "2024-04-25T19:24:31.574477+0000", "nestlock": {}, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "caps": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 33, "rctime": "0.000000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "size": 33, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "../../../../clusters/fixed-1.yaml", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 4, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] }, { "accounted_rstat": { "rbytes": 188, "rctime": "2024-04-25T19:24:31.580477+0000", "rfiles": 3, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-04-25T19:24:31.566477+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 4, "btime": "2024-04-25T19:24:31.566477+0000", "change_attr": 3, "client_caps": [ { "client_id": 4751, "issued": "pAsLsXsFsx", "last_sent": 8, "pending": "pAsLsXsFsx", "wanted": "pAsLsXsFsxcral" } ], "client_ranges": [], "ctime": "2024-04-25T19:24:31.576477+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dentries": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511629738, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "ceph-qa-suite/suites/smoke/1node/clusters/openstack.yaml", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 8, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 8, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } }, { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511629736, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "ceph-qa-suite/suites/smoke/1node/clusters/+", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 10, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 10, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } }, { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511629737, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "ceph-qa-suite/suites/smoke/1node/clusters/fixed-1.yaml", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 4, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 4, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x100000007a7", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/ceph-qa-suite/suites/smoke/1node/clusters", "pins": { "authpin": 0, "child": 1, "dirty": 1 }, "projected_version": "11", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "11" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 3, "mtime": "2024-04-25T19:24:31.576477+0000", "num_files": 3, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1316, "ino": 1099511629735, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 4751, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-04-25T19:24:31.576477+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "lock": 0, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 188, "rctime": "2024-04-25T19:24:31.580477+0000", "rfiles": 3, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 24, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 4751, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] }, { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "atime": "2024-04-25T19:24:31.563477+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-04-25T19:24:31.563477+0000", "change_attr": 0, "client_caps": [ { "client_id": 4751, "issued": "pAsLsXsFs", "last_sent": 3, "pending": "pAsLsXsFs", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-04-25T19:24:31.563477+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1316, "ino": 1099511629734, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 4194304, "pool_id": 7, "pool_ns": "", "stripe_count": 1, "stripe_unit": 4194304 }, "linklock": {}, "loner": 4751, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 33188, "mtime": "2024-04-25T19:24:31.563477+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirty": 1, "dirtyparent": 1, "lock": 0, "ptrwaiter": 0, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 22, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] }, { "accounted_rstat": { "rbytes": 216, "rctime": "2024-04-25T19:24:31.587477+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "atime": "2024-04-25T19:24:31.584477+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-04-25T19:24:31.584477+0000", "change_attr": 1, "client_caps": [ { "client_id": 4751, "issued": "pAsLsXsFsc", "last_sent": 3, "pending": "pAsLsXsFsc", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-04-25T19:24:31.587477+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1316, "ino": 1099511629740, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 4194304, "pool_id": 7, "pool_ns": "", "stripe_count": 1, "stripe_unit": 4194304 }, "linklock": {}, "loner": 4751, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 33188, "mtime": "2024-04-25T19:24:31.587477+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirty": 1, "dirtyparent": 1, "lock": 0, "ptrwaiter": 0, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 216, "rctime": "2024-04-25T19:24:31.587477+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "size": 216, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 4, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] }, { "accounted_rstat": { "rbytes": 216, "rctime": "2024-04-25T19:24:31.587477+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-04-25T19:24:31.580477+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 12, "btime": "2024-04-25T19:24:31.580477+0000", "change_attr": 1, "client_caps": [ { "client_id": 4751, "issued": "pAsLsXsFsx", "last_sent": 6, "pending": "pAsLsXsFsx", "wanted": "pAsLsXsFsxcral" } ], "client_ranges": [], "ctime": "2024-04-25T19:24:31.584477+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dentries": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511629740, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "ceph-qa-suite/suites/smoke/1node/tasks/ceph-deploy.yaml", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 4, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 4, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x100000007ab", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/ceph-qa-suite/suites/smoke/1node/tasks", "pins": { "authpin": 0, "child": 1, "dirty": 1 }, "projected_version": "5", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 1, "mtime": "2024-04-25T19:24:31.584477+0000", "num_files": 1, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1316, "ino": 1099511629739, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 4751, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-04-25T19:24:31.584477+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "lock": 0, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 216, "rctime": "2024-04-25T19:24:31.587477+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 19, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 4751, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] }, { "accounted_rstat": { "rbytes": 404, "rctime": "2024-04-25T19:24:31.587477+0000", "rfiles": 5, "rsnaps": 0, "rsubdirs": 3, "version": 3 }, "atime": "2024-04-25T19:24:31.558477+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-04-25T19:24:31.558477+0000", "change_attr": 3, "client_caps": [ { "client_id": 4751, "issued": "pAsLsXsFsx", "last_sent": 8, "pending": "pAsLsXsFsx", "wanted": "pAsLsXsFsxcral" } ], "client_ranges": [], "ctime": "2024-04-25T19:24:31.580477+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dentries": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511629735, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "ceph-qa-suite/suites/smoke/1node/clusters", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 24, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 24, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } }, { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511629734, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "ceph-qa-suite/suites/smoke/1node/%", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 22, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 22, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } }, { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511629739, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "ceph-qa-suite/suites/smoke/1node/tasks", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 19, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 19, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x100000007a5", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/ceph-qa-suite/suites/smoke/1node", "pins": { "authpin": 0, "child": 1, "dirty": 1 }, "projected_version": "26", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "26" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 3, "mtime": "2024-04-25T19:24:31.580477+0000", "num_files": 1, "num_subdirs": 2, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1316, "ino": 1099511629733, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 4751, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-04-25T19:24:31.580477+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "dirtyrstat": 0, "dirtyscattered": 0, "lock": 0, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 404, "rctime": "2024-04-25T19:24:31.587477+0000", "rfiles": 5, "rsnaps": 0, "rsubdirs": 3, "version": 3 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 61, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 4751, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } ] 2024-04-25T19:30:56.207 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:30:56.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.477+0000 7f8f1aa00640 1 Processor -- start 2024-04-25T19:30:56.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.477+0000 7f8f1aa00640 1 -- start start 2024-04-25T19:30:56.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.479+0000 7f8f1aa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f140cf2f0 0x7f8f140b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:56.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.479+0000 7f8f1aa00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8f141608d0 0x7f8f14160ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:56.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.479+0000 7f8f1aa00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f14161220 con 0x7f8f1415a810 2024-04-25T19:30:56.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.479+0000 7f8f1aa00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f8f1406f870 con 0x7f8f141608d0 2024-04-25T19:30:56.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.479+0000 7f8f1aa00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8f140b74d0 con 0x7f8f140cf2f0 2024-04-25T19:30:56.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.480+0000 7f8f18c00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f8f1415a810 0x7f8f140b4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:43202/0 (socket says 172.21.15.131:43202) 2024-04-25T19:30:56.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.480+0000 7f8f18c00640 1 -- 172.21.15.131:0/749162843 learned_addr learned my addr 172.21.15.131:0/749162843 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:30:56.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.480+0000 7f8f19600640 1 --2- 172.21.15.131:0/749162843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f140cf2f0 0x7f8f140b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:56.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.480+0000 7f8f1a000640 1 --2- 172.21.15.131:0/749162843 >> v2:172.21.15.195:3300/0 conn(0x7f8f141608d0 0x7f8f14160ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:56.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.480+0000 7f8f13e00640 1 -- 172.21.15.131:0/749162843 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2212931232 0 0) 0x7f8f00001110 con 0x7f8f1415a810 2024-04-25T19:30:56.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.480+0000 7f8f13e00640 1 -- 172.21.15.131:0/749162843 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8efc003520 con 0x7f8f1415a810 2024-04-25T19:30:56.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.481+0000 7f8f13e00640 1 -- 172.21.15.131:0/749162843 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 891335713 0 0) 0x7f8efc003520 con 0x7f8f1415a810 2024-04-25T19:30:56.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.481+0000 7f8f13e00640 1 -- 172.21.15.131:0/749162843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f140cf2f0 msgr2=0x7f8f140b6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:30:56.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.481+0000 7f8f13e00640 1 --2- 172.21.15.131:0/749162843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f140cf2f0 0x7f8f140b6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:56.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.481+0000 7f8f13e00640 1 -- 172.21.15.131:0/749162843 >> v2:172.21.15.195:3300/0 conn(0x7f8f141608d0 msgr2=0x7f8f14160ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:30:56.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.481+0000 7f8f13e00640 1 --2- 172.21.15.131:0/749162843 >> v2:172.21.15.195:3300/0 conn(0x7f8f141608d0 0x7f8f14160ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:56.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.481+0000 7f8f13e00640 1 -- 172.21.15.131:0/749162843 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f140b77b0 con 0x7f8f1415a810 2024-04-25T19:30:56.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.481+0000 7f8f13e00640 1 -- 172.21.15.131:0/749162843 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f8f00001840 con 0x7f8f1415a810 2024-04-25T19:30:56.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.481+0000 7f8f13e00640 1 -- 172.21.15.131:0/749162843 >> v1:172.21.15.131:6789/0 conn(0x7f8f1415a810 legacy=0x7f8f140b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:56.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.481+0000 7f8f13e00640 1 --2- 172.21.15.131:0/749162843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f140cf2f0 0x7f8efc0039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:56.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.481+0000 7f8f13e00640 1 --2- 172.21.15.131:0/749162843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8efc003f50 0x7f8efc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:56.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.481+0000 7f8f13e00640 1 --2- 172.21.15.131:0/749162843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8efc004d40 0x7f8efc005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:56.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.481+0000 7f8f13e00640 1 -- 172.21.15.131:0/749162843 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1406f870 con 0x7f8efc003f50 2024-04-25T19:30:56.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.481+0000 7f8f13e00640 1 -- 172.21.15.131:0/749162843 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8f140b74d0 con 0x7f8efc004d40 2024-04-25T19:30:56.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.481+0000 7f8f13e00640 1 -- 172.21.15.131:0/749162843 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8efc00ba40 con 0x7f8f140cf2f0 2024-04-25T19:30:56.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.481+0000 7f8f18c00640 1 --2- 172.21.15.131:0/749162843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8efc003f50 0x7f8efc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:56.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.482+0000 7f8f1a000640 1 --2- 172.21.15.131:0/749162843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8efc004d40 0x7f8efc005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:56.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.482+0000 7f8f19600640 1 --2- 172.21.15.131:0/749162843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f140cf2f0 0x7f8efc0039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:56.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.482+0000 7f8f18c00640 1 -- 172.21.15.131:0/749162843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f140cf2f0 msgr2=0x7f8efc0039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:30:56.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.482+0000 7f8f18c00640 1 --2- 172.21.15.131:0/749162843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f140cf2f0 0x7f8efc0039d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:56.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.482+0000 7f8f18c00640 1 -- 172.21.15.131:0/749162843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8efc004d40 msgr2=0x7f8efc005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:30:56.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.482+0000 7f8f18c00640 1 --2- 172.21.15.131:0/749162843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8efc004d40 0x7f8efc005150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:56.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.482+0000 7f8f18c00640 1 -- 172.21.15.131:0/749162843 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8efc003520 con 0x7f8efc003f50 2024-04-25T19:30:56.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.483+0000 7f8f18c00640 1 --2- 172.21.15.131:0/749162843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8efc003f50 0x7f8efc004800 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000c4c0 tx=0x7f8efc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adebfd0288b229d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:30:56.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.483+0000 7f8f13e00640 1 -- 172.21.15.131:0/749162843 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f00035070 con 0x7f8efc003f50 2024-04-25T19:30:56.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.483+0000 7f8f13e00640 1 -- 172.21.15.131:0/749162843 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f0002c040 con 0x7f8efc003f50 2024-04-25T19:30:56.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.483+0000 7f8f13e00640 1 -- 172.21.15.131:0/749162843 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0000c0e0 con 0x7f8efc003f50 2024-04-25T19:30:56.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.484+0000 7f8f1aa00640 1 -- 172.21.15.131:0/749162843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8efc003f50 msgr2=0x7f8efc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:56.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.484+0000 7f8f1aa00640 1 --2- 172.21.15.131:0/749162843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8efc003f50 0x7f8efc004800 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000c4c0 tx=0x7f8efc005830 comp rx=0 tx=0).stop 2024-04-25T19:30:56.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.484+0000 7f8f1a000640 1 -- 172.21.15.131:0/749162843 reap_dead start 2024-04-25T19:30:56.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.484+0000 7f8f1aa00640 1 -- 172.21.15.131:0/749162843 shutdown_connections 2024-04-25T19:30:56.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.484+0000 7f8f1aa00640 1 -- 172.21.15.131:0/749162843 >> 172.21.15.131:0/749162843 conn(0x7f8f140d1720 msgr2=0x7f8f140d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:30:56.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.484+0000 7f8f1aa00640 1 -- 172.21.15.131:0/749162843 shutdown_connections 2024-04-25T19:30:56.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.484+0000 7f8f1aa00640 1 -- 172.21.15.131:0/749162843 wait complete. 2024-04-25T19:30:56.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.487+0000 7f8f1aa00640 1 Processor -- start 2024-04-25T19:30:56.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.487+0000 7f8f1aa00640 1 -- start start 2024-04-25T19:30:56.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.488+0000 7f8f1aa00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8efc003f50 0x7f8f1415f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:56.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.488+0000 7f8f1aa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f1415f680 0x7f8f141e69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:56.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.488+0000 7f8f1aa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f141e6f10 0x7f8f141e7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:56.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.488+0000 7f8f1aa00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1415ac20 con 0x7f8f141e6f10 2024-04-25T19:30:56.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.488+0000 7f8f1aa00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1406f500 con 0x7f8efc003f50 2024-04-25T19:30:56.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.488+0000 7f8f1aa00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8f140b6e10 con 0x7f8f1415f680 2024-04-25T19:30:56.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.489+0000 7f8f1a000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f141e6f10 0x7f8f141e7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:56.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.489+0000 7f8f1a000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f141e6f10 0x7f8f141e7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34330/0 (socket says 172.21.15.131:34330) 2024-04-25T19:30:56.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.489+0000 7f8f1a000640 1 -- 172.21.15.131:0/1777966482 learned_addr learned my addr 172.21.15.131:0/1777966482 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:30:56.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.489+0000 7f8f19600640 1 --2- 172.21.15.131:0/1777966482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8efc003f50 0x7f8f1415f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:56.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.489+0000 7f8f18c00640 1 --2- 172.21.15.131:0/1777966482 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f1415f680 0x7f8f141e69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:56.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.489+0000 7f8f1a000640 1 -- 172.21.15.131:0/1777966482 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f1415f680 msgr2=0x7f8f141e69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:56.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.489+0000 7f8f1a000640 1 --2- 172.21.15.131:0/1777966482 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f1415f680 0x7f8f141e69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:56.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.489+0000 7f8f1a000640 1 -- 172.21.15.131:0/1777966482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8efc003f50 msgr2=0x7f8f1415f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:56.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.489+0000 7f8f1a000640 1 --2- 172.21.15.131:0/1777966482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8efc003f50 0x7f8f1415f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:56.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.489+0000 7f8f1a000640 1 -- 172.21.15.131:0/1777966482 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f141e7860 con 0x7f8f141e6f10 2024-04-25T19:30:56.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.489+0000 7f8f19600640 1 --2- 172.21.15.131:0/1777966482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8efc003f50 0x7f8f1415f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:30:56.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.489+0000 7f8f1a000640 1 --2- 172.21.15.131:0/1777966482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f141e6f10 0x7f8f141e7320 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8f14072e90 tx=0x7f8f0c010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:30:56.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.490+0000 7f8f11600640 1 -- 172.21.15.131:0/1777966482 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c00f040 con 0x7f8f141e6f10 2024-04-25T19:30:56.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.490+0000 7f8f11600640 1 -- 172.21.15.131:0/1777966482 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f0c01c070 con 0x7f8f141e6f10 2024-04-25T19:30:56.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.490+0000 7f8f11600640 1 -- 172.21.15.131:0/1777966482 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c00eb10 con 0x7f8f141e6f10 2024-04-25T19:30:56.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.490+0000 7f8f1aa00640 1 -- 172.21.15.131:0/1777966482 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f140cd420 con 0x7f8f141e6f10 2024-04-25T19:30:56.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.490+0000 7f8f1aa00640 1 -- 172.21.15.131:0/1777966482 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f140ccb80 con 0x7f8f141e6f10 2024-04-25T19:30:56.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.491+0000 7f8f1aa00640 1 -- 172.21.15.131:0/1777966482 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f140cc610 con 0x7f8f141e6f10 2024-04-25T19:30:56.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.492+0000 7f8f11600640 1 -- 172.21.15.131:0/1777966482 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8f0c00ecb0 con 0x7f8f141e6f10 2024-04-25T19:30:56.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.493+0000 7f8f11600640 1 --2- 172.21.15.131:0/1777966482 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8ef40744e0 0x7f8ef40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:56.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.493+0000 7f8f11600640 1 -- 172.21.15.131:0/1777966482 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f8f0c094b20 con 0x7f8f141e6f10 2024-04-25T19:30:56.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.494+0000 7f8f19600640 1 --2- 172.21.15.131:0/1777966482 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8ef40744e0 0x7f8ef40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:56.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.495+0000 7f8f19600640 1 --2- 172.21.15.131:0/1777966482 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8ef40744e0 0x7f8ef40769f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800b880 tx=0x7f8f0800f040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:30:56.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.498+0000 7f8f11600640 1 -- 172.21.15.131:0/1777966482 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8f0c025020 con 0x7f8f141e6f10 2024-04-25T19:30:56.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.738+0000 7f8f1aa00640 1 -- 172.21.15.131:0/1777966482 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f14050740 con 0x7f8f141e6f10 2024-04-25T19:30:56.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.740+0000 7f8f11600640 1 -- 172.21.15.131:0/1777966482 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5190 (secure 0 0 0) 0x7f8f0c05f260 con 0x7f8f141e6f10 2024-04-25T19:30:56.741 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:30:56.741 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4706,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3512447940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":3512447940},{"type":"v1","addr":"172.21.15.195:6837","nonce":3512447940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2666088311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":2666088311},{"type":"v1","addr":"172.21.15.195:6836","nonce":2666088311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1450320216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1450320216},{"type":"v1","addr":"172.21.15.131:6834","nonce":1450320216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T19:24:15.727328+0000","modified":"2024-04-25T19:24:18.791952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/274211686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":274211686},{"type":"v1","addr":"172.21.15.131:6835","nonce":274211686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5481,"qdb_cluster":[5481]},"id":3}]} 2024-04-25T19:30:56.742 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 25 2024-04-25T19:30:56.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.743+0000 7f8f1aa00640 1 -- 172.21.15.131:0/1777966482 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8ef40744e0 msgr2=0x7f8ef40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:56.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.743+0000 7f8f1aa00640 1 --2- 172.21.15.131:0/1777966482 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8ef40744e0 0x7f8ef40769f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800b880 tx=0x7f8f0800f040 comp rx=0 tx=0).stop 2024-04-25T19:30:56.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.743+0000 7f8f1aa00640 1 -- 172.21.15.131:0/1777966482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f141e6f10 msgr2=0x7f8f141e7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:56.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.743+0000 7f8f1aa00640 1 --2- 172.21.15.131:0/1777966482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f141e6f10 0x7f8f141e7320 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8f14072e90 tx=0x7f8f0c010c20 comp rx=0 tx=0).stop 2024-04-25T19:30:56.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.743+0000 7f8f1aa00640 1 -- 172.21.15.131:0/1777966482 shutdown_connections 2024-04-25T19:30:56.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.743+0000 7f8f1aa00640 1 --2- 172.21.15.131:0/1777966482 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8ef40744e0 0x7f8ef40769f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:56.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.743+0000 7f8f1aa00640 1 --2- 172.21.15.131:0/1777966482 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f1415f680 0x7f8f141e69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:56.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.743+0000 7f8f1aa00640 1 --2- 172.21.15.131:0/1777966482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f141e6f10 0x7f8f141e7320 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:56.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.743+0000 7f8f1aa00640 1 --2- 172.21.15.131:0/1777966482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8efc003f50 0x7f8f1415f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:56.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.743+0000 7f8f1aa00640 1 -- 172.21.15.131:0/1777966482 >> 172.21.15.131:0/1777966482 conn(0x7f8f140d1720 msgr2=0x7f8f14073960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:30:56.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.743+0000 7f8f1aa00640 1 -- 172.21.15.131:0/1777966482 shutdown_connections 2024-04-25T19:30:56.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:56.743+0000 7f8f1aa00640 1 -- 172.21.15.131:0/1777966482 wait complete. 2024-04-25T19:30:56.768 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump tree /ceph-qa-suite/suites/smoke/1node 1 2024-04-25T19:30:57.048 INFO:teuthology.orchestra.run.smithi131.stdout:[{"ino":1099511629735,"rdev":0,"ctime":"2024-04-25T19:24:31.576477+0000","btime":"2024-04-25T19:24:31.566477+0000","mode":16877,"uid":1000,"gid":1316,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-04-25T19:24:31.576477+0000","atime":"2024-04-25T19:24:31.566477+0000","time_warp_seq":0,"change_attr":3,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-04-25T19:24:31.576477+0000","num_files":3,"num_subdirs":0,"change_attr":3},"rstat":{"version":0,"rbytes":188,"rfiles":3,"rsubdirs":1,"rsnaps":0,"rctime":"2024-04-25T19:24:31.580477+0000"},"accounted_rstat":{"version":0,"rbytes":188,"rfiles":3,"rsubdirs":1,"rsnaps":0,"rctime":"2024-04-25T19:24:31.580477+0000"},"version":24,"file_data_version":0,"xattr_version":1,"backtrace_version":4,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"authpin":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4751,"pending":"pAsLsXsFsx","issued":"pAsLsXsFsx","wanted":"pAsLsXsFsxcral","last_sent":8}],"loner":4751,"want_loner":4751,"mds_caps_wanted":[],"dirfrags":[{"path":"/ceph-qa-suite/suites/smoke/1node/clusters","dirfrag":"0x100000007a7","snapid_first":2,"projected_version":"11","version":"11","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"dirty":1,"authpin":0},"nref":2,"dentries":[{"path":"ceph-qa-suite/suites/smoke/1node/clusters/openstack.yaml","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511629738,"remote_type":"","version":8,"projected_version":8,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]},{"path":"ceph-qa-suite/suites/smoke/1node/clusters/+","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511629736,"remote_type":"","version":10,"projected_version":10,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]},{"path":"ceph-qa-suite/suites/smoke/1node/clusters/fixed-1.yaml","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511629737,"remote_type":"","version":4,"projected_version":4,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}],"is_subvolume":false},{"ino":1099511629734,"rdev":0,"ctime":"2024-04-25T19:24:31.563477+0000","btime":"2024-04-25T19:24:31.563477+0000","mode":33188,"uid":1000,"gid":1316,"nlink":1,"dir_layout":{"dir_hash":0,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":4194304,"stripe_count":1,"object_size":4194304,"pool_id":7,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-04-25T19:24:31.563477+0000","atime":"2024-04-25T19:24:31.563477+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"0.000000"},"version":22,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"lock":0,"caps":1,"dirtyparent":1,"dirty":1,"authpin":0},"nref":3,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4751,"pending":"pAsLsXsFs","issued":"pAsLsXsFs","wanted":"-","last_sent":3}],"loner":4751,"want_loner":-1,"mds_caps_wanted":[],"dirfrags":[],"is_subvolume":false},{"ino":1099511629739,"rdev":0,"ctime":"2024-04-25T19:24:31.584477+0000","btime":"2024-04-25T19:24:31.580477+0000","mode":16877,"uid":1000,"gid":1316,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-04-25T19:24:31.584477+0000","atime":"2024-04-25T19:24:31.580477+0000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-04-25T19:24:31.584477+0000","num_files":1,"num_subdirs":0,"change_attr":1},"rstat":{"version":0,"rbytes":216,"rfiles":1,"rsubdirs":1,"rsnaps":0,"rctime":"2024-04-25T19:24:31.587477+0000"},"accounted_rstat":{"version":0,"rbytes":216,"rfiles":1,"rsubdirs":1,"rsnaps":0,"rctime":"2024-04-25T19:24:31.587477+0000"},"version":19,"file_data_version":0,"xattr_version":1,"backtrace_version":12,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"authpin":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4751,"pending":"pAsLsXsFsx","issued":"pAsLsXsFsx","wanted":"pAsLsXsFsxcral","last_sent":6}],"loner":4751,"want_loner":4751,"mds_caps_wanted":[],"dirfrags":[{"path":"/ceph-qa-suite/suites/smoke/1node/tasks","dirfrag":"0x100000007ab","snapid_first":2,"projected_version":"5","version":"5","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"dirty":1,"authpin":0},"nref":2,"dentries":[{"path":"ceph-qa-suite/suites/smoke/1node/tasks/ceph-deploy.yaml","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511629740,"remote_type":"","version":4,"projected_version":4,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}],"is_subvolume":false},{"ino":1099511629733,"rdev":0,"ctime":"2024-04-25T19:24:31.580477+0000","btime":"2024-04-25T19:24:31.558477+0000","mode":16877,"uid":1000,"gid":1316,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-04-25T19:24:31.580477+0000","atime":"2024-04-25T19:24:31.558477+0000","time_warp_seq":0,"change_attr":3,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-04-25T19:24:31.580477+0000","num_files":1,"num_subdirs":2,"change_attr":3},"rstat":{"version":3,"rbytes":404,"rfiles":5,"rsubdirs":3,"rsnaps":0,"rctime":"2024-04-25T19:24:31.587477+0000"},"accounted_rstat":{"version":3,"rbytes":404,"rfiles":5,"rsubdirs":3,"rsnaps":0,"rctime":"2024-04-25T19:24:31.587477+0000"},"version":61,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dirtyscattered":0,"request":0,"lock":0,"dirfrag":1,"caps":1,"dirtyrstat":0,"dirtyparent":1,"dirty":1,"authpin":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4751,"pending":"pAsLsXsFsx","issued":"pAsLsXsFsx","wanted":"pAsLsXsFsxcral","last_sent":8}],"loner":4751,"want_loner":4751,"mds_caps_wanted":[],"dirfrags":[{"path":"/ceph-qa-suite/suites/smoke/1node","dirfrag":"0x100000007a5","snapid_first":2,"projected_version":"26","version":"26","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"dirty":1,"authpin":0},"nref":2,"dentries":[{"path":"ceph-qa-suite/suites/smoke/1node/clusters","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511629735,"remote_type":"","version":24,"projected_version":24,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]},{"path":"ceph-qa-suite/suites/smoke/1node/%","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511629734,"remote_type":"","version":22,"projected_version":22,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]},{"path":"ceph-qa-suite/suites/smoke/1node/tasks","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511629739,"remote_type":"","version":19,"projected_version":19,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}],"is_subvolume":false}] 2024-04-25T19:30:57.052 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "accounted_rstat": { "rbytes": 188, "rctime": "2024-04-25T19:24:31.580477+0000", "rfiles": 3, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-04-25T19:24:31.566477+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 4, "btime": "2024-04-25T19:24:31.566477+0000", "change_attr": 3, "client_caps": [ { "client_id": 4751, "issued": "pAsLsXsFsx", "last_sent": 8, "pending": "pAsLsXsFsx", "wanted": "pAsLsXsFsxcral" } ], "client_ranges": [], "ctime": "2024-04-25T19:24:31.576477+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dentries": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511629738, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "ceph-qa-suite/suites/smoke/1node/clusters/openstack.yaml", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 8, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 8, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } }, { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511629736, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "ceph-qa-suite/suites/smoke/1node/clusters/+", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 10, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 10, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } }, { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511629737, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "ceph-qa-suite/suites/smoke/1node/clusters/fixed-1.yaml", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 4, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 4, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x100000007a7", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/ceph-qa-suite/suites/smoke/1node/clusters", "pins": { "authpin": 0, "child": 1, "dirty": 1 }, "projected_version": "11", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "11" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 3, "mtime": "2024-04-25T19:24:31.576477+0000", "num_files": 3, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1316, "ino": 1099511629735, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 4751, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-04-25T19:24:31.576477+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "lock": 0, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 188, "rctime": "2024-04-25T19:24:31.580477+0000", "rfiles": 3, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 24, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 4751, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] }, { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "atime": "2024-04-25T19:24:31.563477+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-04-25T19:24:31.563477+0000", "change_attr": 0, "client_caps": [ { "client_id": 4751, "issued": "pAsLsXsFs", "last_sent": 3, "pending": "pAsLsXsFs", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-04-25T19:24:31.563477+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1316, "ino": 1099511629734, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 4194304, "pool_id": 7, "pool_ns": "", "stripe_count": 1, "stripe_unit": 4194304 }, "linklock": {}, "loner": 4751, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 33188, "mtime": "2024-04-25T19:24:31.563477+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirty": 1, "dirtyparent": 1, "lock": 0, "ptrwaiter": 0, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 22, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] }, { "accounted_rstat": { "rbytes": 216, "rctime": "2024-04-25T19:24:31.587477+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-04-25T19:24:31.580477+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 12, "btime": "2024-04-25T19:24:31.580477+0000", "change_attr": 1, "client_caps": [ { "client_id": 4751, "issued": "pAsLsXsFsx", "last_sent": 6, "pending": "pAsLsXsFsx", "wanted": "pAsLsXsFsxcral" } ], "client_ranges": [], "ctime": "2024-04-25T19:24:31.584477+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dentries": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511629740, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "ceph-qa-suite/suites/smoke/1node/tasks/ceph-deploy.yaml", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 4, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 4, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x100000007ab", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/ceph-qa-suite/suites/smoke/1node/tasks", "pins": { "authpin": 0, "child": 1, "dirty": 1 }, "projected_version": "5", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 1, "mtime": "2024-04-25T19:24:31.584477+0000", "num_files": 1, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1316, "ino": 1099511629739, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 4751, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-04-25T19:24:31.584477+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "lock": 0, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 216, "rctime": "2024-04-25T19:24:31.587477+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 19, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 4751, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] }, { "accounted_rstat": { "rbytes": 404, "rctime": "2024-04-25T19:24:31.587477+0000", "rfiles": 5, "rsnaps": 0, "rsubdirs": 3, "version": 3 }, "atime": "2024-04-25T19:24:31.558477+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-04-25T19:24:31.558477+0000", "change_attr": 3, "client_caps": [ { "client_id": 4751, "issued": "pAsLsXsFsx", "last_sent": 8, "pending": "pAsLsXsFsx", "wanted": "pAsLsXsFsxcral" } ], "client_ranges": [], "ctime": "2024-04-25T19:24:31.580477+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dentries": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511629735, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "ceph-qa-suite/suites/smoke/1node/clusters", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 24, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 24, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } }, { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511629734, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "ceph-qa-suite/suites/smoke/1node/%", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 22, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 22, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } }, { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511629739, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "ceph-qa-suite/suites/smoke/1node/tasks", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 19, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 19, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x100000007a5", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/ceph-qa-suite/suites/smoke/1node", "pins": { "authpin": 0, "child": 1, "dirty": 1 }, "projected_version": "26", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "26" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 3, "mtime": "2024-04-25T19:24:31.580477+0000", "num_files": 1, "num_subdirs": 2, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1316, "ino": 1099511629733, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 4751, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-04-25T19:24:31.580477+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "dirtyrstat": 0, "dirtyscattered": 0, "lock": 0, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 404, "rctime": "2024-04-25T19:24:31.587477+0000", "rfiles": 5, "rsnaps": 0, "rsubdirs": 3, "version": 3 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 61, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 4751, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } ] 2024-04-25T19:30:57.052 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T19:30:57.052 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T19:30:57.161 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T19:30:57.267 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T19:30:57.267 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T19:30:57.267 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:30:57.267 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:30:57.323 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:30:57.323 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:30:57.375 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:30:57.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.648+0000 7f31eb200640 1 Processor -- start 2024-04-25T19:30:57.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.648+0000 7f31eb200640 1 -- start start 2024-04-25T19:30:57.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.650+0000 7f31eb200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f31ec0cf2f0 0x7f31ec0b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:57.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.650+0000 7f31eb200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31ec1608d0 0x7f31ec160ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:57.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.650+0000 7f31eb200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31ec161220 con 0x7f31ec15a810 2024-04-25T19:30:57.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.650+0000 7f31eb200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f31ec06f870 con 0x7f31ec0cf2f0 2024-04-25T19:30:57.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.650+0000 7f31eb200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f31ec0b74d0 con 0x7f31ec1608d0 2024-04-25T19:30:57.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.651+0000 7f31e9e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f31ec0cf2f0 0x7f31ec0b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:57.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.651+0000 7f31ea800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31ec1608d0 0x7f31ec160ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:57.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.651+0000 7f31ea800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31ec1608d0 0x7f31ec160ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.131:41108/0 (socket says 172.21.15.131:41108) 2024-04-25T19:30:57.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.651+0000 7f31e9e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f31ec0cf2f0 0x7f31ec0b6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.131:33392/0 (socket says 172.21.15.131:33392) 2024-04-25T19:30:57.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.651+0000 7f31ea800640 1 -- 172.21.15.131:0/1726798682 learned_addr learned my addr 172.21.15.131:0/1726798682 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:30:57.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.652+0000 7f31e9e00640 1 -- 172.21.15.131:0/1726798682 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31ec1608d0 msgr2=0x7f31ec160ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:30:57.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.652+0000 7f31e9e00640 1 --2- 172.21.15.131:0/1726798682 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31ec1608d0 0x7f31ec160ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:57.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.652+0000 7f31e9e00640 1 -- 172.21.15.131:0/1726798682 >> v1:172.21.15.195:6789/0 conn(0x7f31ec15a810 legacy=0x7f31ec0b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:57.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.652+0000 7f31e9e00640 1 -- 172.21.15.131:0/1726798682 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ec0b77b0 con 0x7f31ec0cf2f0 2024-04-25T19:30:57.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.653+0000 7f31e9e00640 1 --2- 172.21.15.131:0/1726798682 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31ec0cf2f0 0x7f31ec0b6e10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f31dc0097a0 tx=0x7f31dc02c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d75444605d5ee1a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:30:57.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.654+0000 7f31e9400640 1 -- 172.21.15.131:0/1726798682 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc039070 con 0x7f31ec0cf2f0 2024-04-25T19:30:57.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.654+0000 7f31e9400640 1 -- 172.21.15.131:0/1726798682 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31dc034640 con 0x7f31ec0cf2f0 2024-04-25T19:30:57.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.654+0000 7f31e9400640 1 -- 172.21.15.131:0/1726798682 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc034a10 con 0x7f31ec0cf2f0 2024-04-25T19:30:57.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.655+0000 7f31eb200640 1 -- 172.21.15.131:0/1726798682 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31ec0cf2f0 msgr2=0x7f31ec0b6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:57.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.655+0000 7f31eb200640 1 --2- 172.21.15.131:0/1726798682 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31ec0cf2f0 0x7f31ec0b6e10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f31dc0097a0 tx=0x7f31dc02c390 comp rx=0 tx=0).stop 2024-04-25T19:30:57.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.655+0000 7f31eb200640 1 -- 172.21.15.131:0/1726798682 shutdown_connections 2024-04-25T19:30:57.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.655+0000 7f31eb200640 1 --2- 172.21.15.131:0/1726798682 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31ec1608d0 0x7f31ec160ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:57.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.655+0000 7f31eb200640 1 --2- 172.21.15.131:0/1726798682 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31ec0cf2f0 0x7f31ec0b6e10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:57.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.655+0000 7f31eb200640 1 -- 172.21.15.131:0/1726798682 >> 172.21.15.131:0/1726798682 conn(0x7f31ec0d1720 msgr2=0x7f31ec0d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:30:57.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.655+0000 7f31eb200640 1 -- 172.21.15.131:0/1726798682 shutdown_connections 2024-04-25T19:30:57.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.655+0000 7f31eb200640 1 -- 172.21.15.131:0/1726798682 wait complete. 2024-04-25T19:30:57.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.657+0000 7f31eb200640 1 Processor -- start 2024-04-25T19:30:57.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.657+0000 7f31eb200640 1 -- start start 2024-04-25T19:30:57.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.659+0000 7f31eb200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31ec0cf2f0 0x7f31ec1482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:57.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.659+0000 7f31eb200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31ec15a810 0x7f31ec15e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:57.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.659+0000 7f31eb200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31ec1608d0 0x7f31ec157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:57.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.659+0000 7f31eb200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec15ac20 con 0x7f31ec1608d0 2024-04-25T19:30:57.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.659+0000 7f31eb200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec06f500 con 0x7f31ec15a810 2024-04-25T19:30:57.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.659+0000 7f31eb200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f31ec06fd00 con 0x7f31ec0cf2f0 2024-04-25T19:30:57.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.659+0000 7f31ea800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31ec1608d0 0x7f31ec157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:57.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.659+0000 7f31ea800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31ec1608d0 0x7f31ec157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34344/0 (socket says 172.21.15.131:34344) 2024-04-25T19:30:57.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.659+0000 7f31ea800640 1 -- 172.21.15.131:0/104029539 learned_addr learned my addr 172.21.15.131:0/104029539 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:30:57.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.660+0000 7f31e9e00640 1 --2- 172.21.15.131:0/104029539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31ec0cf2f0 0x7f31ec1482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:57.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.660+0000 7f31e1400640 1 --2- 172.21.15.131:0/104029539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31ec15a810 0x7f31ec15e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:57.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.660+0000 7f31ea800640 1 -- 172.21.15.131:0/104029539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31ec0cf2f0 msgr2=0x7f31ec1482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:57.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.660+0000 7f31ea800640 1 --2- 172.21.15.131:0/104029539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31ec0cf2f0 0x7f31ec1482b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:57.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.660+0000 7f31ea800640 1 -- 172.21.15.131:0/104029539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31ec15a810 msgr2=0x7f31ec15e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:57.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.660+0000 7f31ea800640 1 --2- 172.21.15.131:0/104029539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31ec15a810 0x7f31ec15e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:57.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.660+0000 7f31ea800640 1 -- 172.21.15.131:0/104029539 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ec15f100 con 0x7f31ec1608d0 2024-04-25T19:30:57.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.660+0000 7f31e9e00640 1 --2- 172.21.15.131:0/104029539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31ec0cf2f0 0x7f31ec1482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:30:57.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.660+0000 7f31ea800640 1 --2- 172.21.15.131:0/104029539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31ec1608d0 0x7f31ec157370 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f31e400ec40 tx=0x7f31e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:30:57.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.660+0000 7f31e2a00640 1 -- 172.21.15.131:0/104029539 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e400cd20 con 0x7f31ec1608d0 2024-04-25T19:30:57.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.660+0000 7f31e2a00640 1 -- 172.21.15.131:0/104029539 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e400ee50 con 0x7f31ec1608d0 2024-04-25T19:30:57.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.660+0000 7f31e2a00640 1 -- 172.21.15.131:0/104029539 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e4003bd0 con 0x7f31ec1608d0 2024-04-25T19:30:57.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.660+0000 7f31eb200640 1 -- 172.21.15.131:0/104029539 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31ec15f3e0 con 0x7f31ec1608d0 2024-04-25T19:30:57.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.661+0000 7f31eb200640 1 -- 172.21.15.131:0/104029539 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31ec152ff0 con 0x7f31ec1608d0 2024-04-25T19:30:57.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.662+0000 7f31eb200640 1 -- 172.21.15.131:0/104029539 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31ec0b7250 con 0x7f31ec1608d0 2024-04-25T19:30:57.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.663+0000 7f31e2a00640 1 -- 172.21.15.131:0/104029539 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f31e4012050 con 0x7f31ec1608d0 2024-04-25T19:30:57.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.664+0000 7f31e2a00640 1 --2- 172.21.15.131:0/104029539 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f31c80744e0 0x7f31c80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:57.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.664+0000 7f31e2a00640 1 -- 172.21.15.131:0/104029539 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f31e4095520 con 0x7f31ec1608d0 2024-04-25T19:30:57.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.665+0000 7f31e9e00640 1 --2- 172.21.15.131:0/104029539 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f31c80744e0 0x7f31c80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:57.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.666+0000 7f31e9e00640 1 --2- 172.21.15.131:0/104029539 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f31c80744e0 0x7f31c80769f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f31dc036000 tx=0x7f31dc030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:30:57.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.669+0000 7f31e2a00640 1 -- 172.21.15.131:0/104029539 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f31ec0b7250 con 0x7f31ec1608d0 2024-04-25T19:30:57.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.853+0000 7f31eb200640 1 -- 172.21.15.131:0/104029539 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f31ec0d1b30 con 0x7f31ec1608d0 2024-04-25T19:30:57.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.856+0000 7f31e2a00640 1 -- 172.21.15.131:0/104029539 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16788 (secure 0 0 0) 0x7f31ec0d1b30 con 0x7f31ec1608d0 2024-04-25T19:30:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:30:57.858 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":47,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:24:58.382161+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:24:13.848038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T19:24:14.699910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.4","mappings":[{"from":0,"to":5}]},{"pgid":"7.2c","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:30:57.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.859+0000 7f31eb200640 1 -- 172.21.15.131:0/104029539 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f31c80744e0 msgr2=0x7f31c80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:57.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.859+0000 7f31eb200640 1 --2- 172.21.15.131:0/104029539 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f31c80744e0 0x7f31c80769f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f31dc036000 tx=0x7f31dc030000 comp rx=0 tx=0).stop 2024-04-25T19:30:57.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.859+0000 7f31eb200640 1 -- 172.21.15.131:0/104029539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31ec1608d0 msgr2=0x7f31ec157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:57.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.859+0000 7f31eb200640 1 --2- 172.21.15.131:0/104029539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31ec1608d0 0x7f31ec157370 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f31e400ec40 tx=0x7f31e400c490 comp rx=0 tx=0).stop 2024-04-25T19:30:57.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.859+0000 7f31eb200640 1 -- 172.21.15.131:0/104029539 shutdown_connections 2024-04-25T19:30:57.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.859+0000 7f31eb200640 1 --2- 172.21.15.131:0/104029539 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f31c80744e0 0x7f31c80769f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:57.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.859+0000 7f31eb200640 1 --2- 172.21.15.131:0/104029539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31ec1608d0 0x7f31ec157370 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:57.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.859+0000 7f31eb200640 1 --2- 172.21.15.131:0/104029539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31ec15a810 0x7f31ec15e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:57.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.859+0000 7f31eb200640 1 --2- 172.21.15.131:0/104029539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31ec0cf2f0 0x7f31ec1482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:57.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.859+0000 7f31eb200640 1 -- 172.21.15.131:0/104029539 >> 172.21.15.131:0/104029539 conn(0x7f31ec0d1720 msgr2=0x7f31ec0b1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:30:57.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.859+0000 7f31eb200640 1 -- 172.21.15.131:0/104029539 shutdown_connections 2024-04-25T19:30:57.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:57.859+0000 7f31eb200640 1 -- 172.21.15.131:0/104029539 wait complete. 2024-04-25T19:30:57.886 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T19:22:04.178847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T19:24:13.848038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T19:24:14.699910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T19:30:57.887 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T19:30:58.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.148+0000 7f5538a00640 1 Processor -- start 2024-04-25T19:30:58.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.148+0000 7f5538a00640 1 -- start start 2024-04-25T19:30:58.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.150+0000 7f5538a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f553415ee60 0x7f5534168e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:58.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.150+0000 7f5538a00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5534070000 con 0x7f553406dce0 2024-04-25T19:30:58.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.150+0000 7f5538a00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f553406f240 con 0x7f5534144340 2024-04-25T19:30:58.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.150+0000 7f5538a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f553415f270 con 0x7f553415ee60 2024-04-25T19:30:58.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.150+0000 7f552be00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f553406dce0 0x7f553415e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:60758/0 (socket says 172.21.15.131:60758) 2024-04-25T19:30:58.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.150+0000 7f552be00640 1 -- 172.21.15.131:0/431534485 learned_addr learned my addr 172.21.15.131:0/431534485 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:30:58.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.150+0000 7f5533200640 1 --2- 172.21.15.131:0/431534485 >> v2:172.21.15.195:3300/0 conn(0x7f553415ee60 0x7f5534168e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:58.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.151+0000 7f5531e00640 1 -- 172.21.15.131:0/431534485 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1807801641 0 0) 0x7f5534070000 con 0x7f553406dce0 2024-04-25T19:30:58.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.151+0000 7f5531e00640 1 -- 172.21.15.131:0/431534485 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5518003520 con 0x7f553406dce0 2024-04-25T19:30:58.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.151+0000 7f5531e00640 1 -- 172.21.15.131:0/431534485 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3309165019 0 0) 0x7f5518003520 con 0x7f553406dce0 2024-04-25T19:30:58.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.151+0000 7f5531e00640 1 -- 172.21.15.131:0/431534485 >> v2:172.21.15.195:3300/0 conn(0x7f553415ee60 msgr2=0x7f5534168e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:30:58.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.151+0000 7f5531e00640 1 --2- 172.21.15.131:0/431534485 >> v2:172.21.15.195:3300/0 conn(0x7f553415ee60 0x7f5534168e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:58.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.151+0000 7f5531e00640 1 -- 172.21.15.131:0/431534485 >> v1:172.21.15.195:6789/0 conn(0x7f5534144340 legacy=0x7f553406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:30:58.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.151+0000 7f5531e00640 1 -- 172.21.15.131:0/431534485 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553406f520 con 0x7f553406dce0 2024-04-25T19:30:58.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.151+0000 7f5531e00640 1 -- 172.21.15.131:0/431534485 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f551c001670 con 0x7f553406dce0 2024-04-25T19:30:58.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.151+0000 7f5531e00640 1 -- 172.21.15.131:0/431534485 >> v1:172.21.15.131:6789/0 conn(0x7f553406dce0 legacy=0x7f553415e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:58.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.151+0000 7f5531e00640 1 --2- 172.21.15.131:0/431534485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55180039b0 0x7f5518003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:58.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.151+0000 7f5531e00640 1 --2- 172.21.15.131:0/431534485 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5518004800 0x7f5518004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:58.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.151+0000 7f5531e00640 1 --2- 172.21.15.131:0/431534485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55180051a0 0x7f551800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:58.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.151+0000 7f5531e00640 1 -- 172.21.15.131:0/431534485 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f551800c110 con 0x7f55180039b0 2024-04-25T19:30:58.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.151+0000 7f5531e00640 1 -- 172.21.15.131:0/431534485 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f551800c2c0 con 0x7f55180051a0 2024-04-25T19:30:58.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.151+0000 7f5531e00640 1 -- 172.21.15.131:0/431534485 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f551800c4c0 con 0x7f5518004800 2024-04-25T19:30:58.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.152+0000 7f5532800640 1 --2- 172.21.15.131:0/431534485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55180039b0 0x7f5518003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:58.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.152+0000 7f5532800640 1 -- 172.21.15.131:0/431534485 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5518004800 msgr2=0x7f5518004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:30:58.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.152+0000 7f5532800640 1 --2- 172.21.15.131:0/431534485 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5518004800 0x7f5518004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:58.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.152+0000 7f5532800640 1 -- 172.21.15.131:0/431534485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55180051a0 msgr2=0x7f551800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:30:58.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.152+0000 7f5532800640 1 --2- 172.21.15.131:0/431534485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55180051a0 0x7f551800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:58.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.152+0000 7f5533200640 1 -- 172.21.15.131:0/431534485 reap_dead start 2024-04-25T19:30:58.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.152+0000 7f5532800640 1 -- 172.21.15.131:0/431534485 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5518003520 con 0x7f55180039b0 2024-04-25T19:30:58.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.153+0000 7f5532800640 1 --2- 172.21.15.131:0/431534485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55180039b0 0x7f5518003e00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5518004780 tx=0x7f5518005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484d4944f2d6cdb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:30:58.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.153+0000 7f5531e00640 1 -- 172.21.15.131:0/431534485 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524037070 con 0x7f55180039b0 2024-04-25T19:30:58.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.153+0000 7f5531e00640 1 -- 172.21.15.131:0/431534485 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552402a970 con 0x7f55180039b0 2024-04-25T19:30:58.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.153+0000 7f5531e00640 1 -- 172.21.15.131:0/431534485 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524003980 con 0x7f55180039b0 2024-04-25T19:30:58.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.154+0000 7f5538a00640 1 -- 172.21.15.131:0/431534485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55180039b0 msgr2=0x7f5518003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:58.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.154+0000 7f5538a00640 1 --2- 172.21.15.131:0/431534485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55180039b0 0x7f5518003e00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5518004780 tx=0x7f5518005830 comp rx=0 tx=0).stop 2024-04-25T19:30:58.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.154+0000 7f5538a00640 1 -- 172.21.15.131:0/431534485 shutdown_connections 2024-04-25T19:30:58.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.154+0000 7f5538a00640 1 --2- 172.21.15.131:0/431534485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55180039b0 0x7f5518003e00 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:58.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.154+0000 7f5538a00640 1 -- 172.21.15.131:0/431534485 >> 172.21.15.131:0/431534485 conn(0x7f5534072f40 msgr2=0x7f5534073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:30:58.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.154+0000 7f5538a00640 1 -- 172.21.15.131:0/431534485 shutdown_connections 2024-04-25T19:30:58.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.154+0000 7f5538a00640 1 -- 172.21.15.131:0/431534485 wait complete. 2024-04-25T19:30:58.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.156+0000 7f5538a00640 1 Processor -- start 2024-04-25T19:30:58.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.156+0000 7f5538a00640 1 -- start start 2024-04-25T19:30:58.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.158+0000 7f5538a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55180039b0 0x7f553415a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:58.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.158+0000 7f5538a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55341604f0 0x7f5534160900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:58.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.158+0000 7f5538a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f553415d560 0x7f553415d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:58.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.158+0000 7f5538a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f553406fae0 con 0x7f55180039b0 2024-04-25T19:30:58.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.158+0000 7f5538a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5534144750 con 0x7f55341604f0 2024-04-25T19:30:58.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.158+0000 7f5538a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f553415e750 con 0x7f553415d560 2024-04-25T19:30:58.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.158+0000 7f5532800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55180039b0 0x7f553415a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:58.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.158+0000 7f5532800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55180039b0 0x7f553415a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52878/0 (socket says 172.21.15.131:52878) 2024-04-25T19:30:58.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.158+0000 7f5532800640 1 -- 172.21.15.131:0/1064205049 learned_addr learned my addr 172.21.15.131:0/1064205049 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:30:58.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.159+0000 7f552be00640 1 --2- 172.21.15.131:0/1064205049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55341604f0 0x7f5534160900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:58.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.159+0000 7f5532800640 1 -- 172.21.15.131:0/1064205049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f553415d560 msgr2=0x7f553415d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:58.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.159+0000 7f5533200640 1 --2- 172.21.15.131:0/1064205049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f553415d560 0x7f553415d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:58.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.159+0000 7f5532800640 1 --2- 172.21.15.131:0/1064205049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f553415d560 0x7f553415d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:58.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.159+0000 7f5532800640 1 -- 172.21.15.131:0/1064205049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55341604f0 msgr2=0x7f5534160900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:58.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.159+0000 7f5532800640 1 --2- 172.21.15.131:0/1064205049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55341604f0 0x7f5534160900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:58.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.159+0000 7f5532800640 1 -- 172.21.15.131:0/1064205049 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5534160e40 con 0x7f55180039b0 2024-04-25T19:30:58.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.159+0000 7f552be00640 1 --2- 172.21.15.131:0/1064205049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55341604f0 0x7f5534160900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:30:58.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.159+0000 7f5532800640 1 --2- 172.21.15.131:0/1064205049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55180039b0 0x7f553415a770 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5524000c00 tx=0x7f55240036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:30:58.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.159+0000 7f552aa00640 1 -- 172.21.15.131:0/1064205049 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524037050 con 0x7f55180039b0 2024-04-25T19:30:58.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.159+0000 7f552aa00640 1 -- 172.21.15.131:0/1064205049 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5524038040 con 0x7f55180039b0 2024-04-25T19:30:58.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.159+0000 7f552aa00640 1 -- 172.21.15.131:0/1064205049 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524007a70 con 0x7f55180039b0 2024-04-25T19:30:58.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.159+0000 7f5538a00640 1 -- 172.21.15.131:0/1064205049 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f553415deb0 con 0x7f55180039b0 2024-04-25T19:30:58.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.160+0000 7f5538a00640 1 -- 172.21.15.131:0/1064205049 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f553415c300 con 0x7f55180039b0 2024-04-25T19:30:58.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.161+0000 7f5538a00640 1 -- 172.21.15.131:0/1064205049 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5534076c60 con 0x7f55180039b0 2024-04-25T19:30:58.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.162+0000 7f552aa00640 1 -- 172.21.15.131:0/1064205049 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5524045020 con 0x7f55180039b0 2024-04-25T19:30:58.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.163+0000 7f552aa00640 1 --2- 172.21.15.131:0/1064205049 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f55100744b0 0x7f55100769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:58.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.163+0000 7f552aa00640 1 -- 172.21.15.131:0/1064205049 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f55240b4df0 con 0x7f55180039b0 2024-04-25T19:30:58.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.163+0000 7f552be00640 1 --2- 172.21.15.131:0/1064205049 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f55100744b0 0x7f55100769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:58.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.164+0000 7f552be00640 1 --2- 172.21.15.131:0/1064205049 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f55100744b0 0x7f55100769c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f551c001eb0 tx=0x7f551c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:30:58.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.167+0000 7f552aa00640 1 -- 172.21.15.131:0/1064205049 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f552404c020 con 0x7f55180039b0 2024-04-25T19:30:58.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.351+0000 7f5538a00640 1 -- 172.21.15.131:0/1064205049 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f55340b2780 con 0x7f55180039b0 2024-04-25T19:30:58.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.352+0000 7f552aa00640 1 -- 172.21.15.131:0/1064205049 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) ==== 93+0+10 (secure 0 0 0) 0x7f5534160e40 con 0x7f55180039b0 2024-04-25T19:30:58.353 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-25T19:30:58.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.354+0000 7f5538a00640 1 -- 172.21.15.131:0/1064205049 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f55100744b0 msgr2=0x7f55100769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:58.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.354+0000 7f5538a00640 1 --2- 172.21.15.131:0/1064205049 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f55100744b0 0x7f55100769c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f551c001eb0 tx=0x7f551c009040 comp rx=0 tx=0).stop 2024-04-25T19:30:58.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.354+0000 7f5538a00640 1 -- 172.21.15.131:0/1064205049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55180039b0 msgr2=0x7f553415a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:58.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.354+0000 7f5538a00640 1 --2- 172.21.15.131:0/1064205049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55180039b0 0x7f553415a770 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5524000c00 tx=0x7f55240036f0 comp rx=0 tx=0).stop 2024-04-25T19:30:58.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.355+0000 7f5538a00640 1 -- 172.21.15.131:0/1064205049 shutdown_connections 2024-04-25T19:30:58.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.355+0000 7f5538a00640 1 --2- 172.21.15.131:0/1064205049 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f55100744b0 0x7f55100769c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:58.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.355+0000 7f5538a00640 1 --2- 172.21.15.131:0/1064205049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f553415d560 0x7f553415d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:58.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.355+0000 7f5538a00640 1 --2- 172.21.15.131:0/1064205049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55341604f0 0x7f5534160900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:58.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.355+0000 7f5538a00640 1 --2- 172.21.15.131:0/1064205049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55180039b0 0x7f553415a770 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:58.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.355+0000 7f5538a00640 1 -- 172.21.15.131:0/1064205049 >> 172.21.15.131:0/1064205049 conn(0x7f5534072f40 msgr2=0x7f55340b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:30:58.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.355+0000 7f5538a00640 1 -- 172.21.15.131:0/1064205049 shutdown_connections 2024-04-25T19:30:58.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.355+0000 7f5538a00640 1 -- 172.21.15.131:0/1064205049 wait complete. 2024-04-25T19:30:58.380 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T19:30:58.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.650+0000 7f5372200640 1 Processor -- start 2024-04-25T19:30:58.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.651+0000 7f5372200640 1 -- start start 2024-04-25T19:30:58.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.653+0000 7f5372200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f536c144340 0x7f536c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:58.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.653+0000 7f5372200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f536c15ee60 0x7f536c15f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:58.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.653+0000 7f5372200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f536c06df20 con 0x7f536c06db10 2024-04-25T19:30:58.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.653+0000 7f5372200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f536c15f270 con 0x7f536c144340 2024-04-25T19:30:58.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.653+0000 7f5372200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f536c144750 con 0x7f536c15ee60 2024-04-25T19:30:58.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.653+0000 7f5370e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f536c144340 0x7f536c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:58.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.653+0000 7f5370e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f536c144340 0x7f536c06d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52880/0 (socket says 172.21.15.131:52880) 2024-04-25T19:30:58.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.653+0000 7f5370e00640 1 -- 172.21.15.131:0/1982245824 learned_addr learned my addr 172.21.15.131:0/1982245824 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:30:58.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.654+0000 7f5371800640 1 --2- 172.21.15.131:0/1982245824 >> v2:172.21.15.195:3300/0 conn(0x7f536c15ee60 0x7f536c15f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:58.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.654+0000 7f5370e00640 1 -- 172.21.15.131:0/1982245824 >> v2:172.21.15.195:3300/0 conn(0x7f536c15ee60 msgr2=0x7f536c15f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:30:58.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.654+0000 7f5370e00640 1 --2- 172.21.15.131:0/1982245824 >> v2:172.21.15.195:3300/0 conn(0x7f536c15ee60 0x7f536c15f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:58.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.654+0000 7f5370e00640 1 -- 172.21.15.131:0/1982245824 >> v1:172.21.15.195:6789/0 conn(0x7f536c06db10 legacy=0x7f536c15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:30:58.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.654+0000 7f5370e00640 1 -- 172.21.15.131:0/1982245824 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f536c070000 con 0x7f536c144340 2024-04-25T19:30:58.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.654+0000 7f5371800640 1 --2- 172.21.15.131:0/1982245824 >> v2:172.21.15.195:3300/0 conn(0x7f536c15ee60 0x7f536c15f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:30:58.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.655+0000 7f5370e00640 1 --2- 172.21.15.131:0/1982245824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f536c144340 0x7f536c06d5d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f536c0d1790 tx=0x7f535c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e54ab4c98224c06 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:30:58.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.655+0000 7f536be00640 1 -- 172.21.15.131:0/1982245824 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535c037070 con 0x7f536c144340 2024-04-25T19:30:58.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.655+0000 7f536be00640 1 -- 172.21.15.131:0/1982245824 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f535c032440 con 0x7f536c144340 2024-04-25T19:30:58.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.655+0000 7f536be00640 1 -- 172.21.15.131:0/1982245824 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535c032810 con 0x7f536c144340 2024-04-25T19:30:58.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.656+0000 7f5372200640 1 -- 172.21.15.131:0/1982245824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f536c144340 msgr2=0x7f536c06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:58.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.656+0000 7f5372200640 1 --2- 172.21.15.131:0/1982245824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f536c144340 0x7f536c06d5d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f536c0d1790 tx=0x7f535c02a230 comp rx=0 tx=0).stop 2024-04-25T19:30:58.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.656+0000 7f5372200640 1 -- 172.21.15.131:0/1982245824 shutdown_connections 2024-04-25T19:30:58.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.656+0000 7f5372200640 1 --2- 172.21.15.131:0/1982245824 >> v2:172.21.15.195:3300/0 conn(0x7f536c15ee60 0x7f536c15f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:58.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.656+0000 7f5372200640 1 --2- 172.21.15.131:0/1982245824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f536c144340 0x7f536c06d5d0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:58.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.656+0000 7f5372200640 1 -- 172.21.15.131:0/1982245824 >> 172.21.15.131:0/1982245824 conn(0x7f536c072f40 msgr2=0x7f536c073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:30:58.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.656+0000 7f5372200640 1 -- 172.21.15.131:0/1982245824 shutdown_connections 2024-04-25T19:30:58.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.657+0000 7f5372200640 1 -- 172.21.15.131:0/1982245824 wait complete. 2024-04-25T19:30:58.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.659+0000 7f5372200640 1 Processor -- start 2024-04-25T19:30:58.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.659+0000 7f5372200640 1 -- start start 2024-04-25T19:30:58.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.660+0000 7f5372200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f536c06db10 0x7f536c1f9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:58.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.660+0000 7f5372200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f536c144340 0x7f536c1fa1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:58.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.660+0000 7f5372200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f536c15ee60 0x7f536c1f6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:58.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.660+0000 7f5372200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f536c06f800 con 0x7f536c144340 2024-04-25T19:30:58.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.660+0000 7f5372200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f536c06f520 con 0x7f536c15ee60 2024-04-25T19:30:58.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.660+0000 7f5372200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f536c06fae0 con 0x7f536c06db10 2024-04-25T19:30:58.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.661+0000 7f5363e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f536c144340 0x7f536c1fa1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:58.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.661+0000 7f5363e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f536c144340 0x7f536c1fa1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52892/0 (socket says 172.21.15.131:52892) 2024-04-25T19:30:58.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.661+0000 7f5363e00640 1 -- 172.21.15.131:0/1530793420 learned_addr learned my addr 172.21.15.131:0/1530793420 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:30:58.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.661+0000 7f5363e00640 1 -- 172.21.15.131:0/1530793420 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f536c06db10 msgr2=0x7f536c1f9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:58.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.661+0000 7f5371800640 1 --2- 172.21.15.131:0/1530793420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f536c15ee60 0x7f536c1f6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:58.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.661+0000 7f5370e00640 1 --2- 172.21.15.131:0/1530793420 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f536c06db10 0x7f536c1f9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:58.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.661+0000 7f5363e00640 1 --2- 172.21.15.131:0/1530793420 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f536c06db10 0x7f536c1f9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:58.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.661+0000 7f5363e00640 1 -- 172.21.15.131:0/1530793420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f536c15ee60 msgr2=0x7f536c1f6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:58.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.661+0000 7f5363e00640 1 --2- 172.21.15.131:0/1530793420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f536c15ee60 0x7f536c1f6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:58.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.661+0000 7f5363e00640 1 -- 172.21.15.131:0/1530793420 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f536c144ba0 con 0x7f536c144340 2024-04-25T19:30:58.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.661+0000 7f5370e00640 1 --2- 172.21.15.131:0/1530793420 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f536c06db10 0x7f536c1f9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:30:58.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.662+0000 7f5363e00640 1 --2- 172.21.15.131:0/1530793420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f536c144340 0x7f536c1fa1c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f535400b3f0 tx=0x7f535400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:30:58.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.662+0000 7f5369600640 1 -- 172.21.15.131:0/1530793420 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5354015020 con 0x7f536c144340 2024-04-25T19:30:58.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.662+0000 7f5369600640 1 -- 172.21.15.131:0/1530793420 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5354011830 con 0x7f536c144340 2024-04-25T19:30:58.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.662+0000 7f5369600640 1 -- 172.21.15.131:0/1530793420 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5354011c00 con 0x7f536c144340 2024-04-25T19:30:58.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.662+0000 7f5372200640 1 -- 172.21.15.131:0/1530793420 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f536c146580 con 0x7f536c144340 2024-04-25T19:30:58.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.662+0000 7f5372200640 1 -- 172.21.15.131:0/1530793420 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f536c146d00 con 0x7f536c144340 2024-04-25T19:30:58.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.663+0000 7f5372200640 1 -- 172.21.15.131:0/1530793420 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f536c076c60 con 0x7f536c144340 2024-04-25T19:30:58.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.665+0000 7f5369600640 1 -- 172.21.15.131:0/1530793420 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5354018020 con 0x7f536c144340 2024-04-25T19:30:58.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.665+0000 7f5369600640 1 --2- 172.21.15.131:0/1530793420 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f53480744e0 0x7f53480769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:58.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.666+0000 7f5369600640 1 -- 172.21.15.131:0/1530793420 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f53540952b0 con 0x7f536c144340 2024-04-25T19:30:58.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.666+0000 7f5370e00640 1 --2- 172.21.15.131:0/1530793420 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f53480744e0 0x7f53480769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:58.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.667+0000 7f5370e00640 1 --2- 172.21.15.131:0/1530793420 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f53480744e0 0x7f53480769f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f535c034000 tx=0x7f535c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:30:58.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.670+0000 7f5369600640 1 -- 172.21.15.131:0/1530793420 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f535401f020 con 0x7f536c144340 2024-04-25T19:30:58.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.871+0000 7f5372200640 1 -- 172.21.15.131:0/1530793420 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f536c1467b0 con 0x7f536c144340 2024-04-25T19:30:58.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.871+0000 7f5369600640 1 -- 172.21.15.131:0/1530793420 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) ==== 104+0+11 (secure 0 0 0) 0x7f535405f310 con 0x7f536c144340 2024-04-25T19:30:58.873 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-25T19:30:58.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.874+0000 7f5372200640 1 -- 172.21.15.131:0/1530793420 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f53480744e0 msgr2=0x7f53480769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:58.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.874+0000 7f5372200640 1 --2- 172.21.15.131:0/1530793420 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f53480744e0 0x7f53480769f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f535c034000 tx=0x7f535c02e000 comp rx=0 tx=0).stop 2024-04-25T19:30:58.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.874+0000 7f5372200640 1 -- 172.21.15.131:0/1530793420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f536c144340 msgr2=0x7f536c1fa1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:58.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.874+0000 7f5372200640 1 --2- 172.21.15.131:0/1530793420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f536c144340 0x7f536c1fa1c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f535400b3f0 tx=0x7f535400b8b0 comp rx=0 tx=0).stop 2024-04-25T19:30:58.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.874+0000 7f5372200640 1 -- 172.21.15.131:0/1530793420 shutdown_connections 2024-04-25T19:30:58.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.874+0000 7f5372200640 1 --2- 172.21.15.131:0/1530793420 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f53480744e0 0x7f53480769f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:58.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.874+0000 7f5372200640 1 --2- 172.21.15.131:0/1530793420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f536c15ee60 0x7f536c1f6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:58.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.874+0000 7f5372200640 1 --2- 172.21.15.131:0/1530793420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f536c144340 0x7f536c1fa1c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:58.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.874+0000 7f5372200640 1 --2- 172.21.15.131:0/1530793420 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f536c06db10 0x7f536c1f9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:58.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.874+0000 7f5372200640 1 -- 172.21.15.131:0/1530793420 >> 172.21.15.131:0/1530793420 conn(0x7f536c072f40 msgr2=0x7f536c15e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:30:58.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.874+0000 7f5372200640 1 -- 172.21.15.131:0/1530793420 shutdown_connections 2024-04-25T19:30:58.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:58.874+0000 7f5372200640 1 -- 172.21.15.131:0/1530793420 wait complete. 2024-04-25T19:30:58.901 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T19:30:59.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.171+0000 7f5caf800640 1 Processor -- start 2024-04-25T19:30:59.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.171+0000 7f5caf800640 1 -- start start 2024-04-25T19:30:59.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.173+0000 7f5caf800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ca80ce250 0x7f5ca815cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:59.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.173+0000 7f5caf800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5ca806d5d0 0x7f5ca806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:59.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.173+0000 7f5caf800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ca806df20 con 0x7f5ca81458c0 2024-04-25T19:30:59.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.173+0000 7f5caf800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f5ca80b4ec0 con 0x7f5ca806d5d0 2024-04-25T19:30:59.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.173+0000 7f5caf800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5ca8145cd0 con 0x7f5ca80ce250 2024-04-25T19:30:59.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.174+0000 7f5cad800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5ca806d5d0 0x7f5ca806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:59.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.174+0000 7f5cad800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5ca806d5d0 0x7f5ca806d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52908/0 (socket says 172.21.15.131:52908) 2024-04-25T19:30:59.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.174+0000 7f5cad800640 1 -- 172.21.15.131:0/3349052491 learned_addr learned my addr 172.21.15.131:0/3349052491 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:30:59.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.174+0000 7f5cace00640 1 --2- 172.21.15.131:0/3349052491 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ca80ce250 0x7f5ca815cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:59.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.174+0000 7f5cad800640 1 -- 172.21.15.131:0/3349052491 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ca80ce250 msgr2=0x7f5ca815cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:30:59.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.174+0000 7f5cad800640 1 --2- 172.21.15.131:0/3349052491 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ca80ce250 0x7f5ca815cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:59.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.174+0000 7f5cad800640 1 -- 172.21.15.131:0/3349052491 >> v1:172.21.15.195:6789/0 conn(0x7f5ca81458c0 legacy=0x7f5ca80b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:30:59.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.174+0000 7f5cad800640 1 -- 172.21.15.131:0/3349052491 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca815d5c0 con 0x7f5ca806d5d0 2024-04-25T19:30:59.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.175+0000 7f5cad800640 1 --2- 172.21.15.131:0/3349052491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ca806d5d0 0x7f5ca806d9e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5ca000d150 tx=0x7f5ca002c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed60673ef2b6dad6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:30:59.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.176+0000 7f5ca7400640 1 -- 172.21.15.131:0/3349052491 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca003b070 con 0x7f5ca806d5d0 2024-04-25T19:30:59.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.176+0000 7f5ca7400640 1 -- 172.21.15.131:0/3349052491 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ca0033670 con 0x7f5ca806d5d0 2024-04-25T19:30:59.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.176+0000 7f5ca7400640 1 -- 172.21.15.131:0/3349052491 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca0033a40 con 0x7f5ca806d5d0 2024-04-25T19:30:59.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.176+0000 7f5caf800640 1 -- 172.21.15.131:0/3349052491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ca806d5d0 msgr2=0x7f5ca806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:59.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.176+0000 7f5caf800640 1 --2- 172.21.15.131:0/3349052491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ca806d5d0 0x7f5ca806d9e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5ca000d150 tx=0x7f5ca002c840 comp rx=0 tx=0).stop 2024-04-25T19:30:59.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.176+0000 7f5caf800640 1 -- 172.21.15.131:0/3349052491 shutdown_connections 2024-04-25T19:30:59.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.177+0000 7f5caf800640 1 --2- 172.21.15.131:0/3349052491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ca806d5d0 0x7f5ca806d9e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:59.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.177+0000 7f5caf800640 1 --2- 172.21.15.131:0/3349052491 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ca80ce250 0x7f5ca815cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:59.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.177+0000 7f5caf800640 1 -- 172.21.15.131:0/3349052491 >> 172.21.15.131:0/3349052491 conn(0x7f5ca8073090 msgr2=0x7f5ca80734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:30:59.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.177+0000 7f5caf800640 1 -- 172.21.15.131:0/3349052491 shutdown_connections 2024-04-25T19:30:59.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.177+0000 7f5caf800640 1 -- 172.21.15.131:0/3349052491 wait complete. 2024-04-25T19:30:59.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.179+0000 7f5caf800640 1 Processor -- start 2024-04-25T19:30:59.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.179+0000 7f5caf800640 1 -- start start 2024-04-25T19:30:59.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.181+0000 7f5caf800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ca806d5d0 0x7f5ca81f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:59.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.181+0000 7f5caf800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ca80ce250 0x7f5ca8140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:59.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.181+0000 7f5caf800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ca81458c0 0x7f5ca8141520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:59.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.181+0000 7f5caf800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca806f640 con 0x7f5ca80ce250 2024-04-25T19:30:59.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.181+0000 7f5caf800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca815db80 con 0x7f5ca81458c0 2024-04-25T19:30:59.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.181+0000 7f5caf800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5ca815de60 con 0x7f5ca806d5d0 2024-04-25T19:30:59.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.181+0000 7f5ca7e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ca80ce250 0x7f5ca8140fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:59.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.181+0000 7f5ca7e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ca80ce250 0x7f5ca8140fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52910/0 (socket says 172.21.15.131:52910) 2024-04-25T19:30:59.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.181+0000 7f5ca7e00640 1 -- 172.21.15.131:0/2967415019 learned_addr learned my addr 172.21.15.131:0/2967415019 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:30:59.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.181+0000 7f5cace00640 1 --2- 172.21.15.131:0/2967415019 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ca806d5d0 0x7f5ca81f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:59.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.181+0000 7f5cad800640 1 --2- 172.21.15.131:0/2967415019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ca81458c0 0x7f5ca8141520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:59.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.182+0000 7f5ca7e00640 1 -- 172.21.15.131:0/2967415019 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ca806d5d0 msgr2=0x7f5ca81f6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:59.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.182+0000 7f5ca7e00640 1 --2- 172.21.15.131:0/2967415019 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ca806d5d0 0x7f5ca81f6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:59.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.182+0000 7f5ca7e00640 1 -- 172.21.15.131:0/2967415019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ca81458c0 msgr2=0x7f5ca8141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:59.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.182+0000 7f5ca7e00640 1 --2- 172.21.15.131:0/2967415019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ca81458c0 0x7f5ca8141520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:59.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.182+0000 7f5ca7e00640 1 -- 172.21.15.131:0/2967415019 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca81e60a0 con 0x7f5ca80ce250 2024-04-25T19:30:59.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.182+0000 7f5cad800640 1 --2- 172.21.15.131:0/2967415019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ca81458c0 0x7f5ca8141520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:30:59.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.182+0000 7f5ca7e00640 1 --2- 172.21.15.131:0/2967415019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ca80ce250 0x7f5ca8140fe0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5c9400b3f0 tx=0x7f5c9400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:30:59.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.182+0000 7f5ca4c00640 1 -- 172.21.15.131:0/2967415019 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c94015020 con 0x7f5ca80ce250 2024-04-25T19:30:59.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.182+0000 7f5ca4c00640 1 -- 172.21.15.131:0/2967415019 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c94011830 con 0x7f5ca80ce250 2024-04-25T19:30:59.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.182+0000 7f5ca4c00640 1 -- 172.21.15.131:0/2967415019 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c94011c20 con 0x7f5ca80ce250 2024-04-25T19:30:59.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.182+0000 7f5caf800640 1 -- 172.21.15.131:0/2967415019 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca81e6380 con 0x7f5ca80ce250 2024-04-25T19:30:59.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.182+0000 7f5caf800640 1 -- 172.21.15.131:0/2967415019 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca813ac20 con 0x7f5ca80ce250 2024-04-25T19:30:59.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.184+0000 7f5caf800640 1 -- 172.21.15.131:0/2967415019 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ca8050740 con 0x7f5ca80ce250 2024-04-25T19:30:59.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.185+0000 7f5ca4c00640 1 -- 172.21.15.131:0/2967415019 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5c94018020 con 0x7f5ca80ce250 2024-04-25T19:30:59.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.186+0000 7f5ca4c00640 1 --2- 172.21.15.131:0/2967415019 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f5c880744b0 0x7f5c880769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:59.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.186+0000 7f5ca4c00640 1 -- 172.21.15.131:0/2967415019 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f5c94094f90 con 0x7f5ca80ce250 2024-04-25T19:30:59.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.187+0000 7f5cace00640 1 --2- 172.21.15.131:0/2967415019 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f5c880744b0 0x7f5c880769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:59.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.188+0000 7f5cace00640 1 --2- 172.21.15.131:0/2967415019 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f5c880744b0 0x7f5c880769c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c006fd0 tx=0x7f5c9c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:30:59.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.191+0000 7f5ca4c00640 1 -- 172.21.15.131:0/2967415019 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5c9401f030 con 0x7f5ca80ce250 2024-04-25T19:30:59.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.389+0000 7f5caf800640 1 -- 172.21.15.131:0/2967415019 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5ca81e7040 con 0x7f5ca80ce250 2024-04-25T19:30:59.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.390+0000 7f5ca4c00640 1 -- 172.21.15.131:0/2967415019 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) ==== 100+0+11 (secure 0 0 0) 0x7f5c9405f640 con 0x7f5ca80ce250 2024-04-25T19:30:59.391 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 64 2024-04-25T19:30:59.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.392+0000 7f5caf800640 1 -- 172.21.15.131:0/2967415019 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f5c880744b0 msgr2=0x7f5c880769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:59.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.392+0000 7f5caf800640 1 --2- 172.21.15.131:0/2967415019 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f5c880744b0 0x7f5c880769c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c006fd0 tx=0x7f5c9c008040 comp rx=0 tx=0).stop 2024-04-25T19:30:59.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.392+0000 7f5caf800640 1 -- 172.21.15.131:0/2967415019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ca80ce250 msgr2=0x7f5ca8140fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:59.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.392+0000 7f5caf800640 1 --2- 172.21.15.131:0/2967415019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ca80ce250 0x7f5ca8140fe0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5c9400b3f0 tx=0x7f5c9400b8b0 comp rx=0 tx=0).stop 2024-04-25T19:30:59.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.392+0000 7f5caf800640 1 -- 172.21.15.131:0/2967415019 shutdown_connections 2024-04-25T19:30:59.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.392+0000 7f5caf800640 1 --2- 172.21.15.131:0/2967415019 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f5c880744b0 0x7f5c880769c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:59.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.392+0000 7f5caf800640 1 --2- 172.21.15.131:0/2967415019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ca81458c0 0x7f5ca8141520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:59.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.392+0000 7f5caf800640 1 --2- 172.21.15.131:0/2967415019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ca80ce250 0x7f5ca8140fe0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:59.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.392+0000 7f5caf800640 1 --2- 172.21.15.131:0/2967415019 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ca806d5d0 0x7f5ca81f6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:59.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.392+0000 7f5caf800640 1 -- 172.21.15.131:0/2967415019 >> 172.21.15.131:0/2967415019 conn(0x7f5ca8073090 msgr2=0x7f5ca80cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:30:59.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.392+0000 7f5caf800640 1 -- 172.21.15.131:0/2967415019 shutdown_connections 2024-04-25T19:30:59.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.392+0000 7f5caf800640 1 -- 172.21.15.131:0/2967415019 wait complete. 2024-04-25T19:30:59.417 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T19:30:59.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.684+0000 7ff3cf400640 1 Processor -- start 2024-04-25T19:30:59.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.684+0000 7ff3cf400640 1 -- start start 2024-04-25T19:30:59.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.686+0000 7ff3cf400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff3c8167000 0x7ff3c8169420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:59.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.686+0000 7ff3cf400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3c815f5f0 con 0x7ff3c80cf5e0 2024-04-25T19:30:59.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.686+0000 7ff3cf400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3c815e830 con 0x7ff3c81443c0 2024-04-25T19:30:59.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.686+0000 7ff3cf400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7ff3c80708d0 con 0x7ff3c8167000 2024-04-25T19:30:59.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.686+0000 7ff3bfe00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7ff3c80cf5e0 0x7ff3c80cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:60764/0 (socket says 172.21.15.131:60764) 2024-04-25T19:30:59.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.686+0000 7ff3bfe00640 1 -- 172.21.15.131:0/955461783 learned_addr learned my addr 172.21.15.131:0/955461783 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:30:59.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.687+0000 7ff3cd400640 1 --2- 172.21.15.131:0/955461783 >> v2:172.21.15.195:3300/0 conn(0x7ff3c8167000 0x7ff3c8169420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:59.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.687+0000 7ff3c7e00640 1 -- 172.21.15.131:0/955461783 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4019460254 0 0) 0x7ff3c815f5f0 con 0x7ff3c80cf5e0 2024-04-25T19:30:59.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.687+0000 7ff3c7e00640 1 -- 172.21.15.131:0/955461783 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3ac003520 con 0x7ff3c80cf5e0 2024-04-25T19:30:59.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.687+0000 7ff3c7e00640 1 -- 172.21.15.131:0/955461783 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4227406133 0 0) 0x7ff3ac003520 con 0x7ff3c80cf5e0 2024-04-25T19:30:59.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.687+0000 7ff3c7e00640 1 -- 172.21.15.131:0/955461783 >> v2:172.21.15.195:3300/0 conn(0x7ff3c8167000 msgr2=0x7ff3c8169420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:30:59.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.687+0000 7ff3c7e00640 1 --2- 172.21.15.131:0/955461783 >> v2:172.21.15.195:3300/0 conn(0x7ff3c8167000 0x7ff3c8169420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:59.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.687+0000 7ff3c7e00640 1 -- 172.21.15.131:0/955461783 >> v1:172.21.15.195:6789/0 conn(0x7ff3c81443c0 legacy=0x7ff3c806fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:30:59.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.687+0000 7ff3c7e00640 1 -- 172.21.15.131:0/955461783 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c815eb10 con 0x7ff3c80cf5e0 2024-04-25T19:30:59.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.687+0000 7ff3c7e00640 1 -- 172.21.15.131:0/955461783 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7ff3b0001670 con 0x7ff3c80cf5e0 2024-04-25T19:30:59.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.687+0000 7ff3c7e00640 1 -- 172.21.15.131:0/955461783 >> v1:172.21.15.131:6789/0 conn(0x7ff3c80cf5e0 legacy=0x7ff3c80cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.687+0000 7ff3c7e00640 1 --2- 172.21.15.131:0/955461783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3ac003a00 0x7ff3ac003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.687+0000 7ff3c7e00640 1 --2- 172.21.15.131:0/955461783 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3ac004800 0x7ff3ac004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.687+0000 7ff3c7e00640 1 --2- 172.21.15.131:0/955461783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3ac005270 0x7ff3ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.687+0000 7ff3c7e00640 1 -- 172.21.15.131:0/955461783 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c80708d0 con 0x7ff3ac005270 2024-04-25T19:30:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.687+0000 7ff3c7e00640 1 -- 172.21.15.131:0/955461783 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ac00c190 con 0x7ff3ac003a00 2024-04-25T19:30:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.687+0000 7ff3c7e00640 1 -- 172.21.15.131:0/955461783 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff3ac00c390 con 0x7ff3ac004800 2024-04-25T19:30:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.688+0000 7ff3cd400640 1 --2- 172.21.15.131:0/955461783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3ac005270 0x7ff3ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.688+0000 7ff3bfe00640 1 --2- 172.21.15.131:0/955461783 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3ac004800 0x7ff3ac004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.688+0000 7ff3cca00640 1 --2- 172.21.15.131:0/955461783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3ac003a00 0x7ff3ac003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.688+0000 7ff3cd400640 1 -- 172.21.15.131:0/955461783 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3ac004800 msgr2=0x7ff3ac004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:30:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.688+0000 7ff3cd400640 1 --2- 172.21.15.131:0/955461783 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3ac004800 0x7ff3ac004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.688+0000 7ff3cd400640 1 -- 172.21.15.131:0/955461783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3ac003a00 msgr2=0x7ff3ac003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:30:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.688+0000 7ff3cd400640 1 --2- 172.21.15.131:0/955461783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3ac003a00 0x7ff3ac003e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:59.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.688+0000 7ff3cd400640 1 -- 172.21.15.131:0/955461783 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3ac003520 con 0x7ff3ac005270 2024-04-25T19:30:59.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.688+0000 7ff3bfe00640 1 --2- 172.21.15.131:0/955461783 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3ac004800 0x7ff3ac004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:30:59.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.689+0000 7ff3cd400640 1 -- 172.21.15.131:0/955461783 reap_dead start 2024-04-25T19:30:59.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.689+0000 7ff3cd400640 1 --2- 172.21.15.131:0/955461783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3ac005270 0x7ff3ac00b9c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009f90 tx=0x7ff3ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73986c43697794d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:30:59.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.689+0000 7ff3c7e00640 1 -- 172.21.15.131:0/955461783 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0035020 con 0x7ff3ac005270 2024-04-25T19:30:59.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.690+0000 7ff3c7e00640 1 -- 172.21.15.131:0/955461783 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3c0003b90 con 0x7ff3ac005270 2024-04-25T19:30:59.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.690+0000 7ff3c7e00640 1 -- 172.21.15.131:0/955461783 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0009c10 con 0x7ff3ac005270 2024-04-25T19:30:59.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.690+0000 7ff3cf400640 1 -- 172.21.15.131:0/955461783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3ac005270 msgr2=0x7ff3ac00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:59.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.690+0000 7ff3cf400640 1 --2- 172.21.15.131:0/955461783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3ac005270 0x7ff3ac00b9c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009f90 tx=0x7ff3ac005830 comp rx=0 tx=0).stop 2024-04-25T19:30:59.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.690+0000 7ff3cf400640 1 -- 172.21.15.131:0/955461783 shutdown_connections 2024-04-25T19:30:59.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.690+0000 7ff3cf400640 1 --2- 172.21.15.131:0/955461783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3ac005270 0x7ff3ac00b9c0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:59.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.690+0000 7ff3cf400640 1 -- 172.21.15.131:0/955461783 >> 172.21.15.131:0/955461783 conn(0x7ff3c80d1ae0 msgr2=0x7ff3c80d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:30:59.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.690+0000 7ff3cf400640 1 -- 172.21.15.131:0/955461783 shutdown_connections 2024-04-25T19:30:59.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.690+0000 7ff3cf400640 1 -- 172.21.15.131:0/955461783 wait complete. 2024-04-25T19:30:59.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.693+0000 7ff3cf400640 1 Processor -- start 2024-04-25T19:30:59.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.693+0000 7ff3cf400640 1 -- start start 2024-04-25T19:30:59.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.695+0000 7ff3cf400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3ac005270 0x7ff3c815b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:59.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.695+0000 7ff3cf400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3c8156fc0 0x7ff3c8157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:59.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.695+0000 7ff3cf400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3c81582f0 0x7ff3c80b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:59.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.695+0000 7ff3cf400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c81447d0 con 0x7ff3ac005270 2024-04-25T19:30:59.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.695+0000 7ff3cf400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c815f160 con 0x7ff3c81582f0 2024-04-25T19:30:59.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.695+0000 7ff3cf400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c8162b00 con 0x7ff3c8156fc0 2024-04-25T19:30:59.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.695+0000 7ff3cca00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3ac005270 0x7ff3c815b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:59.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.695+0000 7ff3cca00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3ac005270 0x7ff3c815b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52932/0 (socket says 172.21.15.131:52932) 2024-04-25T19:30:59.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.695+0000 7ff3cca00640 1 -- 172.21.15.131:0/3362716163 learned_addr learned my addr 172.21.15.131:0/3362716163 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:30:59.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.695+0000 7ff3bfe00640 1 --2- 172.21.15.131:0/3362716163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3c8156fc0 0x7ff3c8157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:59.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.695+0000 7ff3cd400640 1 --2- 172.21.15.131:0/3362716163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3c81582f0 0x7ff3c80b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:59.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.695+0000 7ff3cca00640 1 -- 172.21.15.131:0/3362716163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3c8156fc0 msgr2=0x7ff3c8157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:59.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.695+0000 7ff3cca00640 1 --2- 172.21.15.131:0/3362716163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3c8156fc0 0x7ff3c8157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:59.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.695+0000 7ff3cca00640 1 -- 172.21.15.131:0/3362716163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3c81582f0 msgr2=0x7ff3c80b4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:59.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.695+0000 7ff3cca00640 1 --2- 172.21.15.131:0/3362716163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3c81582f0 0x7ff3c80b4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:59.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.695+0000 7ff3cca00640 1 -- 172.21.15.131:0/3362716163 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c8158700 con 0x7ff3ac005270 2024-04-25T19:30:59.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.695+0000 7ff3bfe00640 1 --2- 172.21.15.131:0/3362716163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3c8156fc0 0x7ff3c8157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:30:59.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.695+0000 7ff3cd400640 1 --2- 172.21.15.131:0/3362716163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3c81582f0 0x7ff3c80b4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:30:59.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.696+0000 7ff3cca00640 1 --2- 172.21.15.131:0/3362716163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3ac005270 0x7ff3c815b980 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800d520 tx=0x7ff3b800d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:30:59.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.696+0000 7ff3c5600640 1 -- 172.21.15.131:0/3362716163 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8005230 con 0x7ff3ac005270 2024-04-25T19:30:59.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.696+0000 7ff3c5600640 1 -- 172.21.15.131:0/3362716163 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b80053d0 con 0x7ff3ac005270 2024-04-25T19:30:59.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.696+0000 7ff3c5600640 1 -- 172.21.15.131:0/3362716163 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8012840 con 0x7ff3ac005270 2024-04-25T19:30:59.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.696+0000 7ff3cf400640 1 -- 172.21.15.131:0/3362716163 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c813f1e0 con 0x7ff3ac005270 2024-04-25T19:30:59.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.696+0000 7ff3cf400640 1 -- 172.21.15.131:0/3362716163 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c80b6300 con 0x7ff3ac005270 2024-04-25T19:30:59.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.697+0000 7ff3cf400640 1 -- 172.21.15.131:0/3362716163 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c8050740 con 0x7ff3ac005270 2024-04-25T19:30:59.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.698+0000 7ff3c5600640 1 -- 172.21.15.131:0/3362716163 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff3b80129e0 con 0x7ff3ac005270 2024-04-25T19:30:59.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.699+0000 7ff3c5600640 1 --2- 172.21.15.131:0/3362716163 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff3a40744e0 0x7ff3a40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:30:59.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.699+0000 7ff3c5600640 1 -- 172.21.15.131:0/3362716163 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7ff3b80951f0 con 0x7ff3ac005270 2024-04-25T19:30:59.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.700+0000 7ff3bfe00640 1 --2- 172.21.15.131:0/3362716163 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff3a40744e0 0x7ff3a40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:30:59.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.701+0000 7ff3bfe00640 1 --2- 172.21.15.131:0/3362716163 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff3a40744e0 0x7ff3a40769f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff3c81f99a0 tx=0x7ff3b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:30:59.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.706+0000 7ff3c5600640 1 -- 172.21.15.131:0/3362716163 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff3c8158700 con 0x7ff3ac005270 2024-04-25T19:30:59.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.916+0000 7ff3cf400640 1 -- 172.21.15.131:0/3362716163 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff3c8160020 con 0x7ff3ac005270 2024-04-25T19:30:59.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.917+0000 7ff3c5600640 1 -- 172.21.15.131:0/3362716163 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) ==== 80+0+0 (secure 0 0 0) 0x7ff3b8016020 con 0x7ff3ac005270 2024-04-25T19:30:59.918 INFO:teuthology.orchestra.run.smithi131.stderr:listed 0 entries 2024-04-25T19:30:59.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.919+0000 7ff3cf400640 1 -- 172.21.15.131:0/3362716163 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff3a40744e0 msgr2=0x7ff3a40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:59.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.919+0000 7ff3cf400640 1 --2- 172.21.15.131:0/3362716163 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff3a40744e0 0x7ff3a40769f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff3c81f99a0 tx=0x7ff3b0009040 comp rx=0 tx=0).stop 2024-04-25T19:30:59.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.919+0000 7ff3cf400640 1 -- 172.21.15.131:0/3362716163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3ac005270 msgr2=0x7ff3c815b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:30:59.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.919+0000 7ff3cf400640 1 --2- 172.21.15.131:0/3362716163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3ac005270 0x7ff3c815b980 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800d520 tx=0x7ff3b800d9e0 comp rx=0 tx=0).stop 2024-04-25T19:30:59.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.919+0000 7ff3cf400640 1 -- 172.21.15.131:0/3362716163 shutdown_connections 2024-04-25T19:30:59.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.919+0000 7ff3cf400640 1 --2- 172.21.15.131:0/3362716163 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff3a40744e0 0x7ff3a40769f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:59.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.919+0000 7ff3cf400640 1 --2- 172.21.15.131:0/3362716163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3c8156fc0 0x7ff3c8157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:59.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.919+0000 7ff3cf400640 1 --2- 172.21.15.131:0/3362716163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3c81582f0 0x7ff3c80b4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:59.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.919+0000 7ff3cf400640 1 --2- 172.21.15.131:0/3362716163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3ac005270 0x7ff3c815b980 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:30:59.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.919+0000 7ff3cf400640 1 -- 172.21.15.131:0/3362716163 >> 172.21.15.131:0/3362716163 conn(0x7ff3c80d1ae0 msgr2=0x7ff3c815f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:30:59.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.920+0000 7ff3cf400640 1 -- 172.21.15.131:0/3362716163 shutdown_connections 2024-04-25T19:30:59.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:30:59.920+0000 7ff3cf400640 1 -- 172.21.15.131:0/3362716163 wait complete. 2024-04-25T19:30:59.948 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T19:30:59.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:30:59.949 DEBUG:teuthology.orchestra.run.smithi131:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T19:31:00.134 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2024-04-25T19:31:00.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:31:00.135 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T19:31:00.173 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T19:31:00.173 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:31:00.173 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:31:00.215 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T19:31:00.215 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T19:31:00.216 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:31:00.216 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:31:00.254 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T19:31:00.255 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T19:31:00.255 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:31:00.255 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:31:00.308 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T19:31:00.309 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:31:00.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.567+0000 7f411e600640 1 Processor -- start 2024-04-25T19:31:00.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.567+0000 7f411e600640 1 -- start start 2024-04-25T19:31:00.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.569+0000 7f411e600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4118144500 0x7f4118070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:00.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.569+0000 7f411e600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f41180cdb90 0x7f4118161c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:00.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.569+0000 7f411e600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f411806f5f0 con 0x7f41180cdfa0 2024-04-25T19:31:00.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.569+0000 7f411e600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4118070200 con 0x7f41180cdb90 2024-04-25T19:31:00.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.569+0000 7f411e600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f411806f8d0 con 0x7f4118144500 2024-04-25T19:31:00.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.570+0000 7f4117400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4118144500 0x7f4118070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:00.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.570+0000 7f4116a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f41180cdb90 0x7f4118161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:00.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.570+0000 7f4117400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4118144500 0x7f4118070690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.131:56222/0 (socket says 172.21.15.131:56222) 2024-04-25T19:31:00.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.570+0000 7f4117400640 1 -- 172.21.15.131:0/3768901801 learned_addr learned my addr 172.21.15.131:0/3768901801 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:00.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.571+0000 7f4117400640 1 -- 172.21.15.131:0/3768901801 >> v2:172.21.15.195:3300/0 conn(0x7f41180cdb90 msgr2=0x7f4118161c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:00.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.571+0000 7f4117400640 1 --2- 172.21.15.131:0/3768901801 >> v2:172.21.15.195:3300/0 conn(0x7f41180cdb90 0x7f4118161c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:00.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.571+0000 7f4117400640 1 -- 172.21.15.131:0/3768901801 >> v1:172.21.15.195:6789/0 conn(0x7f41180cdfa0 legacy=0x7f41180ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:00.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.571+0000 7f4117400640 1 -- 172.21.15.131:0/3768901801 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f411806fbb0 con 0x7f4118144500 2024-04-25T19:31:00.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.572+0000 7f4117400640 1 --2- 172.21.15.131:0/3768901801 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4118144500 0x7f4118070690 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4100009870 tx=0x7f410002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=990c57428e3aa941 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:00.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.573+0000 7f4116000640 1 -- 172.21.15.131:0/3768901801 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4100037070 con 0x7f4118144500 2024-04-25T19:31:00.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.573+0000 7f4116000640 1 -- 172.21.15.131:0/3768901801 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4100032440 con 0x7f4118144500 2024-04-25T19:31:00.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.573+0000 7f4116000640 1 -- 172.21.15.131:0/3768901801 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4100032810 con 0x7f4118144500 2024-04-25T19:31:00.575 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.574+0000 7f411e600640 1 -- 172.21.15.131:0/3768901801 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4118144500 msgr2=0x7f4118070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:00.575 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.574+0000 7f411e600640 1 --2- 172.21.15.131:0/3768901801 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4118144500 0x7f4118070690 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4100009870 tx=0x7f410002a210 comp rx=0 tx=0).stop 2024-04-25T19:31:00.575 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.574+0000 7f411e600640 1 -- 172.21.15.131:0/3768901801 shutdown_connections 2024-04-25T19:31:00.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.574+0000 7f411e600640 1 --2- 172.21.15.131:0/3768901801 >> v2:172.21.15.195:3300/0 conn(0x7f41180cdb90 0x7f4118161c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:00.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.574+0000 7f411e600640 1 --2- 172.21.15.131:0/3768901801 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4118144500 0x7f4118070690 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:00.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.574+0000 7f411e600640 1 -- 172.21.15.131:0/3768901801 >> 172.21.15.131:0/3768901801 conn(0x7f4118073050 msgr2=0x7f4118073460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:00.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.574+0000 7f411e600640 1 -- 172.21.15.131:0/3768901801 shutdown_connections 2024-04-25T19:31:00.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.574+0000 7f411e600640 1 -- 172.21.15.131:0/3768901801 wait complete. 2024-04-25T19:31:00.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.577+0000 7f411e600640 1 Processor -- start 2024-04-25T19:31:00.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.577+0000 7f411e600640 1 -- start start 2024-04-25T19:31:00.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.580+0000 7f411e600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41180cdb90 0x7f4118143af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:00.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.580+0000 7f411e600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41180cdfa0 0x7f41181e7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:00.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.580+0000 7f411e600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4118144500 0x7f411813d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:00.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.580+0000 7f411e600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f411806f2e0 con 0x7f41180cdb90 2024-04-25T19:31:00.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.580+0000 7f411e600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f411806f160 con 0x7f41180cdfa0 2024-04-25T19:31:00.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.580+0000 7f411e600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4118162140 con 0x7f4118144500 2024-04-25T19:31:00.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.580+0000 7f4117400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41180cdb90 0x7f4118143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:00.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.580+0000 7f4117400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41180cdb90 0x7f4118143af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52940/0 (socket says 172.21.15.131:52940) 2024-04-25T19:31:00.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.580+0000 7f4117400640 1 -- 172.21.15.131:0/3433358496 learned_addr learned my addr 172.21.15.131:0/3433358496 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:00.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.580+0000 7f4116a00640 1 --2- 172.21.15.131:0/3433358496 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41180cdfa0 0x7f41181e7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:00.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.580+0000 7f4117e00640 1 --2- 172.21.15.131:0/3433358496 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4118144500 0x7f411813d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:00.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.580+0000 7f4117400640 1 -- 172.21.15.131:0/3433358496 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4118144500 msgr2=0x7f411813d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:00.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.580+0000 7f4117400640 1 --2- 172.21.15.131:0/3433358496 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4118144500 0x7f411813d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:00.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.580+0000 7f4117400640 1 -- 172.21.15.131:0/3433358496 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41180cdfa0 msgr2=0x7f41181e7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:00.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.580+0000 7f4117400640 1 --2- 172.21.15.131:0/3433358496 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41180cdfa0 0x7f41181e7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:00.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.580+0000 7f4117400640 1 -- 172.21.15.131:0/3433358496 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41181e7f80 con 0x7f41180cdb90 2024-04-25T19:31:00.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.580+0000 7f4116a00640 1 --2- 172.21.15.131:0/3433358496 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41180cdfa0 0x7f41181e7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:31:00.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.580+0000 7f4117e00640 1 --2- 172.21.15.131:0/3433358496 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4118144500 0x7f411813d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:31:00.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.580+0000 7f4117400640 1 --2- 172.21.15.131:0/3433358496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41180cdb90 0x7f4118143af0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f41000090b0 tx=0x7f41000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:00.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.580+0000 7f410f400640 1 -- 172.21.15.131:0/3433358496 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4100041070 con 0x7f41180cdb90 2024-04-25T19:31:00.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.580+0000 7f410f400640 1 -- 172.21.15.131:0/3433358496 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f410003c870 con 0x7f41180cdb90 2024-04-25T19:31:00.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.580+0000 7f411e600640 1 -- 172.21.15.131:0/3433358496 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f411814fec0 con 0x7f41180cdb90 2024-04-25T19:31:00.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.580+0000 7f410f400640 1 -- 172.21.15.131:0/3433358496 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4100037040 con 0x7f41180cdb90 2024-04-25T19:31:00.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.581+0000 7f411e600640 1 -- 172.21.15.131:0/3433358496 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f411814d5d0 con 0x7f41180cdb90 2024-04-25T19:31:00.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.582+0000 7f411e600640 1 -- 172.21.15.131:0/3433358496 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4118050740 con 0x7f41180cdb90 2024-04-25T19:31:00.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.583+0000 7f410f400640 1 -- 172.21.15.131:0/3433358496 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4100044070 con 0x7f41180cdb90 2024-04-25T19:31:00.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.584+0000 7f410f400640 1 --2- 172.21.15.131:0/3433358496 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f40f40744e0 0x7f40f40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:00.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.585+0000 7f410f400640 1 -- 172.21.15.131:0/3433358496 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f41000b5c50 con 0x7f41180cdb90 2024-04-25T19:31:00.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.585+0000 7f4116a00640 1 --2- 172.21.15.131:0/3433358496 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f40f40744e0 0x7f40f40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:00.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.586+0000 7f4116a00640 1 --2- 172.21.15.131:0/3433358496 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f40f40744e0 0x7f40f40769f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f41180cd580 tx=0x7f410800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:00.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.589+0000 7f410f400640 1 -- 172.21.15.131:0/3433358496 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4100080390 con 0x7f41180cdb90 2024-04-25T19:31:00.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.825+0000 7f411e600640 1 -- 172.21.15.131:0/3433358496 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f411806dae0 con 0x7f41180cdb90 2024-04-25T19:31:00.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.827+0000 7f410f400640 1 -- 172.21.15.131:0/3433358496 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5190 (secure 0 0 0) 0x7f410007fc90 con 0x7f41180cdb90 2024-04-25T19:31:00.828 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:31:00.828 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4706,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3512447940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":3512447940},{"type":"v1","addr":"172.21.15.195:6837","nonce":3512447940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2666088311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":2666088311},{"type":"v1","addr":"172.21.15.195:6836","nonce":2666088311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1450320216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1450320216},{"type":"v1","addr":"172.21.15.131:6834","nonce":1450320216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T19:24:15.727328+0000","modified":"2024-04-25T19:24:18.791952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/274211686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":274211686},{"type":"v1","addr":"172.21.15.131:6835","nonce":274211686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5481,"qdb_cluster":[5481]},"id":3}]} 2024-04-25T19:31:00.829 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 25 2024-04-25T19:31:00.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.829+0000 7f411e600640 1 -- 172.21.15.131:0/3433358496 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f40f40744e0 msgr2=0x7f40f40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:00.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.829+0000 7f411e600640 1 --2- 172.21.15.131:0/3433358496 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f40f40744e0 0x7f40f40769f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f41180cd580 tx=0x7f410800b040 comp rx=0 tx=0).stop 2024-04-25T19:31:00.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.829+0000 7f411e600640 1 -- 172.21.15.131:0/3433358496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41180cdb90 msgr2=0x7f4118143af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:00.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.829+0000 7f411e600640 1 --2- 172.21.15.131:0/3433358496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41180cdb90 0x7f4118143af0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f41000090b0 tx=0x7f41000046c0 comp rx=0 tx=0).stop 2024-04-25T19:31:00.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.829+0000 7f411e600640 1 -- 172.21.15.131:0/3433358496 shutdown_connections 2024-04-25T19:31:00.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.829+0000 7f411e600640 1 --2- 172.21.15.131:0/3433358496 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f40f40744e0 0x7f40f40769f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:00.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.829+0000 7f411e600640 1 --2- 172.21.15.131:0/3433358496 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4118144500 0x7f411813d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:00.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.829+0000 7f411e600640 1 --2- 172.21.15.131:0/3433358496 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41180cdfa0 0x7f41181e7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:00.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.829+0000 7f411e600640 1 --2- 172.21.15.131:0/3433358496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41180cdb90 0x7f4118143af0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:00.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.829+0000 7f411e600640 1 -- 172.21.15.131:0/3433358496 >> 172.21.15.131:0/3433358496 conn(0x7f4118073050 msgr2=0x7f411813ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:00.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.829+0000 7f411e600640 1 -- 172.21.15.131:0/3433358496 shutdown_connections 2024-04-25T19:31:00.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:00.829+0000 7f411e600640 1 -- 172.21.15.131:0/3433358496 wait complete. 2024-04-25T19:31:00.858 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:31:01.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.121+0000 7f6c52000640 1 Processor -- start 2024-04-25T19:31:01.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.122+0000 7f6c52000640 1 -- start start 2024-04-25T19:31:01.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.124+0000 7f6c52000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6c4c0b7c60 0x7f6c4c0d3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:01.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.124+0000 7f6c52000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c4c06c8a0 0x7f6c4c06ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:01.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.124+0000 7f6c52000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c4c0d1f40 con 0x7f6c4c06ecb0 2024-04-25T19:31:01.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.124+0000 7f6c52000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f6c4c0d0430 con 0x7f6c4c0b7c60 2024-04-25T19:31:01.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.124+0000 7f6c52000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6c4c0d21e0 con 0x7f6c4c06c8a0 2024-04-25T19:31:01.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.124+0000 7f6c43e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6c4c0b7c60 0x7f6c4c0d3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:01.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.124+0000 7f6c43e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6c4c0b7c60 0x7f6c4c0d3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52952/0 (socket says 172.21.15.131:52952) 2024-04-25T19:31:01.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.124+0000 7f6c43e00640 1 -- 172.21.15.131:0/2455637756 learned_addr learned my addr 172.21.15.131:0/2455637756 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:01.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.124+0000 7f6c51600640 1 --2- 172.21.15.131:0/2455637756 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c4c06c8a0 0x7f6c4c06ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:01.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.124+0000 7f6c43e00640 1 -- 172.21.15.131:0/2455637756 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c4c06c8a0 msgr2=0x7f6c4c06ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:01.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.124+0000 7f6c43e00640 1 --2- 172.21.15.131:0/2455637756 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c4c06c8a0 0x7f6c4c06ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:01.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.124+0000 7f6c43e00640 1 -- 172.21.15.131:0/2455637756 >> v1:172.21.15.195:6789/0 conn(0x7f6c4c06ecb0 legacy=0x7f6c4c0b7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:01.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.124+0000 7f6c43e00640 1 -- 172.21.15.131:0/2455637756 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c4c0d06d0 con 0x7f6c4c0b7c60 2024-04-25T19:31:01.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.125+0000 7f6c43e00640 1 --2- 172.21.15.131:0/2455637756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c4c0b7c60 0x7f6c4c0d3160 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6c34009870 tx=0x7f6c3402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a8a624b1c71607 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:01.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.125+0000 7f6c4be00640 1 -- 172.21.15.131:0/2455637756 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c34037070 con 0x7f6c4c0b7c60 2024-04-25T19:31:01.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.125+0000 7f6c4be00640 1 -- 172.21.15.131:0/2455637756 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c34032440 con 0x7f6c4c0b7c60 2024-04-25T19:31:01.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.125+0000 7f6c4be00640 1 -- 172.21.15.131:0/2455637756 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c34032810 con 0x7f6c4c0b7c60 2024-04-25T19:31:01.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.126+0000 7f6c52000640 1 -- 172.21.15.131:0/2455637756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c4c0b7c60 msgr2=0x7f6c4c0d3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:01.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.126+0000 7f6c52000640 1 --2- 172.21.15.131:0/2455637756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c4c0b7c60 0x7f6c4c0d3160 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6c34009870 tx=0x7f6c3402a200 comp rx=0 tx=0).stop 2024-04-25T19:31:01.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.126+0000 7f6c52000640 1 -- 172.21.15.131:0/2455637756 shutdown_connections 2024-04-25T19:31:01.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.126+0000 7f6c52000640 1 --2- 172.21.15.131:0/2455637756 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c4c06c8a0 0x7f6c4c06ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:01.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.126+0000 7f6c52000640 1 --2- 172.21.15.131:0/2455637756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c4c0b7c60 0x7f6c4c0d3160 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:01.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.126+0000 7f6c52000640 1 -- 172.21.15.131:0/2455637756 >> 172.21.15.131:0/2455637756 conn(0x7f6c4c09b7d0 msgr2=0x7f6c4c09bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:01.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.126+0000 7f6c52000640 1 -- 172.21.15.131:0/2455637756 shutdown_connections 2024-04-25T19:31:01.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.126+0000 7f6c52000640 1 -- 172.21.15.131:0/2455637756 wait complete. 2024-04-25T19:31:01.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.128+0000 7f6c52000640 1 Processor -- start 2024-04-25T19:31:01.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.128+0000 7f6c52000640 1 -- start start 2024-04-25T19:31:01.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.130+0000 7f6c52000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c4c06c8a0 0x7f6c4c09fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:01.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.130+0000 7f6c52000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c4c06ecb0 0x7f6c4c14eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:01.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.130+0000 7f6c52000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c4c0c7150 0x7f6c4c0c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:01.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.130+0000 7f6c52000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c163bb0 con 0x7f6c4c06c8a0 2024-04-25T19:31:01.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.130+0000 7f6c52000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c0d24c0 con 0x7f6c4c0c7150 2024-04-25T19:31:01.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.130+0000 7f6c52000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6c4c163d30 con 0x7f6c4c06ecb0 2024-04-25T19:31:01.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.130+0000 7f6c50c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c4c06c8a0 0x7f6c4c09fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:01.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.130+0000 7f6c50c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c4c06c8a0 0x7f6c4c09fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52958/0 (socket says 172.21.15.131:52958) 2024-04-25T19:31:01.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.130+0000 7f6c50c00640 1 -- 172.21.15.131:0/1180799091 learned_addr learned my addr 172.21.15.131:0/1180799091 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:01.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.131+0000 7f6c43e00640 1 --2- 172.21.15.131:0/1180799091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c4c06ecb0 0x7f6c4c14eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:01.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.131+0000 7f6c50c00640 1 -- 172.21.15.131:0/1180799091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c4c06ecb0 msgr2=0x7f6c4c14eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:01.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.131+0000 7f6c50c00640 1 --2- 172.21.15.131:0/1180799091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c4c06ecb0 0x7f6c4c14eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:01.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.131+0000 7f6c51600640 1 --2- 172.21.15.131:0/1180799091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c4c0c7150 0x7f6c4c0c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:01.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.131+0000 7f6c50c00640 1 -- 172.21.15.131:0/1180799091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c4c0c7150 msgr2=0x7f6c4c0c7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:01.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.131+0000 7f6c50c00640 1 --2- 172.21.15.131:0/1180799091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c4c0c7150 0x7f6c4c0c7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:01.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.131+0000 7f6c50c00640 1 -- 172.21.15.131:0/1180799091 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c4c0a04c0 con 0x7f6c4c06c8a0 2024-04-25T19:31:01.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.131+0000 7f6c50c00640 1 --2- 172.21.15.131:0/1180799091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c4c06c8a0 0x7f6c4c09fd90 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c009fd0 tx=0x7f6c3c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:01.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.131+0000 7f6c49600640 1 -- 172.21.15.131:0/1180799091 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c015030 con 0x7f6c4c06c8a0 2024-04-25T19:31:01.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.131+0000 7f6c49600640 1 -- 172.21.15.131:0/1180799091 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c3c004020 con 0x7f6c4c06c8a0 2024-04-25T19:31:01.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.131+0000 7f6c52000640 1 -- 172.21.15.131:0/1180799091 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c4c0c6390 con 0x7f6c4c06c8a0 2024-04-25T19:31:01.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.131+0000 7f6c49600640 1 -- 172.21.15.131:0/1180799091 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c004410 con 0x7f6c4c06c8a0 2024-04-25T19:31:01.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.131+0000 7f6c52000640 1 -- 172.21.15.131:0/1180799091 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c4c0c6950 con 0x7f6c4c06c8a0 2024-04-25T19:31:01.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.132+0000 7f6c52000640 1 -- 172.21.15.131:0/1180799091 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c4c0cf5f0 con 0x7f6c4c06c8a0 2024-04-25T19:31:01.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.134+0000 7f6c49600640 1 -- 172.21.15.131:0/1180799091 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6c3c018070 con 0x7f6c4c06c8a0 2024-04-25T19:31:01.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.134+0000 7f6c49600640 1 --2- 172.21.15.131:0/1180799091 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6c280744b0 0x7f6c280769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:01.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.135+0000 7f6c49600640 1 -- 172.21.15.131:0/1180799091 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f6c3c094e60 con 0x7f6c4c06c8a0 2024-04-25T19:31:01.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.135+0000 7f6c43e00640 1 --2- 172.21.15.131:0/1180799091 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6c280744b0 0x7f6c280769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:01.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.137+0000 7f6c43e00640 1 --2- 172.21.15.131:0/1180799091 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6c280744b0 0x7f6c280769c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6c34034000 tx=0x7f6c3402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:01.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.140+0000 7f6c49600640 1 -- 172.21.15.131:0/1180799091 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6c3c05f510 con 0x7f6c4c06c8a0 2024-04-25T19:31:01.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.341+0000 7f6c52000640 1 -- 172.21.15.131:0/1180799091 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6c4c050740 con 0x7f6c4c06c8a0 2024-04-25T19:31:01.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.344+0000 7f6c49600640 1 -- 172.21.15.131:0/1180799091 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16788 (secure 0 0 0) 0x7f6c3c05ee10 con 0x7f6c4c06c8a0 2024-04-25T19:31:01.344 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:31:01.345 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":47,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:24:58.382161+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:24:13.848038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T19:24:14.699910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.4","mappings":[{"from":0,"to":5}]},{"pgid":"7.2c","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:31:01.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.347+0000 7f6c52000640 1 -- 172.21.15.131:0/1180799091 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6c280744b0 msgr2=0x7f6c280769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:01.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.347+0000 7f6c52000640 1 --2- 172.21.15.131:0/1180799091 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6c280744b0 0x7f6c280769c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6c34034000 tx=0x7f6c3402e000 comp rx=0 tx=0).stop 2024-04-25T19:31:01.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.347+0000 7f6c52000640 1 -- 172.21.15.131:0/1180799091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c4c06c8a0 msgr2=0x7f6c4c09fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:01.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.347+0000 7f6c52000640 1 --2- 172.21.15.131:0/1180799091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c4c06c8a0 0x7f6c4c09fd90 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c009fd0 tx=0x7f6c3c00b870 comp rx=0 tx=0).stop 2024-04-25T19:31:01.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.347+0000 7f6c52000640 1 -- 172.21.15.131:0/1180799091 shutdown_connections 2024-04-25T19:31:01.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.347+0000 7f6c52000640 1 --2- 172.21.15.131:0/1180799091 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f6c280744b0 0x7f6c280769c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:01.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.347+0000 7f6c52000640 1 --2- 172.21.15.131:0/1180799091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c4c06ecb0 0x7f6c4c14eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:01.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.347+0000 7f6c52000640 1 --2- 172.21.15.131:0/1180799091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c4c0c7150 0x7f6c4c0c7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:01.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.347+0000 7f6c52000640 1 --2- 172.21.15.131:0/1180799091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c4c06c8a0 0x7f6c4c09fd90 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:01.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.347+0000 7f6c52000640 1 -- 172.21.15.131:0/1180799091 >> 172.21.15.131:0/1180799091 conn(0x7f6c4c09b7d0 msgr2=0x7f6c4c163ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:01.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.347+0000 7f6c52000640 1 -- 172.21.15.131:0/1180799091 shutdown_connections 2024-04-25T19:31:01.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.347+0000 7f6c52000640 1 -- 172.21.15.131:0/1180799091 wait complete. 2024-04-25T19:31:01.375 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T19:22:04.178847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T19:24:13.848038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T19:24:14.699910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T19:31:01.376 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T19:31:01.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.636+0000 7ff0ecc00640 1 Processor -- start 2024-04-25T19:31:01.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.636+0000 7ff0ecc00640 1 -- start start 2024-04-25T19:31:01.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.638+0000 7ff0ecc00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff0e815de90 0x7ff0e81606a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:01.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.638+0000 7ff0ecc00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff0e8163c90 0x7ff0e806f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:01.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.638+0000 7ff0ecc00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0e80b0090 con 0x7ff0e806d5d0 2024-04-25T19:31:01.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.638+0000 7ff0ecc00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ff0e8160c80 con 0x7ff0e8163c90 2024-04-25T19:31:01.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.638+0000 7ff0ecc00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7ff0e8160f60 con 0x7ff0e815de90 2024-04-25T19:31:01.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.639+0000 7ff0e6a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff0e8163c90 0x7ff0e806f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:01.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.639+0000 7ff0e6a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff0e8163c90 0x7ff0e806f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52972/0 (socket says 172.21.15.131:52972) 2024-04-25T19:31:01.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.639+0000 7ff0e6a00640 1 -- 172.21.15.131:0/2808614694 learned_addr learned my addr 172.21.15.131:0/2808614694 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:01.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.639+0000 7ff0e7400640 1 --2- 172.21.15.131:0/2808614694 >> v2:172.21.15.195:3300/0 conn(0x7ff0e815de90 0x7ff0e81606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:01.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.639+0000 7ff0e6a00640 1 -- 172.21.15.131:0/2808614694 >> v2:172.21.15.195:3300/0 conn(0x7ff0e815de90 msgr2=0x7ff0e81606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:01.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.639+0000 7ff0e6a00640 1 --2- 172.21.15.131:0/2808614694 >> v2:172.21.15.195:3300/0 conn(0x7ff0e815de90 0x7ff0e81606a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:01.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.639+0000 7ff0e6a00640 1 -- 172.21.15.131:0/2808614694 >> v1:172.21.15.131:6789/0 conn(0x7ff0e806d5d0 legacy=0x7ff0e806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:01.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.639+0000 7ff0e6a00640 1 -- 172.21.15.131:0/2808614694 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e8161240 con 0x7ff0e8163c90 2024-04-25T19:31:01.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.640+0000 7ff0e6a00640 1 --2- 172.21.15.131:0/2808614694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0e8163c90 0x7ff0e806f0c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8072710 tx=0x7ff0d402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c74feb7f82f38a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:01.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.641+0000 7ff0e6000640 1 -- 172.21.15.131:0/2808614694 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4037070 con 0x7ff0e8163c90 2024-04-25T19:31:01.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.641+0000 7ff0e6000640 1 -- 172.21.15.131:0/2808614694 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d4032440 con 0x7ff0e8163c90 2024-04-25T19:31:01.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.641+0000 7ff0e6000640 1 -- 172.21.15.131:0/2808614694 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4032810 con 0x7ff0e8163c90 2024-04-25T19:31:01.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.641+0000 7ff0ecc00640 1 -- 172.21.15.131:0/2808614694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0e8163c90 msgr2=0x7ff0e806f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:01.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.641+0000 7ff0ecc00640 1 --2- 172.21.15.131:0/2808614694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0e8163c90 0x7ff0e806f0c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8072710 tx=0x7ff0d402a1e0 comp rx=0 tx=0).stop 2024-04-25T19:31:01.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.641+0000 7ff0ecc00640 1 -- 172.21.15.131:0/2808614694 shutdown_connections 2024-04-25T19:31:01.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.641+0000 7ff0ecc00640 1 --2- 172.21.15.131:0/2808614694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0e8163c90 0x7ff0e806f0c0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:01.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.641+0000 7ff0ecc00640 1 --2- 172.21.15.131:0/2808614694 >> v2:172.21.15.195:3300/0 conn(0x7ff0e815de90 0x7ff0e81606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:01.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.641+0000 7ff0ecc00640 1 -- 172.21.15.131:0/2808614694 >> 172.21.15.131:0/2808614694 conn(0x7ff0e8072f40 msgr2=0x7ff0e8073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:01.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.641+0000 7ff0ecc00640 1 -- 172.21.15.131:0/2808614694 shutdown_connections 2024-04-25T19:31:01.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.641+0000 7ff0ecc00640 1 -- 172.21.15.131:0/2808614694 wait complete. 2024-04-25T19:31:01.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.644+0000 7ff0ecc00640 1 Processor -- start 2024-04-25T19:31:01.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.644+0000 7ff0ecc00640 1 -- start start 2024-04-25T19:31:01.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.645+0000 7ff0ecc00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0e806d5d0 0x7ff0e8148a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:01.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.645+0000 7ff0ecc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0e815de90 0x7ff0e8148110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:01.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.645+0000 7ff0ecc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff0e8163c90 0x7ff0e815a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:01.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.645+0000 7ff0ecc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e806f780 con 0x7ff0e815de90 2024-04-25T19:31:01.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.645+0000 7ff0ecc00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e806f600 con 0x7ff0e806d5d0 2024-04-25T19:31:01.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.645+0000 7ff0ecc00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff0e8070d30 con 0x7ff0e8163c90 2024-04-25T19:31:01.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.645+0000 7ff0e6a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0e815de90 0x7ff0e8148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:01.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.645+0000 7ff0e6a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0e815de90 0x7ff0e8148110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52988/0 (socket says 172.21.15.131:52988) 2024-04-25T19:31:01.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.646+0000 7ff0e6a00640 1 -- 172.21.15.131:0/321977885 learned_addr learned my addr 172.21.15.131:0/321977885 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:01.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.646+0000 7ff0e6a00640 1 -- 172.21.15.131:0/321977885 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff0e8163c90 msgr2=0x7ff0e815a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:01.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.646+0000 7ff0e6a00640 1 --2- 172.21.15.131:0/321977885 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff0e8163c90 0x7ff0e815a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:01.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.646+0000 7ff0e6a00640 1 -- 172.21.15.131:0/321977885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0e806d5d0 msgr2=0x7ff0e8148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:01.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.646+0000 7ff0e6a00640 1 --2- 172.21.15.131:0/321977885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0e806d5d0 0x7ff0e8148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:01.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.646+0000 7ff0e6a00640 1 -- 172.21.15.131:0/321977885 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e815f0e0 con 0x7ff0e815de90 2024-04-25T19:31:01.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.646+0000 7ff0e6a00640 1 --2- 172.21.15.131:0/321977885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0e815de90 0x7ff0e8148110 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff0d402a220 tx=0x7ff0d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:01.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.646+0000 7ff0df400640 1 -- 172.21.15.131:0/321977885 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4037040 con 0x7ff0e815de90 2024-04-25T19:31:01.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.647+0000 7ff0df400640 1 -- 172.21.15.131:0/321977885 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d4042070 con 0x7ff0e815de90 2024-04-25T19:31:01.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.647+0000 7ff0ecc00640 1 -- 172.21.15.131:0/321977885 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e815f3c0 con 0x7ff0e815de90 2024-04-25T19:31:01.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.647+0000 7ff0df400640 1 -- 172.21.15.131:0/321977885 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4030bb0 con 0x7ff0e815de90 2024-04-25T19:31:01.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.647+0000 7ff0ecc00640 1 -- 172.21.15.131:0/321977885 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e815f980 con 0x7ff0e815de90 2024-04-25T19:31:01.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.648+0000 7ff0ecc00640 1 -- 172.21.15.131:0/321977885 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0e815ee30 con 0x7ff0e815de90 2024-04-25T19:31:01.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.649+0000 7ff0df400640 1 -- 172.21.15.131:0/321977885 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff0d4047460 con 0x7ff0e815de90 2024-04-25T19:31:01.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.650+0000 7ff0df400640 1 --2- 172.21.15.131:0/321977885 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff0c80744b0 0x7ff0c80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:01.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.650+0000 7ff0df400640 1 -- 172.21.15.131:0/321977885 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7ff0d40b5f00 con 0x7ff0e815de90 2024-04-25T19:31:01.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.650+0000 7ff0e7400640 1 --2- 172.21.15.131:0/321977885 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff0c80744b0 0x7ff0c80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:01.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.652+0000 7ff0e7400640 1 --2- 172.21.15.131:0/321977885 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff0c80744b0 0x7ff0c80769c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80b7880 tx=0x7ff0d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:01.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.655+0000 7ff0df400640 1 -- 172.21.15.131:0/321977885 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff0d4080000 con 0x7ff0e815de90 2024-04-25T19:31:01.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.838+0000 7ff0ecc00640 1 -- 172.21.15.131:0/321977885 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff0e8076c60 con 0x7ff0e815de90 2024-04-25T19:31:01.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.839+0000 7ff0df400640 1 -- 172.21.15.131:0/321977885 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) ==== 93+0+10 (secure 0 0 0) 0x7ff0d4084300 con 0x7ff0e815de90 2024-04-25T19:31:01.840 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-25T19:31:01.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.842+0000 7ff0ecc00640 1 -- 172.21.15.131:0/321977885 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff0c80744b0 msgr2=0x7ff0c80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:01.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.842+0000 7ff0ecc00640 1 --2- 172.21.15.131:0/321977885 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff0c80744b0 0x7ff0c80769c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80b7880 tx=0x7ff0d8008040 comp rx=0 tx=0).stop 2024-04-25T19:31:01.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.842+0000 7ff0ecc00640 1 -- 172.21.15.131:0/321977885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0e815de90 msgr2=0x7ff0e8148110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:01.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.842+0000 7ff0ecc00640 1 --2- 172.21.15.131:0/321977885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0e815de90 0x7ff0e8148110 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff0d402a220 tx=0x7ff0d40046c0 comp rx=0 tx=0).stop 2024-04-25T19:31:01.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.842+0000 7ff0ecc00640 1 -- 172.21.15.131:0/321977885 shutdown_connections 2024-04-25T19:31:01.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.842+0000 7ff0ecc00640 1 --2- 172.21.15.131:0/321977885 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff0c80744b0 0x7ff0c80769c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:01.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.842+0000 7ff0ecc00640 1 --2- 172.21.15.131:0/321977885 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff0e8163c90 0x7ff0e815a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:01.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.842+0000 7ff0ecc00640 1 --2- 172.21.15.131:0/321977885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0e815de90 0x7ff0e8148110 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:01.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.842+0000 7ff0ecc00640 1 --2- 172.21.15.131:0/321977885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0e806d5d0 0x7ff0e8148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:01.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.842+0000 7ff0ecc00640 1 -- 172.21.15.131:0/321977885 >> 172.21.15.131:0/321977885 conn(0x7ff0e8072f40 msgr2=0x7ff0e806f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:01.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.843+0000 7ff0ecc00640 1 -- 172.21.15.131:0/321977885 shutdown_connections 2024-04-25T19:31:01.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:01.843+0000 7ff0ecc00640 1 -- 172.21.15.131:0/321977885 wait complete. 2024-04-25T19:31:01.869 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T19:31:02.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.138+0000 7f03db400640 1 Processor -- start 2024-04-25T19:31:02.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.138+0000 7f03db400640 1 -- start start 2024-04-25T19:31:02.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.140+0000 7f03db400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f03d4070630 0x7f03d40cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:02.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.140+0000 7f03db400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03d415adf0 0x7f03d406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:02.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.140+0000 7f03db400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f03d406db10 0x7f03d40b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:02.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.140+0000 7f03db400640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f03d40713f0 con 0x7f03d406db10 2024-04-25T19:31:02.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.140+0000 7f03db400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f03d40701a0 con 0x7f03d4070630 2024-04-25T19:31:02.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.140+0000 7f03db400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f03d406df20 con 0x7f03d415adf0 2024-04-25T19:31:02.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.140+0000 7f03d9400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f03d406db10 0x7f03d40b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:02.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.141+0000 7f03d9400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f03d406db10 0x7f03d40b59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52990/0 (socket says 172.21.15.131:52990) 2024-04-25T19:31:02.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.141+0000 7f03d9400640 1 -- 172.21.15.131:0/1404383721 learned_addr learned my addr 172.21.15.131:0/1404383721 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:02.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.141+0000 7f03d8a00640 1 --2- 172.21.15.131:0/1404383721 >> v2:172.21.15.195:3300/0 conn(0x7f03d4070630 0x7f03d40cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:02.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.141+0000 7f03d3e00640 1 --2- 172.21.15.131:0/1404383721 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03d415adf0 0x7f03d406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:02.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.141+0000 7f03d9400640 1 -- 172.21.15.131:0/1404383721 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03d415adf0 msgr2=0x7f03d406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:02.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.141+0000 7f03d9400640 1 --2- 172.21.15.131:0/1404383721 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03d415adf0 0x7f03d406d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:02.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.141+0000 7f03d9400640 1 -- 172.21.15.131:0/1404383721 >> v2:172.21.15.195:3300/0 conn(0x7f03d4070630 msgr2=0x7f03d40cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:02.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.141+0000 7f03d9400640 1 --2- 172.21.15.131:0/1404383721 >> v2:172.21.15.195:3300/0 conn(0x7f03d4070630 0x7f03d40cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:02.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.141+0000 7f03d9400640 1 -- 172.21.15.131:0/1404383721 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d4071110 con 0x7f03d406db10 2024-04-25T19:31:02.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.142+0000 7f03d9400640 1 --2- 172.21.15.131:0/1404383721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03d406db10 0x7f03d40b59c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f03d40d2970 tx=0x7f03cc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95015d04c500d6d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:02.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.143+0000 7f03d3400640 1 -- 172.21.15.131:0/1404383721 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03cc036070 con 0x7f03d406db10 2024-04-25T19:31:02.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.143+0000 7f03d3400640 1 -- 172.21.15.131:0/1404383721 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03cc031600 con 0x7f03d406db10 2024-04-25T19:31:02.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.143+0000 7f03d3400640 1 -- 172.21.15.131:0/1404383721 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03cc0319d0 con 0x7f03d406db10 2024-04-25T19:31:02.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.143+0000 7f03db400640 1 -- 172.21.15.131:0/1404383721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03d406db10 msgr2=0x7f03d40b59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:02.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.143+0000 7f03db400640 1 --2- 172.21.15.131:0/1404383721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03d406db10 0x7f03d40b59c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f03d40d2970 tx=0x7f03cc02a610 comp rx=0 tx=0).stop 2024-04-25T19:31:02.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.144+0000 7f03db400640 1 -- 172.21.15.131:0/1404383721 shutdown_connections 2024-04-25T19:31:02.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.144+0000 7f03db400640 1 --2- 172.21.15.131:0/1404383721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03d406db10 0x7f03d40b59c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:02.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.144+0000 7f03db400640 1 --2- 172.21.15.131:0/1404383721 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03d415adf0 0x7f03d406d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:02.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.144+0000 7f03db400640 1 --2- 172.21.15.131:0/1404383721 >> v2:172.21.15.195:3300/0 conn(0x7f03d4070630 0x7f03d40cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:02.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.144+0000 7f03db400640 1 -- 172.21.15.131:0/1404383721 >> 172.21.15.131:0/1404383721 conn(0x7f03d4073090 msgr2=0x7f03d40734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:02.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.144+0000 7f03db400640 1 -- 172.21.15.131:0/1404383721 shutdown_connections 2024-04-25T19:31:02.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.144+0000 7f03db400640 1 -- 172.21.15.131:0/1404383721 wait complete. 2024-04-25T19:31:02.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.146+0000 7f03db400640 1 Processor -- start 2024-04-25T19:31:02.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.146+0000 7f03db400640 1 -- start start 2024-04-25T19:31:02.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.148+0000 7f03db400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03d406db10 0x7f03d415d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:02.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.148+0000 7f03db400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03d4070630 0x7f03d4160020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:02.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.148+0000 7f03db400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03d415adf0 0x7f03d40b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:02.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.148+0000 7f03db400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f03d40b0d00 con 0x7f03d406db10 2024-04-25T19:31:02.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.148+0000 7f03db400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f03d406fe30 con 0x7f03d4070630 2024-04-25T19:31:02.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.148+0000 7f03db400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f03d40b0e80 con 0x7f03d415adf0 2024-04-25T19:31:02.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.148+0000 7f03d8a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03d406db10 0x7f03d415d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:02.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.148+0000 7f03d8a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03d406db10 0x7f03d415d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52992/0 (socket says 172.21.15.131:52992) 2024-04-25T19:31:02.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.148+0000 7f03d8a00640 1 -- 172.21.15.131:0/983617774 learned_addr learned my addr 172.21.15.131:0/983617774 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:02.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.148+0000 7f03d9400640 1 --2- 172.21.15.131:0/983617774 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03d415adf0 0x7f03d40b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:02.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.148+0000 7f03d3e00640 1 --2- 172.21.15.131:0/983617774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03d4070630 0x7f03d4160020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:02.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.148+0000 7f03d8a00640 1 -- 172.21.15.131:0/983617774 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03d415adf0 msgr2=0x7f03d40b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:02.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.148+0000 7f03d8a00640 1 --2- 172.21.15.131:0/983617774 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03d415adf0 0x7f03d40b56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:02.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.148+0000 7f03d8a00640 1 -- 172.21.15.131:0/983617774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03d4070630 msgr2=0x7f03d4160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:02.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.148+0000 7f03d8a00640 1 --2- 172.21.15.131:0/983617774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03d4070630 0x7f03d4160020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:02.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.149+0000 7f03d8a00640 1 -- 172.21.15.131:0/983617774 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d40b4600 con 0x7f03d406db10 2024-04-25T19:31:02.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.149+0000 7f03d9400640 1 --2- 172.21.15.131:0/983617774 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03d415adf0 0x7f03d40b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:31:02.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.149+0000 7f03d3e00640 1 --2- 172.21.15.131:0/983617774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03d4070630 0x7f03d4160020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:31:02.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.149+0000 7f03d8a00640 1 --2- 172.21.15.131:0/983617774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03d406db10 0x7f03d415d7c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f03c400d5d0 tx=0x7f03c400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:02.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.149+0000 7f03d0c00640 1 -- 172.21.15.131:0/983617774 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c4004240 con 0x7f03d406db10 2024-04-25T19:31:02.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.149+0000 7f03d0c00640 1 -- 172.21.15.131:0/983617774 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03c40043e0 con 0x7f03d406db10 2024-04-25T19:31:02.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.149+0000 7f03d0c00640 1 -- 172.21.15.131:0/983617774 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c4003830 con 0x7f03d406db10 2024-04-25T19:31:02.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.149+0000 7f03db400640 1 -- 172.21.15.131:0/983617774 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03d40b48e0 con 0x7f03d406db10 2024-04-25T19:31:02.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.149+0000 7f03db400640 1 -- 172.21.15.131:0/983617774 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03d40b4ea0 con 0x7f03d406db10 2024-04-25T19:31:02.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.151+0000 7f03db400640 1 -- 172.21.15.131:0/983617774 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03d4050740 con 0x7f03d406db10 2024-04-25T19:31:02.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.152+0000 7f03d0c00640 1 -- 172.21.15.131:0/983617774 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f03c40039d0 con 0x7f03d406db10 2024-04-25T19:31:02.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.153+0000 7f03d0c00640 1 --2- 172.21.15.131:0/983617774 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f03b00744b0 0x7f03b00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:02.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.153+0000 7f03d0c00640 1 -- 172.21.15.131:0/983617774 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f03c4095660 con 0x7f03d406db10 2024-04-25T19:31:02.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.153+0000 7f03d3e00640 1 --2- 172.21.15.131:0/983617774 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f03b00744b0 0x7f03b00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:02.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.155+0000 7f03d3e00640 1 --2- 172.21.15.131:0/983617774 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f03b00744b0 0x7f03b00769c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f03bc006fd0 tx=0x7f03bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:02.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.158+0000 7f03d0c00640 1 -- 172.21.15.131:0/983617774 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f03c405fd10 con 0x7f03d406db10 2024-04-25T19:31:02.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.356+0000 7f03db400640 1 -- 172.21.15.131:0/983617774 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f03d406f2e0 con 0x7f03d406db10 2024-04-25T19:31:02.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.357+0000 7f03d0c00640 1 -- 172.21.15.131:0/983617774 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) ==== 104+0+11 (secure 0 0 0) 0x7f03c405f610 con 0x7f03d406db10 2024-04-25T19:31:02.358 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-25T19:31:02.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.360+0000 7f03db400640 1 -- 172.21.15.131:0/983617774 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f03b00744b0 msgr2=0x7f03b00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:02.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.360+0000 7f03db400640 1 --2- 172.21.15.131:0/983617774 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f03b00744b0 0x7f03b00769c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f03bc006fd0 tx=0x7f03bc008040 comp rx=0 tx=0).stop 2024-04-25T19:31:02.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.360+0000 7f03db400640 1 -- 172.21.15.131:0/983617774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03d406db10 msgr2=0x7f03d415d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:02.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.360+0000 7f03db400640 1 --2- 172.21.15.131:0/983617774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03d406db10 0x7f03d415d7c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f03c400d5d0 tx=0x7f03c400da90 comp rx=0 tx=0).stop 2024-04-25T19:31:02.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.360+0000 7f03db400640 1 -- 172.21.15.131:0/983617774 shutdown_connections 2024-04-25T19:31:02.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.360+0000 7f03db400640 1 --2- 172.21.15.131:0/983617774 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f03b00744b0 0x7f03b00769c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:02.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.360+0000 7f03db400640 1 --2- 172.21.15.131:0/983617774 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03d415adf0 0x7f03d40b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:02.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.360+0000 7f03db400640 1 --2- 172.21.15.131:0/983617774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03d4070630 0x7f03d4160020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:02.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.360+0000 7f03db400640 1 --2- 172.21.15.131:0/983617774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03d406db10 0x7f03d415d7c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:02.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.360+0000 7f03db400640 1 -- 172.21.15.131:0/983617774 >> 172.21.15.131:0/983617774 conn(0x7f03d4073090 msgr2=0x7f03d415b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:02.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.360+0000 7f03db400640 1 -- 172.21.15.131:0/983617774 shutdown_connections 2024-04-25T19:31:02.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.360+0000 7f03db400640 1 -- 172.21.15.131:0/983617774 wait complete. 2024-04-25T19:31:02.385 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T19:31:02.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.651+0000 7fa51aa00640 1 Processor -- start 2024-04-25T19:31:02.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.652+0000 7fa51aa00640 1 -- start start 2024-04-25T19:31:02.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.654+0000 7fa51aa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa51406dce0 0x7fa5140af340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:02.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.654+0000 7fa51aa00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa51415fff0 0x7fa5140b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:02.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.654+0000 7fa51aa00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5140af9b0 con 0x7fa5140b0a50 2024-04-25T19:31:02.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.654+0000 7fa51aa00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa5140b54c0 con 0x7fa51415fff0 2024-04-25T19:31:02.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.654+0000 7fa51aa00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa5140afc90 con 0x7fa51406dce0 2024-04-25T19:31:02.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.654+0000 7fa519600640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fa5140b0a50 0x7fa51406d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:60774/0 (socket says 172.21.15.131:60774) 2024-04-25T19:31:02.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.654+0000 7fa519600640 1 -- 172.21.15.131:0/1030850082 learned_addr learned my addr 172.21.15.131:0/1030850082 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:31:02.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.654+0000 7fa51a000640 1 --2- 172.21.15.131:0/1030850082 >> v2:172.21.15.131:3300/0 conn(0x7fa51415fff0 0x7fa5140b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:02.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.654+0000 7fa518c00640 1 --2- 172.21.15.131:0/1030850082 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa51406dce0 0x7fa5140af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:02.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.654+0000 7fa513e00640 1 -- 172.21.15.131:0/1030850082 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1598861330 0 0) 0x7fa5140af9b0 con 0x7fa5140b0a50 2024-04-25T19:31:02.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.655+0000 7fa513e00640 1 -- 172.21.15.131:0/1030850082 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4fc003520 con 0x7fa5140b0a50 2024-04-25T19:31:02.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.655+0000 7fa51a000640 1 -- 172.21.15.131:0/1030850082 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa51406dce0 msgr2=0x7fa5140af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:02.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.655+0000 7fa51a000640 1 --2- 172.21.15.131:0/1030850082 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa51406dce0 0x7fa5140af340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:02.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.655+0000 7fa51a000640 1 -- 172.21.15.131:0/1030850082 >> v1:172.21.15.131:6789/0 conn(0x7fa5140b0a50 legacy=0x7fa51406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:02.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.655+0000 7fa51a000640 1 -- 172.21.15.131:0/1030850082 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5140aff70 con 0x7fa51415fff0 2024-04-25T19:31:02.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.656+0000 7fa51a000640 1 --2- 172.21.15.131:0/1030850082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa51415fff0 0x7fa5140b4f80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009d90 tx=0x7fa50c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61257e28c466dd19 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:02.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.656+0000 7fa513e00640 1 -- 172.21.15.131:0/1030850082 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c031600 con 0x7fa51415fff0 2024-04-25T19:31:02.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.656+0000 7fa513e00640 1 -- 172.21.15.131:0/1030850082 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa50c0317a0 con 0x7fa51415fff0 2024-04-25T19:31:02.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.656+0000 7fa513e00640 1 -- 172.21.15.131:0/1030850082 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c031b70 con 0x7fa51415fff0 2024-04-25T19:31:02.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.657+0000 7fa51aa00640 1 -- 172.21.15.131:0/1030850082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa51415fff0 msgr2=0x7fa5140b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:02.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.657+0000 7fa51aa00640 1 --2- 172.21.15.131:0/1030850082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa51415fff0 0x7fa5140b4f80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009d90 tx=0x7fa50c02a5d0 comp rx=0 tx=0).stop 2024-04-25T19:31:02.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.657+0000 7fa51aa00640 1 -- 172.21.15.131:0/1030850082 shutdown_connections 2024-04-25T19:31:02.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.657+0000 7fa51aa00640 1 --2- 172.21.15.131:0/1030850082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa51415fff0 0x7fa5140b4f80 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:02.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.657+0000 7fa51aa00640 1 --2- 172.21.15.131:0/1030850082 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa51406dce0 0x7fa5140af340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:02.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.657+0000 7fa51aa00640 1 -- 172.21.15.131:0/1030850082 >> 172.21.15.131:0/1030850082 conn(0x7fa514073160 msgr2=0x7fa514073570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:02.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.657+0000 7fa51aa00640 1 -- 172.21.15.131:0/1030850082 shutdown_connections 2024-04-25T19:31:02.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.657+0000 7fa51aa00640 1 -- 172.21.15.131:0/1030850082 wait complete. 2024-04-25T19:31:02.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.659+0000 7fa51aa00640 1 Processor -- start 2024-04-25T19:31:02.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.659+0000 7fa51aa00640 1 -- start start 2024-04-25T19:31:02.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.661+0000 7fa51aa00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5140b0a50 0x7fa5140d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:02.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.661+0000 7fa51aa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa51415fff0 0x7fa5141f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:02.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.661+0000 7fa51aa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5141f62e0 0x7fa5140ce350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:02.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.661+0000 7fa51aa00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa514160400 con 0x7fa51415fff0 2024-04-25T19:31:02.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.661+0000 7fa51aa00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa5140b0530 con 0x7fa5140b0a50 2024-04-25T19:31:02.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.661+0000 7fa51aa00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa51406f090 con 0x7fa5141f62e0 2024-04-25T19:31:02.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.661+0000 7fa518c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa51415fff0 0x7fa5141f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:02.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.661+0000 7fa518c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa51415fff0 0x7fa5141f5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:53010/0 (socket says 172.21.15.131:53010) 2024-04-25T19:31:02.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.661+0000 7fa518c00640 1 -- 172.21.15.131:0/1644783308 learned_addr learned my addr 172.21.15.131:0/1644783308 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:02.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.661+0000 7fa518c00640 1 -- 172.21.15.131:0/1644783308 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5141f62e0 msgr2=0x7fa5140ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:02.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.661+0000 7fa518c00640 1 --2- 172.21.15.131:0/1644783308 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5141f62e0 0x7fa5140ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:02.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.661+0000 7fa518c00640 1 -- 172.21.15.131:0/1644783308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5140b0a50 msgr2=0x7fa5140d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:02.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.661+0000 7fa518c00640 1 --2- 172.21.15.131:0/1644783308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5140b0a50 0x7fa5140d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:02.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.661+0000 7fa518c00640 1 -- 172.21.15.131:0/1644783308 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5141f6a40 con 0x7fa51415fff0 2024-04-25T19:31:02.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.662+0000 7fa518c00640 1 --2- 172.21.15.131:0/1644783308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa51415fff0 0x7fa5141f5da0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa50400d5f0 tx=0x7fa50400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:02.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.662+0000 7fa511600640 1 -- 172.21.15.131:0/1644783308 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5040125f0 con 0x7fa51415fff0 2024-04-25T19:31:02.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.662+0000 7fa511600640 1 -- 172.21.15.131:0/1644783308 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa504019070 con 0x7fa51415fff0 2024-04-25T19:31:02.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.662+0000 7fa51aa00640 1 -- 172.21.15.131:0/1644783308 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5141f6d20 con 0x7fa51415fff0 2024-04-25T19:31:02.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.662+0000 7fa511600640 1 -- 172.21.15.131:0/1644783308 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5040129d0 con 0x7fa51415fff0 2024-04-25T19:31:02.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.662+0000 7fa51aa00640 1 -- 172.21.15.131:0/1644783308 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5140b1550 con 0x7fa51415fff0 2024-04-25T19:31:02.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.663+0000 7fa51aa00640 1 -- 172.21.15.131:0/1644783308 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa514076c60 con 0x7fa51415fff0 2024-04-25T19:31:02.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.664+0000 7fa511600640 1 -- 172.21.15.131:0/1644783308 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa504012b70 con 0x7fa51415fff0 2024-04-25T19:31:02.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.666+0000 7fa511600640 1 --2- 172.21.15.131:0/1644783308 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa4f80744b0 0x7fa4f80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:02.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.666+0000 7fa511600640 1 -- 172.21.15.131:0/1644783308 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fa504095700 con 0x7fa51415fff0 2024-04-25T19:31:02.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.666+0000 7fa519600640 1 --2- 172.21.15.131:0/1644783308 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa4f80744b0 0x7fa4f80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:02.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.667+0000 7fa519600640 1 --2- 172.21.15.131:0/1644783308 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa4f80744b0 0x7fa4f80769c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa508000f60 tx=0x7fa5080078f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:02.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.670+0000 7fa511600640 1 -- 172.21.15.131:0/1644783308 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa50405fdb0 con 0x7fa51415fff0 2024-04-25T19:31:02.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.869+0000 7fa51aa00640 1 -- 172.21.15.131:0/1644783308 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa514073ec0 con 0x7fa51415fff0 2024-04-25T19:31:02.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.869+0000 7fa511600640 1 -- 172.21.15.131:0/1644783308 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) ==== 100+0+11 (secure 0 0 0) 0x7fa50405f6b0 con 0x7fa51415fff0 2024-04-25T19:31:02.870 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 64 2024-04-25T19:31:02.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.872+0000 7fa51aa00640 1 -- 172.21.15.131:0/1644783308 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa4f80744b0 msgr2=0x7fa4f80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:02.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.872+0000 7fa51aa00640 1 --2- 172.21.15.131:0/1644783308 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa4f80744b0 0x7fa4f80769c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa508000f60 tx=0x7fa5080078f0 comp rx=0 tx=0).stop 2024-04-25T19:31:02.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.872+0000 7fa51aa00640 1 -- 172.21.15.131:0/1644783308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa51415fff0 msgr2=0x7fa5141f5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:02.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.872+0000 7fa51aa00640 1 --2- 172.21.15.131:0/1644783308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa51415fff0 0x7fa5141f5da0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa50400d5f0 tx=0x7fa50400dab0 comp rx=0 tx=0).stop 2024-04-25T19:31:02.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.873+0000 7fa51aa00640 1 -- 172.21.15.131:0/1644783308 shutdown_connections 2024-04-25T19:31:02.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.873+0000 7fa51aa00640 1 --2- 172.21.15.131:0/1644783308 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa4f80744b0 0x7fa4f80769c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:02.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.873+0000 7fa51aa00640 1 --2- 172.21.15.131:0/1644783308 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5141f62e0 0x7fa5140ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:02.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.873+0000 7fa51aa00640 1 --2- 172.21.15.131:0/1644783308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa51415fff0 0x7fa5141f5da0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:02.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.873+0000 7fa51aa00640 1 --2- 172.21.15.131:0/1644783308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5140b0a50 0x7fa5140d0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:02.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.873+0000 7fa51aa00640 1 -- 172.21.15.131:0/1644783308 >> 172.21.15.131:0/1644783308 conn(0x7fa514073160 msgr2=0x7fa514158110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:02.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.873+0000 7fa51aa00640 1 -- 172.21.15.131:0/1644783308 shutdown_connections 2024-04-25T19:31:02.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:02.873+0000 7fa51aa00640 1 -- 172.21.15.131:0/1644783308 wait complete. 2024-04-25T19:31:02.898 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:31:03.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.170+0000 7fd398a00640 1 Processor -- start 2024-04-25T19:31:03.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.170+0000 7fd398a00640 1 -- start start 2024-04-25T19:31:03.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.172+0000 7fd398a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd39406c5c0 0x7fd3940cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:03.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.172+0000 7fd398a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd3940b4ea0 0x7fd39415e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:03.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.173+0000 7fd398a00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3940d1230 con 0x7fd394144370 2024-04-25T19:31:03.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.173+0000 7fd398a00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd3940d06b0 con 0x7fd3940b4ea0 2024-04-25T19:31:03.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.173+0000 7fd398a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd3940d0990 con 0x7fd39406c5c0 2024-04-25T19:31:03.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.173+0000 7fd38be00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fd394144370 0x7fd3940b4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:60784/0 (socket says 172.21.15.131:60784) 2024-04-25T19:31:03.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.173+0000 7fd38be00640 1 -- 172.21.15.131:0/607499193 learned_addr learned my addr 172.21.15.131:0/607499193 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:31:03.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.173+0000 7fd393200640 1 --2- 172.21.15.131:0/607499193 >> v2:172.21.15.131:3300/0 conn(0x7fd3940b4ea0 0x7fd39415e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:03.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.173+0000 7fd392800640 1 --2- 172.21.15.131:0/607499193 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd39406c5c0 0x7fd3940cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:03.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.174+0000 7fd391e00640 1 -- 172.21.15.131:0/607499193 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 761541453 0 0) 0x7fd3940d1230 con 0x7fd394144370 2024-04-25T19:31:03.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.174+0000 7fd391e00640 1 -- 172.21.15.131:0/607499193 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd378003520 con 0x7fd394144370 2024-04-25T19:31:03.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.174+0000 7fd393200640 1 -- 172.21.15.131:0/607499193 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd39406c5c0 msgr2=0x7fd3940cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:03.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.174+0000 7fd393200640 1 --2- 172.21.15.131:0/607499193 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd39406c5c0 0x7fd3940cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:03.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.174+0000 7fd393200640 1 -- 172.21.15.131:0/607499193 >> v1:172.21.15.131:6789/0 conn(0x7fd394144370 legacy=0x7fd3940b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:03.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.174+0000 7fd393200640 1 -- 172.21.15.131:0/607499193 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3940d0c70 con 0x7fd3940b4ea0 2024-04-25T19:31:03.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.175+0000 7fd393200640 1 --2- 172.21.15.131:0/607499193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3940b4ea0 0x7fd39415e770 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd38c009d90 tx=0x7fd38c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd38c349fe6690a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:03.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.175+0000 7fd391e00640 1 -- 172.21.15.131:0/607499193 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38c035020 con 0x7fd3940b4ea0 2024-04-25T19:31:03.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.175+0000 7fd391e00640 1 -- 172.21.15.131:0/607499193 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd38c007540 con 0x7fd3940b4ea0 2024-04-25T19:31:03.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.175+0000 7fd391e00640 1 -- 172.21.15.131:0/607499193 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c001670 con 0x7fd3940b4ea0 2024-04-25T19:31:03.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.176+0000 7fd398a00640 1 -- 172.21.15.131:0/607499193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3940b4ea0 msgr2=0x7fd39415e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:03.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.176+0000 7fd398a00640 1 --2- 172.21.15.131:0/607499193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3940b4ea0 0x7fd39415e770 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd38c009d90 tx=0x7fd38c02a5d0 comp rx=0 tx=0).stop 2024-04-25T19:31:03.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.176+0000 7fd398a00640 1 -- 172.21.15.131:0/607499193 shutdown_connections 2024-04-25T19:31:03.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.176+0000 7fd398a00640 1 --2- 172.21.15.131:0/607499193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3940b4ea0 0x7fd39415e770 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:03.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.176+0000 7fd398a00640 1 --2- 172.21.15.131:0/607499193 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd39406c5c0 0x7fd3940cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:03.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.176+0000 7fd398a00640 1 -- 172.21.15.131:0/607499193 >> 172.21.15.131:0/607499193 conn(0x7fd3940d1720 msgr2=0x7fd3940d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:03.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.176+0000 7fd398a00640 1 -- 172.21.15.131:0/607499193 shutdown_connections 2024-04-25T19:31:03.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.176+0000 7fd398a00640 1 -- 172.21.15.131:0/607499193 wait complete. 2024-04-25T19:31:03.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.179+0000 7fd398a00640 1 Processor -- start 2024-04-25T19:31:03.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.179+0000 7fd398a00640 1 -- start start 2024-04-25T19:31:03.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.180+0000 7fd398a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd39406c5c0 0x7fd39415fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:03.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.180+0000 7fd398a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd394144370 0x7fd3941e8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:03.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.180+0000 7fd398a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd39415cd10 0x7fd39406f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:03.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.180+0000 7fd398a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd3940d0450 con 0x7fd394144370 2024-04-25T19:31:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.180+0000 7fd398a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd3940d02d0 con 0x7fd39415cd10 2024-04-25T19:31:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.180+0000 7fd398a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd394147760 con 0x7fd39406c5c0 2024-04-25T19:31:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.181+0000 7fd38be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd394144370 0x7fd3941e8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.181+0000 7fd38be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd394144370 0x7fd3941e8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:53024/0 (socket says 172.21.15.131:53024) 2024-04-25T19:31:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.181+0000 7fd38be00640 1 -- 172.21.15.131:0/2847543755 learned_addr learned my addr 172.21.15.131:0/2847543755 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.181+0000 7fd393200640 1 --2- 172.21.15.131:0/2847543755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd39415cd10 0x7fd39406f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.181+0000 7fd392800640 1 --2- 172.21.15.131:0/2847543755 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd39406c5c0 0x7fd39415fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.181+0000 7fd38be00640 1 -- 172.21.15.131:0/2847543755 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd39406c5c0 msgr2=0x7fd39415fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.181+0000 7fd38be00640 1 --2- 172.21.15.131:0/2847543755 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd39406c5c0 0x7fd39415fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.181+0000 7fd38be00640 1 -- 172.21.15.131:0/2847543755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd39415cd10 msgr2=0x7fd39406f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.181+0000 7fd38be00640 1 --2- 172.21.15.131:0/2847543755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd39415cd10 0x7fd39406f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.181+0000 7fd38be00640 1 -- 172.21.15.131:0/2847543755 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3941e8400 con 0x7fd394144370 2024-04-25T19:31:03.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.181+0000 7fd38be00640 1 --2- 172.21.15.131:0/2847543755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd394144370 0x7fd3941e8ea0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd37c00c780 tx=0x7fd37c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:03.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.182+0000 7fd38aa00640 1 -- 172.21.15.131:0/2847543755 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c005a90 con 0x7fd394144370 2024-04-25T19:31:03.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.182+0000 7fd38aa00640 1 -- 172.21.15.131:0/2847543755 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd37c005c30 con 0x7fd394144370 2024-04-25T19:31:03.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.182+0000 7fd38aa00640 1 -- 172.21.15.131:0/2847543755 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c005e60 con 0x7fd394144370 2024-04-25T19:31:03.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.182+0000 7fd398a00640 1 -- 172.21.15.131:0/2847543755 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3940ccd60 con 0x7fd394144370 2024-04-25T19:31:03.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.182+0000 7fd398a00640 1 -- 172.21.15.131:0/2847543755 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3941e8980 con 0x7fd394144370 2024-04-25T19:31:03.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.183+0000 7fd398a00640 1 -- 172.21.15.131:0/2847543755 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd394050740 con 0x7fd394144370 2024-04-25T19:31:03.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.184+0000 7fd38aa00640 1 -- 172.21.15.131:0/2847543755 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd37c007290 con 0x7fd394144370 2024-04-25T19:31:03.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.185+0000 7fd38aa00640 1 --2- 172.21.15.131:0/2847543755 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd3700744e0 0x7fd3700769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:03.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.185+0000 7fd38aa00640 1 -- 172.21.15.131:0/2847543755 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fd37c095130 con 0x7fd394144370 2024-04-25T19:31:03.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.186+0000 7fd392800640 1 --2- 172.21.15.131:0/2847543755 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd3700744e0 0x7fd3700769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:03.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.187+0000 7fd392800640 1 --2- 172.21.15.131:0/2847543755 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd3700744e0 0x7fd3700769f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd384009970 tx=0x7fd384008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:03.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.190+0000 7fd38aa00640 1 -- 172.21.15.131:0/2847543755 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd37c05f7e0 con 0x7fd394144370 2024-04-25T19:31:03.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.416+0000 7fd398a00640 1 -- 172.21.15.131:0/2847543755 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd394070d80 con 0x7fd394144370 2024-04-25T19:31:03.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.418+0000 7fd38aa00640 1 -- 172.21.15.131:0/2847543755 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5190 (secure 0 0 0) 0x7fd37c05f0e0 con 0x7fd394144370 2024-04-25T19:31:03.418 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:31:03.419 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4706,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3512447940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":3512447940},{"type":"v1","addr":"172.21.15.195:6837","nonce":3512447940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2666088311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":2666088311},{"type":"v1","addr":"172.21.15.195:6836","nonce":2666088311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1450320216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1450320216},{"type":"v1","addr":"172.21.15.131:6834","nonce":1450320216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T19:24:15.727328+0000","modified":"2024-04-25T19:24:18.791952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/274211686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":274211686},{"type":"v1","addr":"172.21.15.131:6835","nonce":274211686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5481,"qdb_cluster":[5481]},"id":3}]} 2024-04-25T19:31:03.419 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 25 2024-04-25T19:31:03.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.420+0000 7fd398a00640 1 -- 172.21.15.131:0/2847543755 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd3700744e0 msgr2=0x7fd3700769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:03.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.420+0000 7fd398a00640 1 --2- 172.21.15.131:0/2847543755 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd3700744e0 0x7fd3700769f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd384009970 tx=0x7fd384008040 comp rx=0 tx=0).stop 2024-04-25T19:31:03.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.420+0000 7fd398a00640 1 -- 172.21.15.131:0/2847543755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd394144370 msgr2=0x7fd3941e8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:03.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.420+0000 7fd398a00640 1 --2- 172.21.15.131:0/2847543755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd394144370 0x7fd3941e8ea0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd37c00c780 tx=0x7fd37c00cc40 comp rx=0 tx=0).stop 2024-04-25T19:31:03.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.420+0000 7fd398a00640 1 -- 172.21.15.131:0/2847543755 shutdown_connections 2024-04-25T19:31:03.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.421+0000 7fd398a00640 1 --2- 172.21.15.131:0/2847543755 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd3700744e0 0x7fd3700769f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:03.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.421+0000 7fd398a00640 1 --2- 172.21.15.131:0/2847543755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd39415cd10 0x7fd39406f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:03.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.421+0000 7fd398a00640 1 --2- 172.21.15.131:0/2847543755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd394144370 0x7fd3941e8ea0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:03.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.421+0000 7fd398a00640 1 --2- 172.21.15.131:0/2847543755 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd39406c5c0 0x7fd39415fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:03.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.421+0000 7fd398a00640 1 -- 172.21.15.131:0/2847543755 >> 172.21.15.131:0/2847543755 conn(0x7fd3940d1720 msgr2=0x7fd394070570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:03.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.421+0000 7fd398a00640 1 -- 172.21.15.131:0/2847543755 shutdown_connections 2024-04-25T19:31:03.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.421+0000 7fd398a00640 1 -- 172.21.15.131:0/2847543755 wait complete. 2024-04-25T19:31:03.448 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:31:03.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.714+0000 7f3114e00640 1 Processor -- start 2024-04-25T19:31:03.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.714+0000 7f3114e00640 1 -- start start 2024-04-25T19:31:03.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.717+0000 7f3114e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f31100cf5e0 0x7f31100cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:03.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.717+0000 7f3114e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f311006c5c0 0x7f311006c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:03.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.717+0000 7f3114e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31100cff30 con 0x7f31101443c0 2024-04-25T19:31:03.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.717+0000 7f3114e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f31100708d0 con 0x7f31100cf5e0 2024-04-25T19:31:03.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.717+0000 7f3114e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f311015f160 con 0x7f311006c5c0 2024-04-25T19:31:03.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.717+0000 7f3105400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f31100cf5e0 0x7f31100cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:03.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.717+0000 7f3105400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f31100cf5e0 0x7f31100cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:53026/0 (socket says 172.21.15.131:53026) 2024-04-25T19:31:03.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.717+0000 7f3105400640 1 -- 172.21.15.131:0/618997922 learned_addr learned my addr 172.21.15.131:0/618997922 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:03.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.717+0000 7f310e800640 1 --2- 172.21.15.131:0/618997922 >> v2:172.21.15.195:3300/0 conn(0x7f311006c5c0 0x7f311006c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:03.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.718+0000 7f3105400640 1 -- 172.21.15.131:0/618997922 >> v2:172.21.15.195:3300/0 conn(0x7f311006c5c0 msgr2=0x7f311006c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:03.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.718+0000 7f3105400640 1 --2- 172.21.15.131:0/618997922 >> v2:172.21.15.195:3300/0 conn(0x7f311006c5c0 0x7f311006c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:03.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.718+0000 7f3105400640 1 -- 172.21.15.131:0/618997922 >> v1:172.21.15.131:6789/0 conn(0x7f31101443c0 legacy=0x7f311006fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:03.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.718+0000 7f3105400640 1 -- 172.21.15.131:0/618997922 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311015f5f0 con 0x7f31100cf5e0 2024-04-25T19:31:03.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.718+0000 7f310d400640 1 -- 172.21.15.131:0/618997922 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3426148733 0 0) 0x7f3100001110 con 0x7f31101443c0 2024-04-25T19:31:03.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.719+0000 7f3105400640 1 --2- 172.21.15.131:0/618997922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31100cf5e0 0x7f31100cf9f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f311015c250 tx=0x7f30f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e07a9d8aa21321ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:03.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.719+0000 7f310d400640 1 -- 172.21.15.131:0/618997922 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f8037070 con 0x7f31100cf5e0 2024-04-25T19:31:03.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.719+0000 7f310d400640 1 -- 172.21.15.131:0/618997922 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f8032440 con 0x7f31100cf5e0 2024-04-25T19:31:03.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.719+0000 7f310d400640 1 -- 172.21.15.131:0/618997922 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f8032810 con 0x7f31100cf5e0 2024-04-25T19:31:03.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.720+0000 7f3114e00640 1 -- 172.21.15.131:0/618997922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31100cf5e0 msgr2=0x7f31100cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:03.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.720+0000 7f3114e00640 1 --2- 172.21.15.131:0/618997922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31100cf5e0 0x7f31100cf9f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f311015c250 tx=0x7f30f802a270 comp rx=0 tx=0).stop 2024-04-25T19:31:03.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.720+0000 7f3114e00640 1 -- 172.21.15.131:0/618997922 shutdown_connections 2024-04-25T19:31:03.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.720+0000 7f3114e00640 1 --2- 172.21.15.131:0/618997922 >> v2:172.21.15.195:3300/0 conn(0x7f311006c5c0 0x7f311006c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:03.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.720+0000 7f3114e00640 1 --2- 172.21.15.131:0/618997922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31100cf5e0 0x7f31100cf9f0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:03.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.720+0000 7f3114e00640 1 -- 172.21.15.131:0/618997922 >> 172.21.15.131:0/618997922 conn(0x7f31100d1ae0 msgr2=0x7f31100d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:03.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.720+0000 7f3114e00640 1 -- 172.21.15.131:0/618997922 shutdown_connections 2024-04-25T19:31:03.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.720+0000 7f3114e00640 1 -- 172.21.15.131:0/618997922 wait complete. 2024-04-25T19:31:03.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.722+0000 7f3114e00640 1 Processor -- start 2024-04-25T19:31:03.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.722+0000 7f3114e00640 1 -- start start 2024-04-25T19:31:03.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.724+0000 7f3114e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f311006c5c0 0x7f31101433b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:03.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.724+0000 7f3114e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31100cf5e0 0x7f31101e9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:03.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.724+0000 7f3114e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31101443c0 0x7f31101ea450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:03.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.724+0000 7f3114e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f311015edf0 con 0x7f311006c5c0 2024-04-25T19:31:03.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.724+0000 7f3114e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f311015eb10 con 0x7f31100cf5e0 2024-04-25T19:31:03.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.724+0000 7f3114e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f31101447d0 con 0x7f31101443c0 2024-04-25T19:31:03.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.724+0000 7f310de00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f311006c5c0 0x7f31101433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:03.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.724+0000 7f310de00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f311006c5c0 0x7f31101433b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:53032/0 (socket says 172.21.15.131:53032) 2024-04-25T19:31:03.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.724+0000 7f310de00640 1 -- 172.21.15.131:0/3401539338 learned_addr learned my addr 172.21.15.131:0/3401539338 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:03.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.724+0000 7f310de00640 1 -- 172.21.15.131:0/3401539338 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31101443c0 msgr2=0x7f31101ea450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:03.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.724+0000 7f310de00640 1 --2- 172.21.15.131:0/3401539338 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31101443c0 0x7f31101ea450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:03.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.724+0000 7f310de00640 1 -- 172.21.15.131:0/3401539338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31100cf5e0 msgr2=0x7f31101e9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:03.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.724+0000 7f310de00640 1 --2- 172.21.15.131:0/3401539338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31100cf5e0 0x7f31101e9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:03.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.724+0000 7f310de00640 1 -- 172.21.15.131:0/3401539338 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31101438f0 con 0x7f311006c5c0 2024-04-25T19:31:03.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.725+0000 7f310de00640 1 --2- 172.21.15.131:0/3401539338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f311006c5c0 0x7f31101433b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f310000c410 tx=0x7f310000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:03.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.725+0000 7f3106a00640 1 -- 172.21.15.131:0/3401539338 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3100017070 con 0x7f311006c5c0 2024-04-25T19:31:03.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.725+0000 7f3106a00640 1 -- 172.21.15.131:0/3401539338 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31000035f0 con 0x7f311006c5c0 2024-04-25T19:31:03.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.725+0000 7f3106a00640 1 -- 172.21.15.131:0/3401539338 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31000039c0 con 0x7f311006c5c0 2024-04-25T19:31:03.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.725+0000 7f3114e00640 1 -- 172.21.15.131:0/3401539338 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31101eace0 con 0x7f311006c5c0 2024-04-25T19:31:03.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.725+0000 7f3114e00640 1 -- 172.21.15.131:0/3401539338 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31101eb2a0 con 0x7f311006c5c0 2024-04-25T19:31:03.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.726+0000 7f3114e00640 1 -- 172.21.15.131:0/3401539338 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3110050740 con 0x7f311006c5c0 2024-04-25T19:31:03.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.727+0000 7f3106a00640 1 -- 172.21.15.131:0/3401539338 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f310001a070 con 0x7f311006c5c0 2024-04-25T19:31:03.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.728+0000 7f3106a00640 1 --2- 172.21.15.131:0/3401539338 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f30ec0744b0 0x7f30ec0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:03.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.729+0000 7f3106a00640 1 -- 172.21.15.131:0/3401539338 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f3100094700 con 0x7f311006c5c0 2024-04-25T19:31:03.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.729+0000 7f3105400640 1 --2- 172.21.15.131:0/3401539338 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f30ec0744b0 0x7f30ec0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:03.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.730+0000 7f3105400640 1 --2- 172.21.15.131:0/3401539338 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f30ec0744b0 0x7f30ec0769c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f30f8034000 tx=0x7f30f802c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:03.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.733+0000 7f3106a00640 1 -- 172.21.15.131:0/3401539338 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f31101438f0 con 0x7f311006c5c0 2024-04-25T19:31:03.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.935+0000 7f3114e00640 1 -- 172.21.15.131:0/3401539338 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f31100cf120 con 0x7f311006c5c0 2024-04-25T19:31:03.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.937+0000 7f3106a00640 1 -- 172.21.15.131:0/3401539338 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16788 (secure 0 0 0) 0x7f31100cff30 con 0x7f311006c5c0 2024-04-25T19:31:03.938 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:31:03.938 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":47,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:24:58.382161+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:24:13.848038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T19:24:14.699910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.4","mappings":[{"from":0,"to":5}]},{"pgid":"7.2c","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:31:03.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.939+0000 7f3114e00640 1 -- 172.21.15.131:0/3401539338 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f30ec0744b0 msgr2=0x7f30ec0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:03.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.939+0000 7f3114e00640 1 --2- 172.21.15.131:0/3401539338 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f30ec0744b0 0x7f30ec0769c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f30f8034000 tx=0x7f30f802c000 comp rx=0 tx=0).stop 2024-04-25T19:31:03.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.939+0000 7f3114e00640 1 -- 172.21.15.131:0/3401539338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f311006c5c0 msgr2=0x7f31101433b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:03.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.939+0000 7f3114e00640 1 --2- 172.21.15.131:0/3401539338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f311006c5c0 0x7f31101433b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f310000c410 tx=0x7f310000c8d0 comp rx=0 tx=0).stop 2024-04-25T19:31:03.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.940+0000 7f3114e00640 1 -- 172.21.15.131:0/3401539338 shutdown_connections 2024-04-25T19:31:03.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.940+0000 7f3114e00640 1 --2- 172.21.15.131:0/3401539338 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f30ec0744b0 0x7f30ec0769c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:03.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.940+0000 7f3114e00640 1 --2- 172.21.15.131:0/3401539338 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31101443c0 0x7f31101ea450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:03.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.940+0000 7f3114e00640 1 --2- 172.21.15.131:0/3401539338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31100cf5e0 0x7f31101e9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:03.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.940+0000 7f3114e00640 1 --2- 172.21.15.131:0/3401539338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f311006c5c0 0x7f31101433b0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:03.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.940+0000 7f3114e00640 1 -- 172.21.15.131:0/3401539338 >> 172.21.15.131:0/3401539338 conn(0x7f31100d1ae0 msgr2=0x7f3110160410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:03.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.940+0000 7f3114e00640 1 -- 172.21.15.131:0/3401539338 shutdown_connections 2024-04-25T19:31:03.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:03.940+0000 7f3114e00640 1 -- 172.21.15.131:0/3401539338 wait complete. 2024-04-25T19:31:03.966 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T19:31:03.966 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:31:04.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.230+0000 7fc049800640 1 Processor -- start 2024-04-25T19:31:04.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.230+0000 7fc049800640 1 -- start start 2024-04-25T19:31:04.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.233+0000 7fc049800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc04415c800 0x7fc04406f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:04.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.233+0000 7fc049800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc044071230 con 0x7fc04406d560 2024-04-25T19:31:04.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.233+0000 7fc049800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc04406f8f0 con 0x7fc044070e20 2024-04-25T19:31:04.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.233+0000 7fc049800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc04406f6c0 con 0x7fc04415c800 2024-04-25T19:31:04.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.233+0000 7fc03b400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fc04406d560 0x7fc0440b5e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:60816/0 (socket says 172.21.15.131:60816) 2024-04-25T19:31:04.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.233+0000 7fc03b400640 1 -- 172.21.15.131:0/1818202059 learned_addr learned my addr 172.21.15.131:0/1818202059 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:31:04.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.234+0000 7fc048e00640 1 --2- 172.21.15.131:0/1818202059 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc04415c800 0x7fc04406f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:04.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.234+0000 7fc043400640 1 -- 172.21.15.131:0/1818202059 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3048297696 0 0) 0x7fc044071230 con 0x7fc04406d560 2024-04-25T19:31:04.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.234+0000 7fc043400640 1 -- 172.21.15.131:0/1818202059 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc028003440 con 0x7fc04406d560 2024-04-25T19:31:04.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.234+0000 7fc043400640 1 -- 172.21.15.131:0/1818202059 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3403858918 0 0) 0x7fc028003440 con 0x7fc04406d560 2024-04-25T19:31:04.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.234+0000 7fc043400640 1 -- 172.21.15.131:0/1818202059 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc04415c800 msgr2=0x7fc04406f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:04.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.234+0000 7fc043400640 1 --2- 172.21.15.131:0/1818202059 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc04415c800 0x7fc04406f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:04.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.234+0000 7fc043400640 1 -- 172.21.15.131:0/1818202059 >> v1:172.21.15.195:6789/0 conn(0x7fc044070e20 legacy=0x7fc04406ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:04.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.234+0000 7fc043400640 1 -- 172.21.15.131:0/1818202059 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc04406fbd0 con 0x7fc04406d560 2024-04-25T19:31:04.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.234+0000 7fc043400640 1 -- 172.21.15.131:0/1818202059 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7fc02c001670 con 0x7fc04406d560 2024-04-25T19:31:04.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.234+0000 7fc043400640 1 -- 172.21.15.131:0/1818202059 >> v1:172.21.15.131:6789/0 conn(0x7fc04406d560 legacy=0x7fc0440b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:04.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.234+0000 7fc043400640 1 --2- 172.21.15.131:0/1818202059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc028003ad0 0x7fc028003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:04.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.234+0000 7fc043400640 1 --2- 172.21.15.131:0/1818202059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0280088a0 0x7fc02800ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:04.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.234+0000 7fc043400640 1 --2- 172.21.15.131:0/1818202059 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc04415c800 0x7fc02800d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:04.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.234+0000 7fc043400640 1 -- 172.21.15.131:0/1818202059 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc02800dcf0 con 0x7fc0280088a0 2024-04-25T19:31:04.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.234+0000 7fc043400640 1 -- 172.21.15.131:0/1818202059 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc02800dea0 con 0x7fc028003ad0 2024-04-25T19:31:04.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.234+0000 7fc043400640 1 -- 172.21.15.131:0/1818202059 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc02800e0a0 con 0x7fc04415c800 2024-04-25T19:31:04.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.235+0000 7fc03b400640 1 --2- 172.21.15.131:0/1818202059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0280088a0 0x7fc02800ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:04.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.235+0000 7fc03b400640 1 -- 172.21.15.131:0/1818202059 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc04415c800 msgr2=0x7fc02800d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:04.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.235+0000 7fc03b400640 1 --2- 172.21.15.131:0/1818202059 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc04415c800 0x7fc02800d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:04.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.235+0000 7fc03b400640 1 -- 172.21.15.131:0/1818202059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc028003ad0 msgr2=0x7fc028003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:04.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.235+0000 7fc03b400640 1 --2- 172.21.15.131:0/1818202059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc028003ad0 0x7fc028003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:04.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.235+0000 7fc03b400640 1 -- 172.21.15.131:0/1818202059 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc028003440 con 0x7fc0280088a0 2024-04-25T19:31:04.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.236+0000 7fc03b400640 1 --2- 172.21.15.131:0/1818202059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0280088a0 0x7fc02800ad40 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00c210 tx=0x7fc028003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e3c1ad3df3266e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:04.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.236+0000 7fc043400640 1 -- 172.21.15.131:0/1818202059 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c007d30 con 0x7fc0280088a0 2024-04-25T19:31:04.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.236+0000 7fc043400640 1 -- 172.21.15.131:0/1818202059 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc02c005ad0 con 0x7fc0280088a0 2024-04-25T19:31:04.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.236+0000 7fc043400640 1 -- 172.21.15.131:0/1818202059 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c007070 con 0x7fc0280088a0 2024-04-25T19:31:04.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.237+0000 7fc049800640 1 -- 172.21.15.131:0/1818202059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0280088a0 msgr2=0x7fc02800ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:04.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.237+0000 7fc049800640 1 --2- 172.21.15.131:0/1818202059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0280088a0 0x7fc02800ad40 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00c210 tx=0x7fc028003730 comp rx=0 tx=0).stop 2024-04-25T19:31:04.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.237+0000 7fc048e00640 1 -- 172.21.15.131:0/1818202059 reap_dead start 2024-04-25T19:31:04.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.237+0000 7fc049800640 1 -- 172.21.15.131:0/1818202059 shutdown_connections 2024-04-25T19:31:04.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.237+0000 7fc049800640 1 -- 172.21.15.131:0/1818202059 >> 172.21.15.131:0/1818202059 conn(0x7fc0440d1720 msgr2=0x7fc0440d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:04.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.237+0000 7fc049800640 1 -- 172.21.15.131:0/1818202059 shutdown_connections 2024-04-25T19:31:04.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.237+0000 7fc049800640 1 -- 172.21.15.131:0/1818202059 wait complete. 2024-04-25T19:31:04.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.240+0000 7fc049800640 1 Processor -- start 2024-04-25T19:31:04.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.240+0000 7fc049800640 1 -- start start 2024-04-25T19:31:04.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.242+0000 7fc049800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0280088a0 0x7fc0441eb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:04.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.242+0000 7fc049800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc044156490 0x7fc0441f91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:04.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.242+0000 7fc049800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0441568a0 0x7fc0441f96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:04.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.242+0000 7fc049800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc04415cc10 con 0x7fc0280088a0 2024-04-25T19:31:04.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.242+0000 7fc049800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc044070190 con 0x7fc044156490 2024-04-25T19:31:04.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.242+0000 7fc049800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc04406f180 con 0x7fc0441568a0 2024-04-25T19:31:04.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.242+0000 7fc043e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0280088a0 0x7fc0441eb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:04.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.242+0000 7fc043e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0280088a0 0x7fc0441eb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:53054/0 (socket says 172.21.15.131:53054) 2024-04-25T19:31:04.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.242+0000 7fc043e00640 1 -- 172.21.15.131:0/729182049 learned_addr learned my addr 172.21.15.131:0/729182049 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:04.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.242+0000 7fc03b400640 1 --2- 172.21.15.131:0/729182049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc044156490 0x7fc0441f91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:04.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.242+0000 7fc048e00640 1 --2- 172.21.15.131:0/729182049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0441568a0 0x7fc0441f96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:04.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.242+0000 7fc043e00640 1 -- 172.21.15.131:0/729182049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0441568a0 msgr2=0x7fc0441f96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:04.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.242+0000 7fc043e00640 1 --2- 172.21.15.131:0/729182049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0441568a0 0x7fc0441f96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:04.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.242+0000 7fc043e00640 1 -- 172.21.15.131:0/729182049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc044156490 msgr2=0x7fc0441f91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:04.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.242+0000 7fc043e00640 1 --2- 172.21.15.131:0/729182049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc044156490 0x7fc0441f91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:04.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.242+0000 7fc043e00640 1 -- 172.21.15.131:0/729182049 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0441e3170 con 0x7fc0280088a0 2024-04-25T19:31:04.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.242+0000 7fc03b400640 1 --2- 172.21.15.131:0/729182049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc044156490 0x7fc0441f91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:31:04.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.243+0000 7fc043e00640 1 --2- 172.21.15.131:0/729182049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0280088a0 0x7fc0441eb7c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc03400c870 tx=0x7fc03400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:04.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.243+0000 7fc040c00640 1 -- 172.21.15.131:0/729182049 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc034003b70 con 0x7fc0280088a0 2024-04-25T19:31:04.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.243+0000 7fc040c00640 1 -- 172.21.15.131:0/729182049 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc034003d30 con 0x7fc0280088a0 2024-04-25T19:31:04.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.243+0000 7fc049800640 1 -- 172.21.15.131:0/729182049 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0441e3450 con 0x7fc0280088a0 2024-04-25T19:31:04.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.243+0000 7fc040c00640 1 -- 172.21.15.131:0/729182049 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03400aa90 con 0x7fc0280088a0 2024-04-25T19:31:04.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.243+0000 7fc049800640 1 -- 172.21.15.131:0/729182049 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0441e9d40 con 0x7fc0280088a0 2024-04-25T19:31:04.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.244+0000 7fc049800640 1 -- 172.21.15.131:0/729182049 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc044050740 con 0x7fc0280088a0 2024-04-25T19:31:04.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.246+0000 7fc040c00640 1 -- 172.21.15.131:0/729182049 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc03400ac30 con 0x7fc0280088a0 2024-04-25T19:31:04.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.247+0000 7fc040c00640 1 --2- 172.21.15.131:0/729182049 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc0200744b0 0x7fc0200769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:04.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.247+0000 7fc040c00640 1 -- 172.21.15.131:0/729182049 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fc0340951d0 con 0x7fc0280088a0 2024-04-25T19:31:04.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.247+0000 7fc03b400640 1 --2- 172.21.15.131:0/729182049 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc0200744b0 0x7fc0200769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:04.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.248+0000 7fc03b400640 1 --2- 172.21.15.131:0/729182049 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc0200744b0 0x7fc0200769c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc02c033000 tx=0x7fc02c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:04.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.251+0000 7fc040c00640 1 -- 172.21.15.131:0/729182049 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc03405f9b0 con 0x7fc0280088a0 2024-04-25T19:31:04.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.475+0000 7fc049800640 1 -- 172.21.15.131:0/729182049 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0441e88e0 con 0x7fc0280088a0 2024-04-25T19:31:04.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.477+0000 7fc040c00640 1 -- 172.21.15.131:0/729182049 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5190 (secure 0 0 0) 0x7fc03405f2b0 con 0x7fc0280088a0 2024-04-25T19:31:04.477 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:31:04.477 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4706,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3512447940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":3512447940},{"type":"v1","addr":"172.21.15.195:6837","nonce":3512447940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2666088311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":2666088311},{"type":"v1","addr":"172.21.15.195:6836","nonce":2666088311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1450320216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1450320216},{"type":"v1","addr":"172.21.15.131:6834","nonce":1450320216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T19:24:15.727328+0000","modified":"2024-04-25T19:24:18.791952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/274211686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":274211686},{"type":"v1","addr":"172.21.15.131:6835","nonce":274211686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5481,"qdb_cluster":[5481]},"id":3}]} 2024-04-25T19:31:04.478 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 25 2024-04-25T19:31:04.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.479+0000 7fc049800640 1 -- 172.21.15.131:0/729182049 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc0200744b0 msgr2=0x7fc0200769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:04.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.479+0000 7fc049800640 1 --2- 172.21.15.131:0/729182049 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc0200744b0 0x7fc0200769c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc02c033000 tx=0x7fc02c02e000 comp rx=0 tx=0).stop 2024-04-25T19:31:04.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.479+0000 7fc049800640 1 -- 172.21.15.131:0/729182049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0280088a0 msgr2=0x7fc0441eb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:04.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.479+0000 7fc049800640 1 --2- 172.21.15.131:0/729182049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0280088a0 0x7fc0441eb7c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc03400c870 tx=0x7fc03400cd30 comp rx=0 tx=0).stop 2024-04-25T19:31:04.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.480+0000 7fc049800640 1 -- 172.21.15.131:0/729182049 shutdown_connections 2024-04-25T19:31:04.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.480+0000 7fc049800640 1 --2- 172.21.15.131:0/729182049 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc0200744b0 0x7fc0200769c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:04.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.480+0000 7fc049800640 1 --2- 172.21.15.131:0/729182049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0441568a0 0x7fc0441f96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:04.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.480+0000 7fc049800640 1 --2- 172.21.15.131:0/729182049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc044156490 0x7fc0441f91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:04.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.480+0000 7fc049800640 1 --2- 172.21.15.131:0/729182049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0280088a0 0x7fc0441eb7c0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:04.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.480+0000 7fc049800640 1 -- 172.21.15.131:0/729182049 >> 172.21.15.131:0/729182049 conn(0x7fc0440d1720 msgr2=0x7fc04415a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:04.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.480+0000 7fc049800640 1 -- 172.21.15.131:0/729182049 shutdown_connections 2024-04-25T19:31:04.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.480+0000 7fc049800640 1 -- 172.21.15.131:0/729182049 wait complete. 2024-04-25T19:31:04.506 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:31:04.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.775+0000 7f31a3e00640 1 Processor -- start 2024-04-25T19:31:04.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.775+0000 7f31a3e00640 1 -- start start 2024-04-25T19:31:04.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.777+0000 7f31a3e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f31a4160fe0 0x7f31a415a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:04.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.777+0000 7f31a3e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31a40b7220 con 0x7f31a40cf2f0 2024-04-25T19:31:04.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.777+0000 7f31a3e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31a40b74d0 con 0x7f31a40b6e10 2024-04-25T19:31:04.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.777+0000 7f31a3e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f31a406f870 con 0x7f31a4160fe0 2024-04-25T19:31:04.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.778+0000 7f31a3400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f31a4160fe0 0x7f31a415a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:04.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.778+0000 7f31a3400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f31a4160fe0 0x7f31a415a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:53058/0 (socket says 172.21.15.131:53058) 2024-04-25T19:31:04.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.778+0000 7f31a3400640 1 -- 172.21.15.131:0/2997971790 learned_addr learned my addr 172.21.15.131:0/2997971790 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:04.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.778+0000 7f31a3400640 1 -- 172.21.15.131:0/2997971790 >> v1:172.21.15.195:6789/0 conn(0x7f31a40b6e10 legacy=0x7f31a41608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:04.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.778+0000 7f31a3400640 1 -- 172.21.15.131:0/2997971790 >> v1:172.21.15.131:6789/0 conn(0x7f31a40cf2f0 legacy=0x7f31a40b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:04.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.778+0000 7f31a3400640 1 -- 172.21.15.131:0/2997971790 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a40b77b0 con 0x7f31a4160fe0 2024-04-25T19:31:04.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.779+0000 7f31a3400640 1 --2- 172.21.15.131:0/2997971790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31a4160fe0 0x7f31a415a810 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f319c009e50 tx=0x7f319c02a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce051f682c90afe0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:04.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.779+0000 7f31a1600640 1 -- 172.21.15.131:0/2997971790 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f319c036070 con 0x7f31a4160fe0 2024-04-25T19:31:04.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.780+0000 7f31a1600640 1 -- 172.21.15.131:0/2997971790 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f319c031600 con 0x7f31a4160fe0 2024-04-25T19:31:04.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.780+0000 7f31a1600640 1 -- 172.21.15.131:0/2997971790 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f319c0319d0 con 0x7f31a4160fe0 2024-04-25T19:31:04.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.780+0000 7f31a3e00640 1 -- 172.21.15.131:0/2997971790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31a4160fe0 msgr2=0x7f31a415a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:04.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.780+0000 7f31a3e00640 1 --2- 172.21.15.131:0/2997971790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31a4160fe0 0x7f31a415a810 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f319c009e50 tx=0x7f319c02a760 comp rx=0 tx=0).stop 2024-04-25T19:31:04.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.780+0000 7f31a3e00640 1 -- 172.21.15.131:0/2997971790 shutdown_connections 2024-04-25T19:31:04.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.780+0000 7f31a3e00640 1 --2- 172.21.15.131:0/2997971790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31a4160fe0 0x7f31a415a810 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:04.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.780+0000 7f31a3e00640 1 -- 172.21.15.131:0/2997971790 >> 172.21.15.131:0/2997971790 conn(0x7f31a40d1720 msgr2=0x7f31a40d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:04.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.780+0000 7f31a3e00640 1 -- 172.21.15.131:0/2997971790 shutdown_connections 2024-04-25T19:31:04.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.781+0000 7f31a3e00640 1 -- 172.21.15.131:0/2997971790 wait complete. 2024-04-25T19:31:04.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.783+0000 7f31a3e00640 1 Processor -- start 2024-04-25T19:31:04.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.783+0000 7f31a3e00640 1 -- start start 2024-04-25T19:31:04.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.784+0000 7f31a3e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31a40b6e10 0x7f31a41f6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:04.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.784+0000 7f31a3e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31a40cf2f0 0x7f31a415e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:04.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.784+0000 7f31a3e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31a41606d0 0x7f31a4160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:04.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.784+0000 7f31a3e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f31a406fd00 con 0x7f31a40b6e10 2024-04-25T19:31:04.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.784+0000 7f31a3e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f31a406f500 con 0x7f31a41606d0 2024-04-25T19:31:04.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.784+0000 7f31a3e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f31a406fe80 con 0x7f31a40cf2f0 2024-04-25T19:31:04.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.785+0000 7f31a2a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31a40b6e10 0x7f31a41f6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:04.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.785+0000 7f31a2a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31a40b6e10 0x7f31a41f6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:53074/0 (socket says 172.21.15.131:53074) 2024-04-25T19:31:04.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.785+0000 7f31a2a00640 1 -- 172.21.15.131:0/1677052790 learned_addr learned my addr 172.21.15.131:0/1677052790 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:04.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.785+0000 7f31a3400640 1 --2- 172.21.15.131:0/1677052790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31a41606d0 0x7f31a4160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:04.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.785+0000 7f31a2a00640 1 -- 172.21.15.131:0/1677052790 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31a40cf2f0 msgr2=0x7f31a415e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:04.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.785+0000 7f31a2a00640 1 --2- 172.21.15.131:0/1677052790 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31a40cf2f0 0x7f31a415e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:04.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.785+0000 7f31a2a00640 1 -- 172.21.15.131:0/1677052790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31a41606d0 msgr2=0x7f31a4160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:04.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.785+0000 7f31a2a00640 1 --2- 172.21.15.131:0/1677052790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31a41606d0 0x7f31a4160ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:04.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.785+0000 7f31a2a00640 1 -- 172.21.15.131:0/1677052790 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a4161020 con 0x7f31a40b6e10 2024-04-25T19:31:04.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.785+0000 7f31a2a00640 1 --2- 172.21.15.131:0/1677052790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31a40b6e10 0x7f31a41f6f90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f319400c3c0 tx=0x7f319400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:04.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.786+0000 7f319b400640 1 -- 172.21.15.131:0/1677052790 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31940052d0 con 0x7f31a40b6e10 2024-04-25T19:31:04.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.786+0000 7f319b400640 1 -- 172.21.15.131:0/1677052790 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3194005490 con 0x7f31a40b6e10 2024-04-25T19:31:04.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.786+0000 7f319b400640 1 -- 172.21.15.131:0/1677052790 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3194007260 con 0x7f31a40b6e10 2024-04-25T19:31:04.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.786+0000 7f31a3e00640 1 -- 172.21.15.131:0/1677052790 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31a415b8c0 con 0x7f31a40b6e10 2024-04-25T19:31:04.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.786+0000 7f31a3e00640 1 -- 172.21.15.131:0/1677052790 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31a415be80 con 0x7f31a40b6e10 2024-04-25T19:31:04.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.787+0000 7f31a3e00640 1 -- 172.21.15.131:0/1677052790 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31a4050740 con 0x7f31a40b6e10 2024-04-25T19:31:04.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.788+0000 7f319b400640 1 -- 172.21.15.131:0/1677052790 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3194007400 con 0x7f31a40b6e10 2024-04-25T19:31:04.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.789+0000 7f319b400640 1 --2- 172.21.15.131:0/1677052790 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f31840744b0 0x7f31840769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:04.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.789+0000 7f319b400640 1 -- 172.21.15.131:0/1677052790 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f3194094750 con 0x7f31a40b6e10 2024-04-25T19:31:04.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.790+0000 7f31a2000640 1 --2- 172.21.15.131:0/1677052790 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f31840744b0 0x7f31840769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:04.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.791+0000 7f31a2000640 1 --2- 172.21.15.131:0/1677052790 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f31840744b0 0x7f31840769c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3190006fd0 tx=0x7f3190006bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:04.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:04.794+0000 7f319b400640 1 -- 172.21.15.131:0/1677052790 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f31a4161020 con 0x7f31a40b6e10 2024-04-25T19:31:05.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.033+0000 7f31a3e00640 1 -- 172.21.15.131:0/1677052790 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31a41f7630 con 0x7f31a40b6e10 2024-04-25T19:31:05.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.034+0000 7f319b400640 1 -- 172.21.15.131:0/1677052790 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5190 (secure 0 0 0) 0x7f319405ee90 con 0x7f31a40b6e10 2024-04-25T19:31:05.036 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:31:05.036 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4706,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3512447940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":3512447940},{"type":"v1","addr":"172.21.15.195:6837","nonce":3512447940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2666088311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":2666088311},{"type":"v1","addr":"172.21.15.195:6836","nonce":2666088311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1450320216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1450320216},{"type":"v1","addr":"172.21.15.131:6834","nonce":1450320216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T19:24:15.727328+0000","modified":"2024-04-25T19:24:18.791952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/274211686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":274211686},{"type":"v1","addr":"172.21.15.131:6835","nonce":274211686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5481,"qdb_cluster":[5481]},"id":3}]} 2024-04-25T19:31:05.036 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 25 2024-04-25T19:31:05.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.037+0000 7f31a3e00640 1 -- 172.21.15.131:0/1677052790 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f31840744b0 msgr2=0x7f31840769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:05.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.037+0000 7f31a3e00640 1 --2- 172.21.15.131:0/1677052790 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f31840744b0 0x7f31840769c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3190006fd0 tx=0x7f3190006bc0 comp rx=0 tx=0).stop 2024-04-25T19:31:05.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.037+0000 7f31a3e00640 1 -- 172.21.15.131:0/1677052790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31a40b6e10 msgr2=0x7f31a41f6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:05.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.037+0000 7f31a3e00640 1 --2- 172.21.15.131:0/1677052790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31a40b6e10 0x7f31a41f6f90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f319400c3c0 tx=0x7f319400c880 comp rx=0 tx=0).stop 2024-04-25T19:31:05.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.037+0000 7f31a3e00640 1 -- 172.21.15.131:0/1677052790 shutdown_connections 2024-04-25T19:31:05.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.037+0000 7f31a3e00640 1 --2- 172.21.15.131:0/1677052790 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f31840744b0 0x7f31840769c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:05.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.037+0000 7f31a3e00640 1 --2- 172.21.15.131:0/1677052790 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31a40cf2f0 0x7f31a415e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:05.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.037+0000 7f31a3e00640 1 --2- 172.21.15.131:0/1677052790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31a41606d0 0x7f31a4160ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:05.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.037+0000 7f31a3e00640 1 --2- 172.21.15.131:0/1677052790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31a40b6e10 0x7f31a41f6f90 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:05.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.037+0000 7f31a3e00640 1 -- 172.21.15.131:0/1677052790 >> 172.21.15.131:0/1677052790 conn(0x7f31a40d1720 msgr2=0x7f31a40d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:05.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.037+0000 7f31a3e00640 1 -- 172.21.15.131:0/1677052790 shutdown_connections 2024-04-25T19:31:05.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.038+0000 7f31a3e00640 1 -- 172.21.15.131:0/1677052790 wait complete. 2024-04-25T19:31:05.062 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:31:05.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.323+0000 7f8f8da00640 1 Processor -- start 2024-04-25T19:31:05.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.323+0000 7f8f8da00640 1 -- start start 2024-04-25T19:31:05.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.326+0000 7f8f8da00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8f88167000 0x7f8f88169420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:05.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.326+0000 7f8f8da00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f8815f5f0 con 0x7f8f880cf5e0 2024-04-25T19:31:05.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.326+0000 7f8f8da00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f8815e830 con 0x7f8f881443c0 2024-04-25T19:31:05.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.326+0000 7f8f8da00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f8f880708d0 con 0x7f8f88167000 2024-04-25T19:31:05.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.326+0000 7f8f7e000640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f8f880cf5e0 0x7f8f880cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:60838/0 (socket says 172.21.15.131:60838) 2024-04-25T19:31:05.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.326+0000 7f8f7e000640 1 -- 172.21.15.131:0/2758921037 learned_addr learned my addr 172.21.15.131:0/2758921037 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:31:05.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.326+0000 7f8f87400640 1 --2- 172.21.15.131:0/2758921037 >> v2:172.21.15.195:3300/0 conn(0x7f8f88167000 0x7f8f88169420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:05.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.327+0000 7f8f86000640 1 -- 172.21.15.131:0/2758921037 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4005452811 0 0) 0x7f8f8815f5f0 con 0x7f8f880cf5e0 2024-04-25T19:31:05.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.327+0000 7f8f86000640 1 -- 172.21.15.131:0/2758921037 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f6c003520 con 0x7f8f880cf5e0 2024-04-25T19:31:05.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.327+0000 7f8f86000640 1 -- 172.21.15.131:0/2758921037 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2962477688 0 0) 0x7f8f6c003520 con 0x7f8f880cf5e0 2024-04-25T19:31:05.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.327+0000 7f8f86000640 1 -- 172.21.15.131:0/2758921037 >> v2:172.21.15.195:3300/0 conn(0x7f8f88167000 msgr2=0x7f8f88169420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:05.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.327+0000 7f8f86000640 1 --2- 172.21.15.131:0/2758921037 >> v2:172.21.15.195:3300/0 conn(0x7f8f88167000 0x7f8f88169420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:05.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.327+0000 7f8f86000640 1 -- 172.21.15.131:0/2758921037 >> v1:172.21.15.195:6789/0 conn(0x7f8f881443c0 legacy=0x7f8f8806fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:05.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.327+0000 7f8f86000640 1 -- 172.21.15.131:0/2758921037 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8815eb10 con 0x7f8f880cf5e0 2024-04-25T19:31:05.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.327+0000 7f8f86000640 1 -- 172.21.15.131:0/2758921037 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f8f70001670 con 0x7f8f880cf5e0 2024-04-25T19:31:05.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.327+0000 7f8f86000640 1 -- 172.21.15.131:0/2758921037 >> v1:172.21.15.131:6789/0 conn(0x7f8f880cf5e0 legacy=0x7f8f880cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:05.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.327+0000 7f8f86000640 1 --2- 172.21.15.131:0/2758921037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f6c0039b0 0x7f8f6c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:05.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.327+0000 7f8f86000640 1 --2- 172.21.15.131:0/2758921037 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f6c004800 0x7f8f6c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:05.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.327+0000 7f8f86000640 1 --2- 172.21.15.131:0/2758921037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f6c0051c0 0x7f8f6c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:05.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.327+0000 7f8f86000640 1 -- 172.21.15.131:0/2758921037 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8f880708d0 con 0x7f8f6c0051c0 2024-04-25T19:31:05.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.327+0000 7f8f86000640 1 -- 172.21.15.131:0/2758921037 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6c00c160 con 0x7f8f6c0039b0 2024-04-25T19:31:05.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.327+0000 7f8f86000640 1 -- 172.21.15.131:0/2758921037 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8f6c00c360 con 0x7f8f6c004800 2024-04-25T19:31:05.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.328+0000 7f8f87400640 1 --2- 172.21.15.131:0/2758921037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f6c0051c0 0x7f8f6c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:05.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.328+0000 7f8f86a00640 1 --2- 172.21.15.131:0/2758921037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f6c0039b0 0x7f8f6c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:05.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.328+0000 7f8f87400640 1 -- 172.21.15.131:0/2758921037 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f6c004800 msgr2=0x7f8f6c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:05.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.328+0000 7f8f87400640 1 --2- 172.21.15.131:0/2758921037 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f6c004800 0x7f8f6c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:05.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.328+0000 7f8f87400640 1 -- 172.21.15.131:0/2758921037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f6c0039b0 msgr2=0x7f8f6c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:05.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.328+0000 7f8f87400640 1 --2- 172.21.15.131:0/2758921037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f6c0039b0 0x7f8f6c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:05.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.328+0000 7f8f87400640 1 -- 172.21.15.131:0/2758921037 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f6c003520 con 0x7f8f6c0051c0 2024-04-25T19:31:05.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.329+0000 7f8f87400640 1 -- 172.21.15.131:0/2758921037 reap_dead start 2024-04-25T19:31:05.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.329+0000 7f8f87400640 1 --2- 172.21.15.131:0/2758921037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f6c0051c0 0x7f8f6c00b9c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8f80009f90 tx=0x7f8f6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5dcb2c5e14a7b81 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:05.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.329+0000 7f8f86000640 1 -- 172.21.15.131:0/2758921037 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f80009c10 con 0x7f8f6c0051c0 2024-04-25T19:31:05.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.329+0000 7f8f86000640 1 -- 172.21.15.131:0/2758921037 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f80003b90 con 0x7f8f6c0051c0 2024-04-25T19:31:05.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.329+0000 7f8f86000640 1 -- 172.21.15.131:0/2758921037 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f80004020 con 0x7f8f6c0051c0 2024-04-25T19:31:05.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.330+0000 7f8f8da00640 1 -- 172.21.15.131:0/2758921037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f6c0051c0 msgr2=0x7f8f6c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:05.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.330+0000 7f8f8da00640 1 --2- 172.21.15.131:0/2758921037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f6c0051c0 0x7f8f6c00b9c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8f80009f90 tx=0x7f8f6c005830 comp rx=0 tx=0).stop 2024-04-25T19:31:05.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.330+0000 7f8f8da00640 1 -- 172.21.15.131:0/2758921037 shutdown_connections 2024-04-25T19:31:05.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.330+0000 7f8f8da00640 1 --2- 172.21.15.131:0/2758921037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f6c0051c0 0x7f8f6c00b9c0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:05.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.330+0000 7f8f8da00640 1 -- 172.21.15.131:0/2758921037 >> 172.21.15.131:0/2758921037 conn(0x7f8f880d1ae0 msgr2=0x7f8f880d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:05.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.330+0000 7f8f8da00640 1 -- 172.21.15.131:0/2758921037 shutdown_connections 2024-04-25T19:31:05.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.330+0000 7f8f8da00640 1 -- 172.21.15.131:0/2758921037 wait complete. 2024-04-25T19:31:05.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.333+0000 7f8f8da00640 1 Processor -- start 2024-04-25T19:31:05.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.333+0000 7f8f8da00640 1 -- start start 2024-04-25T19:31:05.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.334+0000 7f8f8da00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f6c0051c0 0x7f8f881fa9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:05.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.334+0000 7f8f8da00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f88157230 0x7f8f880b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:05.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.334+0000 7f8f8da00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f88157640 0x7f8f880b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:05.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.334+0000 7f8f8da00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8f881447d0 con 0x7f8f88157230 2024-04-25T19:31:05.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.334+0000 7f8f8da00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8815f160 con 0x7f8f6c0051c0 2024-04-25T19:31:05.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.334+0000 7f8f8da00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8f88162b00 con 0x7f8f88157640 2024-04-25T19:31:05.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.335+0000 7f8f7e000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f88157230 0x7f8f880b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:05.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.335+0000 7f8f7e000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f88157230 0x7f8f880b2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:53092/0 (socket says 172.21.15.131:53092) 2024-04-25T19:31:05.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.335+0000 7f8f7e000640 1 -- 172.21.15.131:0/3878836988 learned_addr learned my addr 172.21.15.131:0/3878836988 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:05.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.335+0000 7f8f86a00640 1 --2- 172.21.15.131:0/3878836988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f6c0051c0 0x7f8f881fa9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:05.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.335+0000 7f8f87400640 1 --2- 172.21.15.131:0/3878836988 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f88157640 0x7f8f880b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:05.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.335+0000 7f8f7e000640 1 -- 172.21.15.131:0/3878836988 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f88157640 msgr2=0x7f8f880b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:05.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.335+0000 7f8f7e000640 1 --2- 172.21.15.131:0/3878836988 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f88157640 0x7f8f880b2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:05.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.335+0000 7f8f7e000640 1 -- 172.21.15.131:0/3878836988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f6c0051c0 msgr2=0x7f8f881fa9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:05.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.335+0000 7f8f7e000640 1 --2- 172.21.15.131:0/3878836988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f6c0051c0 0x7f8f881fa9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:05.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.335+0000 7f8f7e000640 1 -- 172.21.15.131:0/3878836988 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f880b0c90 con 0x7f8f88157230 2024-04-25T19:31:05.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.335+0000 7f8f7e000640 1 --2- 172.21.15.131:0/3878836988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f88157230 0x7f8f880b2100 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8f7000c680 tx=0x7f8f7000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:05.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.336+0000 7f8f7f400640 1 -- 172.21.15.131:0/3878836988 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f70018070 con 0x7f8f88157230 2024-04-25T19:31:05.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.336+0000 7f8f7f400640 1 -- 172.21.15.131:0/3878836988 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f700072d0 con 0x7f8f88157230 2024-04-25T19:31:05.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.336+0000 7f8f7f400640 1 -- 172.21.15.131:0/3878836988 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f700047e0 con 0x7f8f88157230 2024-04-25T19:31:05.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.336+0000 7f8f8da00640 1 -- 172.21.15.131:0/3878836988 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f880b1100 con 0x7f8f88157230 2024-04-25T19:31:05.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.336+0000 7f8f8da00640 1 -- 172.21.15.131:0/3878836988 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f880af4e0 con 0x7f8f88157230 2024-04-25T19:31:05.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.337+0000 7f8f8da00640 1 -- 172.21.15.131:0/3878836988 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f880b0e60 con 0x7f8f88157230 2024-04-25T19:31:05.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.338+0000 7f8f7f400640 1 -- 172.21.15.131:0/3878836988 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8f7001b070 con 0x7f8f88157230 2024-04-25T19:31:05.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.339+0000 7f8f7f400640 1 --2- 172.21.15.131:0/3878836988 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8f640744b0 0x7f8f640769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:05.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.339+0000 7f8f7f400640 1 -- 172.21.15.131:0/3878836988 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f8f700947f0 con 0x7f8f88157230 2024-04-25T19:31:05.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.340+0000 7f8f86a00640 1 --2- 172.21.15.131:0/3878836988 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8f640744b0 0x7f8f640769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:05.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.341+0000 7f8f86a00640 1 --2- 172.21.15.131:0/3878836988 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8f640744b0 0x7f8f640769c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8f78000c00 tx=0x7f8f78009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:05.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.344+0000 7f8f7f400640 1 -- 172.21.15.131:0/3878836988 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8f880b0e60 con 0x7f8f88157230 2024-04-25T19:31:05.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.538+0000 7f8f8da00640 1 -- 172.21.15.131:0/3878836988 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f880af720 con 0x7f8f88157230 2024-04-25T19:31:05.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.542+0000 7f8f7f400640 1 -- 172.21.15.131:0/3878836988 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16788 (secure 0 0 0) 0x7f8f7005eea0 con 0x7f8f88157230 2024-04-25T19:31:05.542 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:31:05.543 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":47,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:24:58.382161+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T19:24:13.848038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T19:24:14.699910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.4","mappings":[{"from":0,"to":5}]},{"pgid":"7.2c","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:31:05.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.544+0000 7f8f8da00640 1 -- 172.21.15.131:0/3878836988 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8f640744b0 msgr2=0x7f8f640769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:05.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.544+0000 7f8f8da00640 1 --2- 172.21.15.131:0/3878836988 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8f640744b0 0x7f8f640769c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8f78000c00 tx=0x7f8f78009040 comp rx=0 tx=0).stop 2024-04-25T19:31:05.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.544+0000 7f8f8da00640 1 -- 172.21.15.131:0/3878836988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f88157230 msgr2=0x7f8f880b2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:05.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.544+0000 7f8f8da00640 1 --2- 172.21.15.131:0/3878836988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f88157230 0x7f8f880b2100 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8f7000c680 tx=0x7f8f7000cb40 comp rx=0 tx=0).stop 2024-04-25T19:31:05.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.544+0000 7f8f8da00640 1 -- 172.21.15.131:0/3878836988 shutdown_connections 2024-04-25T19:31:05.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.544+0000 7f8f8da00640 1 --2- 172.21.15.131:0/3878836988 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8f640744b0 0x7f8f640769c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:05.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.544+0000 7f8f8da00640 1 --2- 172.21.15.131:0/3878836988 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f88157640 0x7f8f880b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:05.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.544+0000 7f8f8da00640 1 --2- 172.21.15.131:0/3878836988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f88157230 0x7f8f880b2100 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:05.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.544+0000 7f8f8da00640 1 --2- 172.21.15.131:0/3878836988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f6c0051c0 0x7f8f881fa9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:05.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.544+0000 7f8f8da00640 1 -- 172.21.15.131:0/3878836988 >> 172.21.15.131:0/3878836988 conn(0x7f8f880d1ae0 msgr2=0x7f8f880d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:05.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.545+0000 7f8f8da00640 1 -- 172.21.15.131:0/3878836988 shutdown_connections 2024-04-25T19:31:05.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.545+0000 7f8f8da00640 1 -- 172.21.15.131:0/3878836988 wait complete. 2024-04-25T19:31:05.569 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T19:31:05.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.820+0000 7f4c3a400640 1 Processor -- start 2024-04-25T19:31:05.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.820+0000 7f4c3a400640 1 -- start start 2024-04-25T19:31:05.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.822+0000 7f4c3a400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c340b4ff0 0x7f4c340b67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:05.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.822+0000 7f4c3a400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4c340d21c0 0x7f4c340cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:05.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.822+0000 7f4c3a400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c340d26f0 con 0x7f4c340cf7f0 2024-04-25T19:31:05.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.822+0000 7f4c3a400640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f4c340ce7d0 con 0x7f4c340d21c0 2024-04-25T19:31:05.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.822+0000 7f4c3a400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4c340ceab0 con 0x7f4c340b4ff0 2024-04-25T19:31:05.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.822+0000 7f4c33e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4c340d21c0 0x7f4c340cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:05.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.823+0000 7f4c33e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4c340d21c0 0x7f4c340cf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:53100/0 (socket says 172.21.15.131:53100) 2024-04-25T19:31:05.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.823+0000 7f4c33e00640 1 -- 172.21.15.131:0/1813099721 learned_addr learned my addr 172.21.15.131:0/1813099721 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:05.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.823+0000 7f4c39000640 1 --2- 172.21.15.131:0/1813099721 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c340b4ff0 0x7f4c340b67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:05.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.823+0000 7f4c33e00640 1 -- 172.21.15.131:0/1813099721 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c340b4ff0 msgr2=0x7f4c340b67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:05.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.823+0000 7f4c33e00640 1 --2- 172.21.15.131:0/1813099721 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c340b4ff0 0x7f4c340b67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:05.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.823+0000 7f4c33e00640 1 -- 172.21.15.131:0/1813099721 >> v1:172.21.15.195:6789/0 conn(0x7f4c340cf7f0 legacy=0x7f4c3408cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:05.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.823+0000 7f4c33e00640 1 -- 172.21.15.131:0/1813099721 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c340ced90 con 0x7f4c340d21c0 2024-04-25T19:31:05.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.823+0000 7f4c39000640 1 --2- 172.21.15.131:0/1813099721 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c340b4ff0 0x7f4c340b67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:31:05.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.824+0000 7f4c33e00640 1 --2- 172.21.15.131:0/1813099721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c340d21c0 0x7f4c340cf2b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009e50 tx=0x7f4c1c02a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321bb4a8a97528e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:05.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.824+0000 7f4c33400640 1 -- 172.21.15.131:0/1813099721 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c036070 con 0x7f4c340d21c0 2024-04-25T19:31:05.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.824+0000 7f4c33400640 1 -- 172.21.15.131:0/1813099721 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c1c031600 con 0x7f4c340d21c0 2024-04-25T19:31:05.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.824+0000 7f4c33400640 1 -- 172.21.15.131:0/1813099721 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c0319d0 con 0x7f4c340d21c0 2024-04-25T19:31:05.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.825+0000 7f4c3a400640 1 -- 172.21.15.131:0/1813099721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c340d21c0 msgr2=0x7f4c340cf2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:05.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.825+0000 7f4c3a400640 1 --2- 172.21.15.131:0/1813099721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c340d21c0 0x7f4c340cf2b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009e50 tx=0x7f4c1c02a6d0 comp rx=0 tx=0).stop 2024-04-25T19:31:05.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.825+0000 7f4c3a400640 1 -- 172.21.15.131:0/1813099721 shutdown_connections 2024-04-25T19:31:05.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.825+0000 7f4c3a400640 1 --2- 172.21.15.131:0/1813099721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c340d21c0 0x7f4c340cf2b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:05.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.825+0000 7f4c3a400640 1 --2- 172.21.15.131:0/1813099721 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c340b4ff0 0x7f4c340b67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:05.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.825+0000 7f4c3a400640 1 -- 172.21.15.131:0/1813099721 >> 172.21.15.131:0/1813099721 conn(0x7f4c340b5460 msgr2=0x7f4c340b5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:05.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.825+0000 7f4c3a400640 1 -- 172.21.15.131:0/1813099721 shutdown_connections 2024-04-25T19:31:05.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.825+0000 7f4c3a400640 1 -- 172.21.15.131:0/1813099721 wait complete. 2024-04-25T19:31:05.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.827+0000 7f4c3a400640 1 Processor -- start 2024-04-25T19:31:05.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.828+0000 7f4c3a400640 1 -- start start 2024-04-25T19:31:05.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.829+0000 7f4c3a400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c340b4ff0 0x7f4c34160460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:05.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.829+0000 7f4c3a400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c340cf7f0 0x7f4c340cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:05.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.829+0000 7f4c3a400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c340d21c0 0x7f4c340b7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:05.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.829+0000 7f4c3a400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4c340d29d0 con 0x7f4c340d21c0 2024-04-25T19:31:05.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.829+0000 7f4c3a400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4c340cfc00 con 0x7f4c340b4ff0 2024-04-25T19:31:05.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.829+0000 7f4c3a400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4c340d2b50 con 0x7f4c340cf7f0 2024-04-25T19:31:05.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.829+0000 7f4c39a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c340d21c0 0x7f4c340b7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:05.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.830+0000 7f4c39a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c340d21c0 0x7f4c340b7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:53106/0 (socket says 172.21.15.131:53106) 2024-04-25T19:31:05.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.830+0000 7f4c39a00640 1 -- 172.21.15.131:0/2843908127 learned_addr learned my addr 172.21.15.131:0/2843908127 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:05.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.830+0000 7f4c39000640 1 --2- 172.21.15.131:0/2843908127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c340b4ff0 0x7f4c34160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:05.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.830+0000 7f4c39a00640 1 -- 172.21.15.131:0/2843908127 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c340cf7f0 msgr2=0x7f4c340cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:05.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.830+0000 7f4c39a00640 1 --2- 172.21.15.131:0/2843908127 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c340cf7f0 0x7f4c340cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:05.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.830+0000 7f4c39a00640 1 -- 172.21.15.131:0/2843908127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c340b4ff0 msgr2=0x7f4c34160460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:05.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.830+0000 7f4c39a00640 1 --2- 172.21.15.131:0/2843908127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c340b4ff0 0x7f4c34160460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:05.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.830+0000 7f4c39a00640 1 -- 172.21.15.131:0/2843908127 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c340cb4e0 con 0x7f4c340d21c0 2024-04-25T19:31:05.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.830+0000 7f4c39a00640 1 --2- 172.21.15.131:0/2843908127 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c340d21c0 0x7f4c340b7e00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c00b410 tx=0x7f4c2c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:05.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.830+0000 7f4c30c00640 1 -- 172.21.15.131:0/2843908127 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c015030 con 0x7f4c340d21c0 2024-04-25T19:31:05.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.830+0000 7f4c30c00640 1 -- 172.21.15.131:0/2843908127 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c2c004020 con 0x7f4c340d21c0 2024-04-25T19:31:05.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.830+0000 7f4c30c00640 1 -- 172.21.15.131:0/2843908127 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c004410 con 0x7f4c340d21c0 2024-04-25T19:31:05.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.831+0000 7f4c3a400640 1 -- 172.21.15.131:0/2843908127 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c3415ede0 con 0x7f4c340d21c0 2024-04-25T19:31:05.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.831+0000 7f4c3a400640 1 -- 172.21.15.131:0/2843908127 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c3415f3a0 con 0x7f4c340d21c0 2024-04-25T19:31:05.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.832+0000 7f4c3a400640 1 -- 172.21.15.131:0/2843908127 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c34050740 con 0x7f4c340d21c0 2024-04-25T19:31:05.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.833+0000 7f4c30c00640 1 -- 172.21.15.131:0/2843908127 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4c2c018070 con 0x7f4c340d21c0 2024-04-25T19:31:05.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.834+0000 7f4c30c00640 1 --2- 172.21.15.131:0/2843908127 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f4c100744b0 0x7f4c100769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:05.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.834+0000 7f4c30c00640 1 -- 172.21.15.131:0/2843908127 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f4c2c094c70 con 0x7f4c340d21c0 2024-04-25T19:31:05.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.834+0000 7f4c39000640 1 --2- 172.21.15.131:0/2843908127 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f4c100744b0 0x7f4c100769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:05.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.836+0000 7f4c39000640 1 --2- 172.21.15.131:0/2843908127 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f4c100744b0 0x7f4c100769c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4c24006fd0 tx=0x7f4c24008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:05.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:05.839+0000 7f4c30c00640 1 -- 172.21.15.131:0/2843908127 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4c2c05f440 con 0x7f4c340d21c0 2024-04-25T19:31:06.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.079+0000 7f4c3a400640 1 -- 172.21.15.131:0/2843908127 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4c3415eb70 con 0x7f4c340d21c0 2024-04-25T19:31:06.081 INFO:tasks.ceph.mon.a.smithi131.stderr:2024-04-25T19:31:06.081+0000 7f4e1e400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T19:31:06.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.084+0000 7f4c30c00640 1 -- 172.21.15.131:0/2843908127 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) ==== 161+0+0 (secure 0 0 0) 0x7f4c2c05ed40 con 0x7f4c340d21c0 2024-04-25T19:31:06.085 INFO:teuthology.orchestra.run.smithi131.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T19:31:06.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.088+0000 7f4c3a400640 1 -- 172.21.15.131:0/2843908127 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f4c100744b0 msgr2=0x7f4c100769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:06.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.088+0000 7f4c3a400640 1 --2- 172.21.15.131:0/2843908127 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f4c100744b0 0x7f4c100769c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4c24006fd0 tx=0x7f4c24008040 comp rx=0 tx=0).stop 2024-04-25T19:31:06.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.088+0000 7f4c3a400640 1 -- 172.21.15.131:0/2843908127 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c340d21c0 msgr2=0x7f4c340b7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:06.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.088+0000 7f4c3a400640 1 --2- 172.21.15.131:0/2843908127 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c340d21c0 0x7f4c340b7e00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c00b410 tx=0x7f4c2c00b8d0 comp rx=0 tx=0).stop 2024-04-25T19:31:06.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.089+0000 7f4c3a400640 1 -- 172.21.15.131:0/2843908127 shutdown_connections 2024-04-25T19:31:06.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.089+0000 7f4c3a400640 1 --2- 172.21.15.131:0/2843908127 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f4c100744b0 0x7f4c100769c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:06.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.089+0000 7f4c3a400640 1 --2- 172.21.15.131:0/2843908127 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c340cf7f0 0x7f4c340cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:06.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.089+0000 7f4c3a400640 1 --2- 172.21.15.131:0/2843908127 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c340d21c0 0x7f4c340b7e00 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:06.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.089+0000 7f4c3a400640 1 --2- 172.21.15.131:0/2843908127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c340b4ff0 0x7f4c34160460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:06.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.089+0000 7f4c3a400640 1 -- 172.21.15.131:0/2843908127 >> 172.21.15.131:0/2843908127 conn(0x7f4c340b5460 msgr2=0x7f4c341618f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:06.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.090+0000 7f4c3a400640 1 -- 172.21.15.131:0/2843908127 shutdown_connections 2024-04-25T19:31:06.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.090+0000 7f4c3a400640 1 -- 172.21.15.131:0/2843908127 wait complete. 2024-04-25T19:31:06.117 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T19:31:06.240 INFO:tasks.ceph.mds.c.smithi131.stdout:starting mds.c at 2024-04-25T19:31:06.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.364+0000 7fed64e00640 1 Processor -- start 2024-04-25T19:31:06.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.365+0000 7fed64e00640 1 -- start start 2024-04-25T19:31:06.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.367+0000 7fed64e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fed60155350 0x7fed6015f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:06.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.367+0000 7fed64e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed60161ce0 0x7fed6006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:06.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.367+0000 7fed64e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fed601620f0 0x7fed6006db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:06.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.367+0000 7fed64e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fed60162c10 con 0x7fed601620f0 2024-04-25T19:31:06.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.367+0000 7fed64e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fed60162650 con 0x7fed60155350 2024-04-25T19:31:06.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.367+0000 7fed64e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fed60162930 con 0x7fed60161ce0 2024-04-25T19:31:06.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.367+0000 7fed5e800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fed601620f0 0x7fed6006db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:06.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.368+0000 7fed5e800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fed601620f0 0x7fed6006db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:53128/0 (socket says 172.21.15.131:53128) 2024-04-25T19:31:06.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.368+0000 7fed5e800640 1 -- 172.21.15.131:0/3097348324 learned_addr learned my addr 172.21.15.131:0/3097348324 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:06.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.368+0000 7fed5de00640 1 --2- 172.21.15.131:0/3097348324 >> v2:172.21.15.195:3300/0 conn(0x7fed60155350 0x7fed6015f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:06.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.368+0000 7fed5d400640 1 --2- 172.21.15.131:0/3097348324 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed60161ce0 0x7fed6006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:06.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.368+0000 7fed5e800640 1 -- 172.21.15.131:0/3097348324 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed60161ce0 msgr2=0x7fed6006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:06.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.368+0000 7fed5e800640 1 --2- 172.21.15.131:0/3097348324 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed60161ce0 0x7fed6006d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:06.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.368+0000 7fed5e800640 1 -- 172.21.15.131:0/3097348324 >> v2:172.21.15.195:3300/0 conn(0x7fed60155350 msgr2=0x7fed6015f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:06.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.368+0000 7fed5e800640 1 --2- 172.21.15.131:0/3097348324 >> v2:172.21.15.195:3300/0 conn(0x7fed60155350 0x7fed6015f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:06.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.368+0000 7fed5e800640 1 -- 172.21.15.131:0/3097348324 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed6015e890 con 0x7fed601620f0 2024-04-25T19:31:06.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.369+0000 7fed5e800640 1 --2- 172.21.15.131:0/3097348324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed601620f0 0x7fed6006db10 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fed60074b00 tx=0x7fed5802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69540721f1f22a1d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:06.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.370+0000 7fed5ca00640 1 -- 172.21.15.131:0/3097348324 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed58037070 con 0x7fed601620f0 2024-04-25T19:31:06.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.370+0000 7fed5ca00640 1 -- 172.21.15.131:0/3097348324 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed58032440 con 0x7fed601620f0 2024-04-25T19:31:06.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.370+0000 7fed5ca00640 1 -- 172.21.15.131:0/3097348324 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed58032810 con 0x7fed601620f0 2024-04-25T19:31:06.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.371+0000 7fed64e00640 1 -- 172.21.15.131:0/3097348324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed601620f0 msgr2=0x7fed6006db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:06.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.371+0000 7fed64e00640 1 --2- 172.21.15.131:0/3097348324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed601620f0 0x7fed6006db10 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fed60074b00 tx=0x7fed5802a1e0 comp rx=0 tx=0).stop 2024-04-25T19:31:06.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.371+0000 7fed64e00640 1 -- 172.21.15.131:0/3097348324 shutdown_connections 2024-04-25T19:31:06.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.371+0000 7fed64e00640 1 --2- 172.21.15.131:0/3097348324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed601620f0 0x7fed6006db10 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:06.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.371+0000 7fed64e00640 1 --2- 172.21.15.131:0/3097348324 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed60161ce0 0x7fed6006d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:06.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.371+0000 7fed64e00640 1 --2- 172.21.15.131:0/3097348324 >> v2:172.21.15.195:3300/0 conn(0x7fed60155350 0x7fed6015f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:06.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.371+0000 7fed64e00640 1 -- 172.21.15.131:0/3097348324 >> 172.21.15.131:0/3097348324 conn(0x7fed60073120 msgr2=0x7fed60073530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:06.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.371+0000 7fed64e00640 1 -- 172.21.15.131:0/3097348324 shutdown_connections 2024-04-25T19:31:06.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.371+0000 7fed64e00640 1 -- 172.21.15.131:0/3097348324 wait complete. 2024-04-25T19:31:06.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.373+0000 7fed64e00640 1 Processor -- start 2024-04-25T19:31:06.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.373+0000 7fed64e00640 1 -- start start 2024-04-25T19:31:06.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.375+0000 7fed64e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed60155350 0x7fed6014b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:06.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.375+0000 7fed64e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed60161ce0 0x7fed60158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:06.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.375+0000 7fed64e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed601620f0 0x7fed600b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:06.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.375+0000 7fed64e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fed600707b0 con 0x7fed60161ce0 2024-04-25T19:31:06.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.375+0000 7fed64e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fed6015f5d0 con 0x7fed601620f0 2024-04-25T19:31:06.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.375+0000 7fed64e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fed60070930 con 0x7fed60155350 2024-04-25T19:31:06.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.375+0000 7fed5d400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed60161ce0 0x7fed60158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:06.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.375+0000 7fed5d400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed60161ce0 0x7fed60158420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:53136/0 (socket says 172.21.15.131:53136) 2024-04-25T19:31:06.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.375+0000 7fed5d400640 1 -- 172.21.15.131:0/2660737182 learned_addr learned my addr 172.21.15.131:0/2660737182 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:06.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.376+0000 7fed5e800640 1 --2- 172.21.15.131:0/2660737182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed601620f0 0x7fed600b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:06.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.376+0000 7fed5de00640 1 --2- 172.21.15.131:0/2660737182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed60155350 0x7fed6014b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:06.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.376+0000 7fed5d400640 1 -- 172.21.15.131:0/2660737182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed60155350 msgr2=0x7fed6014b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:06.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.376+0000 7fed5d400640 1 --2- 172.21.15.131:0/2660737182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed60155350 0x7fed6014b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:06.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.376+0000 7fed5d400640 1 -- 172.21.15.131:0/2660737182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed601620f0 msgr2=0x7fed600b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:06.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.376+0000 7fed5d400640 1 --2- 172.21.15.131:0/2660737182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed601620f0 0x7fed600b1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:06.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.376+0000 7fed5d400640 1 -- 172.21.15.131:0/2660737182 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed60150ce0 con 0x7fed60161ce0 2024-04-25T19:31:06.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.376+0000 7fed5e800640 1 --2- 172.21.15.131:0/2660737182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed601620f0 0x7fed600b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:31:06.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.376+0000 7fed5de00640 1 --2- 172.21.15.131:0/2660737182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed60155350 0x7fed6014b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:31:06.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.376+0000 7fed5d400640 1 --2- 172.21.15.131:0/2660737182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed60161ce0 0x7fed60158420 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fed4800d620 tx=0x7fed4800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:06.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.376+0000 7fed56000640 1 -- 172.21.15.131:0/2660737182 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4800b620 con 0x7fed60161ce0 2024-04-25T19:31:06.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.376+0000 7fed56000640 1 -- 172.21.15.131:0/2660737182 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed48019070 con 0x7fed60161ce0 2024-04-25T19:31:06.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.376+0000 7fed56000640 1 -- 172.21.15.131:0/2660737182 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4800ba00 con 0x7fed60161ce0 2024-04-25T19:31:06.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.376+0000 7fed64e00640 1 -- 172.21.15.131:0/2660737182 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed60150fc0 con 0x7fed60161ce0 2024-04-25T19:31:06.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.377+0000 7fed64e00640 1 -- 172.21.15.131:0/2660737182 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed60151580 con 0x7fed60161ce0 2024-04-25T19:31:06.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.378+0000 7fed64e00640 1 -- 172.21.15.131:0/2660737182 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed60150a50 con 0x7fed60161ce0 2024-04-25T19:31:06.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.379+0000 7fed56000640 1 -- 172.21.15.131:0/2660737182 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fed4800bba0 con 0x7fed60161ce0 2024-04-25T19:31:06.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.380+0000 7fed56000640 1 --2- 172.21.15.131:0/2660737182 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fed3c0744b0 0x7fed3c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:06.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.380+0000 7fed56000640 1 -- 172.21.15.131:0/2660737182 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7fed48095660 con 0x7fed60161ce0 2024-04-25T19:31:06.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.381+0000 7fed5de00640 1 --2- 172.21.15.131:0/2660737182 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fed3c0744b0 0x7fed3c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:06.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.382+0000 7fed5de00640 1 --2- 172.21.15.131:0/2660737182 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fed3c0744b0 0x7fed3c0769c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fed60072050 tx=0x7fed5000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:06.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.386+0000 7fed56000640 1 -- 172.21.15.131:0/2660737182 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fed4805fdf0 con 0x7fed60161ce0 2024-04-25T19:31:06.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:06.626+0000 7fed64e00640 1 -- 172.21.15.131:0/2660737182 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fed600761c0 con 0x7fed60161ce0 2024-04-25T19:31:07.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.101+0000 7fed56000640 1 -- 172.21.15.131:0/2660737182 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) ==== 104+0+0 (secure 0 0 0) 0x7fed4805f6f0 con 0x7fed60161ce0 2024-04-25T19:31:07.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.105+0000 7fed64e00640 1 -- 172.21.15.131:0/2660737182 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fed3c0744b0 msgr2=0x7fed3c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:07.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.105+0000 7fed64e00640 1 --2- 172.21.15.131:0/2660737182 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fed3c0744b0 0x7fed3c0769c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fed60072050 tx=0x7fed5000b040 comp rx=0 tx=0).stop 2024-04-25T19:31:07.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.105+0000 7fed64e00640 1 -- 172.21.15.131:0/2660737182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed60161ce0 msgr2=0x7fed60158420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:07.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.105+0000 7fed64e00640 1 --2- 172.21.15.131:0/2660737182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed60161ce0 0x7fed60158420 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fed4800d620 tx=0x7fed4800dae0 comp rx=0 tx=0).stop 2024-04-25T19:31:07.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.105+0000 7fed64e00640 1 -- 172.21.15.131:0/2660737182 shutdown_connections 2024-04-25T19:31:07.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.105+0000 7fed64e00640 1 --2- 172.21.15.131:0/2660737182 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fed3c0744b0 0x7fed3c0769c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:07.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.105+0000 7fed64e00640 1 --2- 172.21.15.131:0/2660737182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed601620f0 0x7fed600b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:07.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.105+0000 7fed64e00640 1 --2- 172.21.15.131:0/2660737182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed60161ce0 0x7fed60158420 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:07.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.105+0000 7fed64e00640 1 --2- 172.21.15.131:0/2660737182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed60155350 0x7fed6014b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:07.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.105+0000 7fed64e00640 1 -- 172.21.15.131:0/2660737182 >> 172.21.15.131:0/2660737182 conn(0x7fed60073120 msgr2=0x7fed600b4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:07.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.105+0000 7fed64e00640 1 -- 172.21.15.131:0/2660737182 shutdown_connections 2024-04-25T19:31:07.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.105+0000 7fed64e00640 1 -- 172.21.15.131:0/2660737182 wait complete. 2024-04-25T19:31:07.138 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T19:31:07.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.407+0000 7fbe0ce00640 1 Processor -- start 2024-04-25T19:31:07.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.407+0000 7fbe0ce00640 1 -- start start 2024-04-25T19:31:07.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.409+0000 7fbe0ce00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe08161710 0x7fbe0815e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:07.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.409+0000 7fbe0ce00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbe0806c5c0 0x7fbe0806c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:07.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.409+0000 7fbe0ce00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbe08163fa0 0x7fbe081643b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:07.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.409+0000 7fbe0ce00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fbe081609b0 con 0x7fbe08163fa0 2024-04-25T19:31:07.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.409+0000 7fbe0ce00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fbe0806cf10 con 0x7fbe0806c5c0 2024-04-25T19:31:07.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.409+0000 7fbe0ce00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbe08164cd0 con 0x7fbe08161710 2024-04-25T19:31:07.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.410+0000 7fbe06800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbe08163fa0 0x7fbe081643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:07.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.410+0000 7fbe06800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbe08163fa0 0x7fbe081643b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:53150/0 (socket says 172.21.15.131:53150) 2024-04-25T19:31:07.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.410+0000 7fbe06800640 1 -- 172.21.15.131:0/2685272611 learned_addr learned my addr 172.21.15.131:0/2685272611 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:07.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.410+0000 7fbe05e00640 1 --2- 172.21.15.131:0/2685272611 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe08161710 0x7fbe0815e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:07.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.410+0000 7fbe05400640 1 --2- 172.21.15.131:0/2685272611 >> v2:172.21.15.195:3300/0 conn(0x7fbe0806c5c0 0x7fbe0806c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:07.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.410+0000 7fbe06800640 1 -- 172.21.15.131:0/2685272611 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe08161710 msgr2=0x7fbe0815e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:07.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.410+0000 7fbe06800640 1 --2- 172.21.15.131:0/2685272611 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe08161710 0x7fbe0815e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:07.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.410+0000 7fbe06800640 1 -- 172.21.15.131:0/2685272611 >> v2:172.21.15.195:3300/0 conn(0x7fbe0806c5c0 msgr2=0x7fbe0806c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:07.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.410+0000 7fbe06800640 1 --2- 172.21.15.131:0/2685272611 >> v2:172.21.15.195:3300/0 conn(0x7fbe0806c5c0 0x7fbe0806c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:07.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.410+0000 7fbe06800640 1 -- 172.21.15.131:0/2685272611 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe08160c30 con 0x7fbe08163fa0 2024-04-25T19:31:07.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.410+0000 7fbe05400640 1 --2- 172.21.15.131:0/2685272611 >> v2:172.21.15.195:3300/0 conn(0x7fbe0806c5c0 0x7fbe0806c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:31:07.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.411+0000 7fbe06800640 1 --2- 172.21.15.131:0/2685272611 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe08163fa0 0x7fbe081643b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fbe0806efa0 tx=0x7fbe0002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1bc8a3abb6bb9a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:07.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.412+0000 7fbe04a00640 1 -- 172.21.15.131:0/2685272611 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe00037070 con 0x7fbe08163fa0 2024-04-25T19:31:07.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.412+0000 7fbe04a00640 1 -- 172.21.15.131:0/2685272611 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe00032440 con 0x7fbe08163fa0 2024-04-25T19:31:07.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.412+0000 7fbe04a00640 1 -- 172.21.15.131:0/2685272611 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe00032810 con 0x7fbe08163fa0 2024-04-25T19:31:07.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.413+0000 7fbe0ce00640 1 -- 172.21.15.131:0/2685272611 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe08163fa0 msgr2=0x7fbe081643b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:07.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.413+0000 7fbe0ce00640 1 --2- 172.21.15.131:0/2685272611 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe08163fa0 0x7fbe081643b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fbe0806efa0 tx=0x7fbe0002a140 comp rx=0 tx=0).stop 2024-04-25T19:31:07.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.413+0000 7fbe0ce00640 1 -- 172.21.15.131:0/2685272611 shutdown_connections 2024-04-25T19:31:07.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.413+0000 7fbe0ce00640 1 --2- 172.21.15.131:0/2685272611 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe08163fa0 0x7fbe081643b0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:07.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.413+0000 7fbe0ce00640 1 --2- 172.21.15.131:0/2685272611 >> v2:172.21.15.195:3300/0 conn(0x7fbe0806c5c0 0x7fbe0806c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:07.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.413+0000 7fbe0ce00640 1 --2- 172.21.15.131:0/2685272611 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe08161710 0x7fbe0815e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:07.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.413+0000 7fbe0ce00640 1 -- 172.21.15.131:0/2685272611 >> 172.21.15.131:0/2685272611 conn(0x7fbe080d5d90 msgr2=0x7fbe080d61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:07.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.413+0000 7fbe0ce00640 1 -- 172.21.15.131:0/2685272611 shutdown_connections 2024-04-25T19:31:07.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.413+0000 7fbe0ce00640 1 -- 172.21.15.131:0/2685272611 wait complete. 2024-04-25T19:31:07.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.415+0000 7fbe0ce00640 1 Processor -- start 2024-04-25T19:31:07.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.415+0000 7fbe0ce00640 1 -- start start 2024-04-25T19:31:07.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.417+0000 7fbe0ce00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe0806c5c0 0x7fbe081521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:07.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.417+0000 7fbe0ce00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe08161710 0x7fbe080ce110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:07.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.417+0000 7fbe0ce00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe08163fa0 0x7fbe080b79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:07.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.417+0000 7fbe0ce00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbe081648f0 con 0x7fbe0806c5c0 2024-04-25T19:31:07.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.417+0000 7fbe0ce00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fbe081611f0 con 0x7fbe08161710 2024-04-25T19:31:07.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.417+0000 7fbe0ce00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbe08164a70 con 0x7fbe08163fa0 2024-04-25T19:31:07.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.417+0000 7fbe05e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe0806c5c0 0x7fbe081521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:07.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.417+0000 7fbe05e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe0806c5c0 0x7fbe081521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:53162/0 (socket says 172.21.15.131:53162) 2024-04-25T19:31:07.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.417+0000 7fbe05e00640 1 -- 172.21.15.131:0/272549769 learned_addr learned my addr 172.21.15.131:0/272549769 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:07.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.418+0000 7fbe06800640 1 --2- 172.21.15.131:0/272549769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe08163fa0 0x7fbe080b79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:07.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.418+0000 7fbe05400640 1 --2- 172.21.15.131:0/272549769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe08161710 0x7fbe080ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:07.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.418+0000 7fbe05e00640 1 -- 172.21.15.131:0/272549769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe08163fa0 msgr2=0x7fbe080b79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:07.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.418+0000 7fbe05e00640 1 --2- 172.21.15.131:0/272549769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe08163fa0 0x7fbe080b79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:07.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.418+0000 7fbe05e00640 1 -- 172.21.15.131:0/272549769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe08161710 msgr2=0x7fbe080ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:07.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.418+0000 7fbe05e00640 1 --2- 172.21.15.131:0/272549769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe08161710 0x7fbe080ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:07.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.418+0000 7fbe05e00640 1 -- 172.21.15.131:0/272549769 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe081f6e80 con 0x7fbe0806c5c0 2024-04-25T19:31:07.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.418+0000 7fbe05400640 1 --2- 172.21.15.131:0/272549769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe08161710 0x7fbe080ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:31:07.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.418+0000 7fbe05e00640 1 --2- 172.21.15.131:0/272549769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe0806c5c0 0x7fbe081521d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8007e90 tx=0x7fbdf800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:07.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.418+0000 7fbdfe000640 1 -- 172.21.15.131:0/272549769 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf801a070 con 0x7fbe0806c5c0 2024-04-25T19:31:07.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.419+0000 7fbdfe000640 1 -- 172.21.15.131:0/272549769 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf8003b90 con 0x7fbe0806c5c0 2024-04-25T19:31:07.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.419+0000 7fbdfe000640 1 -- 172.21.15.131:0/272549769 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf800ee70 con 0x7fbe0806c5c0 2024-04-25T19:31:07.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.419+0000 7fbe0ce00640 1 -- 172.21.15.131:0/272549769 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe080cecf0 con 0x7fbe0806c5c0 2024-04-25T19:31:07.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.419+0000 7fbe0ce00640 1 -- 172.21.15.131:0/272549769 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe080b5a00 con 0x7fbe0806c5c0 2024-04-25T19:31:07.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.420+0000 7fbe0ce00640 1 -- 172.21.15.131:0/272549769 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe080cf210 con 0x7fbe0806c5c0 2024-04-25T19:31:07.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.421+0000 7fbdfe000640 1 -- 172.21.15.131:0/272549769 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbdf801d070 con 0x7fbe0806c5c0 2024-04-25T19:31:07.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.422+0000 7fbdfe000640 1 --2- 172.21.15.131:0/272549769 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbde40744b0 0x7fbde40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:07.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.422+0000 7fbdfe000640 1 -- 172.21.15.131:0/272549769 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7fbdf8095450 con 0x7fbe0806c5c0 2024-04-25T19:31:07.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.423+0000 7fbe05400640 1 --2- 172.21.15.131:0/272549769 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbde40744b0 0x7fbde40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:07.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.424+0000 7fbe05400640 1 --2- 172.21.15.131:0/272549769 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbde40744b0 0x7fbde40769c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbe081f46d0 tx=0x7fbdf0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:07.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.426+0000 7fbdfe000640 1 -- 172.21.15.131:0/272549769 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbe081f6e80 con 0x7fbe0806c5c0 2024-04-25T19:31:07.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:07.623+0000 7fbe0ce00640 1 -- 172.21.15.131:0/272549769 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbe080b57f0 con 0x7fbe0806c5c0 2024-04-25T19:31:08.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.124+0000 7fbdfe000640 1 -- 172.21.15.131:0/272549769 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v49) ==== 181+0+0 (secure 0 0 0) 0x7fbdf805f4f0 con 0x7fbe0806c5c0 2024-04-25T19:31:08.125 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'cephfs_metadata' removed 2024-04-25T19:31:08.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.129+0000 7fbe0ce00640 1 -- 172.21.15.131:0/272549769 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbde40744b0 msgr2=0x7fbde40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:08.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.129+0000 7fbe0ce00640 1 --2- 172.21.15.131:0/272549769 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbde40744b0 0x7fbde40769c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbe081f46d0 tx=0x7fbdf0008040 comp rx=0 tx=0).stop 2024-04-25T19:31:08.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.129+0000 7fbe0ce00640 1 -- 172.21.15.131:0/272549769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe0806c5c0 msgr2=0x7fbe081521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:08.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.129+0000 7fbe0ce00640 1 --2- 172.21.15.131:0/272549769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe0806c5c0 0x7fbe081521d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8007e90 tx=0x7fbdf800e4b0 comp rx=0 tx=0).stop 2024-04-25T19:31:08.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.130+0000 7fbe0ce00640 1 -- 172.21.15.131:0/272549769 shutdown_connections 2024-04-25T19:31:08.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.130+0000 7fbe0ce00640 1 --2- 172.21.15.131:0/272549769 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fbde40744b0 0x7fbde40769c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:08.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.130+0000 7fbe0ce00640 1 --2- 172.21.15.131:0/272549769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe08163fa0 0x7fbe080b79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:08.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.130+0000 7fbe0ce00640 1 --2- 172.21.15.131:0/272549769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe08161710 0x7fbe080ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:08.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.130+0000 7fbe0ce00640 1 --2- 172.21.15.131:0/272549769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe0806c5c0 0x7fbe081521d0 secure :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8007e90 tx=0x7fbdf800e4b0 comp rx=0 tx=0).stop 2024-04-25T19:31:08.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.130+0000 7fbe0ce00640 1 -- 172.21.15.131:0/272549769 >> 172.21.15.131:0/272549769 conn(0x7fbe080d5d90 msgr2=0x7fbe080d5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:08.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.131+0000 7fbe0ce00640 1 -- 172.21.15.131:0/272549769 shutdown_connections 2024-04-25T19:31:08.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.131+0000 7fbe0ce00640 1 -- 172.21.15.131:0/272549769 wait complete. 2024-04-25T19:31:08.159 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T19:31:08.238 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:31:08.248 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:31:08.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.429+0000 7fb6d0400640 1 Processor -- start 2024-04-25T19:31:08.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.430+0000 7fb6d0400640 1 -- start start 2024-04-25T19:31:08.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.431+0000 7fb6d0400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb6c8161710 0x7fb6c815e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:08.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.431+0000 7fb6d0400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6c8163fa0 0x7fb6c81643b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:08.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.431+0000 7fb6d0400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6c81609b0 con 0x7fb6c806c5c0 2024-04-25T19:31:08.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.431+0000 7fb6d0400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb6c8164cd0 con 0x7fb6c8161710 2024-04-25T19:31:08.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.431+0000 7fb6d0400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c8160c30 con 0x7fb6c8163fa0 2024-04-25T19:31:08.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.432+0000 7fb6cda00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb6c8161710 0x7fb6c815e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:08.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.432+0000 7fb6ce400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6c8163fa0 0x7fb6c81643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:08.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.432+0000 7fb6cda00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb6c8161710 0x7fb6c815e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.131:42408/0 (socket says 172.21.15.131:42408) 2024-04-25T19:31:08.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.432+0000 7fb6cda00640 1 -- 172.21.15.131:0/274447595 learned_addr learned my addr 172.21.15.131:0/274447595 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:08.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.433+0000 7fb6cda00640 1 -- 172.21.15.131:0/274447595 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6c8163fa0 msgr2=0x7fb6c81643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:08.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.433+0000 7fb6cda00640 1 --2- 172.21.15.131:0/274447595 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6c8163fa0 0x7fb6c81643b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:08.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.433+0000 7fb6cda00640 1 -- 172.21.15.131:0/274447595 >> v1:172.21.15.195:6789/0 conn(0x7fb6c806c5c0 legacy=0x7fb6c806c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:08.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.433+0000 7fb6cda00640 1 -- 172.21.15.131:0/274447595 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c8160f10 con 0x7fb6c8161710 2024-04-25T19:31:08.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.434+0000 7fb6cda00640 1 --2- 172.21.15.131:0/274447595 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6c8161710 0x7fb6c815e080 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc009870 tx=0x7fb6bc02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=181f8da59e9afcbc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:08.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.435+0000 7fb6c7e00640 1 -- 172.21.15.131:0/274447595 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc037070 con 0x7fb6c8161710 2024-04-25T19:31:08.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.435+0000 7fb6c7e00640 1 -- 172.21.15.131:0/274447595 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6bc032440 con 0x7fb6c8161710 2024-04-25T19:31:08.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.435+0000 7fb6c7e00640 1 -- 172.21.15.131:0/274447595 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc032810 con 0x7fb6c8161710 2024-04-25T19:31:08.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.436+0000 7fb6d0400640 1 -- 172.21.15.131:0/274447595 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6c8161710 msgr2=0x7fb6c815e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:08.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.436+0000 7fb6d0400640 1 --2- 172.21.15.131:0/274447595 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6c8161710 0x7fb6c815e080 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc009870 tx=0x7fb6bc02a1c0 comp rx=0 tx=0).stop 2024-04-25T19:31:08.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.436+0000 7fb6d0400640 1 -- 172.21.15.131:0/274447595 shutdown_connections 2024-04-25T19:31:08.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.436+0000 7fb6d0400640 1 --2- 172.21.15.131:0/274447595 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6c8163fa0 0x7fb6c81643b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:08.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.436+0000 7fb6d0400640 1 --2- 172.21.15.131:0/274447595 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6c8161710 0x7fb6c815e080 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:08.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.436+0000 7fb6d0400640 1 -- 172.21.15.131:0/274447595 >> 172.21.15.131:0/274447595 conn(0x7fb6c80d5d90 msgr2=0x7fb6c80d61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:08.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.436+0000 7fb6d0400640 1 -- 172.21.15.131:0/274447595 shutdown_connections 2024-04-25T19:31:08.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.436+0000 7fb6d0400640 1 -- 172.21.15.131:0/274447595 wait complete. 2024-04-25T19:31:08.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.438+0000 7fb6d0400640 1 Processor -- start 2024-04-25T19:31:08.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.439+0000 7fb6d0400640 1 -- start start 2024-04-25T19:31:08.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.440+0000 7fb6d0400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6c806c5c0 0x7fb6c80ce870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:08.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.440+0000 7fb6d0400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6c8161710 0x7fb6c81f7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:08.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.440+0000 7fb6d0400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6c8163fa0 0x7fb6c81f7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:08.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.440+0000 7fb6d0400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c8164a70 con 0x7fb6c8163fa0 2024-04-25T19:31:08.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.440+0000 7fb6d0400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c81648f0 con 0x7fb6c8161710 2024-04-25T19:31:08.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.440+0000 7fb6d0400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c80d49f0 con 0x7fb6c806c5c0 2024-04-25T19:31:08.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.440+0000 7fb6ce400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6c8163fa0 0x7fb6c81f7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:08.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.440+0000 7fb6ce400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6c8163fa0 0x7fb6c81f7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57064/0 (socket says 172.21.15.131:57064) 2024-04-25T19:31:08.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.441+0000 7fb6ce400640 1 -- 172.21.15.131:0/1910345123 learned_addr learned my addr 172.21.15.131:0/1910345123 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:08.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.441+0000 7fb6cd000640 1 --2- 172.21.15.131:0/1910345123 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6c8161710 0x7fb6c81f7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:08.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.441+0000 7fb6cda00640 1 --2- 172.21.15.131:0/1910345123 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6c806c5c0 0x7fb6c80ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:08.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.441+0000 7fb6ce400640 1 -- 172.21.15.131:0/1910345123 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6c806c5c0 msgr2=0x7fb6c80ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:08.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.441+0000 7fb6ce400640 1 --2- 172.21.15.131:0/1910345123 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6c806c5c0 0x7fb6c80ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:08.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.441+0000 7fb6ce400640 1 -- 172.21.15.131:0/1910345123 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6c8161710 msgr2=0x7fb6c81f7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:08.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.441+0000 7fb6ce400640 1 --2- 172.21.15.131:0/1910345123 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6c8161710 0x7fb6c81f7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:08.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.441+0000 7fb6ce400640 1 -- 172.21.15.131:0/1910345123 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c80cd020 con 0x7fb6c8163fa0 2024-04-25T19:31:08.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.441+0000 7fb6cda00640 1 --2- 172.21.15.131:0/1910345123 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6c806c5c0 0x7fb6c80ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:31:08.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.441+0000 7fb6ce400640 1 --2- 172.21.15.131:0/1910345123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6c8163fa0 0x7fb6c81f7680 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb6c000ef90 tx=0x7fb6c000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:08.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.442+0000 7fb6c5600640 1 -- 172.21.15.131:0/1910345123 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0018020 con 0x7fb6c8163fa0 2024-04-25T19:31:08.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.442+0000 7fb6c5600640 1 -- 172.21.15.131:0/1910345123 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c0014480 con 0x7fb6c8163fa0 2024-04-25T19:31:08.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.442+0000 7fb6c5600640 1 -- 172.21.15.131:0/1910345123 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0009e60 con 0x7fb6c8163fa0 2024-04-25T19:31:08.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.442+0000 7fb6d0400640 1 -- 172.21.15.131:0/1910345123 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c80cd300 con 0x7fb6c8163fa0 2024-04-25T19:31:08.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.442+0000 7fb6d0400640 1 -- 172.21.15.131:0/1910345123 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c80ca620 con 0x7fb6c8163fa0 2024-04-25T19:31:08.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.443+0000 7fb6d0400640 1 -- 172.21.15.131:0/1910345123 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c80ca880 con 0x7fb6c8163fa0 2024-04-25T19:31:08.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.444+0000 7fb6c5600640 1 -- 172.21.15.131:0/1910345123 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb6c001b020 con 0x7fb6c8163fa0 2024-04-25T19:31:08.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.445+0000 7fb6c5600640 1 --2- 172.21.15.131:0/1910345123 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb6a80744b0 0x7fb6a80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:08.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.445+0000 7fb6c5600640 1 -- 172.21.15.131:0/1910345123 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5415+0+0 (secure 0 0 0) 0x7fb6c0095ff0 con 0x7fb6c8163fa0 2024-04-25T19:31:08.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.446+0000 7fb6cda00640 1 --2- 172.21.15.131:0/1910345123 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb6a80744b0 0x7fb6a80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:08.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.447+0000 7fb6cda00640 1 --2- 172.21.15.131:0/1910345123 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb6a80744b0 0x7fb6a80769c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc034000 tx=0x7fb6bc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:08.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.450+0000 7fb6c5600640 1 -- 172.21.15.131:0/1910345123 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb6c0022020 con 0x7fb6c8163fa0 2024-04-25T19:31:08.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:08.652+0000 7fb6d0400640 1 -- 172.21.15.131:0/1910345123 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb6c8050740 con 0x7fb6c8163fa0 2024-04-25T19:31:09.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.136+0000 7fb6c5600640 1 -- 172.21.15.131:0/1910345123 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v50) ==== 169+0+0 (secure 0 0 0) 0x7fb6c0010040 con 0x7fb6c8163fa0 2024-04-25T19:31:09.137 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'cephfs_data' removed 2024-04-25T19:31:09.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.140+0000 7fb6d0400640 1 -- 172.21.15.131:0/1910345123 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb6a80744b0 msgr2=0x7fb6a80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:09.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.140+0000 7fb6d0400640 1 --2- 172.21.15.131:0/1910345123 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb6a80744b0 0x7fb6a80769c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc034000 tx=0x7fb6bc02e000 comp rx=0 tx=0).stop 2024-04-25T19:31:09.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.140+0000 7fb6d0400640 1 -- 172.21.15.131:0/1910345123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6c8163fa0 msgr2=0x7fb6c81f7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:09.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.140+0000 7fb6d0400640 1 --2- 172.21.15.131:0/1910345123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6c8163fa0 0x7fb6c81f7680 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb6c000ef90 tx=0x7fb6c000c490 comp rx=0 tx=0).stop 2024-04-25T19:31:09.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.140+0000 7fb6d0400640 1 -- 172.21.15.131:0/1910345123 shutdown_connections 2024-04-25T19:31:09.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.140+0000 7fb6d0400640 1 --2- 172.21.15.131:0/1910345123 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb6a80744b0 0x7fb6a80769c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:09.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.140+0000 7fb6d0400640 1 --2- 172.21.15.131:0/1910345123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6c8163fa0 0x7fb6c81f7680 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:09.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.140+0000 7fb6d0400640 1 --2- 172.21.15.131:0/1910345123 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6c8161710 0x7fb6c81f7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:09.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.140+0000 7fb6d0400640 1 --2- 172.21.15.131:0/1910345123 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6c806c5c0 0x7fb6c80ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:09.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.140+0000 7fb6d0400640 1 -- 172.21.15.131:0/1910345123 >> 172.21.15.131:0/1910345123 conn(0x7fb6c80d5d90 msgr2=0x7fb6c815e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:09.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.140+0000 7fb6d0400640 1 -- 172.21.15.131:0/1910345123 shutdown_connections 2024-04-25T19:31:09.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.140+0000 7fb6d0400640 1 -- 172.21.15.131:0/1910345123 wait complete. 2024-04-25T19:31:09.179 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T19:31:09.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.444+0000 7fd96be00640 1 Processor -- start 2024-04-25T19:31:09.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.445+0000 7fd96be00640 1 -- start start 2024-04-25T19:31:09.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.447+0000 7fd96be00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd96c0d3d40 0x7fd96c160290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:09.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.447+0000 7fd96be00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd96c0d4510 0x7fd96c0b7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:09.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.447+0000 7fd96be00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd96c0b7e90 con 0x7fd96c0b7a80 2024-04-25T19:31:09.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.447+0000 7fd96be00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd96c0d5590 con 0x7fd96c0d4510 2024-04-25T19:31:09.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.447+0000 7fd96be00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd96c0b9110 con 0x7fd96c0d3d40 2024-04-25T19:31:09.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.447+0000 7fd962000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd96c0d4510 0x7fd96c0b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:09.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.448+0000 7fd962000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd96c0d4510 0x7fd96c0b7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57074/0 (socket says 172.21.15.131:57074) 2024-04-25T19:31:09.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.448+0000 7fd962000640 1 -- 172.21.15.131:0/2483605013 learned_addr learned my addr 172.21.15.131:0/2483605013 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:09.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.448+0000 7fd96aa00640 1 --2- 172.21.15.131:0/2483605013 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd96c0d3d40 0x7fd96c160290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:09.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.448+0000 7fd962000640 1 -- 172.21.15.131:0/2483605013 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd96c0d3d40 msgr2=0x7fd96c160290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:09.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.448+0000 7fd962000640 1 --2- 172.21.15.131:0/2483605013 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd96c0d3d40 0x7fd96c160290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:09.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.448+0000 7fd962000640 1 -- 172.21.15.131:0/2483605013 >> v1:172.21.15.131:6789/0 conn(0x7fd96c0b7a80 legacy=0x7fd96c06c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:09.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.448+0000 7fd962000640 1 -- 172.21.15.131:0/2483605013 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd96c0d4cf0 con 0x7fd96c0d4510 2024-04-25T19:31:09.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.449+0000 7fd962000640 1 --2- 172.21.15.131:0/2483605013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd96c0d4510 0x7fd96c0b7540 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd954009870 tx=0x7fd95402a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76987f57d1409955 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:09.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.449+0000 7fd96a000640 1 -- 172.21.15.131:0/2483605013 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd954037070 con 0x7fd96c0d4510 2024-04-25T19:31:09.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.449+0000 7fd96a000640 1 -- 172.21.15.131:0/2483605013 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd954032440 con 0x7fd96c0d4510 2024-04-25T19:31:09.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.449+0000 7fd96a000640 1 -- 172.21.15.131:0/2483605013 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd954032810 con 0x7fd96c0d4510 2024-04-25T19:31:09.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.450+0000 7fd96be00640 1 -- 172.21.15.131:0/2483605013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd96c0d4510 msgr2=0x7fd96c0b7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:09.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.450+0000 7fd96be00640 1 --2- 172.21.15.131:0/2483605013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd96c0d4510 0x7fd96c0b7540 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd954009870 tx=0x7fd95402a1d0 comp rx=0 tx=0).stop 2024-04-25T19:31:09.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.450+0000 7fd96be00640 1 -- 172.21.15.131:0/2483605013 shutdown_connections 2024-04-25T19:31:09.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.450+0000 7fd96be00640 1 --2- 172.21.15.131:0/2483605013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd96c0d4510 0x7fd96c0b7540 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:09.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.450+0000 7fd96be00640 1 --2- 172.21.15.131:0/2483605013 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd96c0d3d40 0x7fd96c160290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:09.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.450+0000 7fd96be00640 1 -- 172.21.15.131:0/2483605013 >> 172.21.15.131:0/2483605013 conn(0x7fd96c0d2540 msgr2=0x7fd96c0d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:09.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.450+0000 7fd96be00640 1 -- 172.21.15.131:0/2483605013 shutdown_connections 2024-04-25T19:31:09.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.450+0000 7fd96be00640 1 -- 172.21.15.131:0/2483605013 wait complete. 2024-04-25T19:31:09.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.453+0000 7fd96be00640 1 Processor -- start 2024-04-25T19:31:09.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.453+0000 7fd96be00640 1 -- start start 2024-04-25T19:31:09.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.454+0000 7fd96be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd96c0b7a80 0x7fd96c151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:09.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.454+0000 7fd96be00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd96c0d3d40 0x7fd96c15eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:09.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.454+0000 7fd96be00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd96c0d4510 0x7fd96c15f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:09.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.454+0000 7fd96be00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd96c0b93b0 con 0x7fd96c0b7a80 2024-04-25T19:31:09.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.454+0000 7fd96be00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd96c0d52b0 con 0x7fd96c0d4510 2024-04-25T19:31:09.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.454+0000 7fd96be00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd96c0d4920 con 0x7fd96c0d3d40 2024-04-25T19:31:09.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.454+0000 7fd96aa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd96c0b7a80 0x7fd96c151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:09.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.454+0000 7fd96aa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd96c0b7a80 0x7fd96c151b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57086/0 (socket says 172.21.15.131:57086) 2024-04-25T19:31:09.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.455+0000 7fd96aa00640 1 -- 172.21.15.131:0/3262957006 learned_addr learned my addr 172.21.15.131:0/3262957006 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:09.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.455+0000 7fd96aa00640 1 -- 172.21.15.131:0/3262957006 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd96c0d3d40 msgr2=0x7fd96c15eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:09.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.455+0000 7fd96aa00640 1 --2- 172.21.15.131:0/3262957006 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd96c0d3d40 0x7fd96c15eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:09.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.455+0000 7fd96aa00640 1 -- 172.21.15.131:0/3262957006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd96c0d4510 msgr2=0x7fd96c15f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:09.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.455+0000 7fd96aa00640 1 --2- 172.21.15.131:0/3262957006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd96c0d4510 0x7fd96c15f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:09.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.455+0000 7fd96aa00640 1 -- 172.21.15.131:0/3262957006 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd96c1520a0 con 0x7fd96c0b7a80 2024-04-25T19:31:09.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.455+0000 7fd96aa00640 1 --2- 172.21.15.131:0/3262957006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd96c0b7a80 0x7fd96c151b60 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00c7f0 tx=0x7fd95c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:09.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.455+0000 7fd963e00640 1 -- 172.21.15.131:0/3262957006 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95c004230 con 0x7fd96c0b7a80 2024-04-25T19:31:09.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.455+0000 7fd963e00640 1 -- 172.21.15.131:0/3262957006 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd95c0043d0 con 0x7fd96c0b7a80 2024-04-25T19:31:09.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.455+0000 7fd96be00640 1 -- 172.21.15.131:0/3262957006 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd96c15b0c0 con 0x7fd96c0b7a80 2024-04-25T19:31:09.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.455+0000 7fd963e00640 1 -- 172.21.15.131:0/3262957006 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95c007860 con 0x7fd96c0b7a80 2024-04-25T19:31:09.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.456+0000 7fd96be00640 1 -- 172.21.15.131:0/3262957006 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd96c15b680 con 0x7fd96c0b7a80 2024-04-25T19:31:09.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.457+0000 7fd96be00640 1 -- 172.21.15.131:0/3262957006 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd96c152630 con 0x7fd96c0b7a80 2024-04-25T19:31:09.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.458+0000 7fd963e00640 1 -- 172.21.15.131:0/3262957006 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd95c007c10 con 0x7fd96c0b7a80 2024-04-25T19:31:09.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.459+0000 7fd963e00640 1 --2- 172.21.15.131:0/3262957006 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd948074500 0x7fd948076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:09.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.459+0000 7fd963e00640 1 -- 172.21.15.131:0/3262957006 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7fd95c094ff0 con 0x7fd96c0b7a80 2024-04-25T19:31:09.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.459+0000 7fd962000640 1 --2- 172.21.15.131:0/3262957006 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd948074500 0x7fd948076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:09.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.461+0000 7fd962000640 1 --2- 172.21.15.131:0/3262957006 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd948074500 0x7fd948076a10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd954034000 tx=0x7fd95402c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:09.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.463+0000 7fd963e00640 1 -- 172.21.15.131:0/3262957006 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd95c015020 con 0x7fd96c0b7a80 2024-04-25T19:31:09.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.647+0000 7fd96be00640 1 -- 172.21.15.131:0/3262957006 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fd96c076c60 con 0x7fd96c0b7a80 2024-04-25T19:31:09.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.653+0000 7fd963e00640 1 -- 172.21.15.131:0/3262957006 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7fd95c05fb30 con 0x7fd96c0b7a80 2024-04-25T19:31:09.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.656+0000 7fd96be00640 1 -- 172.21.15.131:0/3262957006 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd948074500 msgr2=0x7fd948076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:09.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.656+0000 7fd96be00640 1 --2- 172.21.15.131:0/3262957006 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd948074500 0x7fd948076a10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd954034000 tx=0x7fd95402c000 comp rx=0 tx=0).stop 2024-04-25T19:31:09.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.656+0000 7fd96be00640 1 -- 172.21.15.131:0/3262957006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd96c0b7a80 msgr2=0x7fd96c151b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:09.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.656+0000 7fd96be00640 1 --2- 172.21.15.131:0/3262957006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd96c0b7a80 0x7fd96c151b60 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00c7f0 tx=0x7fd95c00ccb0 comp rx=0 tx=0).stop 2024-04-25T19:31:09.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.656+0000 7fd96be00640 1 -- 172.21.15.131:0/3262957006 shutdown_connections 2024-04-25T19:31:09.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.656+0000 7fd96be00640 1 --2- 172.21.15.131:0/3262957006 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fd948074500 0x7fd948076a10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:09.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.656+0000 7fd96be00640 1 --2- 172.21.15.131:0/3262957006 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd96c0d3d40 0x7fd96c15eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:09.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.656+0000 7fd96be00640 1 --2- 172.21.15.131:0/3262957006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd96c0d4510 0x7fd96c15f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:09.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.656+0000 7fd96be00640 1 --2- 172.21.15.131:0/3262957006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd96c0b7a80 0x7fd96c151b60 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:09.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.656+0000 7fd96be00640 1 -- 172.21.15.131:0/3262957006 >> 172.21.15.131:0/3262957006 conn(0x7fd96c0d2540 msgr2=0x7fd96c06c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:09.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.656+0000 7fd96be00640 1 -- 172.21.15.131:0/3262957006 shutdown_connections 2024-04-25T19:31:09.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.657+0000 7fd96be00640 1 -- 172.21.15.131:0/3262957006 wait complete. 2024-04-25T19:31:09.682 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_dump_tree.TestDumpTree.test_random' 2024-04-25T19:31:09.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.958+0000 7f2649200640 1 Processor -- start 2024-04-25T19:31:09.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.958+0000 7f2649200640 1 -- start start 2024-04-25T19:31:09.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.960+0000 7f2649200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f264406d5d0 0x7f264406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:09.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.960+0000 7f2649200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2644141fd0 0x7f26441423e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:09.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.960+0000 7f2649200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f264406df20 con 0x7f2644140e00 2024-04-25T19:31:09.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.960+0000 7f2649200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f2644141b40 con 0x7f264406d5d0 2024-04-25T19:31:09.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.960+0000 7f2649200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2644141210 con 0x7f2644141fd0 2024-04-25T19:31:09.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.961+0000 7f2643e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2644141fd0 0x7f26441423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:09.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.961+0000 7f2642a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f264406d5d0 0x7f264406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:09.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.961+0000 7f2643e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2644141fd0 0x7f26441423e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.131:43354/0 (socket says 172.21.15.131:43354) 2024-04-25T19:31:09.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.961+0000 7f2643e00640 1 -- 172.21.15.131:0/438525255 learned_addr learned my addr 172.21.15.131:0/438525255 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:09.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.961+0000 7f2643e00640 1 -- 172.21.15.131:0/438525255 >> v2:172.21.15.195:3300/0 conn(0x7f264406d5d0 msgr2=0x7f264406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:09.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.961+0000 7f2643e00640 1 --2- 172.21.15.131:0/438525255 >> v2:172.21.15.195:3300/0 conn(0x7f264406d5d0 0x7f264406d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:09.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.961+0000 7f2643e00640 1 -- 172.21.15.131:0/438525255 >> v1:172.21.15.195:6789/0 conn(0x7f2644140e00 legacy=0x7f2644143550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:09.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.961+0000 7f2643e00640 1 -- 172.21.15.131:0/438525255 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2644141510 con 0x7f2644141fd0 2024-04-25T19:31:09.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.963+0000 7f2643e00640 1 --2- 172.21.15.131:0/438525255 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2644141fd0 0x7f26441423e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f263c009e50 tx=0x7f263c02a6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21e0bec84c9823dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:09.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.964+0000 7f2642000640 1 -- 172.21.15.131:0/438525255 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c036070 con 0x7f2644141fd0 2024-04-25T19:31:09.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.964+0000 7f2642000640 1 -- 172.21.15.131:0/438525255 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f263c031600 con 0x7f2644141fd0 2024-04-25T19:31:09.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.964+0000 7f2642000640 1 -- 172.21.15.131:0/438525255 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c0319d0 con 0x7f2644141fd0 2024-04-25T19:31:09.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.965+0000 7f2649200640 1 -- 172.21.15.131:0/438525255 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2644141fd0 msgr2=0x7f26441423e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:09.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.965+0000 7f2649200640 1 --2- 172.21.15.131:0/438525255 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2644141fd0 0x7f26441423e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f263c009e50 tx=0x7f263c02a6c0 comp rx=0 tx=0).stop 2024-04-25T19:31:09.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.965+0000 7f2649200640 1 -- 172.21.15.131:0/438525255 shutdown_connections 2024-04-25T19:31:09.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.965+0000 7f2649200640 1 --2- 172.21.15.131:0/438525255 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2644141fd0 0x7f26441423e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:09.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.965+0000 7f2649200640 1 --2- 172.21.15.131:0/438525255 >> v2:172.21.15.195:3300/0 conn(0x7f264406d5d0 0x7f264406d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:09.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.965+0000 7f2649200640 1 -- 172.21.15.131:0/438525255 >> 172.21.15.131:0/438525255 conn(0x7f2644072ee0 msgr2=0x7f26440732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:09.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.965+0000 7f2649200640 1 -- 172.21.15.131:0/438525255 shutdown_connections 2024-04-25T19:31:09.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.965+0000 7f2649200640 1 -- 172.21.15.131:0/438525255 wait complete. 2024-04-25T19:31:09.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.968+0000 7f2649200640 1 Processor -- start 2024-04-25T19:31:09.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.968+0000 7f2649200640 1 -- start start 2024-04-25T19:31:09.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.969+0000 7f2649200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f264406d5d0 0x7f26441f6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:09.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.969+0000 7f2649200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2644140e00 0x7f26440b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:09.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.969+0000 7f2649200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2644141fd0 0x7f26440b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:09.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.969+0000 7f2649200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f26441417d0 con 0x7f2644141fd0 2024-04-25T19:31:09.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.969+0000 7f2649200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f26441443d0 con 0x7f2644140e00 2024-04-25T19:31:09.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.969+0000 7f2649200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f26440d1490 con 0x7f264406d5d0 2024-04-25T19:31:09.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.970+0000 7f2643e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2644141fd0 0x7f26440b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:09.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.970+0000 7f2643e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2644141fd0 0x7f26440b63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57102/0 (socket says 172.21.15.131:57102) 2024-04-25T19:31:09.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.970+0000 7f2643e00640 1 -- 172.21.15.131:0/2182830368 learned_addr learned my addr 172.21.15.131:0/2182830368 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:09.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.970+0000 7f2643400640 1 --2- 172.21.15.131:0/2182830368 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f264406d5d0 0x7f26441f6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:09.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.970+0000 7f2642a00640 1 --2- 172.21.15.131:0/2182830368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2644140e00 0x7f26440b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:09.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.970+0000 7f2643e00640 1 -- 172.21.15.131:0/2182830368 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f264406d5d0 msgr2=0x7f26441f6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:09.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.970+0000 7f2643e00640 1 --2- 172.21.15.131:0/2182830368 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f264406d5d0 0x7f26441f6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:09.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.970+0000 7f2643e00640 1 -- 172.21.15.131:0/2182830368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2644140e00 msgr2=0x7f26440b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:09.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.970+0000 7f2643e00640 1 --2- 172.21.15.131:0/2182830368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2644140e00 0x7f26440b5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:09.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.970+0000 7f2643e00640 1 -- 172.21.15.131:0/2182830368 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26441f6970 con 0x7f2644141fd0 2024-04-25T19:31:09.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.970+0000 7f2643e00640 1 --2- 172.21.15.131:0/2182830368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2644141fd0 0x7f26440b63d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f263c009e50 tx=0x7f263c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:09.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.971+0000 7f263b400640 1 -- 172.21.15.131:0/2182830368 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c041020 con 0x7f2644141fd0 2024-04-25T19:31:09.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.971+0000 7f263b400640 1 -- 172.21.15.131:0/2182830368 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f263c0086b0 con 0x7f2644141fd0 2024-04-25T19:31:09.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.971+0000 7f2649200640 1 -- 172.21.15.131:0/2182830368 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26440b6910 con 0x7f2644141fd0 2024-04-25T19:31:09.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.971+0000 7f263b400640 1 -- 172.21.15.131:0/2182830368 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c036040 con 0x7f2644141fd0 2024-04-25T19:31:09.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.971+0000 7f2649200640 1 -- 172.21.15.131:0/2182830368 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26440b53b0 con 0x7f2644141fd0 2024-04-25T19:31:09.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.972+0000 7f2649200640 1 -- 172.21.15.131:0/2182830368 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2644050740 con 0x7f2644141fd0 2024-04-25T19:31:09.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.973+0000 7f263b400640 1 -- 172.21.15.131:0/2182830368 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f263c044020 con 0x7f2644141fd0 2024-04-25T19:31:09.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.975+0000 7f263b400640 1 --2- 172.21.15.131:0/2182830368 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f26240744e0 0x7f26240769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:09.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.975+0000 7f263b400640 1 -- 172.21.15.131:0/2182830368 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f263c0b5930 con 0x7f2644141fd0 2024-04-25T19:31:09.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.976+0000 7f2643400640 1 --2- 172.21.15.131:0/2182830368 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f26240744e0 0x7f26240769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:09.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.977+0000 7f2643400640 1 --2- 172.21.15.131:0/2182830368 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f26240744e0 0x7f26240769f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2634006fd0 tx=0x7f2634008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:09.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:09.980+0000 7f263b400640 1 -- 172.21.15.131:0/2182830368 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f263c04b070 con 0x7f2644141fd0 2024-04-25T19:31:10.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:10.251+0000 7f2649200640 1 -- 172.21.15.131:0/2182830368 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_dump_tree.TestDumpTree.test_random"]} v 0) -- 0x7f26440b7710 con 0x7f2644141fd0 2024-04-25T19:31:11.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:11.152+0000 7f263b400640 1 -- 172.21.15.131:0/2182830368 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_dump_tree.TestDumpTree.test_random"]}]=0 v356) ==== 131+0+0 (secure 0 0 0) 0x7f264406df20 con 0x7f2644141fd0 2024-04-25T19:31:11.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:11.155+0000 7f2649200640 1 -- 172.21.15.131:0/2182830368 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f26240744e0 msgr2=0x7f26240769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:11.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:11.155+0000 7f2649200640 1 --2- 172.21.15.131:0/2182830368 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f26240744e0 0x7f26240769f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2634006fd0 tx=0x7f2634008040 comp rx=0 tx=0).stop 2024-04-25T19:31:11.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:11.155+0000 7f2649200640 1 -- 172.21.15.131:0/2182830368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2644141fd0 msgr2=0x7f26440b63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:11.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:11.155+0000 7f2649200640 1 --2- 172.21.15.131:0/2182830368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2644141fd0 0x7f26440b63d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f263c009e50 tx=0x7f263c004a40 comp rx=0 tx=0).stop 2024-04-25T19:31:11.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:11.155+0000 7f2649200640 1 -- 172.21.15.131:0/2182830368 shutdown_connections 2024-04-25T19:31:11.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:11.155+0000 7f2649200640 1 --2- 172.21.15.131:0/2182830368 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f26240744e0 0x7f26240769f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:11.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:11.155+0000 7f2649200640 1 --2- 172.21.15.131:0/2182830368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2644141fd0 0x7f26440b63d0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:11.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:11.155+0000 7f2649200640 1 --2- 172.21.15.131:0/2182830368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2644140e00 0x7f26440b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:11.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:11.155+0000 7f2649200640 1 --2- 172.21.15.131:0/2182830368 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f264406d5d0 0x7f26441f6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:11.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:11.155+0000 7f2649200640 1 -- 172.21.15.131:0/2182830368 >> 172.21.15.131:0/2182830368 conn(0x7f2644072ee0 msgr2=0x7f26441423e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:11.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:11.156+0000 7f2649200640 1 -- 172.21.15.131:0/2182830368 shutdown_connections 2024-04-25T19:31:11.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:11.156+0000 7f2649200640 1 -- 172.21.15.131:0/2182830368 wait complete. 2024-04-25T19:31:11.188 INFO:tasks.cephfs_test_runner:test_random (tasks.cephfs.test_dump_tree.TestDumpTree) ... ok 2024-04-25T19:31:11.188 INFO:tasks.cephfs_test_runner: 2024-04-25T19:31:11.188 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-25T19:31:11.188 INFO:tasks.cephfs_test_runner:Ran 2 tests in 490.902s 2024-04-25T19:31:11.188 INFO:tasks.cephfs_test_runner: 2024-04-25T19:31:11.188 INFO:tasks.cephfs_test_runner:OK 2024-04-25T19:31:11.189 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-25T19:31:11.198 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-25T19:31:11.244 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-25T19:31:11.244 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:31:11.244 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:31:11.301 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T19:31:11.301 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-25T19:31:11.301 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:31:11.351 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T19:31:11.352 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:31:11.352 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:31:11.409 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T19:31:11.409 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T19:31:11.410 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T19:31:11.465 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T19:31:11.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:31:11.466 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-04-25T19:31:11.523 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T19:31:11.524 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T19:31:11.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:31:11.525 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T19:31:11.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:31:11.607 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T19:31:11.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:31:11.675 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link delete ceph-brx 2024-04-25T19:31:11.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:31:11.786 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-04-25T19:31:11.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:31:11.828 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link delete ceph-brx 2024-04-25T19:31:11.954 INFO:teuthology.orchestra.run.smithi131.stderr:Cannot find device "ceph-brx" 2024-04-25T19:31:11.957 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T19:31:11.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:31:11.957 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T19:31:12.017 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T19:31:12.017 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-25T19:31:12.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:31:12.018 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T19:31:12.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:31:12.102 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T19:31:12.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:31:12.181 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-04-25T19:31:12.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:31:12.294 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T19:31:12.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T19:31:12.334 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-04-25T19:31:12.454 INFO:teuthology.orchestra.run.smithi195.stderr:Cannot find device "ceph-brx" 2024-04-25T19:31:12.458 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T19:31:12.458 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T19:31:12.468 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T19:31:12.468 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T19:31:12.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.748+0000 7f3467e00640 1 Processor -- start 2024-04-25T19:31:12.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.748+0000 7f3467e00640 1 -- start start 2024-04-25T19:31:12.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.750+0000 7f3467e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34680cf2f0 0x7f34680b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:12.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.750+0000 7f3467e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f34681608d0 0x7f3468160ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:12.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.750+0000 7f3467e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3468161220 con 0x7f346815a810 2024-04-25T19:31:12.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.750+0000 7f3467e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f346806f870 con 0x7f34681608d0 2024-04-25T19:31:12.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.750+0000 7f3467e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f34680b74d0 con 0x7f34680cf2f0 2024-04-25T19:31:12.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.751+0000 7f345fe00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f346815a810 0x7f34680b4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46552/0 (socket says 172.21.15.131:46552) 2024-04-25T19:31:12.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.751+0000 7f345fe00640 1 -- 172.21.15.131:0/2654978738 learned_addr learned my addr 172.21.15.131:0/2654978738 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:31:12.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.751+0000 7f3467400640 1 --2- 172.21.15.131:0/2654978738 >> v2:172.21.15.195:3300/0 conn(0x7f34681608d0 0x7f3468160ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:12.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.751+0000 7f3466a00640 1 --2- 172.21.15.131:0/2654978738 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34680cf2f0 0x7f34680b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:12.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.751+0000 7f3466000640 1 -- 172.21.15.131:0/2654978738 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1222217382 0 0) 0x7f3450001110 con 0x7f346815a810 2024-04-25T19:31:12.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.751+0000 7f3466000640 1 -- 172.21.15.131:0/2654978738 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f344c003520 con 0x7f346815a810 2024-04-25T19:31:12.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.752+0000 7f3466000640 1 -- 172.21.15.131:0/2654978738 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3324988010 0 0) 0x7f344c003520 con 0x7f346815a810 2024-04-25T19:31:12.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.752+0000 7f3466000640 1 -- 172.21.15.131:0/2654978738 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34680cf2f0 msgr2=0x7f34680b6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:12.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.752+0000 7f3466000640 1 --2- 172.21.15.131:0/2654978738 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34680cf2f0 0x7f34680b6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:12.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.752+0000 7f3466000640 1 -- 172.21.15.131:0/2654978738 >> v2:172.21.15.195:3300/0 conn(0x7f34681608d0 msgr2=0x7f3468160ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:12.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.752+0000 7f3466000640 1 --2- 172.21.15.131:0/2654978738 >> v2:172.21.15.195:3300/0 conn(0x7f34681608d0 0x7f3468160ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:12.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.752+0000 7f3466000640 1 -- 172.21.15.131:0/2654978738 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34680b77b0 con 0x7f346815a810 2024-04-25T19:31:12.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.752+0000 7f3466000640 1 -- 172.21.15.131:0/2654978738 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f3450001840 con 0x7f346815a810 2024-04-25T19:31:12.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.752+0000 7f3466000640 1 -- 172.21.15.131:0/2654978738 >> v1:172.21.15.131:6789/0 conn(0x7f346815a810 legacy=0x7f34680b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:12.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.752+0000 7f3466000640 1 --2- 172.21.15.131:0/2654978738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f344c0039b0 0x7f344c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:12.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.752+0000 7f3466000640 1 --2- 172.21.15.131:0/2654978738 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f344c004800 0x7f344c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:12.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.752+0000 7f3466000640 1 --2- 172.21.15.131:0/2654978738 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34680cf2f0 0x7f344c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:12.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.752+0000 7f3466000640 1 -- 172.21.15.131:0/2654978738 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f346806f870 con 0x7f344c0039b0 2024-04-25T19:31:12.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.752+0000 7f3466000640 1 -- 172.21.15.131:0/2654978738 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f34680b74d0 con 0x7f344c004800 2024-04-25T19:31:12.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.752+0000 7f3466000640 1 -- 172.21.15.131:0/2654978738 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f344c00b9c0 con 0x7f34680cf2f0 2024-04-25T19:31:12.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.752+0000 7f3466a00640 1 --2- 172.21.15.131:0/2654978738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f344c0039b0 0x7f344c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:12.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.752+0000 7f345fe00640 1 --2- 172.21.15.131:0/2654978738 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f344c004800 0x7f344c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:12.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.753+0000 7f3467400640 1 --2- 172.21.15.131:0/2654978738 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34680cf2f0 0x7f344c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:12.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.753+0000 7f3466a00640 1 -- 172.21.15.131:0/2654978738 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34680cf2f0 msgr2=0x7f344c005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:12.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.753+0000 7f3466a00640 1 --2- 172.21.15.131:0/2654978738 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34680cf2f0 0x7f344c005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:12.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.753+0000 7f3466a00640 1 -- 172.21.15.131:0/2654978738 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f344c004800 msgr2=0x7f344c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:12.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.753+0000 7f3466a00640 1 --2- 172.21.15.131:0/2654978738 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f344c004800 0x7f344c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:12.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.753+0000 7f3466a00640 1 -- 172.21.15.131:0/2654978738 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f344c003520 con 0x7f344c0039b0 2024-04-25T19:31:12.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.753+0000 7f3467400640 1 --2- 172.21.15.131:0/2654978738 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34680cf2f0 0x7f344c005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:31:12.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.754+0000 7f3466a00640 1 --2- 172.21.15.131:0/2654978738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f344c0039b0 0x7f344c003e40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f3458009ac0 tx=0x7f344c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5dfd2321b4c4e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:12.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.754+0000 7f3466000640 1 -- 172.21.15.131:0/2654978738 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3458036070 con 0x7f344c0039b0 2024-04-25T19:31:12.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.754+0000 7f3466000640 1 -- 172.21.15.131:0/2654978738 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3458031400 con 0x7f344c0039b0 2024-04-25T19:31:12.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.754+0000 7f3466000640 1 -- 172.21.15.131:0/2654978738 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3458009690 con 0x7f344c0039b0 2024-04-25T19:31:12.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.755+0000 7f3467e00640 1 -- 172.21.15.131:0/2654978738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f344c0039b0 msgr2=0x7f344c003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:12.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.755+0000 7f3467e00640 1 --2- 172.21.15.131:0/2654978738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f344c0039b0 0x7f344c003e40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f3458009ac0 tx=0x7f344c005830 comp rx=0 tx=0).stop 2024-04-25T19:31:12.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.755+0000 7f3467400640 1 -- 172.21.15.131:0/2654978738 reap_dead start 2024-04-25T19:31:12.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.755+0000 7f3467e00640 1 -- 172.21.15.131:0/2654978738 shutdown_connections 2024-04-25T19:31:12.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.755+0000 7f3467e00640 1 -- 172.21.15.131:0/2654978738 >> 172.21.15.131:0/2654978738 conn(0x7f34680d1720 msgr2=0x7f34680d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:12.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.755+0000 7f3467e00640 1 -- 172.21.15.131:0/2654978738 shutdown_connections 2024-04-25T19:31:12.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.755+0000 7f3467e00640 1 -- 172.21.15.131:0/2654978738 wait complete. 2024-04-25T19:31:12.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.757+0000 7f3467e00640 1 Processor -- start 2024-04-25T19:31:12.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.758+0000 7f3467e00640 1 -- start start 2024-04-25T19:31:12.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.759+0000 7f3467e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f344c0039b0 0x7f34681e66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:12.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.759+0000 7f3467e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34681f6360 0x7f346814a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:12.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.759+0000 7f3467e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f346815b720 0x7f34680cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:12.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.759+0000 7f3467e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f346815ac20 con 0x7f346815b720 2024-04-25T19:31:12.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.759+0000 7f3467e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f346806f500 con 0x7f34681f6360 2024-04-25T19:31:12.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.759+0000 7f3467e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f34680b6e10 con 0x7f344c0039b0 2024-04-25T19:31:12.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.759+0000 7f3467400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f346815b720 0x7f34680cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:12.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.759+0000 7f3467400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f346815b720 0x7f34680cbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57114/0 (socket says 172.21.15.131:57114) 2024-04-25T19:31:12.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.759+0000 7f3467400640 1 -- 172.21.15.131:0/459176622 learned_addr learned my addr 172.21.15.131:0/459176622 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:12.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.760+0000 7f3466a00640 1 --2- 172.21.15.131:0/459176622 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f344c0039b0 0x7f34681e66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:12.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.760+0000 7f345fe00640 1 --2- 172.21.15.131:0/459176622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34681f6360 0x7f346814a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:12.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.760+0000 7f3467400640 1 -- 172.21.15.131:0/459176622 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f344c0039b0 msgr2=0x7f34681e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:12.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.760+0000 7f3467400640 1 --2- 172.21.15.131:0/459176622 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f344c0039b0 0x7f34681e66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:12.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.760+0000 7f3467400640 1 -- 172.21.15.131:0/459176622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34681f6360 msgr2=0x7f346814a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:12.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.760+0000 7f3467400640 1 --2- 172.21.15.131:0/459176622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34681f6360 0x7f346814a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:12.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.760+0000 7f3467400640 1 -- 172.21.15.131:0/459176622 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34681f6e20 con 0x7f346815b720 2024-04-25T19:31:12.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.760+0000 7f3467400640 1 --2- 172.21.15.131:0/459176622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f346815b720 0x7f34680cbb60 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f34680d27c0 tx=0x7f346000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:12.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.760+0000 7f345ea00640 1 -- 172.21.15.131:0/459176622 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3460016620 con 0x7f346815b720 2024-04-25T19:31:12.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.760+0000 7f345ea00640 1 -- 172.21.15.131:0/459176622 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f346001b070 con 0x7f346815b720 2024-04-25T19:31:12.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.760+0000 7f345ea00640 1 -- 172.21.15.131:0/459176622 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3460016a20 con 0x7f346815b720 2024-04-25T19:31:12.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.760+0000 7f3467e00640 1 -- 172.21.15.131:0/459176622 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34681f7100 con 0x7f346815b720 2024-04-25T19:31:12.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.761+0000 7f3467e00640 1 -- 172.21.15.131:0/459176622 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f346815b200 con 0x7f346815b720 2024-04-25T19:31:12.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.762+0000 7f3467e00640 1 -- 172.21.15.131:0/459176622 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3468050740 con 0x7f346815b720 2024-04-25T19:31:12.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.763+0000 7f345ea00640 1 -- 172.21.15.131:0/459176622 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3460005d10 con 0x7f346815b720 2024-04-25T19:31:12.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.765+0000 7f345ea00640 1 --2- 172.21.15.131:0/459176622 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f34440744b0 0x7f34440769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:12.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.765+0000 7f345ea00640 1 -- 172.21.15.131:0/459176622 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f3460095b20 con 0x7f346815b720 2024-04-25T19:31:12.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.765+0000 7f3466a00640 1 --2- 172.21.15.131:0/459176622 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f34440744b0 0x7f34440769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:12.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.767+0000 7f3466a00640 1 --2- 172.21.15.131:0/459176622 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f34440744b0 0x7f34440769c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3458033000 tx=0x7f3458008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:12.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.770+0000 7f345ea00640 1 -- 172.21.15.131:0/459176622 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3460025020 con 0x7f346815b720 2024-04-25T19:31:12.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.965+0000 7f3467e00640 1 -- 172.21.15.131:0/459176622 --> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f34681f6b70 con 0x7f34440744b0 2024-04-25T19:31:12.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.968+0000 7f345ea00640 1 -- 172.21.15.131:0/459176622 <== mgr.4105 v2:172.21.15.195:6832/2541913764 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13520 (secure 0 0 0) 0x7f34681f6b70 con 0x7f34440744b0 2024-04-25T19:31:12.969 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:31:12.969 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-04-25T19:31:12.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.971+0000 7f3467e00640 1 -- 172.21.15.131:0/459176622 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f34440744b0 msgr2=0x7f34440769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:12.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.971+0000 7f3467e00640 1 --2- 172.21.15.131:0/459176622 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f34440744b0 0x7f34440769c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3458033000 tx=0x7f3458008030 comp rx=0 tx=0).stop 2024-04-25T19:31:12.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.971+0000 7f3467e00640 1 -- 172.21.15.131:0/459176622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f346815b720 msgr2=0x7f34680cbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:12.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.971+0000 7f3467e00640 1 --2- 172.21.15.131:0/459176622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f346815b720 0x7f34680cbb60 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f34680d27c0 tx=0x7f346000f520 comp rx=0 tx=0).stop 2024-04-25T19:31:12.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.971+0000 7f3467e00640 1 -- 172.21.15.131:0/459176622 shutdown_connections 2024-04-25T19:31:12.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.971+0000 7f3467e00640 1 --2- 172.21.15.131:0/459176622 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f34440744b0 0x7f34440769c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:12.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.971+0000 7f3467e00640 1 --2- 172.21.15.131:0/459176622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f346815b720 0x7f34680cbb60 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:12.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.971+0000 7f3467e00640 1 --2- 172.21.15.131:0/459176622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34681f6360 0x7f346814a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:12.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.971+0000 7f3467e00640 1 --2- 172.21.15.131:0/459176622 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f344c0039b0 0x7f34681e66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:12.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.971+0000 7f3467e00640 1 -- 172.21.15.131:0/459176622 >> 172.21.15.131:0/459176622 conn(0x7f34680d1720 msgr2=0x7f3468073a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:12.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.971+0000 7f3467e00640 1 -- 172.21.15.131:0/459176622 shutdown_connections 2024-04-25T19:31:12.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:12.971+0000 7f3467e00640 1 -- 172.21.15.131:0/459176622 wait complete. 2024-04-25T19:31:12.999 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-04-25T19:31:12.367957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":278084,"kb_used_data":36960,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754696636,"statfs":{"total":773094113280,"available":772809355264,"internally_reserved":0,"allocated":37847040,"data_stored":28162583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":246795828},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-18538450,"num_objects":-993,"num_object_clones":0,"num_object_copies":-1986,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-993,"num_whiteouts":0,"num_read":-3,"num_read_kb":-3,"num_write":-1516,"num_write_kb":-19291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-31,"num_bytes_recovered":-21488,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.280041"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":167,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T19:31:08.958298+0000","last_change":"2024-04-25T19:22:06.081655+0000","last_active":"2024-04-25T19:31:08.958298+0000","last_peered":"2024-04-25T19:31:08.958298+0000","last_clean":"2024-04-25T19:31:08.958298+0000","last_became_active":"2024-04-25T19:22:06.078999+0000","last_became_peered":"2024-04-25T19:22:06.078999+0000","last_unstale":"2024-04-25T19:31:08.958298+0000","last_undegraded":"2024-04-25T19:31:08.958298+0000","last_fullsized":"2024-04-25T19:31:08.958298+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_clean_scrub_stamp":"2024-04-25T19:22:04.921147+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:30.543734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574961,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33464,"kb_used_data":2284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338376,"statfs":{"total":96636764160,"available":96602497024,"internally_reserved":0,"allocated":2338816,"data_stored":1159946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574959,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38788,"kb_used_data":7608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333052,"statfs":{"total":96636764160,"available":96597045248,"internally_reserved":0,"allocated":7790592,"data_stored":6294239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574960,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32772,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1630208,"data_stored":678550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574960,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32908,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338932,"statfs":{"total":96636764160,"available":96603066368,"internally_reserved":0,"allocated":1769472,"data_stored":666272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574960,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":39772,"kb_used_data":8592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332068,"statfs":{"total":96636764160,"available":96596037632,"internally_reserved":0,"allocated":8798208,"data_stored":7609422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574961,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":5112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":5234688,"data_stored":4127943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574960,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34072,"kb_used_data":7052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337768,"statfs":{"total":96636764160,"available":96601874432,"internally_reserved":0,"allocated":7221248,"data_stored":6078913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34172,"kb_used_data":2992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337668,"statfs":{"total":96636764160,"available":96601772032,"internally_reserved":0,"allocated":3063808,"data_stored":1547298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T19:31:12.999 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T19:31:13.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.272+0000 7ff1bb200640 1 Processor -- start 2024-04-25T19:31:13.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.272+0000 7ff1bb200640 1 -- start start 2024-04-25T19:31:13.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.275+0000 7ff1bb200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1bc144370 0x7ff1bc0cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:13.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.275+0000 7ff1bb200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1bc0d1230 con 0x7ff1bc0b4ea0 2024-04-25T19:31:13.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.275+0000 7ff1bb200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1bc0d06b0 con 0x7ff1bc06c5c0 2024-04-25T19:31:13.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.275+0000 7ff1bb200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff1bc0d0990 con 0x7ff1bc144370 2024-04-25T19:31:13.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.275+0000 7ff1b1400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7ff1bc0b4ea0 0x7ff1bc15e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46554/0 (socket says 172.21.15.131:46554) 2024-04-25T19:31:13.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.275+0000 7ff1b1400640 1 -- 172.21.15.131:0/3941536712 learned_addr learned my addr 172.21.15.131:0/3941536712 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:31:13.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.275+0000 7ff1ba800640 1 --2- 172.21.15.131:0/3941536712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1bc144370 0x7ff1bc0cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:13.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.276+0000 7ff1b9400640 1 -- 172.21.15.131:0/3941536712 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 978718237 0 0) 0x7ff1bc0d1230 con 0x7ff1bc0b4ea0 2024-04-25T19:31:13.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.276+0000 7ff1b9400640 1 -- 172.21.15.131:0/3941536712 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1a0003520 con 0x7ff1bc0b4ea0 2024-04-25T19:31:13.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.276+0000 7ff1b9400640 1 -- 172.21.15.131:0/3941536712 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3136301957 0 0) 0x7ff1a0003520 con 0x7ff1bc0b4ea0 2024-04-25T19:31:13.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.276+0000 7ff1b9400640 1 -- 172.21.15.131:0/3941536712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1bc144370 msgr2=0x7ff1bc0cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:13.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.276+0000 7ff1b9400640 1 --2- 172.21.15.131:0/3941536712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1bc144370 0x7ff1bc0cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:13.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.276+0000 7ff1b9400640 1 -- 172.21.15.131:0/3941536712 >> v1:172.21.15.195:6789/0 conn(0x7ff1bc06c5c0 legacy=0x7ff1bc0b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:13.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.276+0000 7ff1b9400640 1 -- 172.21.15.131:0/3941536712 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1bc0d0c70 con 0x7ff1bc0b4ea0 2024-04-25T19:31:13.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.276+0000 7ff1b9400640 1 -- 172.21.15.131:0/3941536712 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7ff1a4001670 con 0x7ff1bc0b4ea0 2024-04-25T19:31:13.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.276+0000 7ff1b9400640 1 -- 172.21.15.131:0/3941536712 >> v1:172.21.15.131:6789/0 conn(0x7ff1bc0b4ea0 legacy=0x7ff1bc15e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:13.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.276+0000 7ff1b9400640 1 --2- 172.21.15.131:0/3941536712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1a00039e0 0x7ff1a0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:13.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.276+0000 7ff1b9400640 1 --2- 172.21.15.131:0/3941536712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1a0004800 0x7ff1a0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:13.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.276+0000 7ff1b9400640 1 --2- 172.21.15.131:0/3941536712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1bc144370 0x7ff1a0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:13.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.276+0000 7ff1b9400640 1 -- 172.21.15.131:0/3941536712 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc0d0990 con 0x7ff1a0004800 2024-04-25T19:31:13.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.276+0000 7ff1b9400640 1 -- 172.21.15.131:0/3941536712 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a000baf0 con 0x7ff1a00039e0 2024-04-25T19:31:13.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.276+0000 7ff1b9400640 1 -- 172.21.15.131:0/3941536712 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff1a000bcf0 con 0x7ff1bc144370 2024-04-25T19:31:13.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.277+0000 7ff1b1400640 1 --2- 172.21.15.131:0/3941536712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1a0004800 0x7ff1a0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:13.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.277+0000 7ff1b9e00640 1 --2- 172.21.15.131:0/3941536712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1a00039e0 0x7ff1a0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:13.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.277+0000 7ff1ba800640 1 --2- 172.21.15.131:0/3941536712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1bc144370 0x7ff1a0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:13.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.277+0000 7ff1b1400640 1 -- 172.21.15.131:0/3941536712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1bc144370 msgr2=0x7ff1a0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:13.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.277+0000 7ff1b1400640 1 --2- 172.21.15.131:0/3941536712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1bc144370 0x7ff1a0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:13.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.277+0000 7ff1b1400640 1 -- 172.21.15.131:0/3941536712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1a00039e0 msgr2=0x7ff1a0003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:13.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.277+0000 7ff1b1400640 1 --2- 172.21.15.131:0/3941536712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1a00039e0 0x7ff1a0003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:13.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.277+0000 7ff1b1400640 1 -- 172.21.15.131:0/3941536712 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a0003520 con 0x7ff1a0004800 2024-04-25T19:31:13.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.278+0000 7ff1b1400640 1 --2- 172.21.15.131:0/3941536712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1a0004800 0x7ff1a0004c10 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400c210 tx=0x7ff1a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f0b49ae200e7a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:13.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.279+0000 7ff1b9400640 1 -- 172.21.15.131:0/3941536712 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4007d10 con 0x7ff1a0004800 2024-04-25T19:31:13.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.279+0000 7ff1b9400640 1 -- 172.21.15.131:0/3941536712 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a40058d0 con 0x7ff1a0004800 2024-04-25T19:31:13.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.279+0000 7ff1b9400640 1 -- 172.21.15.131:0/3941536712 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4005d00 con 0x7ff1a0004800 2024-04-25T19:31:13.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.279+0000 7ff1bb200640 1 -- 172.21.15.131:0/3941536712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1a0004800 msgr2=0x7ff1a0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:13.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.279+0000 7ff1bb200640 1 --2- 172.21.15.131:0/3941536712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1a0004800 0x7ff1a0004c10 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400c210 tx=0x7ff1a0005830 comp rx=0 tx=0).stop 2024-04-25T19:31:13.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.279+0000 7ff1ba800640 1 -- 172.21.15.131:0/3941536712 reap_dead start 2024-04-25T19:31:13.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.280+0000 7ff1bb200640 1 -- 172.21.15.131:0/3941536712 shutdown_connections 2024-04-25T19:31:13.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.280+0000 7ff1bb200640 1 -- 172.21.15.131:0/3941536712 >> 172.21.15.131:0/3941536712 conn(0x7ff1bc0d1720 msgr2=0x7ff1bc0d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:13.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.280+0000 7ff1bb200640 1 -- 172.21.15.131:0/3941536712 shutdown_connections 2024-04-25T19:31:13.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.280+0000 7ff1bb200640 1 -- 172.21.15.131:0/3941536712 wait complete. 2024-04-25T19:31:13.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.282+0000 7ff1bb200640 1 Processor -- start 2024-04-25T19:31:13.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.282+0000 7ff1bb200640 1 -- start start 2024-04-25T19:31:13.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.284+0000 7ff1bb200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1a0004800 0x7ff1bc140350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:13.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.284+0000 7ff1bb200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1bc140ae0 0x7ff1bc072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:13.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.284+0000 7ff1bb200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1bc073320 0x7ff1bc1457d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:13.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.284+0000 7ff1bb200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc0d0450 con 0x7ff1a0004800 2024-04-25T19:31:13.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.284+0000 7ff1bb200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc0d02d0 con 0x7ff1bc140ae0 2024-04-25T19:31:13.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.284+0000 7ff1bb200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff1bc147760 con 0x7ff1bc073320 2024-04-25T19:31:13.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.284+0000 7ff1b9e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1a0004800 0x7ff1bc140350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:13.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.284+0000 7ff1b9e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1a0004800 0x7ff1bc140350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57128/0 (socket says 172.21.15.131:57128) 2024-04-25T19:31:13.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.284+0000 7ff1b9e00640 1 -- 172.21.15.131:0/1986582658 learned_addr learned my addr 172.21.15.131:0/1986582658 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:13.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.284+0000 7ff1ba800640 1 --2- 172.21.15.131:0/1986582658 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1bc073320 0x7ff1bc1457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:13.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.284+0000 7ff1b1400640 1 --2- 172.21.15.131:0/1986582658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1bc140ae0 0x7ff1bc072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:13.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.285+0000 7ff1b9e00640 1 -- 172.21.15.131:0/1986582658 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1bc073320 msgr2=0x7ff1bc1457d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:13.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.285+0000 7ff1b9e00640 1 --2- 172.21.15.131:0/1986582658 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1bc073320 0x7ff1bc1457d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:13.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.285+0000 7ff1b9e00640 1 -- 172.21.15.131:0/1986582658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1bc140ae0 msgr2=0x7ff1bc072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:13.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.285+0000 7ff1b9e00640 1 --2- 172.21.15.131:0/1986582658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1bc140ae0 0x7ff1bc072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:13.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.285+0000 7ff1b9e00640 1 -- 172.21.15.131:0/1986582658 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1bc073730 con 0x7ff1a0004800 2024-04-25T19:31:13.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.285+0000 7ff1ba800640 1 --2- 172.21.15.131:0/1986582658 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1bc073320 0x7ff1bc1457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:31:13.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.285+0000 7ff1b1400640 1 --2- 172.21.15.131:0/1986582658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1bc140ae0 0x7ff1bc072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:31:13.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.285+0000 7ff1b9e00640 1 --2- 172.21.15.131:0/1986582658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1a0004800 0x7ff1bc140350 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00e8f0 tx=0x7ff1ac00edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:13.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.285+0000 7ff1b2a00640 1 -- 172.21.15.131:0/1986582658 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac003b80 con 0x7ff1a0004800 2024-04-25T19:31:13.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.285+0000 7ff1b2a00640 1 -- 172.21.15.131:0/1986582658 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1ac018070 con 0x7ff1a0004800 2024-04-25T19:31:13.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.285+0000 7ff1bb200640 1 -- 172.21.15.131:0/1986582658 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1bc140890 con 0x7ff1a0004800 2024-04-25T19:31:13.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.285+0000 7ff1b2a00640 1 -- 172.21.15.131:0/1986582658 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac0050d0 con 0x7ff1a0004800 2024-04-25T19:31:13.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.285+0000 7ff1bb200640 1 -- 172.21.15.131:0/1986582658 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1bc0cb3d0 con 0x7ff1a0004800 2024-04-25T19:31:13.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.287+0000 7ff1bb200640 1 -- 172.21.15.131:0/1986582658 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1bc050740 con 0x7ff1a0004800 2024-04-25T19:31:13.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.288+0000 7ff1b2a00640 1 -- 172.21.15.131:0/1986582658 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff1ac005270 con 0x7ff1a0004800 2024-04-25T19:31:13.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.289+0000 7ff1b2a00640 1 --2- 172.21.15.131:0/1986582658 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff1980744e0 0x7ff1980769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:13.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.289+0000 7ff1b2a00640 1 -- 172.21.15.131:0/1986582658 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7ff1ac094f00 con 0x7ff1a0004800 2024-04-25T19:31:13.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.289+0000 7ff1b1400640 1 --2- 172.21.15.131:0/1986582658 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff1980744e0 0x7ff1980769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:13.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.291+0000 7ff1b1400640 1 --2- 172.21.15.131:0/1986582658 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff1980744e0 0x7ff1980769f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4033000 tx=0x7ff1a402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:13.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.293+0000 7ff1b2a00640 1 -- 172.21.15.131:0/1986582658 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff1bc073730 con 0x7ff1a0004800 2024-04-25T19:31:13.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.488+0000 7ff1bb200640 1 -- 172.21.15.131:0/1986582658 --> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff1bc0702c0 con 0x7ff1980744e0 2024-04-25T19:31:13.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.491+0000 7ff1b2a00640 1 -- 172.21.15.131:0/1986582658 <== mgr.4105 v2:172.21.15.195:6832/2541913764 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13520 (secure 0 0 0) 0x7ff1bc0702c0 con 0x7ff1980744e0 2024-04-25T19:31:13.491 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:31:13.492 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-04-25T19:31:13.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.493+0000 7ff1bb200640 1 -- 172.21.15.131:0/1986582658 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff1980744e0 msgr2=0x7ff1980769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:13.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.493+0000 7ff1bb200640 1 --2- 172.21.15.131:0/1986582658 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff1980744e0 0x7ff1980769f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4033000 tx=0x7ff1a402e000 comp rx=0 tx=0).stop 2024-04-25T19:31:13.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.493+0000 7ff1bb200640 1 -- 172.21.15.131:0/1986582658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1a0004800 msgr2=0x7ff1bc140350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:13.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.493+0000 7ff1bb200640 1 --2- 172.21.15.131:0/1986582658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1a0004800 0x7ff1bc140350 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00e8f0 tx=0x7ff1ac00edb0 comp rx=0 tx=0).stop 2024-04-25T19:31:13.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.493+0000 7ff1bb200640 1 -- 172.21.15.131:0/1986582658 shutdown_connections 2024-04-25T19:31:13.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.493+0000 7ff1bb200640 1 --2- 172.21.15.131:0/1986582658 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff1980744e0 0x7ff1980769f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:13.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.493+0000 7ff1bb200640 1 --2- 172.21.15.131:0/1986582658 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1bc073320 0x7ff1bc1457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:13.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.493+0000 7ff1bb200640 1 --2- 172.21.15.131:0/1986582658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1bc140ae0 0x7ff1bc072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:13.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.493+0000 7ff1bb200640 1 --2- 172.21.15.131:0/1986582658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1a0004800 0x7ff1bc140350 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:13.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.493+0000 7ff1bb200640 1 -- 172.21.15.131:0/1986582658 >> 172.21.15.131:0/1986582658 conn(0x7ff1bc0d1720 msgr2=0x7ff1bc0d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:13.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.494+0000 7ff1bb200640 1 -- 172.21.15.131:0/1986582658 shutdown_connections 2024-04-25T19:31:13.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.494+0000 7ff1bb200640 1 -- 172.21.15.131:0/1986582658 wait complete. 2024-04-25T19:31:13.521 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-04-25T19:31:12.367957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":278084,"kb_used_data":36960,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754696636,"statfs":{"total":773094113280,"available":772809355264,"internally_reserved":0,"allocated":37847040,"data_stored":28162583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":246795828},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-18538450,"num_objects":-993,"num_object_clones":0,"num_object_copies":-1986,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-993,"num_whiteouts":0,"num_read":-3,"num_read_kb":-3,"num_write":-1516,"num_write_kb":-19291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-31,"num_bytes_recovered":-21488,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.280041"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":167,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T19:31:08.958298+0000","last_change":"2024-04-25T19:22:06.081655+0000","last_active":"2024-04-25T19:31:08.958298+0000","last_peered":"2024-04-25T19:31:08.958298+0000","last_clean":"2024-04-25T19:31:08.958298+0000","last_became_active":"2024-04-25T19:22:06.078999+0000","last_became_peered":"2024-04-25T19:22:06.078999+0000","last_unstale":"2024-04-25T19:31:08.958298+0000","last_undegraded":"2024-04-25T19:31:08.958298+0000","last_fullsized":"2024-04-25T19:31:08.958298+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_clean_scrub_stamp":"2024-04-25T19:22:04.921147+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:30.543734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574961,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33464,"kb_used_data":2284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338376,"statfs":{"total":96636764160,"available":96602497024,"internally_reserved":0,"allocated":2338816,"data_stored":1159946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574959,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38788,"kb_used_data":7608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333052,"statfs":{"total":96636764160,"available":96597045248,"internally_reserved":0,"allocated":7790592,"data_stored":6294239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574960,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32772,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1630208,"data_stored":678550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574960,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32908,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338932,"statfs":{"total":96636764160,"available":96603066368,"internally_reserved":0,"allocated":1769472,"data_stored":666272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574960,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":39772,"kb_used_data":8592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332068,"statfs":{"total":96636764160,"available":96596037632,"internally_reserved":0,"allocated":8798208,"data_stored":7609422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574961,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":5112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":5234688,"data_stored":4127943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574960,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34072,"kb_used_data":7052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337768,"statfs":{"total":96636764160,"available":96601874432,"internally_reserved":0,"allocated":7221248,"data_stored":6078913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34172,"kb_used_data":2992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337668,"statfs":{"total":96636764160,"available":96601772032,"internally_reserved":0,"allocated":3063808,"data_stored":1547298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T19:31:13.523 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T19:31:13.523 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T19:31:13.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.787+0000 7f93cac00640 1 Processor -- start 2024-04-25T19:31:13.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.787+0000 7f93cac00640 1 -- start start 2024-04-25T19:31:13.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.790+0000 7f93cac00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93c40b4ea0 0x7f93c40cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:13.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.790+0000 7f93cac00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f93c4144370 0x7f93c415e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:13.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.790+0000 7f93cac00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93c40d1230 con 0x7f93c406c5c0 2024-04-25T19:31:13.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.790+0000 7f93cac00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f93c40d06b0 con 0x7f93c4144370 2024-04-25T19:31:13.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.790+0000 7f93cac00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f93c40d0990 con 0x7f93c40b4ea0 2024-04-25T19:31:13.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.790+0000 7f93c9800640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f93c406c5c0 0x7f93c40b4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46570/0 (socket says 172.21.15.131:46570) 2024-04-25T19:31:13.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.790+0000 7f93c9800640 1 -- 172.21.15.131:0/3060830965 learned_addr learned my addr 172.21.15.131:0/3060830965 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:31:13.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.790+0000 7f93ca200640 1 --2- 172.21.15.131:0/3060830965 >> v2:172.21.15.131:3300/0 conn(0x7f93c4144370 0x7f93c415e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:13.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.790+0000 7f93c8e00640 1 --2- 172.21.15.131:0/3060830965 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93c40b4ea0 0x7f93c40cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:13.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.790+0000 7f93c3e00640 1 -- 172.21.15.131:0/3060830965 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 701537074 0 0) 0x7f93c40d1230 con 0x7f93c406c5c0 2024-04-25T19:31:13.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.790+0000 7f93c3e00640 1 -- 172.21.15.131:0/3060830965 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93ac003520 con 0x7f93c406c5c0 2024-04-25T19:31:13.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.791+0000 7f93ca200640 1 -- 172.21.15.131:0/3060830965 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93c40b4ea0 msgr2=0x7f93c40cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:13.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.791+0000 7f93ca200640 1 --2- 172.21.15.131:0/3060830965 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93c40b4ea0 0x7f93c40cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:13.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.791+0000 7f93ca200640 1 -- 172.21.15.131:0/3060830965 >> v1:172.21.15.131:6789/0 conn(0x7f93c406c5c0 legacy=0x7f93c40b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:13.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.791+0000 7f93ca200640 1 -- 172.21.15.131:0/3060830965 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c40d0c70 con 0x7f93c4144370 2024-04-25T19:31:13.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.792+0000 7f93ca200640 1 --2- 172.21.15.131:0/3060830965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93c4144370 0x7f93c415e770 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f93bc009d90 tx=0x7f93bc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5d0e489d368d55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:13.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.792+0000 7f93c3e00640 1 -- 172.21.15.131:0/3060830965 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc007740 con 0x7f93c4144370 2024-04-25T19:31:13.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.792+0000 7f93c3e00640 1 -- 172.21.15.131:0/3060830965 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93bc0078e0 con 0x7f93c4144370 2024-04-25T19:31:13.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.792+0000 7f93c3e00640 1 -- 172.21.15.131:0/3060830965 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc007cb0 con 0x7f93c4144370 2024-04-25T19:31:13.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.793+0000 7f93cac00640 1 -- 172.21.15.131:0/3060830965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93c4144370 msgr2=0x7f93c415e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:13.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.793+0000 7f93cac00640 1 --2- 172.21.15.131:0/3060830965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93c4144370 0x7f93c415e770 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f93bc009d90 tx=0x7f93bc02a660 comp rx=0 tx=0).stop 2024-04-25T19:31:13.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.793+0000 7f93cac00640 1 -- 172.21.15.131:0/3060830965 shutdown_connections 2024-04-25T19:31:13.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.793+0000 7f93cac00640 1 --2- 172.21.15.131:0/3060830965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93c4144370 0x7f93c415e770 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:13.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.793+0000 7f93cac00640 1 --2- 172.21.15.131:0/3060830965 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93c40b4ea0 0x7f93c40cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:13.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.793+0000 7f93cac00640 1 -- 172.21.15.131:0/3060830965 >> 172.21.15.131:0/3060830965 conn(0x7f93c40d1720 msgr2=0x7f93c40d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:13.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.793+0000 7f93cac00640 1 -- 172.21.15.131:0/3060830965 shutdown_connections 2024-04-25T19:31:13.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.793+0000 7f93cac00640 1 -- 172.21.15.131:0/3060830965 wait complete. 2024-04-25T19:31:13.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.795+0000 7f93cac00640 1 Processor -- start 2024-04-25T19:31:13.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.795+0000 7f93cac00640 1 -- start start 2024-04-25T19:31:13.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.797+0000 7f93cac00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93c406c5c0 0x7f93c40aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:13.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.797+0000 7f93cac00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93c4144370 0x7f93c41386b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:13.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.797+0000 7f93cac00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93c4135d90 0x7f93c41361a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:13.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.797+0000 7f93cac00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f93c40d0450 con 0x7f93c406c5c0 2024-04-25T19:31:13.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.797+0000 7f93cac00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f93c40d02d0 con 0x7f93c4144370 2024-04-25T19:31:13.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.797+0000 7f93cac00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f93c4147760 con 0x7f93c4135d90 2024-04-25T19:31:13.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.797+0000 7f93c9800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93c406c5c0 0x7f93c40aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:13.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.797+0000 7f93c9800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93c406c5c0 0x7f93c40aecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57144/0 (socket says 172.21.15.131:57144) 2024-04-25T19:31:13.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.797+0000 7f93c9800640 1 -- 172.21.15.131:0/390199779 learned_addr learned my addr 172.21.15.131:0/390199779 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:13.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.798+0000 7f93ca200640 1 --2- 172.21.15.131:0/390199779 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93c4135d90 0x7f93c41361a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:13.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.798+0000 7f93c8e00640 1 --2- 172.21.15.131:0/390199779 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93c4144370 0x7f93c41386b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:13.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.798+0000 7f93c9800640 1 -- 172.21.15.131:0/390199779 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93c4135d90 msgr2=0x7f93c41361a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:13.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.798+0000 7f93c9800640 1 --2- 172.21.15.131:0/390199779 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93c4135d90 0x7f93c41361a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:13.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.798+0000 7f93c9800640 1 -- 172.21.15.131:0/390199779 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93c4144370 msgr2=0x7f93c41386b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:13.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.798+0000 7f93c9800640 1 --2- 172.21.15.131:0/390199779 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93c4144370 0x7f93c41386b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:13.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.798+0000 7f93c9800640 1 -- 172.21.15.131:0/390199779 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c40af540 con 0x7f93c406c5c0 2024-04-25T19:31:13.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.798+0000 7f93c8e00640 1 --2- 172.21.15.131:0/390199779 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93c4144370 0x7f93c41386b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:31:13.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.798+0000 7f93c9800640 1 --2- 172.21.15.131:0/390199779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93c406c5c0 0x7f93c40aecf0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f93b800c390 tx=0x7f93b800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:13.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.798+0000 7f93c1600640 1 -- 172.21.15.131:0/390199779 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b8017070 con 0x7f93c406c5c0 2024-04-25T19:31:13.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.798+0000 7f93c1600640 1 -- 172.21.15.131:0/390199779 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93b8005ce0 con 0x7f93c406c5c0 2024-04-25T19:31:13.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.798+0000 7f93cac00640 1 -- 172.21.15.131:0/390199779 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93c40af820 con 0x7f93c406c5c0 2024-04-25T19:31:13.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.798+0000 7f93c1600640 1 -- 172.21.15.131:0/390199779 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b80072f0 con 0x7f93c406c5c0 2024-04-25T19:31:13.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.799+0000 7f93cac00640 1 -- 172.21.15.131:0/390199779 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93c40afde0 con 0x7f93c406c5c0 2024-04-25T19:31:13.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.800+0000 7f93cac00640 1 -- 172.21.15.131:0/390199779 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93c4071170 con 0x7f93c406c5c0 2024-04-25T19:31:13.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.801+0000 7f93c1600640 1 -- 172.21.15.131:0/390199779 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f93b801a070 con 0x7f93c406c5c0 2024-04-25T19:31:13.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.802+0000 7f93c1600640 1 --2- 172.21.15.131:0/390199779 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f93a40744b0 0x7f93a40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:13.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.802+0000 7f93c1600640 1 -- 172.21.15.131:0/390199779 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f93b8094370 con 0x7f93c406c5c0 2024-04-25T19:31:13.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.803+0000 7f93c8e00640 1 --2- 172.21.15.131:0/390199779 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f93a40744b0 0x7f93a40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:13.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.804+0000 7f93c8e00640 1 --2- 172.21.15.131:0/390199779 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f93a40744b0 0x7f93a40769c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f93b0006fd0 tx=0x7f93b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:13.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:13.807+0000 7f93c1600640 1 -- 172.21.15.131:0/390199779 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f93c4071170 con 0x7f93c406c5c0 2024-04-25T19:31:14.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.001+0000 7f93cac00640 1 -- 172.21.15.131:0/390199779 --> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f93c406d6c0 con 0x7f93a40744b0 2024-04-25T19:31:14.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.003+0000 7f93c1600640 1 -- 172.21.15.131:0/390199779 <== mgr.4105 v2:172.21.15.195:6832/2541913764 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13520 (secure 0 0 0) 0x7f93c406d6c0 con 0x7f93a40744b0 2024-04-25T19:31:14.004 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:31:14.004 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-04-25T19:31:14.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.006+0000 7f93cac00640 1 -- 172.21.15.131:0/390199779 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f93a40744b0 msgr2=0x7f93a40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:14.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.006+0000 7f93cac00640 1 --2- 172.21.15.131:0/390199779 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f93a40744b0 0x7f93a40769c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f93b0006fd0 tx=0x7f93b0008040 comp rx=0 tx=0).stop 2024-04-25T19:31:14.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.006+0000 7f93cac00640 1 -- 172.21.15.131:0/390199779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93c406c5c0 msgr2=0x7f93c40aecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:14.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.006+0000 7f93cac00640 1 --2- 172.21.15.131:0/390199779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93c406c5c0 0x7f93c40aecf0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f93b800c390 tx=0x7f93b800c850 comp rx=0 tx=0).stop 2024-04-25T19:31:14.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.006+0000 7f93cac00640 1 -- 172.21.15.131:0/390199779 shutdown_connections 2024-04-25T19:31:14.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.006+0000 7f93cac00640 1 --2- 172.21.15.131:0/390199779 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f93a40744b0 0x7f93a40769c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:14.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.006+0000 7f93cac00640 1 --2- 172.21.15.131:0/390199779 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93c4135d90 0x7f93c41361a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:14.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.006+0000 7f93cac00640 1 --2- 172.21.15.131:0/390199779 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93c4144370 0x7f93c41386b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:14.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.006+0000 7f93cac00640 1 --2- 172.21.15.131:0/390199779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93c406c5c0 0x7f93c40aecf0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:14.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.006+0000 7f93cac00640 1 -- 172.21.15.131:0/390199779 >> 172.21.15.131:0/390199779 conn(0x7f93c40d1720 msgr2=0x7f93c40d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:14.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.006+0000 7f93cac00640 1 -- 172.21.15.131:0/390199779 shutdown_connections 2024-04-25T19:31:14.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.006+0000 7f93cac00640 1 -- 172.21.15.131:0/390199779 wait complete. 2024-04-25T19:31:14.030 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-04-25T19:31:12.367957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":278084,"kb_used_data":36960,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754696636,"statfs":{"total":773094113280,"available":772809355264,"internally_reserved":0,"allocated":37847040,"data_stored":28162583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":246795828},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-18538450,"num_objects":-993,"num_object_clones":0,"num_object_copies":-1986,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-993,"num_whiteouts":0,"num_read":-3,"num_read_kb":-3,"num_write":-1516,"num_write_kb":-19291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-31,"num_bytes_recovered":-21488,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.280041"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":167,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T19:31:08.958298+0000","last_change":"2024-04-25T19:22:06.081655+0000","last_active":"2024-04-25T19:31:08.958298+0000","last_peered":"2024-04-25T19:31:08.958298+0000","last_clean":"2024-04-25T19:31:08.958298+0000","last_became_active":"2024-04-25T19:22:06.078999+0000","last_became_peered":"2024-04-25T19:22:06.078999+0000","last_unstale":"2024-04-25T19:31:08.958298+0000","last_undegraded":"2024-04-25T19:31:08.958298+0000","last_fullsized":"2024-04-25T19:31:08.958298+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_clean_scrub_stamp":"2024-04-25T19:22:04.921147+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:30.543734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574961,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33464,"kb_used_data":2284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338376,"statfs":{"total":96636764160,"available":96602497024,"internally_reserved":0,"allocated":2338816,"data_stored":1159946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574959,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38788,"kb_used_data":7608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333052,"statfs":{"total":96636764160,"available":96597045248,"internally_reserved":0,"allocated":7790592,"data_stored":6294239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574960,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32772,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1630208,"data_stored":678550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574960,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32908,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338932,"statfs":{"total":96636764160,"available":96603066368,"internally_reserved":0,"allocated":1769472,"data_stored":666272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574960,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":39772,"kb_used_data":8592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332068,"statfs":{"total":96636764160,"available":96596037632,"internally_reserved":0,"allocated":8798208,"data_stored":7609422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574961,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":5112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":5234688,"data_stored":4127943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574960,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34072,"kb_used_data":7052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337768,"statfs":{"total":96636764160,"available":96601874432,"internally_reserved":0,"allocated":7221248,"data_stored":6078913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34172,"kb_used_data":2992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337668,"statfs":{"total":96636764160,"available":96601772032,"internally_reserved":0,"allocated":3063808,"data_stored":1547298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T19:31:14.031 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T19:31:14.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.301+0000 7feb88a00640 1 Processor -- start 2024-04-25T19:31:14.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.301+0000 7feb88a00640 1 -- start start 2024-04-25T19:31:14.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.303+0000 7feb88a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7feb840cf2f0 0x7feb840b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:14.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.303+0000 7feb88a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb8415a810 0x7feb840b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:14.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.303+0000 7feb88a00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb840b4e90 con 0x7feb841608d0 2024-04-25T19:31:14.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.303+0000 7feb88a00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7feb8406f870 con 0x7feb840cf2f0 2024-04-25T19:31:14.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.303+0000 7feb88a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7feb840b74d0 con 0x7feb8415a810 2024-04-25T19:31:14.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.303+0000 7feb83400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7feb840cf2f0 0x7feb840b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:14.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.304+0000 7feb83400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7feb840cf2f0 0x7feb840b6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57152/0 (socket says 172.21.15.131:57152) 2024-04-25T19:31:14.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.304+0000 7feb83400640 1 -- 172.21.15.131:0/1054391040 learned_addr learned my addr 172.21.15.131:0/1054391040 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:14.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.304+0000 7feb83400640 1 -- 172.21.15.131:0/1054391040 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb8415a810 msgr2=0x7feb840b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:14.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.304+0000 7feb83400640 1 --2- 172.21.15.131:0/1054391040 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb8415a810 0x7feb840b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:14.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.304+0000 7feb83400640 1 -- 172.21.15.131:0/1054391040 >> v1:172.21.15.195:6789/0 conn(0x7feb841608d0 legacy=0x7feb84160ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:14.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.304+0000 7feb83400640 1 -- 172.21.15.131:0/1054391040 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb840b77b0 con 0x7feb840cf2f0 2024-04-25T19:31:14.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.305+0000 7feb83400640 1 --2- 172.21.15.131:0/1054391040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb840cf2f0 0x7feb840b6e10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7feb840d26d0 tx=0x7feb7402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506584c6b04b4df1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:14.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.305+0000 7feb82a00640 1 -- 172.21.15.131:0/1054391040 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb74036070 con 0x7feb840cf2f0 2024-04-25T19:31:14.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.305+0000 7feb82a00640 1 -- 172.21.15.131:0/1054391040 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb74031600 con 0x7feb840cf2f0 2024-04-25T19:31:14.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.305+0000 7feb82a00640 1 -- 172.21.15.131:0/1054391040 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb740319d0 con 0x7feb840cf2f0 2024-04-25T19:31:14.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.306+0000 7feb88a00640 1 -- 172.21.15.131:0/1054391040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb840cf2f0 msgr2=0x7feb840b6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:14.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.306+0000 7feb88a00640 1 --2- 172.21.15.131:0/1054391040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb840cf2f0 0x7feb840b6e10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7feb840d26d0 tx=0x7feb7402a6c0 comp rx=0 tx=0).stop 2024-04-25T19:31:14.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.306+0000 7feb88a00640 1 -- 172.21.15.131:0/1054391040 shutdown_connections 2024-04-25T19:31:14.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.306+0000 7feb88a00640 1 --2- 172.21.15.131:0/1054391040 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb8415a810 0x7feb840b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:14.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.306+0000 7feb88a00640 1 --2- 172.21.15.131:0/1054391040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb840cf2f0 0x7feb840b6e10 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:14.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.306+0000 7feb88a00640 1 -- 172.21.15.131:0/1054391040 >> 172.21.15.131:0/1054391040 conn(0x7feb840d1720 msgr2=0x7feb840d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:14.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.306+0000 7feb88a00640 1 -- 172.21.15.131:0/1054391040 shutdown_connections 2024-04-25T19:31:14.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.306+0000 7feb88a00640 1 -- 172.21.15.131:0/1054391040 wait complete. 2024-04-25T19:31:14.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.309+0000 7feb88a00640 1 Processor -- start 2024-04-25T19:31:14.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.309+0000 7feb88a00640 1 -- start start 2024-04-25T19:31:14.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.310+0000 7feb88a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb840cf2f0 0x7feb841566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:14.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.310+0000 7feb88a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb8415a810 0x7feb841515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:14.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.310+0000 7feb88a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb841608d0 0x7feb840aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:14.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.310+0000 7feb88a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7feb8415ac20 con 0x7feb8415a810 2024-04-25T19:31:14.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.310+0000 7feb88a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7feb8406f500 con 0x7feb841608d0 2024-04-25T19:31:14.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.310+0000 7feb88a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7feb8406fd00 con 0x7feb840cf2f0 2024-04-25T19:31:14.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.311+0000 7feb7aa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb8415a810 0x7feb841515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:14.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.311+0000 7feb7aa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb8415a810 0x7feb841515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57166/0 (socket says 172.21.15.131:57166) 2024-04-25T19:31:14.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.311+0000 7feb7aa00640 1 -- 172.21.15.131:0/2549272747 learned_addr learned my addr 172.21.15.131:0/2549272747 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:14.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.311+0000 7feb7aa00640 1 -- 172.21.15.131:0/2549272747 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb840cf2f0 msgr2=0x7feb841566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:14.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.311+0000 7feb7aa00640 1 --2- 172.21.15.131:0/2549272747 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb840cf2f0 0x7feb841566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:14.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.311+0000 7feb7aa00640 1 -- 172.21.15.131:0/2549272747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb841608d0 msgr2=0x7feb840aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:14.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.311+0000 7feb83e00640 1 --2- 172.21.15.131:0/2549272747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb841608d0 0x7feb840aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:14.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.311+0000 7feb7aa00640 1 --2- 172.21.15.131:0/2549272747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb841608d0 0x7feb840aeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:14.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.311+0000 7feb7aa00640 1 -- 172.21.15.131:0/2549272747 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb84156bf0 con 0x7feb8415a810 2024-04-25T19:31:14.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.312+0000 7feb7aa00640 1 --2- 172.21.15.131:0/2549272747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb8415a810 0x7feb841515b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7feb6c00b440 tx=0x7feb6c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:14.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.312+0000 7feb7be00640 1 -- 172.21.15.131:0/2549272747 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6c015020 con 0x7feb8415a810 2024-04-25T19:31:14.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.312+0000 7feb7be00640 1 -- 172.21.15.131:0/2549272747 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb6c011890 con 0x7feb8415a810 2024-04-25T19:31:14.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.312+0000 7feb88a00640 1 -- 172.21.15.131:0/2549272747 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb84151af0 con 0x7feb8415a810 2024-04-25T19:31:14.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.312+0000 7feb7be00640 1 -- 172.21.15.131:0/2549272747 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6c011c80 con 0x7feb8415a810 2024-04-25T19:31:14.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.312+0000 7feb88a00640 1 -- 172.21.15.131:0/2549272747 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb84158080 con 0x7feb8415a810 2024-04-25T19:31:14.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.313+0000 7feb88a00640 1 -- 172.21.15.131:0/2549272747 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb84050740 con 0x7feb8415a810 2024-04-25T19:31:14.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.314+0000 7feb7be00640 1 -- 172.21.15.131:0/2549272747 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7feb6c018020 con 0x7feb8415a810 2024-04-25T19:31:14.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.315+0000 7feb7be00640 1 --2- 172.21.15.131:0/2549272747 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7feb600744e0 0x7feb600769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:14.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.316+0000 7feb7be00640 1 -- 172.21.15.131:0/2549272747 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7feb6c094fe0 con 0x7feb8415a810 2024-04-25T19:31:14.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.316+0000 7feb83400640 1 --2- 172.21.15.131:0/2549272747 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7feb600744e0 0x7feb600769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:14.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.317+0000 7feb83400640 1 --2- 172.21.15.131:0/2549272747 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7feb600744e0 0x7feb600769f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7feb74033000 tx=0x7feb7402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:14.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.320+0000 7feb7be00640 1 -- 172.21.15.131:0/2549272747 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feb6c01f020 con 0x7feb8415a810 2024-04-25T19:31:14.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.508+0000 7feb88a00640 1 -- 172.21.15.131:0/2549272747 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb8406c770 con 0x7feb8415a810 2024-04-25T19:31:14.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.510+0000 7feb7be00640 1 -- 172.21.15.131:0/2549272747 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+13044 (secure 0 0 0) 0x7feb6c00d040 con 0x7feb8415a810 2024-04-25T19:31:14.511 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:31:14.511 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":50,"fsid":"4ba607f8-c2c3-4d8d-85a8-7800763c470f","created":"2024-04-25T19:21:50.959619+0000","modified":"2024-04-25T19:31:09.125250+0000","last_up_change":"2024-04-25T19:22:03.916705+0000","last_in_change":"2024-04-25T19:21:54.936103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T19:22:04.178847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d3eb3b71-ee14-4ddd-ab93-eae503ae2afc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6824","nonce":182543209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6827","nonce":182543209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6831","nonce":182543209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":182543209},{"type":"v1","addr":"172.21.15.131:6829","nonce":182543209}]},"public_addr":"172.21.15.131:6824/182543209","cluster_addr":"172.21.15.131:6827/182543209","heartbeat_back_addr":"172.21.15.131:6831/182543209","heartbeat_front_addr":"172.21.15.131:6829/182543209","state":["exists","up"]},{"osd":1,"uuid":"6d038d7a-8cbd-4525-8348-031fde89415b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6809","nonce":2785914367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6811","nonce":2785914367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6815","nonce":2785914367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2785914367},{"type":"v1","addr":"172.21.15.131:6813","nonce":2785914367}]},"public_addr":"172.21.15.131:6809/2785914367","cluster_addr":"172.21.15.131:6811/2785914367","heartbeat_back_addr":"172.21.15.131:6815/2785914367","heartbeat_front_addr":"172.21.15.131:6813/2785914367","state":["exists","up"]},{"osd":2,"uuid":"3cb06a2f-7f35-4e0f-bbdf-654793d2c10a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6801","nonce":1135187016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6803","nonce":1135187016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6807","nonce":1135187016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1135187016},{"type":"v1","addr":"172.21.15.131:6805","nonce":1135187016}]},"public_addr":"172.21.15.131:6801/1135187016","cluster_addr":"172.21.15.131:6803/1135187016","heartbeat_back_addr":"172.21.15.131:6807/1135187016","heartbeat_front_addr":"172.21.15.131:6805/1135187016","state":["exists","up"]},{"osd":3,"uuid":"24e40ad5-13b1-4ae6-9586-d2814758641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6817","nonce":2154643557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6819","nonce":2154643557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6825","nonce":2154643557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2154643557},{"type":"v1","addr":"172.21.15.131:6821","nonce":2154643557}]},"public_addr":"172.21.15.131:6817/2154643557","cluster_addr":"172.21.15.131:6819/2154643557","heartbeat_back_addr":"172.21.15.131:6825/2154643557","heartbeat_front_addr":"172.21.15.131:6821/2154643557","state":["exists","up"]},{"osd":4,"uuid":"cdb1a626-bcbd-4d86-9176-f93b23644451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6801","nonce":3394326073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6803","nonce":3394326073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6807","nonce":3394326073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3394326073},{"type":"v1","addr":"172.21.15.195:6805","nonce":3394326073}]},"public_addr":"172.21.15.195:6801/3394326073","cluster_addr":"172.21.15.195:6803/3394326073","heartbeat_back_addr":"172.21.15.195:6807/3394326073","heartbeat_front_addr":"172.21.15.195:6805/3394326073","state":["exists","up"]},{"osd":5,"uuid":"1b4d09c7-1bc1-47e0-928c-76c7da4e9100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6825","nonce":360782693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6827","nonce":360782693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6831","nonce":360782693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":360782693},{"type":"v1","addr":"172.21.15.195:6829","nonce":360782693}]},"public_addr":"172.21.15.195:6825/360782693","cluster_addr":"172.21.15.195:6827/360782693","heartbeat_back_addr":"172.21.15.195:6831/360782693","heartbeat_front_addr":"172.21.15.195:6829/360782693","state":["exists","up"]},{"osd":6,"uuid":"8b363ae9-9f98-48c8-98ce-2eb085dc13c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6817","nonce":439683850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6819","nonce":439683850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6823","nonce":439683850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":439683850},{"type":"v1","addr":"172.21.15.195:6821","nonce":439683850}]},"public_addr":"172.21.15.195:6817/439683850","cluster_addr":"172.21.15.195:6819/439683850","heartbeat_back_addr":"172.21.15.195:6823/439683850","heartbeat_front_addr":"172.21.15.195:6821/439683850","state":["exists","up"]},{"osd":7,"uuid":"646998b8-8951-4dad-9e5d-ff4e377cd149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6809","nonce":3283593923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6811","nonce":3283593923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6815","nonce":3283593923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":3283593923},{"type":"v1","addr":"172.21.15.195:6813","nonce":3283593923}]},"public_addr":"172.21.15.195:6809/3283593923","cluster_addr":"172.21.15.195:6811/3283593923","heartbeat_back_addr":"172.21.15.195:6815/3283593923","heartbeat_front_addr":"172.21.15.195:6813/3283593923","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.245309+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.446101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.263178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.270608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.304346+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.486364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.650590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T19:22:00.671831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.131:6835/274211686":"2024-04-26T19:31:06.080812+0000","172.21.15.131:6833/274211686":"2024-04-26T19:31:06.080812+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T19:31:14.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.513+0000 7feb88a00640 1 -- 172.21.15.131:0/2549272747 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7feb600744e0 msgr2=0x7feb600769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:14.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.513+0000 7feb88a00640 1 --2- 172.21.15.131:0/2549272747 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7feb600744e0 0x7feb600769f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7feb74033000 tx=0x7feb7402e000 comp rx=0 tx=0).stop 2024-04-25T19:31:14.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.513+0000 7feb88a00640 1 -- 172.21.15.131:0/2549272747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb8415a810 msgr2=0x7feb841515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:14.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.513+0000 7feb88a00640 1 --2- 172.21.15.131:0/2549272747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb8415a810 0x7feb841515b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7feb6c00b440 tx=0x7feb6c00b900 comp rx=0 tx=0).stop 2024-04-25T19:31:14.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.513+0000 7feb88a00640 1 -- 172.21.15.131:0/2549272747 shutdown_connections 2024-04-25T19:31:14.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.513+0000 7feb88a00640 1 --2- 172.21.15.131:0/2549272747 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7feb600744e0 0x7feb600769f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:14.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.513+0000 7feb88a00640 1 --2- 172.21.15.131:0/2549272747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb841608d0 0x7feb840aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:14.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.513+0000 7feb88a00640 1 --2- 172.21.15.131:0/2549272747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb8415a810 0x7feb841515b0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:14.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.513+0000 7feb88a00640 1 --2- 172.21.15.131:0/2549272747 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb840cf2f0 0x7feb841566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:14.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.513+0000 7feb88a00640 1 -- 172.21.15.131:0/2549272747 >> 172.21.15.131:0/2549272747 conn(0x7feb840d1720 msgr2=0x7feb84073b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:14.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.513+0000 7feb88a00640 1 -- 172.21.15.131:0/2549272747 shutdown_connections 2024-04-25T19:31:14.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:14.513+0000 7feb88a00640 1 -- 172.21.15.131:0/2549272747 wait complete. 2024-04-25T19:31:15.541 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T19:31:15.542 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T19:31:15.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.831+0000 7fed3a600640 1 Processor -- start 2024-04-25T19:31:15.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.831+0000 7fed3a600640 1 -- start start 2024-04-25T19:31:15.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.833+0000 7fed3a600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fed34163c90 0x7fed341606a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:15.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.833+0000 7fed3a600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed3406d5d0 0x7fed3406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:15.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.834+0000 7fed3a600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed3406df20 con 0x7fed3415de90 2024-04-25T19:31:15.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.834+0000 7fed3a600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fed340b0090 con 0x7fed34163c90 2024-04-25T19:31:15.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.834+0000 7fed3a600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fed34160c80 con 0x7fed3406d5d0 2024-04-25T19:31:15.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.835+0000 7fed33e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fed34163c90 0x7fed341606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:15.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.835+0000 7fed33e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fed34163c90 0x7fed341606a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57170/0 (socket says 172.21.15.131:57170) 2024-04-25T19:31:15.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.835+0000 7fed33e00640 1 -- 172.21.15.131:0/2723124455 learned_addr learned my addr 172.21.15.131:0/2723124455 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:15.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.835+0000 7fed33e00640 1 -- 172.21.15.131:0/2723124455 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed3406d5d0 msgr2=0x7fed3406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:15.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.835+0000 7fed33e00640 1 --2- 172.21.15.131:0/2723124455 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed3406d5d0 0x7fed3406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:15.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.835+0000 7fed33e00640 1 -- 172.21.15.131:0/2723124455 >> v1:172.21.15.195:6789/0 conn(0x7fed3415de90 legacy=0x7fed3406f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:15.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.835+0000 7fed33e00640 1 -- 172.21.15.131:0/2723124455 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed34160f60 con 0x7fed34163c90 2024-04-25T19:31:15.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.837+0000 7fed33e00640 1 --2- 172.21.15.131:0/2723124455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed34163c90 0x7fed341606a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fed20009870 tx=0x7fed2002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5126ef9a6207722 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:15.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.837+0000 7fed33400640 1 -- 172.21.15.131:0/2723124455 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed20037070 con 0x7fed34163c90 2024-04-25T19:31:15.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.837+0000 7fed33400640 1 -- 172.21.15.131:0/2723124455 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed20032440 con 0x7fed34163c90 2024-04-25T19:31:15.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.837+0000 7fed33400640 1 -- 172.21.15.131:0/2723124455 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed20032810 con 0x7fed34163c90 2024-04-25T19:31:15.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.838+0000 7fed3a600640 1 -- 172.21.15.131:0/2723124455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed34163c90 msgr2=0x7fed341606a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:15.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.838+0000 7fed3a600640 1 --2- 172.21.15.131:0/2723124455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed34163c90 0x7fed341606a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fed20009870 tx=0x7fed2002a1c0 comp rx=0 tx=0).stop 2024-04-25T19:31:15.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.838+0000 7fed3a600640 1 -- 172.21.15.131:0/2723124455 shutdown_connections 2024-04-25T19:31:15.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.838+0000 7fed3a600640 1 --2- 172.21.15.131:0/2723124455 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed3406d5d0 0x7fed3406d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:15.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.838+0000 7fed3a600640 1 --2- 172.21.15.131:0/2723124455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed34163c90 0x7fed341606a0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:15.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.838+0000 7fed3a600640 1 -- 172.21.15.131:0/2723124455 >> 172.21.15.131:0/2723124455 conn(0x7fed34072f40 msgr2=0x7fed34073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:15.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.838+0000 7fed3a600640 1 -- 172.21.15.131:0/2723124455 shutdown_connections 2024-04-25T19:31:15.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.838+0000 7fed3a600640 1 -- 172.21.15.131:0/2723124455 wait complete. 2024-04-25T19:31:15.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.840+0000 7fed3a600640 1 Processor -- start 2024-04-25T19:31:15.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.840+0000 7fed3a600640 1 -- start start 2024-04-25T19:31:15.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.842+0000 7fed3a600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed3406d5d0 0x7fed3414a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:15.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.842+0000 7fed3a600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed3415de90 0x7fed341f7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:15.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.842+0000 7fed3a600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed34163c90 0x7fed340c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:15.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.842+0000 7fed3a600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fed34070d30 con 0x7fed3415de90 2024-04-25T19:31:15.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.842+0000 7fed3a600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fed34161520 con 0x7fed3406d5d0 2024-04-25T19:31:15.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.842+0000 7fed3a600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fed34070eb0 con 0x7fed34163c90 2024-04-25T19:31:15.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.842+0000 7fed33e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed3415de90 0x7fed341f7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:15.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.842+0000 7fed33e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed3415de90 0x7fed341f7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57176/0 (socket says 172.21.15.131:57176) 2024-04-25T19:31:15.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.842+0000 7fed33e00640 1 -- 172.21.15.131:0/1425536861 learned_addr learned my addr 172.21.15.131:0/1425536861 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:15.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.843+0000 7fed39200640 1 --2- 172.21.15.131:0/1425536861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed3406d5d0 0x7fed3414a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:15.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.843+0000 7fed39c00640 1 --2- 172.21.15.131:0/1425536861 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed34163c90 0x7fed340c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:15.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.843+0000 7fed33e00640 1 -- 172.21.15.131:0/1425536861 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed34163c90 msgr2=0x7fed340c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:15.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.843+0000 7fed33e00640 1 --2- 172.21.15.131:0/1425536861 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed34163c90 0x7fed340c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:15.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.843+0000 7fed33e00640 1 -- 172.21.15.131:0/1425536861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed3406d5d0 msgr2=0x7fed3414a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:15.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.843+0000 7fed33e00640 1 --2- 172.21.15.131:0/1425536861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed3406d5d0 0x7fed3414a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:15.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.843+0000 7fed33e00640 1 -- 172.21.15.131:0/1425536861 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed341f7980 con 0x7fed3415de90 2024-04-25T19:31:15.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.843+0000 7fed39c00640 1 --2- 172.21.15.131:0/1425536861 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed34163c90 0x7fed340c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:31:15.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.843+0000 7fed33e00640 1 --2- 172.21.15.131:0/1425536861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed3415de90 0x7fed341f7440 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fed20009870 tx=0x7fed200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:15.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.844+0000 7fed30c00640 1 -- 172.21.15.131:0/1425536861 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed20041070 con 0x7fed3415de90 2024-04-25T19:31:15.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.844+0000 7fed30c00640 1 -- 172.21.15.131:0/1425536861 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed2003c870 con 0x7fed3415de90 2024-04-25T19:31:15.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.844+0000 7fed30c00640 1 -- 172.21.15.131:0/1425536861 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed20037040 con 0x7fed3415de90 2024-04-25T19:31:15.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.844+0000 7fed3a600640 1 -- 172.21.15.131:0/1425536861 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed341605b0 con 0x7fed3415de90 2024-04-25T19:31:15.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.844+0000 7fed3a600640 1 -- 172.21.15.131:0/1425536861 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed341f6c40 con 0x7fed3415de90 2024-04-25T19:31:15.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.845+0000 7fed3a600640 1 -- 172.21.15.131:0/1425536861 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fed34076c60 con 0x7fed3415de90 2024-04-25T19:31:15.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.846+0000 7fed30c00640 1 -- 172.21.15.131:0/1425536861 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fed20044070 con 0x7fed3415de90 2024-04-25T19:31:15.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.847+0000 7fed30c00640 1 --2- 172.21.15.131:0/1425536861 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fed140744e0 0x7fed140769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:15.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.847+0000 7fed30c00640 1 -- 172.21.15.131:0/1425536861 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7fed200b5ee0 con 0x7fed3415de90 2024-04-25T19:31:15.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.847+0000 7fed30c00640 1 --2- 172.21.15.131:0/1425536861 >> [v2:172.21.15.131:6822/182543209,v1:172.21.15.131:6824/182543209] conn(0x7fed1407a3f0 0x7fed1407c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:15.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.847+0000 7fed30c00640 1 -- 172.21.15.131:0/1425536861 --> [v2:172.21.15.131:6822/182543209,v1:172.21.15.131:6824/182543209] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fed20032440 con 0x7fed1407a3f0 2024-04-25T19:31:15.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.847+0000 7fed30c00640 1 -- 172.21.15.131:0/1425536861 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fed200b6290 con 0x7fed3415de90 2024-04-25T19:31:15.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.848+0000 7fed39c00640 1 --2- 172.21.15.131:0/1425536861 >> [v2:172.21.15.131:6822/182543209,v1:172.21.15.131:6824/182543209] conn(0x7fed1407a3f0 0x7fed1407c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:15.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.848+0000 7fed39200640 1 --2- 172.21.15.131:0/1425536861 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fed140744e0 0x7fed140769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:15.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.848+0000 7fed39c00640 1 --2- 172.21.15.131:0/1425536861 >> [v2:172.21.15.131:6822/182543209,v1:172.21.15.131:6824/182543209] conn(0x7fed1407a3f0 0x7fed1407c840 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:15.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.849+0000 7fed39200640 1 --2- 172.21.15.131:0/1425536861 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fed140744e0 0x7fed140769f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fed340b7880 tx=0x7fed28009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:15.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.849+0000 7fed30c00640 1 -- 172.21.15.131:0/1425536861 <== osd.0 v2:172.21.15.131:6822/182543209 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fed20032440 con 0x7fed1407a3f0 2024-04-25T19:31:15.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.863+0000 7fed3a600640 1 -- 172.21.15.131:0/1425536861 --> [v2:172.21.15.131:6822/182543209,v1:172.21.15.131:6824/182543209] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fed34160360 con 0x7fed1407a3f0 2024-04-25T19:31:15.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.864+0000 7fed30c00640 1 -- 172.21.15.131:0/1425536861 <== osd.0 v2:172.21.15.131:6822/182543209 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fed34160360 con 0x7fed1407a3f0 2024-04-25T19:31:15.864 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-25T19:31:15.864 INFO:teuthology.orchestra.run.smithi131.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T19:31:15.864 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-25T19:31:15.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.864+0000 7fed3a600640 1 -- 172.21.15.131:0/1425536861 >> [v2:172.21.15.131:6822/182543209,v1:172.21.15.131:6824/182543209] conn(0x7fed1407a3f0 msgr2=0x7fed1407c840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:15.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.864+0000 7fed3a600640 1 --2- 172.21.15.131:0/1425536861 >> [v2:172.21.15.131:6822/182543209,v1:172.21.15.131:6824/182543209] conn(0x7fed1407a3f0 0x7fed1407c840 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:15.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.864+0000 7fed3a600640 1 -- 172.21.15.131:0/1425536861 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fed140744e0 msgr2=0x7fed140769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:15.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.864+0000 7fed3a600640 1 --2- 172.21.15.131:0/1425536861 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fed140744e0 0x7fed140769f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fed340b7880 tx=0x7fed28009040 comp rx=0 tx=0).stop 2024-04-25T19:31:15.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.865+0000 7fed3a600640 1 -- 172.21.15.131:0/1425536861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed3415de90 msgr2=0x7fed341f7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:15.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.865+0000 7fed3a600640 1 --2- 172.21.15.131:0/1425536861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed3415de90 0x7fed341f7440 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fed20009870 tx=0x7fed200046c0 comp rx=0 tx=0).stop 2024-04-25T19:31:15.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.865+0000 7fed39c00640 1 -- 172.21.15.131:0/1425536861 reap_dead start 2024-04-25T19:31:15.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.865+0000 7fed3a600640 1 -- 172.21.15.131:0/1425536861 shutdown_connections 2024-04-25T19:31:15.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.865+0000 7fed3a600640 1 -- 172.21.15.131:0/1425536861 >> 172.21.15.131:0/1425536861 conn(0x7fed34072f40 msgr2=0x7fed340688a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:15.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.865+0000 7fed3a600640 1 -- 172.21.15.131:0/1425536861 shutdown_connections 2024-04-25T19:31:15.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:15.865+0000 7fed3a600640 1 -- 172.21.15.131:0/1425536861 wait complete. 2024-04-25T19:31:15.890 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T19:31:16.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.164+0000 7f4603000640 1 Processor -- start 2024-04-25T19:31:16.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.164+0000 7f4603000640 1 -- start start 2024-04-25T19:31:16.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.166+0000 7f4603000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f45fc0b5e40 0x7f45fc0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:16.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.166+0000 7f4603000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45fc06c5c0 0x7f45fc06c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:16.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.166+0000 7f4603000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45fc0b6790 con 0x7f45fc14ad60 2024-04-25T19:31:16.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.166+0000 7f4603000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f45fc0b4af0 con 0x7f45fc0b5e40 2024-04-25T19:31:16.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.166+0000 7f4603000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f45fc0b4dd0 con 0x7f45fc06c5c0 2024-04-25T19:31:16.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.167+0000 7f45fb400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f45fc0b5e40 0x7f45fc0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:16.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.167+0000 7f45fb400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f45fc0b5e40 0x7f45fc0b6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57188/0 (socket says 172.21.15.131:57188) 2024-04-25T19:31:16.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.167+0000 7f45fb400640 1 -- 172.21.15.131:0/4069730839 learned_addr learned my addr 172.21.15.131:0/4069730839 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:16.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.167+0000 7f4601000640 1 --2- 172.21.15.131:0/4069730839 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45fc06c5c0 0x7f45fc06c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:16.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.167+0000 7f45fb400640 1 -- 172.21.15.131:0/4069730839 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45fc06c5c0 msgr2=0x7f45fc06c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:16.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.167+0000 7f45fb400640 1 --2- 172.21.15.131:0/4069730839 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45fc06c5c0 0x7f45fc06c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:16.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.167+0000 7f45fb400640 1 -- 172.21.15.131:0/4069730839 >> v1:172.21.15.195:6789/0 conn(0x7f45fc14ad60 legacy=0x7f45fc070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:16.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.167+0000 7f45fb400640 1 -- 172.21.15.131:0/4069730839 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45fc0b50b0 con 0x7f45fc0b5e40 2024-04-25T19:31:16.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.168+0000 7f45fb400640 1 --2- 172.21.15.131:0/4069730839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45fc0b5e40 0x7f45fc0b6250 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f45e4009870 tx=0x7f45e402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d74a27d32dd90a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:16.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.169+0000 7f45faa00640 1 -- 172.21.15.131:0/4069730839 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e4037070 con 0x7f45fc0b5e40 2024-04-25T19:31:16.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.169+0000 7f45faa00640 1 -- 172.21.15.131:0/4069730839 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e4032440 con 0x7f45fc0b5e40 2024-04-25T19:31:16.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.169+0000 7f45faa00640 1 -- 172.21.15.131:0/4069730839 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e4032810 con 0x7f45fc0b5e40 2024-04-25T19:31:16.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.169+0000 7f4603000640 1 -- 172.21.15.131:0/4069730839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45fc0b5e40 msgr2=0x7f45fc0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:16.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.169+0000 7f4603000640 1 --2- 172.21.15.131:0/4069730839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45fc0b5e40 0x7f45fc0b6250 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f45e4009870 tx=0x7f45e402a210 comp rx=0 tx=0).stop 2024-04-25T19:31:16.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.170+0000 7f4603000640 1 -- 172.21.15.131:0/4069730839 shutdown_connections 2024-04-25T19:31:16.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.170+0000 7f4603000640 1 --2- 172.21.15.131:0/4069730839 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45fc06c5c0 0x7f45fc06c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:16.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.170+0000 7f4603000640 1 --2- 172.21.15.131:0/4069730839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45fc0b5e40 0x7f45fc0b6250 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:16.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.170+0000 7f4603000640 1 -- 172.21.15.131:0/4069730839 >> 172.21.15.131:0/4069730839 conn(0x7f45fc0d1ae0 msgr2=0x7f45fc0d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:16.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.170+0000 7f4603000640 1 -- 172.21.15.131:0/4069730839 shutdown_connections 2024-04-25T19:31:16.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.170+0000 7f4603000640 1 -- 172.21.15.131:0/4069730839 wait complete. 2024-04-25T19:31:16.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.172+0000 7f4603000640 1 Processor -- start 2024-04-25T19:31:16.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.172+0000 7f4603000640 1 -- start start 2024-04-25T19:31:16.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.174+0000 7f4603000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45fc06c5c0 0x7f45fc15ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:16.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.174+0000 7f4603000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45fc0b5e40 0x7f45fc15b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:16.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.174+0000 7f4603000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45fc14ad60 0x7f45fc0d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:16.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.174+0000 7f4603000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc06fb80 con 0x7f45fc0b5e40 2024-04-25T19:31:16.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.174+0000 7f4603000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc0b5670 con 0x7f45fc06c5c0 2024-04-25T19:31:16.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.174+0000 7f4603000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f45fc06fd00 con 0x7f45fc14ad60 2024-04-25T19:31:16.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.174+0000 7f45fb400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45fc0b5e40 0x7f45fc15b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:16.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.174+0000 7f45fb400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45fc0b5e40 0x7f45fc15b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57198/0 (socket says 172.21.15.131:57198) 2024-04-25T19:31:16.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.174+0000 7f45fb400640 1 -- 172.21.15.131:0/1155344823 learned_addr learned my addr 172.21.15.131:0/1155344823 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:16.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.174+0000 7f4601000640 1 --2- 172.21.15.131:0/1155344823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45fc14ad60 0x7f45fc0d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:16.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.174+0000 7f45fb400640 1 -- 172.21.15.131:0/1155344823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45fc14ad60 msgr2=0x7f45fc0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:16.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.174+0000 7f45fb400640 1 --2- 172.21.15.131:0/1155344823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45fc14ad60 0x7f45fc0d03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:16.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.174+0000 7f45fb400640 1 -- 172.21.15.131:0/1155344823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45fc06c5c0 msgr2=0x7f45fc15ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:16.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.174+0000 7f45fbe00640 1 --2- 172.21.15.131:0/1155344823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45fc06c5c0 0x7f45fc15ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:16.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.174+0000 7f45fb400640 1 --2- 172.21.15.131:0/1155344823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45fc06c5c0 0x7f45fc15ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:16.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.174+0000 7f45fb400640 1 -- 172.21.15.131:0/1155344823 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45fc15baf0 con 0x7f45fc0b5e40 2024-04-25T19:31:16.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.175+0000 7f45fb400640 1 --2- 172.21.15.131:0/1155344823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45fc0b5e40 0x7f45fc15b5b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f45e402a780 tx=0x7f45e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:16.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.175+0000 7f45f3e00640 1 -- 172.21.15.131:0/1155344823 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e4041020 con 0x7f45fc0b5e40 2024-04-25T19:31:16.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.175+0000 7f45f3e00640 1 -- 172.21.15.131:0/1155344823 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e40306c0 con 0x7f45fc0b5e40 2024-04-25T19:31:16.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.175+0000 7f45f3e00640 1 -- 172.21.15.131:0/1155344823 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e4037040 con 0x7f45fc0b5e40 2024-04-25T19:31:16.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.175+0000 7f4603000640 1 -- 172.21.15.131:0/1155344823 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45fc15d350 con 0x7f45fc0b5e40 2024-04-25T19:31:16.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.175+0000 7f4603000640 1 -- 172.21.15.131:0/1155344823 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45fc15d910 con 0x7f45fc0b5e40 2024-04-25T19:31:16.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.176+0000 7f4603000640 1 -- 172.21.15.131:0/1155344823 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45fc050740 con 0x7f45fc0b5e40 2024-04-25T19:31:16.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.178+0000 7f45f3e00640 1 -- 172.21.15.131:0/1155344823 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f45e4044020 con 0x7f45fc0b5e40 2024-04-25T19:31:16.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.179+0000 7f45f3e00640 1 --2- 172.21.15.131:0/1155344823 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f45d80744b0 0x7f45d80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:16.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.179+0000 7f45f3e00640 1 -- 172.21.15.131:0/1155344823 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f45e40b5fc0 con 0x7f45fc0b5e40 2024-04-25T19:31:16.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.179+0000 7f45fbe00640 1 --2- 172.21.15.131:0/1155344823 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f45d80744b0 0x7f45d80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:16.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.181+0000 7f45fbe00640 1 --2- 172.21.15.131:0/1155344823 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f45d80744b0 0x7f45d80769c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f45fc0b1590 tx=0x7f45ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:16.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.187+0000 7f45f3e00640 1 -- 172.21.15.131:0/1155344823 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f45e404b030 con 0x7f45fc0b5e40 2024-04-25T19:31:16.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.388+0000 7f4603000640 1 -- 172.21.15.131:0/1155344823 --> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f45fc0b3430 con 0x7f45d80744b0 2024-04-25T19:31:16.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.389+0000 7f45f3e00640 1 -- 172.21.15.131:0/1155344823 <== mgr.4105 v2:172.21.15.195:6832/2541913764 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f45fc0b3430 con 0x7f45d80744b0 2024-04-25T19:31:16.390 INFO:teuthology.orchestra.run.smithi131.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T19:31:16.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.392+0000 7f4603000640 1 -- 172.21.15.131:0/1155344823 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f45d80744b0 msgr2=0x7f45d80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:16.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.392+0000 7f4603000640 1 --2- 172.21.15.131:0/1155344823 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f45d80744b0 0x7f45d80769c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f45fc0b1590 tx=0x7f45ec008040 comp rx=0 tx=0).stop 2024-04-25T19:31:16.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.392+0000 7f4603000640 1 -- 172.21.15.131:0/1155344823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45fc0b5e40 msgr2=0x7f45fc15b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:16.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.392+0000 7f4603000640 1 --2- 172.21.15.131:0/1155344823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45fc0b5e40 0x7f45fc15b5b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f45e402a780 tx=0x7f45e40046c0 comp rx=0 tx=0).stop 2024-04-25T19:31:16.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.392+0000 7f4603000640 1 -- 172.21.15.131:0/1155344823 shutdown_connections 2024-04-25T19:31:16.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.392+0000 7f4603000640 1 --2- 172.21.15.131:0/1155344823 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f45d80744b0 0x7f45d80769c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:16.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.392+0000 7f4603000640 1 --2- 172.21.15.131:0/1155344823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45fc14ad60 0x7f45fc0d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:16.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.392+0000 7f4603000640 1 --2- 172.21.15.131:0/1155344823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45fc0b5e40 0x7f45fc15b5b0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:16.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.392+0000 7f4603000640 1 --2- 172.21.15.131:0/1155344823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45fc06c5c0 0x7f45fc15ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:16.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.392+0000 7f4603000640 1 -- 172.21.15.131:0/1155344823 >> 172.21.15.131:0/1155344823 conn(0x7f45fc0d1ae0 msgr2=0x7f45fc164c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:16.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.392+0000 7f4603000640 1 -- 172.21.15.131:0/1155344823 shutdown_connections 2024-04-25T19:31:16.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.392+0000 7f4603000640 1 -- 172.21.15.131:0/1155344823 wait complete. 2024-04-25T19:31:16.418 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T19:31:16.418 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T19:31:16.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.695+0000 7ff8db200640 1 Processor -- start 2024-04-25T19:31:16.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.695+0000 7ff8db200640 1 -- start start 2024-04-25T19:31:16.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.697+0000 7ff8db200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff8dc15e180 0x7ff8dc161c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:16.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.697+0000 7ff8db200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8dc0d1470 0x7ff8dc0d22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:16.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.697+0000 7ff8db200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8dc162150 con 0x7ff8dc0d1880 2024-04-25T19:31:16.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.697+0000 7ff8db200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7ff8dc0b84b0 con 0x7ff8dc15e180 2024-04-25T19:31:16.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.697+0000 7ff8db200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff8dc0d4420 con 0x7ff8dc0d1470 2024-04-25T19:31:16.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.697+0000 7ff8da800640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7ff8dc0d1880 0x7ff8dc160e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46584/0 (socket says 172.21.15.131:46584) 2024-04-25T19:31:16.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.698+0000 7ff8da800640 1 -- 172.21.15.131:0/862952786 learned_addr learned my addr 172.21.15.131:0/862952786 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:31:16.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.698+0000 7ff8d9e00640 1 --2- 172.21.15.131:0/862952786 >> v2:172.21.15.195:3300/0 conn(0x7ff8dc15e180 0x7ff8dc161c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:16.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.698+0000 7ff8d9400640 1 --2- 172.21.15.131:0/862952786 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8dc0d1470 0x7ff8dc0d22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:16.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.698+0000 7ff8d8a00640 1 -- 172.21.15.131:0/862952786 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2608465566 0 0) 0x7ff8dc162150 con 0x7ff8dc0d1880 2024-04-25T19:31:16.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.698+0000 7ff8d8a00640 1 -- 172.21.15.131:0/862952786 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8bc003520 con 0x7ff8dc0d1880 2024-04-25T19:31:16.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.698+0000 7ff8d8a00640 1 -- 172.21.15.131:0/862952786 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2150964306 0 0) 0x7ff8bc003520 con 0x7ff8dc0d1880 2024-04-25T19:31:16.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.698+0000 7ff8d8a00640 1 -- 172.21.15.131:0/862952786 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8dc0d1470 msgr2=0x7ff8dc0d22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:16.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.698+0000 7ff8d8a00640 1 --2- 172.21.15.131:0/862952786 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8dc0d1470 0x7ff8dc0d22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:16.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.698+0000 7ff8d8a00640 1 -- 172.21.15.131:0/862952786 >> v2:172.21.15.195:3300/0 conn(0x7ff8dc15e180 msgr2=0x7ff8dc161c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:16.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.698+0000 7ff8d8a00640 1 --2- 172.21.15.131:0/862952786 >> v2:172.21.15.195:3300/0 conn(0x7ff8dc15e180 0x7ff8dc161c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:16.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.698+0000 7ff8d8a00640 1 -- 172.21.15.131:0/862952786 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8dc0b7930 con 0x7ff8dc0d1880 2024-04-25T19:31:16.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.698+0000 7ff8d8a00640 1 -- 172.21.15.131:0/862952786 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7ff8d4001670 con 0x7ff8dc0d1880 2024-04-25T19:31:16.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.698+0000 7ff8d8a00640 1 -- 172.21.15.131:0/862952786 >> v1:172.21.15.131:6789/0 conn(0x7ff8dc0d1880 legacy=0x7ff8dc160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:16.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.699+0000 7ff8d8a00640 1 --2- 172.21.15.131:0/862952786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8bc0039b0 0x7ff8bc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:16.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.699+0000 7ff8d8a00640 1 --2- 172.21.15.131:0/862952786 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8bc004800 0x7ff8bc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:16.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.699+0000 7ff8d8a00640 1 --2- 172.21.15.131:0/862952786 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8dc0d1470 0x7ff8bc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:16.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.699+0000 7ff8d8a00640 1 -- 172.21.15.131:0/862952786 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff8dc0b84b0 con 0x7ff8bc0039b0 2024-04-25T19:31:16.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.699+0000 7ff8d8a00640 1 -- 172.21.15.131:0/862952786 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff8dc0d4420 con 0x7ff8bc004800 2024-04-25T19:31:16.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.699+0000 7ff8d8a00640 1 -- 172.21.15.131:0/862952786 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff8bc00bb80 con 0x7ff8dc0d1470 2024-04-25T19:31:16.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.699+0000 7ff8d9e00640 1 --2- 172.21.15.131:0/862952786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8bc0039b0 0x7ff8bc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:16.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.699+0000 7ff8d9e00640 1 -- 172.21.15.131:0/862952786 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8dc0d1470 msgr2=0x7ff8bc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:16.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.699+0000 7ff8d9e00640 1 --2- 172.21.15.131:0/862952786 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8dc0d1470 0x7ff8bc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:16.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.699+0000 7ff8d9e00640 1 -- 172.21.15.131:0/862952786 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8bc004800 msgr2=0x7ff8bc004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:16.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.699+0000 7ff8d9e00640 1 --2- 172.21.15.131:0/862952786 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8bc004800 0x7ff8bc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:16.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.699+0000 7ff8d9e00640 1 -- 172.21.15.131:0/862952786 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8bc003520 con 0x7ff8bc0039b0 2024-04-25T19:31:16.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.700+0000 7ff8d9e00640 1 --2- 172.21.15.131:0/862952786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8bc0039b0 0x7ff8bc003e20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0d1230 tx=0x7ff8bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=998492b73768b88f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:16.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.700+0000 7ff8d8a00640 1 -- 172.21.15.131:0/862952786 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc030070 con 0x7ff8bc0039b0 2024-04-25T19:31:16.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.700+0000 7ff8d8a00640 1 -- 172.21.15.131:0/862952786 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8cc02adb0 con 0x7ff8bc0039b0 2024-04-25T19:31:16.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.700+0000 7ff8d8a00640 1 -- 172.21.15.131:0/862952786 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc00b610 con 0x7ff8bc0039b0 2024-04-25T19:31:16.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.701+0000 7ff8db200640 1 -- 172.21.15.131:0/862952786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8bc0039b0 msgr2=0x7ff8bc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:16.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.701+0000 7ff8db200640 1 --2- 172.21.15.131:0/862952786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8bc0039b0 0x7ff8bc003e20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0d1230 tx=0x7ff8bc005830 comp rx=0 tx=0).stop 2024-04-25T19:31:16.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.701+0000 7ff8da800640 1 -- 172.21.15.131:0/862952786 reap_dead start 2024-04-25T19:31:16.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.701+0000 7ff8db200640 1 -- 172.21.15.131:0/862952786 shutdown_connections 2024-04-25T19:31:16.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.701+0000 7ff8db200640 1 -- 172.21.15.131:0/862952786 >> 172.21.15.131:0/862952786 conn(0x7ff8dc06dc30 msgr2=0x7ff8dc06e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:16.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.701+0000 7ff8db200640 1 -- 172.21.15.131:0/862952786 shutdown_connections 2024-04-25T19:31:16.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.701+0000 7ff8db200640 1 -- 172.21.15.131:0/862952786 wait complete. 2024-04-25T19:31:16.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.704+0000 7ff8db200640 1 Processor -- start 2024-04-25T19:31:16.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.704+0000 7ff8db200640 1 -- start start 2024-04-25T19:31:16.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.705+0000 7ff8db200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8bc0039b0 0x7ff8dc14ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:16.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.705+0000 7ff8db200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8dc1e8bf0 0x7ff8dc1e9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:16.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.705+0000 7ff8db200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8dc1e9540 0x7ff8dc1f7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:16.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.705+0000 7ff8db200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff8dc0b81d0 con 0x7ff8bc0039b0 2024-04-25T19:31:16.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.705+0000 7ff8db200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff8dc0b7ef0 con 0x7ff8dc1e9540 2024-04-25T19:31:16.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.705+0000 7ff8db200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff8dc0b75e0 con 0x7ff8dc1e8bf0 2024-04-25T19:31:16.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.706+0000 7ff8d9e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8bc0039b0 0x7ff8dc14ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:16.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.706+0000 7ff8d9e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8bc0039b0 0x7ff8dc14ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57224/0 (socket says 172.21.15.131:57224) 2024-04-25T19:31:16.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.706+0000 7ff8d9e00640 1 -- 172.21.15.131:0/3517182207 learned_addr learned my addr 172.21.15.131:0/3517182207 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:16.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.706+0000 7ff8d9400640 1 --2- 172.21.15.131:0/3517182207 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8dc1e8bf0 0x7ff8dc1e9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:16.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.706+0000 7ff8d9e00640 1 -- 172.21.15.131:0/3517182207 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8dc1e8bf0 msgr2=0x7ff8dc1e9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:16.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.706+0000 7ff8d9e00640 1 --2- 172.21.15.131:0/3517182207 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8dc1e8bf0 0x7ff8dc1e9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:16.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.706+0000 7ff8d9e00640 1 -- 172.21.15.131:0/3517182207 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8dc1e9540 msgr2=0x7ff8dc1f7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:16.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.706+0000 7ff8d9e00640 1 --2- 172.21.15.131:0/3517182207 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8dc1e9540 0x7ff8dc1f7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:16.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.706+0000 7ff8d9e00640 1 -- 172.21.15.131:0/3517182207 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8dc14f4d0 con 0x7ff8bc0039b0 2024-04-25T19:31:16.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.706+0000 7ff8d9e00640 1 --2- 172.21.15.131:0/3517182207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8bc0039b0 0x7ff8dc14ef90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc02a8a0 tx=0x7ff8cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:16.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.707+0000 7ff8d2000640 1 -- 172.21.15.131:0/3517182207 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc043020 con 0x7ff8bc0039b0 2024-04-25T19:31:16.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.707+0000 7ff8d2000640 1 -- 172.21.15.131:0/3517182207 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8cc03f680 con 0x7ff8bc0039b0 2024-04-25T19:31:16.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.707+0000 7ff8d2000640 1 -- 172.21.15.131:0/3517182207 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc00b610 con 0x7ff8bc0039b0 2024-04-25T19:31:16.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.707+0000 7ff8db200640 1 -- 172.21.15.131:0/3517182207 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8dc1f6b10 con 0x7ff8bc0039b0 2024-04-25T19:31:16.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.707+0000 7ff8db200640 1 -- 172.21.15.131:0/3517182207 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8dc1f70d0 con 0x7ff8bc0039b0 2024-04-25T19:31:16.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.708+0000 7ff8db200640 1 -- 172.21.15.131:0/3517182207 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff8dc076c60 con 0x7ff8bc0039b0 2024-04-25T19:31:16.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.709+0000 7ff8d2000640 1 -- 172.21.15.131:0/3517182207 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff8cc046020 con 0x7ff8bc0039b0 2024-04-25T19:31:16.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.710+0000 7ff8d2000640 1 --2- 172.21.15.131:0/3517182207 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff8b80744e0 0x7ff8b80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:16.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.710+0000 7ff8d2000640 1 -- 172.21.15.131:0/3517182207 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7ff8cc0b61b0 con 0x7ff8bc0039b0 2024-04-25T19:31:16.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.710+0000 7ff8d2000640 1 --2- 172.21.15.131:0/3517182207 >> [v2:172.21.15.131:6808/2785914367,v1:172.21.15.131:6809/2785914367] conn(0x7ff8b807a3f0 0x7ff8b807c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:16.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.710+0000 7ff8d2000640 1 -- 172.21.15.131:0/3517182207 --> [v2:172.21.15.131:6808/2785914367,v1:172.21.15.131:6809/2785914367] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff8cc041e50 con 0x7ff8b807a3f0 2024-04-25T19:31:16.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.710+0000 7ff8d2000640 1 -- 172.21.15.131:0/3517182207 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7ff8cc0b6560 con 0x7ff8bc0039b0 2024-04-25T19:31:16.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.711+0000 7ff8da800640 1 --2- 172.21.15.131:0/3517182207 >> [v2:172.21.15.131:6808/2785914367,v1:172.21.15.131:6809/2785914367] conn(0x7ff8b807a3f0 0x7ff8b807c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:16.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.711+0000 7ff8d9400640 1 --2- 172.21.15.131:0/3517182207 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff8b80744e0 0x7ff8b80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:16.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.711+0000 7ff8da800640 1 --2- 172.21.15.131:0/3517182207 >> [v2:172.21.15.131:6808/2785914367,v1:172.21.15.131:6809/2785914367] conn(0x7ff8b807a3f0 0x7ff8b807c840 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:16.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.712+0000 7ff8d9400640 1 --2- 172.21.15.131:0/3517182207 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff8b80744e0 0x7ff8b80769f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009670 tx=0x7ff8c400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:16.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.712+0000 7ff8d2000640 1 -- 172.21.15.131:0/3517182207 <== osd.1 v2:172.21.15.131:6808/2785914367 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff8cc041e50 con 0x7ff8b807a3f0 2024-04-25T19:31:16.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.726+0000 7ff8db200640 1 -- 172.21.15.131:0/3517182207 --> [v2:172.21.15.131:6808/2785914367,v1:172.21.15.131:6809/2785914367] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff8dc0d0fe0 con 0x7ff8b807a3f0 2024-04-25T19:31:16.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.727+0000 7ff8d2000640 1 -- 172.21.15.131:0/3517182207 <== osd.1 v2:172.21.15.131:6808/2785914367 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff8dc0d0fe0 con 0x7ff8b807a3f0 2024-04-25T19:31:16.728 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-25T19:31:16.728 INFO:teuthology.orchestra.run.smithi131.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T19:31:16.728 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-25T19:31:16.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.727+0000 7ff8db200640 1 -- 172.21.15.131:0/3517182207 >> [v2:172.21.15.131:6808/2785914367,v1:172.21.15.131:6809/2785914367] conn(0x7ff8b807a3f0 msgr2=0x7ff8b807c840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:16.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.727+0000 7ff8db200640 1 --2- 172.21.15.131:0/3517182207 >> [v2:172.21.15.131:6808/2785914367,v1:172.21.15.131:6809/2785914367] conn(0x7ff8b807a3f0 0x7ff8b807c840 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:16.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.728+0000 7ff8db200640 1 -- 172.21.15.131:0/3517182207 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff8b80744e0 msgr2=0x7ff8b80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:16.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.728+0000 7ff8db200640 1 --2- 172.21.15.131:0/3517182207 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7ff8b80744e0 0x7ff8b80769f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009670 tx=0x7ff8c400b040 comp rx=0 tx=0).stop 2024-04-25T19:31:16.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.728+0000 7ff8db200640 1 -- 172.21.15.131:0/3517182207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8bc0039b0 msgr2=0x7ff8dc14ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:16.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.728+0000 7ff8db200640 1 --2- 172.21.15.131:0/3517182207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8bc0039b0 0x7ff8dc14ef90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc02a8a0 tx=0x7ff8cc004730 comp rx=0 tx=0).stop 2024-04-25T19:31:16.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.728+0000 7ff8da800640 1 -- 172.21.15.131:0/3517182207 reap_dead start 2024-04-25T19:31:16.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.728+0000 7ff8db200640 1 -- 172.21.15.131:0/3517182207 shutdown_connections 2024-04-25T19:31:16.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.728+0000 7ff8db200640 1 -- 172.21.15.131:0/3517182207 >> 172.21.15.131:0/3517182207 conn(0x7ff8dc06dc30 msgr2=0x7ff8dc0d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:16.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.728+0000 7ff8db200640 1 -- 172.21.15.131:0/3517182207 shutdown_connections 2024-04-25T19:31:16.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:16.728+0000 7ff8db200640 1 -- 172.21.15.131:0/3517182207 wait complete. 2024-04-25T19:31:16.754 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T19:31:17.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.019+0000 7f1089800640 1 Processor -- start 2024-04-25T19:31:17.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.019+0000 7f1089800640 1 -- start start 2024-04-25T19:31:17.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.021+0000 7f1089800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f10840cf5e0 0x7f10840cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:17.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.021+0000 7f1089800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f108406c5c0 0x7f108406c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:17.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.021+0000 7f1089800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10840cff30 con 0x7f10841443c0 2024-04-25T19:31:17.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.021+0000 7f1089800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f10840708d0 con 0x7f108406c5c0 2024-04-25T19:31:17.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.021+0000 7f1089800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f108415f160 con 0x7f10840cf5e0 2024-04-25T19:31:17.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.022+0000 7f1083400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f108406c5c0 0x7f108406c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:17.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.022+0000 7f1083400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f108406c5c0 0x7f108406c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57230/0 (socket says 172.21.15.131:57230) 2024-04-25T19:31:17.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.022+0000 7f1083400640 1 -- 172.21.15.131:0/751056201 learned_addr learned my addr 172.21.15.131:0/751056201 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:17.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.022+0000 7f1082000640 1 --2- 172.21.15.131:0/751056201 >> v2:172.21.15.195:3300/0 conn(0x7f10840cf5e0 0x7f10840cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:17.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.022+0000 7f1083400640 1 -- 172.21.15.131:0/751056201 >> v2:172.21.15.195:3300/0 conn(0x7f10840cf5e0 msgr2=0x7f10840cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:17.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.023+0000 7f1083400640 1 --2- 172.21.15.131:0/751056201 >> v2:172.21.15.195:3300/0 conn(0x7f10840cf5e0 0x7f10840cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:17.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.023+0000 7f1083400640 1 -- 172.21.15.131:0/751056201 >> v1:172.21.15.131:6789/0 conn(0x7f10841443c0 legacy=0x7f108406fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:17.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.023+0000 7f1083400640 1 -- 172.21.15.131:0/751056201 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f108415f5f0 con 0x7f108406c5c0 2024-04-25T19:31:17.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.023+0000 7f1081600640 1 -- 172.21.15.131:0/751056201 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1184507872 0 0) 0x7f1074001110 con 0x7f10841443c0 2024-04-25T19:31:17.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.024+0000 7f1083400640 1 --2- 172.21.15.131:0/751056201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f108406c5c0 0x7f108406c9d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f108406f8f0 tx=0x7f107c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c302c618ca379b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:17.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.024+0000 7f1081600640 1 -- 172.21.15.131:0/751056201 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c036070 con 0x7f108406c5c0 2024-04-25T19:31:17.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.024+0000 7f1081600640 1 -- 172.21.15.131:0/751056201 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107c031600 con 0x7f108406c5c0 2024-04-25T19:31:17.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.024+0000 7f1081600640 1 -- 172.21.15.131:0/751056201 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c0319d0 con 0x7f108406c5c0 2024-04-25T19:31:17.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.025+0000 7f1089800640 1 -- 172.21.15.131:0/751056201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f108406c5c0 msgr2=0x7f108406c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:17.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.025+0000 7f1089800640 1 --2- 172.21.15.131:0/751056201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f108406c5c0 0x7f108406c9d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f108406f8f0 tx=0x7f107c02a730 comp rx=0 tx=0).stop 2024-04-25T19:31:17.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.025+0000 7f1089800640 1 -- 172.21.15.131:0/751056201 shutdown_connections 2024-04-25T19:31:17.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.025+0000 7f1089800640 1 --2- 172.21.15.131:0/751056201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f108406c5c0 0x7f108406c9d0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:17.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.025+0000 7f1089800640 1 --2- 172.21.15.131:0/751056201 >> v2:172.21.15.195:3300/0 conn(0x7f10840cf5e0 0x7f10840cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:17.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.025+0000 7f1089800640 1 -- 172.21.15.131:0/751056201 >> 172.21.15.131:0/751056201 conn(0x7f10840d1ae0 msgr2=0x7f10840d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:17.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.025+0000 7f1089800640 1 -- 172.21.15.131:0/751056201 shutdown_connections 2024-04-25T19:31:17.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.025+0000 7f1089800640 1 -- 172.21.15.131:0/751056201 wait complete. 2024-04-25T19:31:17.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.027+0000 7f1089800640 1 Processor -- start 2024-04-25T19:31:17.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.028+0000 7f1089800640 1 -- start start 2024-04-25T19:31:17.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.029+0000 7f1089800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f108406c5c0 0x7f10840afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:17.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.029+0000 7f1089800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10840cf5e0 0x7f10841f82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:17.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.029+0000 7f1089800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10841443c0 0x7f1084143010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:17.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.029+0000 7f1089800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f108415edf0 con 0x7f10841443c0 2024-04-25T19:31:17.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.029+0000 7f1089800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f108415eb10 con 0x7f10840cf5e0 2024-04-25T19:31:17.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.029+0000 7f1089800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f10841447d0 con 0x7f108406c5c0 2024-04-25T19:31:17.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.030+0000 7f1083400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10841443c0 0x7f1084143010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:17.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.030+0000 7f1083400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10841443c0 0x7f1084143010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57246/0 (socket says 172.21.15.131:57246) 2024-04-25T19:31:17.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.030+0000 7f1083400640 1 -- 172.21.15.131:0/2645639722 learned_addr learned my addr 172.21.15.131:0/2645639722 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:17.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.030+0000 7f1082000640 1 --2- 172.21.15.131:0/2645639722 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10840cf5e0 0x7f10841f82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:17.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.030+0000 7f1082a00640 1 --2- 172.21.15.131:0/2645639722 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f108406c5c0 0x7f10840afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:17.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.030+0000 7f1083400640 1 -- 172.21.15.131:0/2645639722 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f108406c5c0 msgr2=0x7f10840afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:17.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.030+0000 7f1083400640 1 --2- 172.21.15.131:0/2645639722 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f108406c5c0 0x7f10840afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:17.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.030+0000 7f1083400640 1 -- 172.21.15.131:0/2645639722 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10840cf5e0 msgr2=0x7f10841f82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:17.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.030+0000 7f1083400640 1 --2- 172.21.15.131:0/2645639722 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10840cf5e0 0x7f10841f82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:17.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.030+0000 7f1083400640 1 -- 172.21.15.131:0/2645639722 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10840b0160 con 0x7f10841443c0 2024-04-25T19:31:17.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.031+0000 7f1083400640 1 --2- 172.21.15.131:0/2645639722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10841443c0 0x7f1084143010 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f107c009f40 tx=0x7f107c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:17.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.031+0000 7f107aa00640 1 -- 172.21.15.131:0/2645639722 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c036050 con 0x7f10841443c0 2024-04-25T19:31:17.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.031+0000 7f107aa00640 1 -- 172.21.15.131:0/2645639722 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107c042070 con 0x7f10841443c0 2024-04-25T19:31:17.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.031+0000 7f107aa00640 1 -- 172.21.15.131:0/2645639722 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c009510 con 0x7f10841443c0 2024-04-25T19:31:17.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.031+0000 7f1089800640 1 -- 172.21.15.131:0/2645639722 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10841f8800 con 0x7f10841443c0 2024-04-25T19:31:17.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.031+0000 7f1089800640 1 -- 172.21.15.131:0/2645639722 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10840af140 con 0x7f10841443c0 2024-04-25T19:31:17.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.032+0000 7f1089800640 1 -- 172.21.15.131:0/2645639722 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1084050740 con 0x7f10841443c0 2024-04-25T19:31:17.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.033+0000 7f107aa00640 1 -- 172.21.15.131:0/2645639722 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f107c007bf0 con 0x7f10841443c0 2024-04-25T19:31:17.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.034+0000 7f107aa00640 1 --2- 172.21.15.131:0/2645639722 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f10640744b0 0x7f10640769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:17.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.035+0000 7f107aa00640 1 -- 172.21.15.131:0/2645639722 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f107c0b5df0 con 0x7f10841443c0 2024-04-25T19:31:17.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.035+0000 7f1082a00640 1 --2- 172.21.15.131:0/2645639722 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f10640744b0 0x7f10640769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:17.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.036+0000 7f1082a00640 1 --2- 172.21.15.131:0/2645639722 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f10640744b0 0x7f10640769c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1074007fd0 tx=0x7f1074009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:17.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.039+0000 7f107aa00640 1 -- 172.21.15.131:0/2645639722 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f107c080870 con 0x7f10841443c0 2024-04-25T19:31:17.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.239+0000 7f1089800640 1 -- 172.21.15.131:0/2645639722 --> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f10840ad000 con 0x7f10640744b0 2024-04-25T19:31:17.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.240+0000 7f107aa00640 1 -- 172.21.15.131:0/2645639722 <== mgr.4105 v2:172.21.15.195:6832/2541913764 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f10840ad000 con 0x7f10640744b0 2024-04-25T19:31:17.240 INFO:teuthology.orchestra.run.smithi131.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T19:31:17.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.242+0000 7f1089800640 1 -- 172.21.15.131:0/2645639722 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f10640744b0 msgr2=0x7f10640769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:17.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.242+0000 7f1089800640 1 --2- 172.21.15.131:0/2645639722 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f10640744b0 0x7f10640769c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1074007fd0 tx=0x7f1074009040 comp rx=0 tx=0).stop 2024-04-25T19:31:17.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.242+0000 7f1089800640 1 -- 172.21.15.131:0/2645639722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10841443c0 msgr2=0x7f1084143010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:17.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.242+0000 7f1089800640 1 --2- 172.21.15.131:0/2645639722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10841443c0 0x7f1084143010 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f107c009f40 tx=0x7f107c004a40 comp rx=0 tx=0).stop 2024-04-25T19:31:17.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.243+0000 7f1089800640 1 -- 172.21.15.131:0/2645639722 shutdown_connections 2024-04-25T19:31:17.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.243+0000 7f1089800640 1 --2- 172.21.15.131:0/2645639722 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f10640744b0 0x7f10640769c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:17.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.243+0000 7f1089800640 1 --2- 172.21.15.131:0/2645639722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10841443c0 0x7f1084143010 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:17.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.243+0000 7f1089800640 1 --2- 172.21.15.131:0/2645639722 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10840cf5e0 0x7f10841f82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:17.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.243+0000 7f1089800640 1 --2- 172.21.15.131:0/2645639722 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f108406c5c0 0x7f10840afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:17.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.243+0000 7f1089800640 1 -- 172.21.15.131:0/2645639722 >> 172.21.15.131:0/2645639722 conn(0x7f10840d1ae0 msgr2=0x7f10840b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:17.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.243+0000 7f1089800640 1 -- 172.21.15.131:0/2645639722 shutdown_connections 2024-04-25T19:31:17.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.243+0000 7f1089800640 1 -- 172.21.15.131:0/2645639722 wait complete. 2024-04-25T19:31:17.273 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T19:31:17.274 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T19:31:17.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.552+0000 7fdf4a200640 1 Processor -- start 2024-04-25T19:31:17.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.552+0000 7fdf4a200640 1 -- start start 2024-04-25T19:31:17.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.554+0000 7fdf4a200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf440ce520 0x7fdf4415d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:17.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.554+0000 7fdf4a200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdf440ce930 0x7fdf4415d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:17.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.554+0000 7fdf4a200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf440cda60 con 0x7fdf4406d5d0 2024-04-25T19:31:17.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.554+0000 7fdf4a200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fdf4415dfe0 con 0x7fdf440ce930 2024-04-25T19:31:17.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.554+0000 7fdf4a200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdf4415e2c0 con 0x7fdf440ce520 2024-04-25T19:31:17.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.554+0000 7fdf48e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf440ce520 0x7fdf4415d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:17.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.554+0000 7fdf48e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf440ce520 0x7fdf4415d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.131:43532/0 (socket says 172.21.15.131:43532) 2024-04-25T19:31:17.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.554+0000 7fdf48e00640 1 -- 172.21.15.131:0/3967331269 learned_addr learned my addr 172.21.15.131:0/3967331269 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:17.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.554+0000 7fdf43e00640 1 --2- 172.21.15.131:0/3967331269 >> v2:172.21.15.195:3300/0 conn(0x7fdf440ce930 0x7fdf4415d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:17.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.555+0000 7fdf43e00640 1 -- 172.21.15.131:0/3967331269 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf440ce520 msgr2=0x7fdf4415d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:17.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.555+0000 7fdf43e00640 1 --2- 172.21.15.131:0/3967331269 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf440ce520 0x7fdf4415d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:17.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.555+0000 7fdf43e00640 1 -- 172.21.15.131:0/3967331269 >> v1:172.21.15.195:6789/0 conn(0x7fdf4406d5d0 legacy=0x7fdf4406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:17.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.555+0000 7fdf43e00640 1 -- 172.21.15.131:0/3967331269 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf440cdd20 con 0x7fdf440ce930 2024-04-25T19:31:17.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.555+0000 7fdf48e00640 1 --2- 172.21.15.131:0/3967331269 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf440ce520 0x7fdf4415d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T19:31:17.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.557+0000 7fdf43e00640 1 --2- 172.21.15.131:0/3967331269 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf440ce930 0x7fdf4415d9f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdf300097a0 tx=0x7fdf3002c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3f60dbf2e2c201e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:17.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.557+0000 7fdf43400640 1 -- 172.21.15.131:0/3967331269 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf30039070 con 0x7fdf440ce930 2024-04-25T19:31:17.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.557+0000 7fdf43400640 1 -- 172.21.15.131:0/3967331269 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf3002ce50 con 0x7fdf440ce930 2024-04-25T19:31:17.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.557+0000 7fdf43400640 1 -- 172.21.15.131:0/3967331269 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf30034860 con 0x7fdf440ce930 2024-04-25T19:31:17.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.558+0000 7fdf4a200640 1 -- 172.21.15.131:0/3967331269 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf440ce930 msgr2=0x7fdf4415d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:17.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.558+0000 7fdf4a200640 1 --2- 172.21.15.131:0/3967331269 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf440ce930 0x7fdf4415d9f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdf300097a0 tx=0x7fdf3002c300 comp rx=0 tx=0).stop 2024-04-25T19:31:17.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.558+0000 7fdf4a200640 1 -- 172.21.15.131:0/3967331269 shutdown_connections 2024-04-25T19:31:17.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.558+0000 7fdf4a200640 1 --2- 172.21.15.131:0/3967331269 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf440ce930 0x7fdf4415d9f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:17.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.558+0000 7fdf4a200640 1 --2- 172.21.15.131:0/3967331269 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf440ce520 0x7fdf4415d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:17.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.558+0000 7fdf4a200640 1 -- 172.21.15.131:0/3967331269 >> 172.21.15.131:0/3967331269 conn(0x7fdf44072f40 msgr2=0x7fdf44073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:17.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.559+0000 7fdf4a200640 1 -- 172.21.15.131:0/3967331269 shutdown_connections 2024-04-25T19:31:17.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.559+0000 7fdf4a200640 1 -- 172.21.15.131:0/3967331269 wait complete. 2024-04-25T19:31:17.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.561+0000 7fdf4a200640 1 Processor -- start 2024-04-25T19:31:17.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.561+0000 7fdf4a200640 1 -- start start 2024-04-25T19:31:17.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.563+0000 7fdf4a200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf4406d5d0 0x7fdf44142660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:17.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.563+0000 7fdf4a200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf440ce520 0x7fdf4413fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:17.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.563+0000 7fdf4a200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf440ce930 0x7fdf440b6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:17.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.563+0000 7fdf4a200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdf440b73d0 con 0x7fdf440ce520 2024-04-25T19:31:17.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.563+0000 7fdf4a200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdf44160d30 con 0x7fdf4406d5d0 2024-04-25T19:31:17.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.563+0000 7fdf4a200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdf440b7550 con 0x7fdf440ce930 2024-04-25T19:31:17.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.563+0000 7fdf43e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf440ce520 0x7fdf4413fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:17.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.563+0000 7fdf43e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf440ce520 0x7fdf4413fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57262/0 (socket says 172.21.15.131:57262) 2024-04-25T19:31:17.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.563+0000 7fdf43e00640 1 -- 172.21.15.131:0/3067346338 learned_addr learned my addr 172.21.15.131:0/3067346338 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:17.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.563+0000 7fdf48e00640 1 --2- 172.21.15.131:0/3067346338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf4406d5d0 0x7fdf44142660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:17.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.563+0000 7fdf49800640 1 --2- 172.21.15.131:0/3067346338 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf440ce930 0x7fdf440b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:17.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.563+0000 7fdf43e00640 1 -- 172.21.15.131:0/3067346338 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf440ce930 msgr2=0x7fdf440b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:17.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.563+0000 7fdf43e00640 1 --2- 172.21.15.131:0/3067346338 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf440ce930 0x7fdf440b6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:17.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.563+0000 7fdf43e00640 1 -- 172.21.15.131:0/3067346338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf4406d5d0 msgr2=0x7fdf44142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:17.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.563+0000 7fdf43e00640 1 --2- 172.21.15.131:0/3067346338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf4406d5d0 0x7fdf44142660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:17.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.563+0000 7fdf43e00640 1 -- 172.21.15.131:0/3067346338 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf44143130 con 0x7fdf440ce520 2024-04-25T19:31:17.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.564+0000 7fdf43e00640 1 --2- 172.21.15.131:0/3067346338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf440ce520 0x7fdf4413fd40 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fdf30037040 tx=0x7fdf300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:17.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.564+0000 7fdf40c00640 1 -- 172.21.15.131:0/3067346338 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf30039040 con 0x7fdf440ce520 2024-04-25T19:31:17.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.564+0000 7fdf40c00640 1 -- 172.21.15.131:0/3067346338 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf3003f630 con 0x7fdf440ce520 2024-04-25T19:31:17.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.564+0000 7fdf40c00640 1 -- 172.21.15.131:0/3067346338 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3003fa20 con 0x7fdf440ce520 2024-04-25T19:31:17.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.564+0000 7fdf4a200640 1 -- 172.21.15.131:0/3067346338 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf44143410 con 0x7fdf440ce520 2024-04-25T19:31:17.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.564+0000 7fdf4a200640 1 -- 172.21.15.131:0/3067346338 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf44140b50 con 0x7fdf440ce520 2024-04-25T19:31:17.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.565+0000 7fdf4a200640 1 -- 172.21.15.131:0/3067346338 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdf44076c60 con 0x7fdf440ce520 2024-04-25T19:31:17.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.567+0000 7fdf40c00640 1 -- 172.21.15.131:0/3067346338 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fdf3003fbc0 con 0x7fdf440ce520 2024-04-25T19:31:17.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.568+0000 7fdf40c00640 1 --2- 172.21.15.131:0/3067346338 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdf240744b0 0x7fdf240769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:17.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.568+0000 7fdf40c00640 1 -- 172.21.15.131:0/3067346338 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7fdf300b64c0 con 0x7fdf440ce520 2024-04-25T19:31:17.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.568+0000 7fdf40c00640 1 --2- 172.21.15.131:0/3067346338 >> [v2:172.21.15.131:6800/1135187016,v1:172.21.15.131:6801/1135187016] conn(0x7fdf2407a3c0 0x7fdf2407c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:17.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.568+0000 7fdf40c00640 1 -- 172.21.15.131:0/3067346338 --> [v2:172.21.15.131:6800/1135187016,v1:172.21.15.131:6801/1135187016] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf30040e70 con 0x7fdf2407a3c0 2024-04-25T19:31:17.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.568+0000 7fdf40c00640 1 -- 172.21.15.131:0/3067346338 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fdf300b6950 con 0x7fdf440ce520 2024-04-25T19:31:17.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.568+0000 7fdf48e00640 1 --2- 172.21.15.131:0/3067346338 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdf240744b0 0x7fdf240769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:17.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.568+0000 7fdf49800640 1 --2- 172.21.15.131:0/3067346338 >> [v2:172.21.15.131:6800/1135187016,v1:172.21.15.131:6801/1135187016] conn(0x7fdf2407a3c0 0x7fdf2407c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:17.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.569+0000 7fdf49800640 1 --2- 172.21.15.131:0/3067346338 >> [v2:172.21.15.131:6800/1135187016,v1:172.21.15.131:6801/1135187016] conn(0x7fdf2407a3c0 0x7fdf2407c810 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:17.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.570+0000 7fdf48e00640 1 --2- 172.21.15.131:0/3067346338 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdf240744b0 0x7fdf240769c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdf440b5b40 tx=0x7fdf38008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:17.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.570+0000 7fdf40c00640 1 -- 172.21.15.131:0/3067346338 <== osd.2 v2:172.21.15.131:6800/1135187016 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdf30040e70 con 0x7fdf2407a3c0 2024-04-25T19:31:17.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.584+0000 7fdf4a200640 1 -- 172.21.15.131:0/3067346338 --> [v2:172.21.15.131:6800/1135187016,v1:172.21.15.131:6801/1135187016] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdf44142ee0 con 0x7fdf2407a3c0 2024-04-25T19:31:17.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.585+0000 7fdf40c00640 1 -- 172.21.15.131:0/3067346338 <== osd.2 v2:172.21.15.131:6800/1135187016 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdf44142ee0 con 0x7fdf2407a3c0 2024-04-25T19:31:17.585 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-25T19:31:17.585 INFO:teuthology.orchestra.run.smithi131.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T19:31:17.586 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-25T19:31:17.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.585+0000 7fdf4a200640 1 -- 172.21.15.131:0/3067346338 >> [v2:172.21.15.131:6800/1135187016,v1:172.21.15.131:6801/1135187016] conn(0x7fdf2407a3c0 msgr2=0x7fdf2407c810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:17.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.585+0000 7fdf4a200640 1 --2- 172.21.15.131:0/3067346338 >> [v2:172.21.15.131:6800/1135187016,v1:172.21.15.131:6801/1135187016] conn(0x7fdf2407a3c0 0x7fdf2407c810 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:17.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.585+0000 7fdf4a200640 1 -- 172.21.15.131:0/3067346338 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdf240744b0 msgr2=0x7fdf240769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:17.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.585+0000 7fdf4a200640 1 --2- 172.21.15.131:0/3067346338 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fdf240744b0 0x7fdf240769c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdf440b5b40 tx=0x7fdf38008040 comp rx=0 tx=0).stop 2024-04-25T19:31:17.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.585+0000 7fdf4a200640 1 -- 172.21.15.131:0/3067346338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf440ce520 msgr2=0x7fdf4413fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:17.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.585+0000 7fdf4a200640 1 --2- 172.21.15.131:0/3067346338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf440ce520 0x7fdf4413fd40 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fdf30037040 tx=0x7fdf300046c0 comp rx=0 tx=0).stop 2024-04-25T19:31:17.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.586+0000 7fdf49800640 1 -- 172.21.15.131:0/3067346338 reap_dead start 2024-04-25T19:31:17.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.586+0000 7fdf4a200640 1 -- 172.21.15.131:0/3067346338 shutdown_connections 2024-04-25T19:31:17.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.586+0000 7fdf4a200640 1 -- 172.21.15.131:0/3067346338 >> 172.21.15.131:0/3067346338 conn(0x7fdf44072f40 msgr2=0x7fdf44073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:17.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.586+0000 7fdf4a200640 1 -- 172.21.15.131:0/3067346338 shutdown_connections 2024-04-25T19:31:17.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.586+0000 7fdf4a200640 1 -- 172.21.15.131:0/3067346338 wait complete. 2024-04-25T19:31:17.612 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T19:31:17.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.879+0000 7f50fde00640 1 Processor -- start 2024-04-25T19:31:17.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.880+0000 7f50fde00640 1 -- start start 2024-04-25T19:31:17.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.881+0000 7f50fde00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50f80b6430 0x7f50f806d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:17.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.882+0000 7f50fde00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50f806c7d0 con 0x7f50f80d0bd0 2024-04-25T19:31:17.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.882+0000 7f50fde00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50f806cab0 con 0x7f50f8160aa0 2024-04-25T19:31:17.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.882+0000 7f50fde00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f50f806cd90 con 0x7f50f80b6430 2024-04-25T19:31:17.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.882+0000 7f50fd400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f50f80d0bd0 0x7f50f80d0fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:57456/0 (socket says 172.21.15.131:57456) 2024-04-25T19:31:17.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.882+0000 7f50fd400640 1 -- 172.21.15.131:0/3312972849 learned_addr learned my addr 172.21.15.131:0/3312972849 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:31:17.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.882+0000 7f50fca00640 1 --2- 172.21.15.131:0/3312972849 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50f80b6430 0x7f50f806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:17.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.882+0000 7f50f7e00640 1 -- 172.21.15.131:0/3312972849 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 583926963 0 0) 0x7f50f806c7d0 con 0x7f50f80d0bd0 2024-04-25T19:31:17.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.883+0000 7f50f7e00640 1 -- 172.21.15.131:0/3312972849 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50dc005730 con 0x7f50f80d0bd0 2024-04-25T19:31:17.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.883+0000 7f50f7e00640 1 -- 172.21.15.131:0/3312972849 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 726426726 0 0) 0x7f50dc005730 con 0x7f50f80d0bd0 2024-04-25T19:31:17.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.883+0000 7f50f7e00640 1 -- 172.21.15.131:0/3312972849 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50f80b6430 msgr2=0x7f50f806d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:17.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.883+0000 7f50f7e00640 1 --2- 172.21.15.131:0/3312972849 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50f80b6430 0x7f50f806d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:17.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.883+0000 7f50f7e00640 1 -- 172.21.15.131:0/3312972849 >> v1:172.21.15.195:6789/0 conn(0x7f50f8160aa0 legacy=0x7f50f8160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:17.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.883+0000 7f50f7e00640 1 -- 172.21.15.131:0/3312972849 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f806d070 con 0x7f50f80d0bd0 2024-04-25T19:31:17.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.883+0000 7f50f7e00640 1 -- 172.21.15.131:0/3312972849 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f50f00019f0 con 0x7f50f80d0bd0 2024-04-25T19:31:17.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.883+0000 7f50f7e00640 1 -- 172.21.15.131:0/3312972849 >> v1:172.21.15.131:6789/0 conn(0x7f50f80d0bd0 legacy=0x7f50f80d0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:17.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.883+0000 7f50f7e00640 1 --2- 172.21.15.131:0/3312972849 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50f80b6430 0x7f50dc005bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:17.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.883+0000 7f50f7e00640 1 --2- 172.21.15.131:0/3312972849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50dc006170 0x7f50dc006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:17.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.883+0000 7f50f7e00640 1 --2- 172.21.15.131:0/3312972849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50dc006f50 0x7f50dc007400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:17.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.883+0000 7f50f7e00640 1 -- 172.21.15.131:0/3312972849 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f50f806cd90 con 0x7f50dc006f50 2024-04-25T19:31:17.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.883+0000 7f50f7e00640 1 -- 172.21.15.131:0/3312972849 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc00de90 con 0x7f50dc006170 2024-04-25T19:31:17.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.883+0000 7f50f7e00640 1 -- 172.21.15.131:0/3312972849 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f50dc00e090 con 0x7f50f80b6430 2024-04-25T19:31:17.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.884+0000 7f50fd400640 1 --2- 172.21.15.131:0/3312972849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50dc006f50 0x7f50dc007400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:17.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.884+0000 7f50efe00640 1 --2- 172.21.15.131:0/3312972849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50dc006170 0x7f50dc006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:17.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.884+0000 7f50fca00640 1 --2- 172.21.15.131:0/3312972849 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50f80b6430 0x7f50dc005bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:17.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.884+0000 7f50fd400640 1 -- 172.21.15.131:0/3312972849 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50f80b6430 msgr2=0x7f50dc005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:17.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.884+0000 7f50fd400640 1 --2- 172.21.15.131:0/3312972849 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50f80b6430 0x7f50dc005bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:17.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.884+0000 7f50fd400640 1 -- 172.21.15.131:0/3312972849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50dc006170 msgr2=0x7f50dc006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:17.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.884+0000 7f50fd400640 1 --2- 172.21.15.131:0/3312972849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50dc006170 0x7f50dc006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:17.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.884+0000 7f50fd400640 1 -- 172.21.15.131:0/3312972849 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50dc005730 con 0x7f50dc006f50 2024-04-25T19:31:17.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.884+0000 7f50efe00640 1 --2- 172.21.15.131:0/3312972849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50dc006170 0x7f50dc006a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:31:17.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.885+0000 7f50fd400640 1 --2- 172.21.15.131:0/3312972849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50dc006f50 0x7f50dc007400 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f50f80d16f0 tx=0x7f50dc007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d9a77867a07d27 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:17.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.885+0000 7f50f7e00640 1 -- 172.21.15.131:0/3312972849 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f000a460 con 0x7f50dc006f50 2024-04-25T19:31:17.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.885+0000 7f50f7e00640 1 -- 172.21.15.131:0/3312972849 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f002f070 con 0x7f50dc006f50 2024-04-25T19:31:17.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.885+0000 7f50f7e00640 1 -- 172.21.15.131:0/3312972849 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f002bc90 con 0x7f50dc006f50 2024-04-25T19:31:17.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.886+0000 7f50fde00640 1 -- 172.21.15.131:0/3312972849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50dc006f50 msgr2=0x7f50dc007400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:17.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.886+0000 7f50fde00640 1 --2- 172.21.15.131:0/3312972849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50dc006f50 0x7f50dc007400 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f50f80d16f0 tx=0x7f50dc007a40 comp rx=0 tx=0).stop 2024-04-25T19:31:17.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.886+0000 7f50fd400640 1 -- 172.21.15.131:0/3312972849 reap_dead start 2024-04-25T19:31:17.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.886+0000 7f50fde00640 1 -- 172.21.15.131:0/3312972849 shutdown_connections 2024-04-25T19:31:17.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.886+0000 7f50fde00640 1 -- 172.21.15.131:0/3312972849 >> 172.21.15.131:0/3312972849 conn(0x7f50f80d1720 msgr2=0x7f50f80d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:17.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.886+0000 7f50fde00640 1 -- 172.21.15.131:0/3312972849 shutdown_connections 2024-04-25T19:31:17.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.886+0000 7f50fde00640 1 -- 172.21.15.131:0/3312972849 wait complete. 2024-04-25T19:31:17.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.889+0000 7f50fde00640 1 Processor -- start 2024-04-25T19:31:17.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.889+0000 7f50fde00640 1 -- start start 2024-04-25T19:31:17.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.890+0000 7f50fde00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50dc006f50 0x7f50f81502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:17.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.890+0000 7f50fde00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50f81462e0 0x7f50f815b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:17.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.890+0000 7f50fde00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50f81466f0 0x7f50f815bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:17.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.890+0000 7f50fde00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f50f806d9f0 con 0x7f50dc006f50 2024-04-25T19:31:17.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.890+0000 7f50fde00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f50f806d870 con 0x7f50f81466f0 2024-04-25T19:31:17.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.890+0000 7f50fde00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f50f806db70 con 0x7f50f81462e0 2024-04-25T19:31:17.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.891+0000 7f50fca00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50dc006f50 0x7f50f81502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:17.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.891+0000 7f50fca00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50dc006f50 0x7f50f81502b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34976/0 (socket says 172.21.15.131:34976) 2024-04-25T19:31:17.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.891+0000 7f50fca00640 1 -- 172.21.15.131:0/3704895051 learned_addr learned my addr 172.21.15.131:0/3704895051 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:17.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.891+0000 7f50fca00640 1 -- 172.21.15.131:0/3704895051 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50f81462e0 msgr2=0x7f50f815b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:17.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.891+0000 7f50fca00640 1 --2- 172.21.15.131:0/3704895051 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50f81462e0 0x7f50f815b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:17.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.891+0000 7f50fca00640 1 -- 172.21.15.131:0/3704895051 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50f81466f0 msgr2=0x7f50f815bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:17.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.891+0000 7f50fca00640 1 --2- 172.21.15.131:0/3704895051 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50f81466f0 0x7f50f815bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:17.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.891+0000 7f50fca00640 1 -- 172.21.15.131:0/3704895051 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f814f430 con 0x7f50dc006f50 2024-04-25T19:31:17.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.891+0000 7f50fca00640 1 --2- 172.21.15.131:0/3704895051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50dc006f50 0x7f50f81502b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f50e8010860 tx=0x7f50e8010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:17.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.891+0000 7f50f5600640 1 -- 172.21.15.131:0/3704895051 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e800f040 con 0x7f50dc006f50 2024-04-25T19:31:17.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.892+0000 7f50f5600640 1 -- 172.21.15.131:0/3704895051 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50e800eae0 con 0x7f50dc006f50 2024-04-25T19:31:17.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.892+0000 7f50fde00640 1 -- 172.21.15.131:0/3704895051 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50f814f710 con 0x7f50dc006f50 2024-04-25T19:31:17.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.892+0000 7f50f5600640 1 -- 172.21.15.131:0/3704895051 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e801c400 con 0x7f50dc006f50 2024-04-25T19:31:17.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.892+0000 7f50fde00640 1 -- 172.21.15.131:0/3704895051 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50f814fcd0 con 0x7f50dc006f50 2024-04-25T19:31:17.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.893+0000 7f50fde00640 1 -- 172.21.15.131:0/3704895051 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50f80d13f0 con 0x7f50dc006f50 2024-04-25T19:31:17.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.894+0000 7f50f5600640 1 -- 172.21.15.131:0/3704895051 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f50e801c5a0 con 0x7f50dc006f50 2024-04-25T19:31:17.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.895+0000 7f50f5600640 1 --2- 172.21.15.131:0/3704895051 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f50d40744e0 0x7f50d40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:17.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.895+0000 7f50f5600640 1 -- 172.21.15.131:0/3704895051 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f50e8095590 con 0x7f50dc006f50 2024-04-25T19:31:17.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.895+0000 7f50efe00640 1 --2- 172.21.15.131:0/3704895051 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f50d40744e0 0x7f50d40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:17.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.897+0000 7f50efe00640 1 --2- 172.21.15.131:0/3704895051 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f50d40744e0 0x7f50d40769f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f50f8070750 tx=0x7f50e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:17.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:17.900+0000 7f50f5600640 1 -- 172.21.15.131:0/3704895051 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f50f80d13f0 con 0x7f50dc006f50 2024-04-25T19:31:18.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.098+0000 7f50fde00640 1 -- 172.21.15.131:0/3704895051 --> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f50f8050740 con 0x7f50d40744e0 2024-04-25T19:31:18.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.099+0000 7f50f5600640 1 -- 172.21.15.131:0/3704895051 <== mgr.4105 v2:172.21.15.195:6832/2541913764 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f50f8050740 con 0x7f50d40744e0 2024-04-25T19:31:18.100 INFO:teuthology.orchestra.run.smithi131.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T19:31:18.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.102+0000 7f50fde00640 1 -- 172.21.15.131:0/3704895051 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f50d40744e0 msgr2=0x7f50d40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:18.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.102+0000 7f50fde00640 1 --2- 172.21.15.131:0/3704895051 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f50d40744e0 0x7f50d40769f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f50f8070750 tx=0x7f50e0009040 comp rx=0 tx=0).stop 2024-04-25T19:31:18.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.102+0000 7f50fde00640 1 -- 172.21.15.131:0/3704895051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50dc006f50 msgr2=0x7f50f81502b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:18.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.102+0000 7f50fde00640 1 --2- 172.21.15.131:0/3704895051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50dc006f50 0x7f50f81502b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f50e8010860 tx=0x7f50e8010d20 comp rx=0 tx=0).stop 2024-04-25T19:31:18.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.102+0000 7f50fde00640 1 -- 172.21.15.131:0/3704895051 shutdown_connections 2024-04-25T19:31:18.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.102+0000 7f50fde00640 1 --2- 172.21.15.131:0/3704895051 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f50d40744e0 0x7f50d40769f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:18.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.102+0000 7f50fde00640 1 --2- 172.21.15.131:0/3704895051 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50f81462e0 0x7f50f815b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:18.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.102+0000 7f50fde00640 1 --2- 172.21.15.131:0/3704895051 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50f81466f0 0x7f50f815bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:18.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.102+0000 7f50fde00640 1 --2- 172.21.15.131:0/3704895051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50dc006f50 0x7f50f81502b0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:18.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.102+0000 7f50fde00640 1 -- 172.21.15.131:0/3704895051 >> 172.21.15.131:0/3704895051 conn(0x7f50f80d1720 msgr2=0x7f50f8160eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:18.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.102+0000 7f50fde00640 1 -- 172.21.15.131:0/3704895051 shutdown_connections 2024-04-25T19:31:18.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.102+0000 7f50fde00640 1 -- 172.21.15.131:0/3704895051 wait complete. 2024-04-25T19:31:18.130 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T19:31:18.130 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T19:31:18.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.412+0000 7f8c31800640 1 Processor -- start 2024-04-25T19:31:18.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.412+0000 7f8c31800640 1 -- start start 2024-04-25T19:31:18.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.414+0000 7f8c31800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c2c14aac0 0x7f8c2c1655a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:18.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.414+0000 7f8c31800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8c2c06d5d0 0x7f8c2c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:18.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.414+0000 7f8c31800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c2c165ae0 con 0x7f8c2c168110 2024-04-25T19:31:18.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.414+0000 7f8c31800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f8c2c06df20 con 0x7f8c2c06d5d0 2024-04-25T19:31:18.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.414+0000 7f8c31800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8c2c14aed0 con 0x7f8c2c14aac0 2024-04-25T19:31:18.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.415+0000 7f8c30e00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f8c2c168110 0x7f8c2c168520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:57472/0 (socket says 172.21.15.131:57472) 2024-04-25T19:31:18.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.415+0000 7f8c30e00640 1 -- 172.21.15.131:0/3480652454 learned_addr learned my addr 172.21.15.131:0/3480652454 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:31:18.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.415+0000 7f8c23400640 1 --2- 172.21.15.131:0/3480652454 >> v2:172.21.15.195:3300/0 conn(0x7f8c2c06d5d0 0x7f8c2c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:18.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.415+0000 7f8c2be00640 1 --2- 172.21.15.131:0/3480652454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c2c14aac0 0x7f8c2c1655a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:18.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.415+0000 7f8c2b400640 1 -- 172.21.15.131:0/3480652454 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2011783327 0 0) 0x7f8c24001490 con 0x7f8c2c168110 2024-04-25T19:31:18.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.416+0000 7f8c2b400640 1 -- 172.21.15.131:0/3480652454 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c10003520 con 0x7f8c2c168110 2024-04-25T19:31:18.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.416+0000 7f8c2b400640 1 -- 172.21.15.131:0/3480652454 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3422942429 0 0) 0x7f8c10003520 con 0x7f8c2c168110 2024-04-25T19:31:18.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.416+0000 7f8c2b400640 1 -- 172.21.15.131:0/3480652454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c2c14aac0 msgr2=0x7f8c2c1655a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:18.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.416+0000 7f8c2b400640 1 --2- 172.21.15.131:0/3480652454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c2c14aac0 0x7f8c2c1655a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:18.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.416+0000 7f8c2b400640 1 -- 172.21.15.131:0/3480652454 >> v2:172.21.15.195:3300/0 conn(0x7f8c2c06d5d0 msgr2=0x7f8c2c06d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:18.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.416+0000 7f8c2b400640 1 --2- 172.21.15.131:0/3480652454 >> v2:172.21.15.195:3300/0 conn(0x7f8c2c06d5d0 0x7f8c2c06d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:18.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.416+0000 7f8c2b400640 1 -- 172.21.15.131:0/3480652454 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2c06f460 con 0x7f8c2c168110 2024-04-25T19:31:18.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.416+0000 7f8c2b400640 1 -- 172.21.15.131:0/3480652454 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f8c24001bc0 con 0x7f8c2c168110 2024-04-25T19:31:18.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.416+0000 7f8c2b400640 1 -- 172.21.15.131:0/3480652454 >> v1:172.21.15.131:6789/0 conn(0x7f8c2c168110 legacy=0x7f8c2c168520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:18.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.416+0000 7f8c2b400640 1 --2- 172.21.15.131:0/3480652454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c100039b0 0x7f8c10003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:18.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.416+0000 7f8c2b400640 1 --2- 172.21.15.131:0/3480652454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c2c14aac0 0x7f8c10004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:18.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.416+0000 7f8c2b400640 1 --2- 172.21.15.131:0/3480652454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c10004d40 0x7f8c10005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:18.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.416+0000 7f8c2b400640 1 -- 172.21.15.131:0/3480652454 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c06df20 con 0x7f8c10004d40 2024-04-25T19:31:18.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.416+0000 7f8c2b400640 1 -- 172.21.15.131:0/3480652454 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c14aed0 con 0x7f8c100039b0 2024-04-25T19:31:18.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.416+0000 7f8c2b400640 1 -- 172.21.15.131:0/3480652454 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8c1000ba40 con 0x7f8c2c14aac0 2024-04-25T19:31:18.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.416+0000 7f8c30e00640 1 --2- 172.21.15.131:0/3480652454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c10004d40 0x7f8c10005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:18.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.417+0000 7f8c2be00640 1 --2- 172.21.15.131:0/3480652454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c100039b0 0x7f8c10003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:18.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.417+0000 7f8c23400640 1 --2- 172.21.15.131:0/3480652454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c2c14aac0 0x7f8c10004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:18.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.417+0000 7f8c30e00640 1 -- 172.21.15.131:0/3480652454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c2c14aac0 msgr2=0x7f8c10004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:18.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.417+0000 7f8c30e00640 1 --2- 172.21.15.131:0/3480652454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c2c14aac0 0x7f8c10004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:18.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.417+0000 7f8c30e00640 1 -- 172.21.15.131:0/3480652454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c100039b0 msgr2=0x7f8c10003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:18.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.417+0000 7f8c30e00640 1 --2- 172.21.15.131:0/3480652454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c100039b0 0x7f8c10003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:18.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.417+0000 7f8c30e00640 1 -- 172.21.15.131:0/3480652454 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c10003520 con 0x7f8c10004d40 2024-04-25T19:31:18.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.418+0000 7f8c30e00640 1 --2- 172.21.15.131:0/3480652454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c10004d40 0x7f8c10005150 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400aa40 tx=0x7f8c10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc58d7a3e84173e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:18.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.418+0000 7f8c2b400640 1 -- 172.21.15.131:0/3480652454 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2400a690 con 0x7f8c10004d40 2024-04-25T19:31:18.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.418+0000 7f8c2b400640 1 -- 172.21.15.131:0/3480652454 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c2402f070 con 0x7f8c10004d40 2024-04-25T19:31:18.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.418+0000 7f8c2b400640 1 -- 172.21.15.131:0/3480652454 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c24034470 con 0x7f8c10004d40 2024-04-25T19:31:18.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.419+0000 7f8c31800640 1 -- 172.21.15.131:0/3480652454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c10004d40 msgr2=0x7f8c10005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:18.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.419+0000 7f8c31800640 1 --2- 172.21.15.131:0/3480652454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c10004d40 0x7f8c10005150 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400aa40 tx=0x7f8c10005830 comp rx=0 tx=0).stop 2024-04-25T19:31:18.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.419+0000 7f8c30e00640 1 -- 172.21.15.131:0/3480652454 reap_dead start 2024-04-25T19:31:18.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.419+0000 7f8c31800640 1 -- 172.21.15.131:0/3480652454 shutdown_connections 2024-04-25T19:31:18.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.419+0000 7f8c31800640 1 -- 172.21.15.131:0/3480652454 >> 172.21.15.131:0/3480652454 conn(0x7f8c2c072f40 msgr2=0x7f8c2c073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:18.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.419+0000 7f8c31800640 1 -- 172.21.15.131:0/3480652454 shutdown_connections 2024-04-25T19:31:18.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.419+0000 7f8c31800640 1 -- 172.21.15.131:0/3480652454 wait complete. 2024-04-25T19:31:18.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.422+0000 7f8c31800640 1 Processor -- start 2024-04-25T19:31:18.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.422+0000 7f8c31800640 1 -- start start 2024-04-25T19:31:18.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.423+0000 7f8c31800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c10004d40 0x7f8c2c163ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:18.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.423+0000 7f8c31800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c2c14ca30 0x7f8c2c1485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:18.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.423+0000 7f8c31800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c2c14ce40 0x7f8c2c148af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:18.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.423+0000 7f8c31800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c06fd00 con 0x7f8c2c14ca30 2024-04-25T19:31:18.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.423+0000 7f8c31800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c06fa20 con 0x7f8c2c14ce40 2024-04-25T19:31:18.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.423+0000 7f8c31800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8c2c06ffe0 con 0x7f8c10004d40 2024-04-25T19:31:18.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.424+0000 7f8c23400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c2c14ca30 0x7f8c2c1485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:18.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.424+0000 7f8c23400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c2c14ca30 0x7f8c2c1485b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34988/0 (socket says 172.21.15.131:34988) 2024-04-25T19:31:18.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.424+0000 7f8c23400640 1 -- 172.21.15.131:0/3622347734 learned_addr learned my addr 172.21.15.131:0/3622347734 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:18.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.424+0000 7f8c2be00640 1 --2- 172.21.15.131:0/3622347734 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c10004d40 0x7f8c2c163ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:18.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.424+0000 7f8c30e00640 1 --2- 172.21.15.131:0/3622347734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c2c14ce40 0x7f8c2c148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:18.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.424+0000 7f8c23400640 1 -- 172.21.15.131:0/3622347734 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c10004d40 msgr2=0x7f8c2c163ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:18.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.424+0000 7f8c23400640 1 --2- 172.21.15.131:0/3622347734 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c10004d40 0x7f8c2c163ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:18.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.424+0000 7f8c23400640 1 -- 172.21.15.131:0/3622347734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c2c14ce40 msgr2=0x7f8c2c148af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:18.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.424+0000 7f8c23400640 1 --2- 172.21.15.131:0/3622347734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c2c14ce40 0x7f8c2c148af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:18.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.424+0000 7f8c23400640 1 -- 172.21.15.131:0/3622347734 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2c14dda0 con 0x7f8c2c14ca30 2024-04-25T19:31:18.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.424+0000 7f8c2be00640 1 --2- 172.21.15.131:0/3622347734 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c10004d40 0x7f8c2c163ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:31:18.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.425+0000 7f8c23400640 1 --2- 172.21.15.131:0/3622347734 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c2c14ca30 0x7f8c2c1485b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8c140108c0 tx=0x7f8c14010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:18.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.425+0000 7f8c28c00640 1 -- 172.21.15.131:0/3622347734 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1400f040 con 0x7f8c2c14ca30 2024-04-25T19:31:18.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.425+0000 7f8c28c00640 1 -- 172.21.15.131:0/3622347734 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c1400eb60 con 0x7f8c2c14ca30 2024-04-25T19:31:18.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.425+0000 7f8c28c00640 1 -- 172.21.15.131:0/3622347734 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1401c400 con 0x7f8c2c14ca30 2024-04-25T19:31:18.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.425+0000 7f8c31800640 1 -- 172.21.15.131:0/3622347734 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c2c1fe360 con 0x7f8c2c14ca30 2024-04-25T19:31:18.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.425+0000 7f8c31800640 1 -- 172.21.15.131:0/3622347734 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c2c1fe920 con 0x7f8c2c14ca30 2024-04-25T19:31:18.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.426+0000 7f8c31800640 1 -- 172.21.15.131:0/3622347734 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8c2c068f10 con 0x7f8c2c14ca30 2024-04-25T19:31:18.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.428+0000 7f8c28c00640 1 -- 172.21.15.131:0/3622347734 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8c1401c5a0 con 0x7f8c2c14ca30 2024-04-25T19:31:18.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.429+0000 7f8c28c00640 1 --2- 172.21.15.131:0/3622347734 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8c080744e0 0x7f8c080769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:18.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.429+0000 7f8c28c00640 1 -- 172.21.15.131:0/3622347734 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f8c140958a0 con 0x7f8c2c14ca30 2024-04-25T19:31:18.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.429+0000 7f8c28c00640 1 --2- 172.21.15.131:0/3622347734 >> [v2:172.21.15.131:6816/2154643557,v1:172.21.15.131:6817/2154643557] conn(0x7f8c0807a3f0 0x7f8c0807c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:18.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.429+0000 7f8c28c00640 1 -- 172.21.15.131:0/3622347734 --> [v2:172.21.15.131:6816/2154643557,v1:172.21.15.131:6817/2154643557] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c0807cf10 con 0x7f8c0807a3f0 2024-04-25T19:31:18.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.429+0000 7f8c28c00640 1 -- 172.21.15.131:0/3622347734 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f8c14095c50 con 0x7f8c2c14ca30 2024-04-25T19:31:18.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.429+0000 7f8c2be00640 1 --2- 172.21.15.131:0/3622347734 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8c080744e0 0x7f8c080769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:18.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.429+0000 7f8c30e00640 1 --2- 172.21.15.131:0/3622347734 >> [v2:172.21.15.131:6816/2154643557,v1:172.21.15.131:6817/2154643557] conn(0x7f8c0807a3f0 0x7f8c0807c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:18.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.430+0000 7f8c30e00640 1 --2- 172.21.15.131:0/3622347734 >> [v2:172.21.15.131:6816/2154643557,v1:172.21.15.131:6817/2154643557] conn(0x7f8c0807a3f0 0x7f8c0807c840 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:18.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.430+0000 7f8c2be00640 1 --2- 172.21.15.131:0/3622347734 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8c080744e0 0x7f8c080769f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c14e3a0 tx=0x7f8c1c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:18.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.431+0000 7f8c28c00640 1 -- 172.21.15.131:0/3622347734 <== osd.3 v2:172.21.15.131:6816/2154643557 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8c24040a50 con 0x7f8c0807a3f0 2024-04-25T19:31:18.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.447+0000 7f8c31800640 1 -- 172.21.15.131:0/3622347734 --> [v2:172.21.15.131:6816/2154643557,v1:172.21.15.131:6817/2154643557] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8c2c076c60 con 0x7f8c0807a3f0 2024-04-25T19:31:18.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.448+0000 7f8c28c00640 1 -- 172.21.15.131:0/3622347734 <== osd.3 v2:172.21.15.131:6816/2154643557 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8c2403a070 con 0x7f8c0807a3f0 2024-04-25T19:31:18.448 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-25T19:31:18.449 INFO:teuthology.orchestra.run.smithi131.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T19:31:18.449 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-25T19:31:18.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.448+0000 7f8c31800640 1 -- 172.21.15.131:0/3622347734 >> [v2:172.21.15.131:6816/2154643557,v1:172.21.15.131:6817/2154643557] conn(0x7f8c0807a3f0 msgr2=0x7f8c0807c840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:18.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.448+0000 7f8c31800640 1 --2- 172.21.15.131:0/3622347734 >> [v2:172.21.15.131:6816/2154643557,v1:172.21.15.131:6817/2154643557] conn(0x7f8c0807a3f0 0x7f8c0807c840 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:18.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.449+0000 7f8c31800640 1 -- 172.21.15.131:0/3622347734 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8c080744e0 msgr2=0x7f8c080769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:18.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.449+0000 7f8c31800640 1 --2- 172.21.15.131:0/3622347734 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f8c080744e0 0x7f8c080769f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c14e3a0 tx=0x7f8c1c008040 comp rx=0 tx=0).stop 2024-04-25T19:31:18.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.449+0000 7f8c31800640 1 -- 172.21.15.131:0/3622347734 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c2c14ca30 msgr2=0x7f8c2c1485b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:18.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.449+0000 7f8c31800640 1 --2- 172.21.15.131:0/3622347734 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c2c14ca30 0x7f8c2c1485b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8c140108c0 tx=0x7f8c14010d80 comp rx=0 tx=0).stop 2024-04-25T19:31:18.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.449+0000 7f8c30e00640 1 -- 172.21.15.131:0/3622347734 reap_dead start 2024-04-25T19:31:18.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.449+0000 7f8c31800640 1 -- 172.21.15.131:0/3622347734 shutdown_connections 2024-04-25T19:31:18.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.449+0000 7f8c31800640 1 -- 172.21.15.131:0/3622347734 >> 172.21.15.131:0/3622347734 conn(0x7f8c2c072f40 msgr2=0x7f8c2c0b5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:18.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.449+0000 7f8c31800640 1 -- 172.21.15.131:0/3622347734 shutdown_connections 2024-04-25T19:31:18.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.449+0000 7f8c31800640 1 -- 172.21.15.131:0/3622347734 wait complete. 2024-04-25T19:31:18.474 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T19:31:18.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.743+0000 7fb702200640 1 Processor -- start 2024-04-25T19:31:18.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.743+0000 7fb702200640 1 -- start start 2024-04-25T19:31:18.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.745+0000 7fb702200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb6fc0cf2f0 0x7fb6fc0cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:18.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.745+0000 7fb702200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb6fc168010 0x7fb6fc168420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:18.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.745+0000 7fb702200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6fc1649d0 0x7fb6fc164de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:18.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.745+0000 7fb702200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fb6fc070cf0 con 0x7fb6fc0cf2f0 2024-04-25T19:31:18.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.745+0000 7fb702200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb6fc168960 con 0x7fb6fc168010 2024-04-25T19:31:18.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.745+0000 7fb702200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb6fc071180 con 0x7fb6fc1649d0 2024-04-25T19:31:18.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.745+0000 7fb700e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb6fc0cf2f0 0x7fb6fc0cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:18.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.746+0000 7fb700e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb6fc0cf2f0 0x7fb6fc0cf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:35000/0 (socket says 172.21.15.131:35000) 2024-04-25T19:31:18.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.746+0000 7fb700e00640 1 -- 172.21.15.131:0/4011838183 learned_addr learned my addr 172.21.15.131:0/4011838183 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:18.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.746+0000 7fb700e00640 1 -- 172.21.15.131:0/4011838183 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6fc1649d0 msgr2=0x7fb6fc164de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:18.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.746+0000 7fb700e00640 1 --2- 172.21.15.131:0/4011838183 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6fc1649d0 0x7fb6fc164de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:18.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.746+0000 7fb700e00640 1 -- 172.21.15.131:0/4011838183 >> v2:172.21.15.195:3300/0 conn(0x7fb6fc168010 msgr2=0x7fb6fc168420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:18.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.746+0000 7fb6f3e00640 1 --2- 172.21.15.131:0/4011838183 >> v2:172.21.15.195:3300/0 conn(0x7fb6fc168010 0x7fb6fc168420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:18.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.746+0000 7fb700e00640 1 --2- 172.21.15.131:0/4011838183 >> v2:172.21.15.195:3300/0 conn(0x7fb6fc168010 0x7fb6fc168420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:18.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.746+0000 7fb700e00640 1 -- 172.21.15.131:0/4011838183 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6fc0700e0 con 0x7fb6fc0cf2f0 2024-04-25T19:31:18.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.747+0000 7fb700e00640 1 --2- 172.21.15.131:0/4011838183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6fc0cf2f0 0x7fb6fc0cf700 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc0cfed0 tx=0x7fb6e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f66cd1e8eb044f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:18.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.747+0000 7fb6fbe00640 1 -- 172.21.15.131:0/4011838183 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e4037070 con 0x7fb6fc0cf2f0 2024-04-25T19:31:18.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.748+0000 7fb6fbe00640 1 -- 172.21.15.131:0/4011838183 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6e4032440 con 0x7fb6fc0cf2f0 2024-04-25T19:31:18.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.748+0000 7fb6fbe00640 1 -- 172.21.15.131:0/4011838183 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e4032810 con 0x7fb6fc0cf2f0 2024-04-25T19:31:18.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.748+0000 7fb702200640 1 -- 172.21.15.131:0/4011838183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6fc0cf2f0 msgr2=0x7fb6fc0cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:18.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.748+0000 7fb702200640 1 --2- 172.21.15.131:0/4011838183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6fc0cf2f0 0x7fb6fc0cf700 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc0cfed0 tx=0x7fb6e402a1e0 comp rx=0 tx=0).stop 2024-04-25T19:31:18.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.748+0000 7fb702200640 1 -- 172.21.15.131:0/4011838183 shutdown_connections 2024-04-25T19:31:18.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.748+0000 7fb702200640 1 --2- 172.21.15.131:0/4011838183 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6fc1649d0 0x7fb6fc164de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:18.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.748+0000 7fb702200640 1 --2- 172.21.15.131:0/4011838183 >> v2:172.21.15.195:3300/0 conn(0x7fb6fc168010 0x7fb6fc168420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:18.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.748+0000 7fb702200640 1 --2- 172.21.15.131:0/4011838183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6fc0cf2f0 0x7fb6fc0cf700 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:18.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.748+0000 7fb702200640 1 -- 172.21.15.131:0/4011838183 >> 172.21.15.131:0/4011838183 conn(0x7fb6fc0d1720 msgr2=0x7fb6fc0d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:18.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.749+0000 7fb702200640 1 -- 172.21.15.131:0/4011838183 shutdown_connections 2024-04-25T19:31:18.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.749+0000 7fb702200640 1 -- 172.21.15.131:0/4011838183 wait complete. 2024-04-25T19:31:18.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.751+0000 7fb702200640 1 Processor -- start 2024-04-25T19:31:18.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.751+0000 7fb702200640 1 -- start start 2024-04-25T19:31:18.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.752+0000 7fb702200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6fc0cf2f0 0x7fb6fc1605c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:18.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.752+0000 7fb702200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6fc1649d0 0x7fb6fc0b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:18.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.752+0000 7fb702200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6fc168010 0x7fb6fc14da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:18.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.753+0000 7fb702200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc070980 con 0x7fb6fc168010 2024-04-25T19:31:18.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.753+0000 7fb702200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc0706a0 con 0x7fb6fc1649d0 2024-04-25T19:31:18.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.753+0000 7fb702200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb6fc168d00 con 0x7fb6fc0cf2f0 2024-04-25T19:31:18.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.753+0000 7fb701800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6fc168010 0x7fb6fc14da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:18.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.753+0000 7fb701800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6fc168010 0x7fb6fc14da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:35006/0 (socket says 172.21.15.131:35006) 2024-04-25T19:31:18.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.753+0000 7fb701800640 1 -- 172.21.15.131:0/1702498867 learned_addr learned my addr 172.21.15.131:0/1702498867 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:18.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.753+0000 7fb6f3e00640 1 --2- 172.21.15.131:0/1702498867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6fc1649d0 0x7fb6fc0b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:18.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.753+0000 7fb700e00640 1 --2- 172.21.15.131:0/1702498867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6fc0cf2f0 0x7fb6fc1605c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:18.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.753+0000 7fb701800640 1 -- 172.21.15.131:0/1702498867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6fc0cf2f0 msgr2=0x7fb6fc1605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:18.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.753+0000 7fb701800640 1 --2- 172.21.15.131:0/1702498867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6fc0cf2f0 0x7fb6fc1605c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:18.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.753+0000 7fb701800640 1 -- 172.21.15.131:0/1702498867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6fc1649d0 msgr2=0x7fb6fc0b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:18.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.753+0000 7fb701800640 1 --2- 172.21.15.131:0/1702498867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6fc1649d0 0x7fb6fc0b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:18.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.753+0000 7fb701800640 1 -- 172.21.15.131:0/1702498867 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6fc14df40 con 0x7fb6fc168010 2024-04-25T19:31:18.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.754+0000 7fb701800640 1 --2- 172.21.15.131:0/1702498867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6fc168010 0x7fb6fc14da00 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb6f400ba10 tx=0x7fb6f400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:18.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.754+0000 7fb6f9600640 1 -- 172.21.15.131:0/1702498867 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4019070 con 0x7fb6fc168010 2024-04-25T19:31:18.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.754+0000 7fb6f9600640 1 -- 172.21.15.131:0/1702498867 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f400cb60 con 0x7fb6fc168010 2024-04-25T19:31:18.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.754+0000 7fb6f9600640 1 -- 172.21.15.131:0/1702498867 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4014440 con 0x7fb6fc168010 2024-04-25T19:31:18.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.754+0000 7fb702200640 1 -- 172.21.15.131:0/1702498867 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6fc161b40 con 0x7fb6fc168010 2024-04-25T19:31:18.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.754+0000 7fb702200640 1 -- 172.21.15.131:0/1702498867 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6fc15fae0 con 0x7fb6fc168010 2024-04-25T19:31:18.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.756+0000 7fb702200640 1 -- 172.21.15.131:0/1702498867 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6fc050740 con 0x7fb6fc168010 2024-04-25T19:31:18.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.757+0000 7fb6f9600640 1 -- 172.21.15.131:0/1702498867 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb6f401c070 con 0x7fb6fc168010 2024-04-25T19:31:18.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.758+0000 7fb6f9600640 1 --2- 172.21.15.131:0/1702498867 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb6d80744e0 0x7fb6d80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:18.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.758+0000 7fb6f9600640 1 -- 172.21.15.131:0/1702498867 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7fb6f4094c10 con 0x7fb6fc168010 2024-04-25T19:31:18.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.758+0000 7fb700e00640 1 --2- 172.21.15.131:0/1702498867 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb6d80744e0 0x7fb6d80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:18.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.759+0000 7fb700e00640 1 --2- 172.21.15.131:0/1702498867 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb6d80744e0 0x7fb6d80769f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4034000 tx=0x7fb6e402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:18.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.762+0000 7fb6f9600640 1 -- 172.21.15.131:0/1702498867 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb6fc14df40 con 0x7fb6fc168010 2024-04-25T19:31:18.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.962+0000 7fb702200640 1 -- 172.21.15.131:0/1702498867 --> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fb6fc1ef630 con 0x7fb6d80744e0 2024-04-25T19:31:18.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.963+0000 7fb6f9600640 1 -- 172.21.15.131:0/1702498867 <== mgr.4105 v2:172.21.15.195:6832/2541913764 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb6e4032770 con 0x7fb6d80744e0 2024-04-25T19:31:18.963 INFO:teuthology.orchestra.run.smithi131.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T19:31:18.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.966+0000 7fb702200640 1 -- 172.21.15.131:0/1702498867 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb6d80744e0 msgr2=0x7fb6d80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:18.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.966+0000 7fb702200640 1 --2- 172.21.15.131:0/1702498867 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb6d80744e0 0x7fb6d80769f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4034000 tx=0x7fb6e402e000 comp rx=0 tx=0).stop 2024-04-25T19:31:18.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.966+0000 7fb702200640 1 -- 172.21.15.131:0/1702498867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6fc168010 msgr2=0x7fb6fc14da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:18.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.966+0000 7fb702200640 1 --2- 172.21.15.131:0/1702498867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6fc168010 0x7fb6fc14da00 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb6f400ba10 tx=0x7fb6f400bed0 comp rx=0 tx=0).stop 2024-04-25T19:31:18.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.966+0000 7fb702200640 1 -- 172.21.15.131:0/1702498867 shutdown_connections 2024-04-25T19:31:18.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.966+0000 7fb702200640 1 --2- 172.21.15.131:0/1702498867 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb6d80744e0 0x7fb6d80769f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:18.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.966+0000 7fb702200640 1 --2- 172.21.15.131:0/1702498867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6fc168010 0x7fb6fc14da00 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:18.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.966+0000 7fb702200640 1 --2- 172.21.15.131:0/1702498867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6fc1649d0 0x7fb6fc0b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:18.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.966+0000 7fb702200640 1 --2- 172.21.15.131:0/1702498867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6fc0cf2f0 0x7fb6fc1605c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:18.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.966+0000 7fb702200640 1 -- 172.21.15.131:0/1702498867 >> 172.21.15.131:0/1702498867 conn(0x7fb6fc0d1720 msgr2=0x7fb6fc0d09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:18.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.966+0000 7fb702200640 1 -- 172.21.15.131:0/1702498867 shutdown_connections 2024-04-25T19:31:18.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:18.966+0000 7fb702200640 1 -- 172.21.15.131:0/1702498867 wait complete. 2024-04-25T19:31:18.991 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T19:31:18.991 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T19:31:19.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.270+0000 7f968ca00640 1 Processor -- start 2024-04-25T19:31:19.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.270+0000 7f968ca00640 1 -- start start 2024-04-25T19:31:19.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.272+0000 7f968ca00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f968806dce0 0x7f96880cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:19.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.272+0000 7f968ca00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9688071110 con 0x7f968815adf0 2024-04-25T19:31:19.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.272+0000 7f968ca00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f968806fb50 con 0x7f9688070630 2024-04-25T19:31:19.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.272+0000 7f968ca00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f96880713f0 con 0x7f968806dce0 2024-04-25T19:31:19.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.273+0000 7f9686800640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f968815adf0 0x7f9688160d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:57482/0 (socket says 172.21.15.131:57482) 2024-04-25T19:31:19.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.273+0000 7f9686800640 1 -- 172.21.15.131:0/4284407182 learned_addr learned my addr 172.21.15.131:0/4284407182 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:31:19.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.273+0000 7f967fe00640 1 --2- 172.21.15.131:0/4284407182 >> v2:172.21.15.195:3300/0 conn(0x7f968806dce0 0x7f96880cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:19.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.273+0000 7f9685400640 1 -- 172.21.15.131:0/4284407182 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2211921027 0 0) 0x7f9688071110 con 0x7f968815adf0 2024-04-25T19:31:19.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.273+0000 7f9685400640 1 -- 172.21.15.131:0/4284407182 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f966c003520 con 0x7f968815adf0 2024-04-25T19:31:19.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.273+0000 7f9685400640 1 -- 172.21.15.131:0/4284407182 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1680809537 0 0) 0x7f966c003520 con 0x7f968815adf0 2024-04-25T19:31:19.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.274+0000 7f9685400640 1 -- 172.21.15.131:0/4284407182 >> v2:172.21.15.195:3300/0 conn(0x7f968806dce0 msgr2=0x7f96880cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:19.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.274+0000 7f9685400640 1 --2- 172.21.15.131:0/4284407182 >> v2:172.21.15.195:3300/0 conn(0x7f968806dce0 0x7f96880cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:19.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.274+0000 7f9685400640 1 -- 172.21.15.131:0/4284407182 >> v1:172.21.15.195:6789/0 conn(0x7f9688070630 legacy=0x7f968806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:19.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.274+0000 7f9685400640 1 -- 172.21.15.131:0/4284407182 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968806fe30 con 0x7f968815adf0 2024-04-25T19:31:19.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.274+0000 7f9685400640 1 -- 172.21.15.131:0/4284407182 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f96800019f0 con 0x7f968815adf0 2024-04-25T19:31:19.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.274+0000 7f9685400640 1 -- 172.21.15.131:0/4284407182 >> v1:172.21.15.131:6789/0 conn(0x7f968815adf0 legacy=0x7f9688160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:19.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.274+0000 7f9685400640 1 --2- 172.21.15.131:0/4284407182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f966c003a00 0x7f966c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:19.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.274+0000 7f9685400640 1 --2- 172.21.15.131:0/4284407182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f966c004800 0x7f966c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:19.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.274+0000 7f9685400640 1 --2- 172.21.15.131:0/4284407182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f966c0052a0 0x7f966c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:19.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.274+0000 7f9685400640 1 -- 172.21.15.131:0/4284407182 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f96880713f0 con 0x7f966c004800 2024-04-25T19:31:19.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.274+0000 7f9685400640 1 -- 172.21.15.131:0/4284407182 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f966c00e440 con 0x7f966c0052a0 2024-04-25T19:31:19.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.274+0000 7f9685400640 1 -- 172.21.15.131:0/4284407182 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f966c00e640 con 0x7f966c003a00 2024-04-25T19:31:19.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.274+0000 7f967fe00640 1 --2- 172.21.15.131:0/4284407182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f966c004800 0x7f966c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:19.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.274+0000 7f9686800640 1 --2- 172.21.15.131:0/4284407182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f966c0052a0 0x7f966c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:19.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.274+0000 7f9685e00640 1 --2- 172.21.15.131:0/4284407182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f966c003a00 0x7f966c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:19.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.275+0000 7f967fe00640 1 -- 172.21.15.131:0/4284407182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f966c003a00 msgr2=0x7f966c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:19.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.275+0000 7f967fe00640 1 --2- 172.21.15.131:0/4284407182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f966c003a00 0x7f966c003e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:19.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.275+0000 7f967fe00640 1 -- 172.21.15.131:0/4284407182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f966c0052a0 msgr2=0x7f966c00dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:19.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.275+0000 7f967fe00640 1 --2- 172.21.15.131:0/4284407182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f966c0052a0 0x7f966c00dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:19.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.275+0000 7f9686800640 1 -- 172.21.15.131:0/4284407182 reap_dead start 2024-04-25T19:31:19.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.275+0000 7f967fe00640 1 -- 172.21.15.131:0/4284407182 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f966c003520 con 0x7f966c004800 2024-04-25T19:31:19.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.276+0000 7f967fe00640 1 --2- 172.21.15.131:0/4284407182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f966c004800 0x7f966c004c10 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9670009ac0 tx=0x7f966c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c210e10dbc0e4df4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:19.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.276+0000 7f9685400640 1 -- 172.21.15.131:0/4284407182 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9670036070 con 0x7f966c004800 2024-04-25T19:31:19.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.276+0000 7f9685400640 1 -- 172.21.15.131:0/4284407182 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9670031400 con 0x7f966c004800 2024-04-25T19:31:19.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.276+0000 7f9685400640 1 -- 172.21.15.131:0/4284407182 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9670009690 con 0x7f966c004800 2024-04-25T19:31:19.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.277+0000 7f968ca00640 1 -- 172.21.15.131:0/4284407182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f966c004800 msgr2=0x7f966c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:19.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.277+0000 7f968ca00640 1 --2- 172.21.15.131:0/4284407182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f966c004800 0x7f966c004c10 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9670009ac0 tx=0x7f966c005830 comp rx=0 tx=0).stop 2024-04-25T19:31:19.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.277+0000 7f968ca00640 1 -- 172.21.15.131:0/4284407182 shutdown_connections 2024-04-25T19:31:19.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.277+0000 7f968ca00640 1 --2- 172.21.15.131:0/4284407182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f966c004800 0x7f966c004c10 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:19.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.277+0000 7f968ca00640 1 -- 172.21.15.131:0/4284407182 >> 172.21.15.131:0/4284407182 conn(0x7f9688073090 msgr2=0x7f96880734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:19.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.277+0000 7f968ca00640 1 -- 172.21.15.131:0/4284407182 shutdown_connections 2024-04-25T19:31:19.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.277+0000 7f968ca00640 1 -- 172.21.15.131:0/4284407182 wait complete. 2024-04-25T19:31:19.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.279+0000 7f968ca00640 1 Processor -- start 2024-04-25T19:31:19.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.280+0000 7f968ca00640 1 -- start start 2024-04-25T19:31:19.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.281+0000 7f968ca00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f966c004800 0x7f968815d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:19.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.281+0000 7f968ca00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96880b5fc0 0x7f9688151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:19.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.281+0000 7f968ca00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f968815b200 0x7f968815b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:19.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.281+0000 7f968ca00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f96880701a0 con 0x7f966c004800 2024-04-25T19:31:19.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.281+0000 7f968ca00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f96880b0f10 con 0x7f96880b5fc0 2024-04-25T19:31:19.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.281+0000 7f968ca00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9688070c80 con 0x7f968815b200 2024-04-25T19:31:19.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.281+0000 7f9685e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f966c004800 0x7f968815d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:19.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.281+0000 7f9685e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f966c004800 0x7f968815d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:35030/0 (socket says 172.21.15.131:35030) 2024-04-25T19:31:19.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.281+0000 7f9685e00640 1 -- 172.21.15.131:0/2367730651 learned_addr learned my addr 172.21.15.131:0/2367730651 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:19.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.282+0000 7f967fe00640 1 --2- 172.21.15.131:0/2367730651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96880b5fc0 0x7f9688151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:19.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.282+0000 7f9685e00640 1 -- 172.21.15.131:0/2367730651 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f968815b200 msgr2=0x7f968815b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:19.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.282+0000 7f9685e00640 1 --2- 172.21.15.131:0/2367730651 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f968815b200 0x7f968815b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:19.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.282+0000 7f9685e00640 1 -- 172.21.15.131:0/2367730651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96880b5fc0 msgr2=0x7f9688151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:19.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.282+0000 7f9685e00640 1 --2- 172.21.15.131:0/2367730651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96880b5fc0 0x7f9688151250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:19.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.282+0000 7f9685e00640 1 -- 172.21.15.131:0/2367730651 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968815bb50 con 0x7f966c004800 2024-04-25T19:31:19.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.282+0000 7f9685e00640 1 --2- 172.21.15.131:0/2367730651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f966c004800 0x7f968815d7c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f967800d540 tx=0x7f967800da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:19.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.282+0000 7f967e000640 1 -- 172.21.15.131:0/2367730651 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678005480 con 0x7f966c004800 2024-04-25T19:31:19.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.282+0000 7f967e000640 1 -- 172.21.15.131:0/2367730651 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9678017070 con 0x7f966c004800 2024-04-25T19:31:19.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.282+0000 7f967e000640 1 -- 172.21.15.131:0/2367730651 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678003810 con 0x7f966c004800 2024-04-25T19:31:19.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.282+0000 7f968ca00640 1 -- 172.21.15.131:0/2367730651 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f968815e0c0 con 0x7f966c004800 2024-04-25T19:31:19.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.283+0000 7f968ca00640 1 -- 172.21.15.131:0/2367730651 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f968815e680 con 0x7f966c004800 2024-04-25T19:31:19.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.284+0000 7f968ca00640 1 -- 172.21.15.131:0/2367730651 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9688050740 con 0x7f966c004800 2024-04-25T19:31:19.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.285+0000 7f967e000640 1 -- 172.21.15.131:0/2367730651 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f96780039b0 con 0x7f966c004800 2024-04-25T19:31:19.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.286+0000 7f967e000640 1 --2- 172.21.15.131:0/2367730651 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f96640744b0 0x7f96640769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:19.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.286+0000 7f967e000640 1 -- 172.21.15.131:0/2367730651 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f9678094ca0 con 0x7f966c004800 2024-04-25T19:31:19.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.286+0000 7f967e000640 1 --2- 172.21.15.131:0/2367730651 >> [v2:172.21.15.195:6800/3394326073,v1:172.21.15.195:6801/3394326073] conn(0x7f966407a3c0 0x7f966407c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:19.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.286+0000 7f967e000640 1 -- 172.21.15.131:0/2367730651 --> [v2:172.21.15.195:6800/3394326073,v1:172.21.15.195:6801/3394326073] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9678017e70 con 0x7f966407a3c0 2024-04-25T19:31:19.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.286+0000 7f967e000640 1 -- 172.21.15.131:0/2367730651 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f96780972c0 con 0x7f966c004800 2024-04-25T19:31:19.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.287+0000 7f967fe00640 1 --2- 172.21.15.131:0/2367730651 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f96640744b0 0x7f96640769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:19.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.287+0000 7f9686800640 1 --2- 172.21.15.131:0/2367730651 >> [v2:172.21.15.195:6800/3394326073,v1:172.21.15.195:6801/3394326073] conn(0x7f966407a3c0 0x7f966407c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:19.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.288+0000 7f967fe00640 1 --2- 172.21.15.131:0/2367730651 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f96640744b0 0x7f96640769c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9670033000 tx=0x7f9670008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:19.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.289+0000 7f9686800640 1 --2- 172.21.15.131:0/2367730651 >> [v2:172.21.15.195:6800/3394326073,v1:172.21.15.195:6801/3394326073] conn(0x7f966407a3c0 0x7f966407c810 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:19.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.291+0000 7f967e000640 1 -- 172.21.15.131:0/2367730651 <== osd.4 v2:172.21.15.195:6800/3394326073 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9678017e70 con 0x7f966407a3c0 2024-04-25T19:31:19.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.305+0000 7f968ca00640 1 -- 172.21.15.131:0/2367730651 --> [v2:172.21.15.195:6800/3394326073,v1:172.21.15.195:6801/3394326073] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9688153b60 con 0x7f966407a3c0 2024-04-25T19:31:19.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.306+0000 7f967e000640 1 -- 172.21.15.131:0/2367730651 <== osd.4 v2:172.21.15.195:6800/3394326073 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9688153b60 con 0x7f966407a3c0 2024-04-25T19:31:19.308 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-25T19:31:19.308 INFO:teuthology.orchestra.run.smithi131.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T19:31:19.308 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-25T19:31:19.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.307+0000 7f968ca00640 1 -- 172.21.15.131:0/2367730651 >> [v2:172.21.15.195:6800/3394326073,v1:172.21.15.195:6801/3394326073] conn(0x7f966407a3c0 msgr2=0x7f966407c810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:19.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.307+0000 7f968ca00640 1 --2- 172.21.15.131:0/2367730651 >> [v2:172.21.15.195:6800/3394326073,v1:172.21.15.195:6801/3394326073] conn(0x7f966407a3c0 0x7f966407c810 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:19.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.307+0000 7f968ca00640 1 -- 172.21.15.131:0/2367730651 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f96640744b0 msgr2=0x7f96640769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:19.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.307+0000 7f968ca00640 1 --2- 172.21.15.131:0/2367730651 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f96640744b0 0x7f96640769c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9670033000 tx=0x7f9670008030 comp rx=0 tx=0).stop 2024-04-25T19:31:19.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.307+0000 7f968ca00640 1 -- 172.21.15.131:0/2367730651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f966c004800 msgr2=0x7f968815d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:19.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.307+0000 7f968ca00640 1 --2- 172.21.15.131:0/2367730651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f966c004800 0x7f968815d7c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f967800d540 tx=0x7f967800da00 comp rx=0 tx=0).stop 2024-04-25T19:31:19.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.307+0000 7f9686800640 1 -- 172.21.15.131:0/2367730651 reap_dead start 2024-04-25T19:31:19.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.307+0000 7f968ca00640 1 -- 172.21.15.131:0/2367730651 shutdown_connections 2024-04-25T19:31:19.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.307+0000 7f968ca00640 1 -- 172.21.15.131:0/2367730651 >> 172.21.15.131:0/2367730651 conn(0x7f9688073090 msgr2=0x7f96880b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:19.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.307+0000 7f968ca00640 1 -- 172.21.15.131:0/2367730651 shutdown_connections 2024-04-25T19:31:19.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.307+0000 7f968ca00640 1 -- 172.21.15.131:0/2367730651 wait complete. 2024-04-25T19:31:19.334 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T19:31:19.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.613+0000 7fb672c00640 1 Processor -- start 2024-04-25T19:31:19.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.613+0000 7fb672c00640 1 -- start start 2024-04-25T19:31:19.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.615+0000 7fb672c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb66c160360 0x7fb66c1647f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:19.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.615+0000 7fb672c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb66c0b5c90 0x7fb66c0b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:19.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.615+0000 7fb672c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb66c0b65e0 con 0x7fb66c070680 2024-04-25T19:31:19.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.615+0000 7fb672c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fb66c06d100 con 0x7fb66c0b5c90 2024-04-25T19:31:19.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.615+0000 7fb672c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb66c06c7d0 con 0x7fb66c160360 2024-04-25T19:31:19.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.616+0000 7fb670c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb66c0b5c90 0x7fb66c0b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:19.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.616+0000 7fb670c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb66c0b5c90 0x7fb66c0b60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:35044/0 (socket says 172.21.15.131:35044) 2024-04-25T19:31:19.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.616+0000 7fb670c00640 1 -- 172.21.15.131:0/2017333833 learned_addr learned my addr 172.21.15.131:0/2017333833 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:19.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.616+0000 7fb66b400640 1 --2- 172.21.15.131:0/2017333833 >> v2:172.21.15.195:3300/0 conn(0x7fb66c160360 0x7fb66c1647f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:19.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.616+0000 7fb670c00640 1 -- 172.21.15.131:0/2017333833 >> v2:172.21.15.195:3300/0 conn(0x7fb66c160360 msgr2=0x7fb66c1647f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:19.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.616+0000 7fb670c00640 1 --2- 172.21.15.131:0/2017333833 >> v2:172.21.15.195:3300/0 conn(0x7fb66c160360 0x7fb66c1647f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:19.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.616+0000 7fb670c00640 1 -- 172.21.15.131:0/2017333833 >> v1:172.21.15.195:6789/0 conn(0x7fb66c070680 legacy=0x7fb66c0af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:19.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.616+0000 7fb670c00640 1 -- 172.21.15.131:0/2017333833 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb66c06cab0 con 0x7fb66c0b5c90 2024-04-25T19:31:19.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.617+0000 7fb670c00640 1 --2- 172.21.15.131:0/2017333833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb66c0b5c90 0x7fb66c0b60a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0b46e0 tx=0x7fb66402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c48e8bc7c39706 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:19.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.618+0000 7fb66aa00640 1 -- 172.21.15.131:0/2017333833 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb664036070 con 0x7fb66c0b5c90 2024-04-25T19:31:19.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.618+0000 7fb66aa00640 1 -- 172.21.15.131:0/2017333833 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb664031600 con 0x7fb66c0b5c90 2024-04-25T19:31:19.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.618+0000 7fb66aa00640 1 -- 172.21.15.131:0/2017333833 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6640319d0 con 0x7fb66c0b5c90 2024-04-25T19:31:19.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.618+0000 7fb672c00640 1 -- 172.21.15.131:0/2017333833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb66c0b5c90 msgr2=0x7fb66c0b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:19.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.618+0000 7fb672c00640 1 --2- 172.21.15.131:0/2017333833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb66c0b5c90 0x7fb66c0b60a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0b46e0 tx=0x7fb66402a660 comp rx=0 tx=0).stop 2024-04-25T19:31:19.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.619+0000 7fb672c00640 1 -- 172.21.15.131:0/2017333833 shutdown_connections 2024-04-25T19:31:19.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.619+0000 7fb672c00640 1 --2- 172.21.15.131:0/2017333833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb66c0b5c90 0x7fb66c0b60a0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:19.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.619+0000 7fb672c00640 1 --2- 172.21.15.131:0/2017333833 >> v2:172.21.15.195:3300/0 conn(0x7fb66c160360 0x7fb66c1647f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:19.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.619+0000 7fb672c00640 1 -- 172.21.15.131:0/2017333833 >> 172.21.15.131:0/2017333833 conn(0x7fb66c0d1ae0 msgr2=0x7fb66c0d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:19.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.619+0000 7fb672c00640 1 -- 172.21.15.131:0/2017333833 shutdown_connections 2024-04-25T19:31:19.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.619+0000 7fb672c00640 1 -- 172.21.15.131:0/2017333833 wait complete. 2024-04-25T19:31:19.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.621+0000 7fb672c00640 1 Processor -- start 2024-04-25T19:31:19.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.621+0000 7fb672c00640 1 -- start start 2024-04-25T19:31:19.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.623+0000 7fb672c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb66c070680 0x7fb66c14e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:19.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.623+0000 7fb672c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb66c0b5c90 0x7fb66c0ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:19.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.623+0000 7fb672c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb66c160360 0x7fb66c15e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:19.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.623+0000 7fb672c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb66c0afbb0 con 0x7fb66c160360 2024-04-25T19:31:19.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.623+0000 7fb672c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb66c06fcc0 con 0x7fb66c070680 2024-04-25T19:31:19.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.623+0000 7fb672c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb66c0afd30 con 0x7fb66c0b5c90 2024-04-25T19:31:19.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.623+0000 7fb670c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb66c160360 0x7fb66c15e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:19.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.623+0000 7fb670c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb66c160360 0x7fb66c15e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:35056/0 (socket says 172.21.15.131:35056) 2024-04-25T19:31:19.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.623+0000 7fb670c00640 1 -- 172.21.15.131:0/698521504 learned_addr learned my addr 172.21.15.131:0/698521504 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:19.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.623+0000 7fb66be00640 1 --2- 172.21.15.131:0/698521504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb66c070680 0x7fb66c14e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:19.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.623+0000 7fb66b400640 1 --2- 172.21.15.131:0/698521504 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb66c0b5c90 0x7fb66c0ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:19.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.624+0000 7fb670c00640 1 -- 172.21.15.131:0/698521504 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb66c0b5c90 msgr2=0x7fb66c0ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:19.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.624+0000 7fb670c00640 1 --2- 172.21.15.131:0/698521504 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb66c0b5c90 0x7fb66c0ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:19.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.624+0000 7fb670c00640 1 -- 172.21.15.131:0/698521504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb66c070680 msgr2=0x7fb66c14e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:19.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.624+0000 7fb670c00640 1 --2- 172.21.15.131:0/698521504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb66c070680 0x7fb66c14e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:19.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.624+0000 7fb670c00640 1 -- 172.21.15.131:0/698521504 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb66c1f79f0 con 0x7fb66c160360 2024-04-25T19:31:19.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.624+0000 7fb66be00640 1 --2- 172.21.15.131:0/698521504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb66c070680 0x7fb66c14e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T19:31:19.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.624+0000 7fb670c00640 1 --2- 172.21.15.131:0/698521504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb66c160360 0x7fb66c15e270 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb664009f40 tx=0x7fb664004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:19.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.624+0000 7fb663e00640 1 -- 172.21.15.131:0/698521504 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb664041020 con 0x7fb66c160360 2024-04-25T19:31:19.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.624+0000 7fb663e00640 1 -- 172.21.15.131:0/698521504 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb664007780 con 0x7fb66c160360 2024-04-25T19:31:19.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.624+0000 7fb663e00640 1 -- 172.21.15.131:0/698521504 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb664036040 con 0x7fb66c160360 2024-04-25T19:31:19.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.625+0000 7fb672c00640 1 -- 172.21.15.131:0/698521504 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb66c1f7cd0 con 0x7fb66c160360 2024-04-25T19:31:19.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.625+0000 7fb672c00640 1 -- 172.21.15.131:0/698521504 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb66c1f8290 con 0x7fb66c160360 2024-04-25T19:31:19.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.626+0000 7fb672c00640 1 -- 172.21.15.131:0/698521504 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb66c050740 con 0x7fb66c160360 2024-04-25T19:31:19.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.627+0000 7fb663e00640 1 -- 172.21.15.131:0/698521504 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb664044020 con 0x7fb66c160360 2024-04-25T19:31:19.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.628+0000 7fb663e00640 1 --2- 172.21.15.131:0/698521504 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb64c0744e0 0x7fb64c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:19.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.628+0000 7fb663e00640 1 -- 172.21.15.131:0/698521504 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7fb6640b59e0 con 0x7fb66c160360 2024-04-25T19:31:19.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.629+0000 7fb66be00640 1 --2- 172.21.15.131:0/698521504 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb64c0744e0 0x7fb64c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:19.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.630+0000 7fb66be00640 1 --2- 172.21.15.131:0/698521504 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb64c0744e0 0x7fb64c0769f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb65c006fd0 tx=0x7fb65c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:19.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.633+0000 7fb663e00640 1 -- 172.21.15.131:0/698521504 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb66404b070 con 0x7fb66c160360 2024-04-25T19:31:19.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.830+0000 7fb672c00640 1 -- 172.21.15.131:0/698521504 --> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fb66c0caa30 con 0x7fb64c0744e0 2024-04-25T19:31:19.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.832+0000 7fb663e00640 1 -- 172.21.15.131:0/698521504 <== mgr.4105 v2:172.21.15.195:6832/2541913764 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb66c0caa30 con 0x7fb64c0744e0 2024-04-25T19:31:19.833 INFO:teuthology.orchestra.run.smithi131.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T19:31:19.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.834+0000 7fb672c00640 1 -- 172.21.15.131:0/698521504 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb64c0744e0 msgr2=0x7fb64c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:19.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.834+0000 7fb672c00640 1 --2- 172.21.15.131:0/698521504 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb64c0744e0 0x7fb64c0769f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb65c006fd0 tx=0x7fb65c008040 comp rx=0 tx=0).stop 2024-04-25T19:31:19.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.834+0000 7fb672c00640 1 -- 172.21.15.131:0/698521504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb66c160360 msgr2=0x7fb66c15e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:19.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.834+0000 7fb672c00640 1 --2- 172.21.15.131:0/698521504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb66c160360 0x7fb66c15e270 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb664009f40 tx=0x7fb664004a40 comp rx=0 tx=0).stop 2024-04-25T19:31:19.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.835+0000 7fb672c00640 1 -- 172.21.15.131:0/698521504 shutdown_connections 2024-04-25T19:31:19.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.835+0000 7fb672c00640 1 --2- 172.21.15.131:0/698521504 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb64c0744e0 0x7fb64c0769f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:19.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.835+0000 7fb672c00640 1 --2- 172.21.15.131:0/698521504 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb66c0b5c90 0x7fb66c0ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:19.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.835+0000 7fb672c00640 1 --2- 172.21.15.131:0/698521504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb66c160360 0x7fb66c15e270 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:19.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.835+0000 7fb672c00640 1 --2- 172.21.15.131:0/698521504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb66c070680 0x7fb66c14e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:19.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.835+0000 7fb672c00640 1 -- 172.21.15.131:0/698521504 >> 172.21.15.131:0/698521504 conn(0x7fb66c0d1ae0 msgr2=0x7fb66c0d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:19.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.835+0000 7fb672c00640 1 -- 172.21.15.131:0/698521504 shutdown_connections 2024-04-25T19:31:19.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:19.835+0000 7fb672c00640 1 -- 172.21.15.131:0/698521504 wait complete. 2024-04-25T19:31:19.860 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T19:31:19.860 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T19:31:20.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.138+0000 7f0597e00640 1 Processor -- start 2024-04-25T19:31:20.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.138+0000 7f0597e00640 1 -- start start 2024-04-25T19:31:20.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.140+0000 7f0597e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f059806c5c0 0x7f05980cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:20.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.140+0000 7f0597e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f05980cd420 0x7f0598160910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:20.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.140+0000 7f0597e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f059815d1b0 con 0x7f0598070480 2024-04-25T19:31:20.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.140+0000 7f0597e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f05980cbf80 con 0x7f059806c5c0 2024-04-25T19:31:20.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.140+0000 7f0597e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f05980ce190 con 0x7f05980cd420 2024-04-25T19:31:20.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.140+0000 7f0596a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f059806c5c0 0x7f05980cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:20.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.140+0000 7f0596a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f059806c5c0 0x7f05980cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:35060/0 (socket says 172.21.15.131:35060) 2024-04-25T19:31:20.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.140+0000 7f0596a00640 1 -- 172.21.15.131:0/3859875796 learned_addr learned my addr 172.21.15.131:0/3859875796 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:20.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.141+0000 7f0597400640 1 --2- 172.21.15.131:0/3859875796 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f05980cd420 0x7f0598160910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:20.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.141+0000 7f0596a00640 1 -- 172.21.15.131:0/3859875796 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f05980cd420 msgr2=0x7f0598160910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:20.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.141+0000 7f0596a00640 1 --2- 172.21.15.131:0/3859875796 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f05980cd420 0x7f0598160910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:20.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.141+0000 7f0596a00640 1 -- 172.21.15.131:0/3859875796 >> v1:172.21.15.195:6789/0 conn(0x7f0598070480 legacy=0x7f0598070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:20.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.141+0000 7f0596a00640 1 -- 172.21.15.131:0/3859875796 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05980d05b0 con 0x7f059806c5c0 2024-04-25T19:31:20.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.141+0000 7f0597400640 1 --2- 172.21.15.131:0/3859875796 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f05980cd420 0x7f0598160910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:31:20.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.142+0000 7f0596a00640 1 --2- 172.21.15.131:0/3859875796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f059806c5c0 0x7f05980cfec0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0588009870 tx=0x7f058802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95bde35af43dae72 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:20.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.142+0000 7f0595600640 1 -- 172.21.15.131:0/3859875796 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588037070 con 0x7f059806c5c0 2024-04-25T19:31:20.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.142+0000 7f0595600640 1 -- 172.21.15.131:0/3859875796 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0588032440 con 0x7f059806c5c0 2024-04-25T19:31:20.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.142+0000 7f0595600640 1 -- 172.21.15.131:0/3859875796 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588032810 con 0x7f059806c5c0 2024-04-25T19:31:20.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.143+0000 7f0597e00640 1 -- 172.21.15.131:0/3859875796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f059806c5c0 msgr2=0x7f05980cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:20.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.143+0000 7f0597e00640 1 --2- 172.21.15.131:0/3859875796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f059806c5c0 0x7f05980cfec0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0588009870 tx=0x7f058802a210 comp rx=0 tx=0).stop 2024-04-25T19:31:20.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.143+0000 7f0597e00640 1 -- 172.21.15.131:0/3859875796 shutdown_connections 2024-04-25T19:31:20.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.143+0000 7f0597e00640 1 --2- 172.21.15.131:0/3859875796 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f05980cd420 0x7f0598160910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:20.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.143+0000 7f0597e00640 1 --2- 172.21.15.131:0/3859875796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f059806c5c0 0x7f05980cfec0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:20.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.143+0000 7f0597e00640 1 -- 172.21.15.131:0/3859875796 >> 172.21.15.131:0/3859875796 conn(0x7f05980ce3b0 msgr2=0x7f05980ce7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:20.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.143+0000 7f0597e00640 1 -- 172.21.15.131:0/3859875796 shutdown_connections 2024-04-25T19:31:20.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.143+0000 7f0597e00640 1 -- 172.21.15.131:0/3859875796 wait complete. 2024-04-25T19:31:20.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.145+0000 7f0597e00640 1 Processor -- start 2024-04-25T19:31:20.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.146+0000 7f0597e00640 1 -- start start 2024-04-25T19:31:20.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.147+0000 7f0597e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f059806c5c0 0x7f059809d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:20.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.147+0000 7f0597e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0598070480 0x7f059814fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:20.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.147+0000 7f0597e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f05980cd420 0x7f0598150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:20.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.147+0000 7f0597e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f05980d0e50 con 0x7f059806c5c0 2024-04-25T19:31:20.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.147+0000 7f0597e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f05980d0b70 con 0x7f0598070480 2024-04-25T19:31:20.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.147+0000 7f0597e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0598070fa0 con 0x7f05980cd420 2024-04-25T19:31:20.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.147+0000 7f0596a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f059806c5c0 0x7f059809d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:20.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.147+0000 7f0596a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f059806c5c0 0x7f059809d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:35064/0 (socket says 172.21.15.131:35064) 2024-04-25T19:31:20.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.147+0000 7f0596a00640 1 -- 172.21.15.131:0/338726472 learned_addr learned my addr 172.21.15.131:0/338726472 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:20.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.148+0000 7f0596a00640 1 -- 172.21.15.131:0/338726472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f05980cd420 msgr2=0x7f0598150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:20.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.148+0000 7f0596a00640 1 --2- 172.21.15.131:0/338726472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f05980cd420 0x7f0598150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:20.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.148+0000 7f0596a00640 1 -- 172.21.15.131:0/338726472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0598070480 msgr2=0x7f059814fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:20.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.148+0000 7f0596a00640 1 --2- 172.21.15.131:0/338726472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0598070480 0x7f059814fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:20.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.148+0000 7f0596a00640 1 -- 172.21.15.131:0/338726472 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f059809bfc0 con 0x7f059806c5c0 2024-04-25T19:31:20.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.148+0000 7f0596a00640 1 --2- 172.21.15.131:0/338726472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f059806c5c0 0x7f059809d060 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0588009870 tx=0x7f05880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:20.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.148+0000 7f058f400640 1 -- 172.21.15.131:0/338726472 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588041020 con 0x7f059806c5c0 2024-04-25T19:31:20.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.149+0000 7f058f400640 1 -- 172.21.15.131:0/338726472 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0588030970 con 0x7f059806c5c0 2024-04-25T19:31:20.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.149+0000 7f0597e00640 1 -- 172.21.15.131:0/338726472 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f059809c2a0 con 0x7f059806c5c0 2024-04-25T19:31:20.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.149+0000 7f058f400640 1 -- 172.21.15.131:0/338726472 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588037040 con 0x7f059806c5c0 2024-04-25T19:31:20.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.149+0000 7f0597e00640 1 -- 172.21.15.131:0/338726472 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f059809c860 con 0x7f059806c5c0 2024-04-25T19:31:20.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.150+0000 7f0597e00640 1 -- 172.21.15.131:0/338726472 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0598076c60 con 0x7f059806c5c0 2024-04-25T19:31:20.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.151+0000 7f058f400640 1 -- 172.21.15.131:0/338726472 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0588044020 con 0x7f059806c5c0 2024-04-25T19:31:20.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.152+0000 7f058f400640 1 --2- 172.21.15.131:0/338726472 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f05780744e0 0x7f05780769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:20.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.152+0000 7f058f400640 1 -- 172.21.15.131:0/338726472 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f05880b5ed0 con 0x7f059806c5c0 2024-04-25T19:31:20.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.153+0000 7f058f400640 1 --2- 172.21.15.131:0/338726472 >> [v2:172.21.15.195:6824/360782693,v1:172.21.15.195:6825/360782693] conn(0x7f057807a3f0 0x7f057807c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:20.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.153+0000 7f058f400640 1 -- 172.21.15.131:0/338726472 --> [v2:172.21.15.195:6824/360782693,v1:172.21.15.195:6825/360782693] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0588031ec0 con 0x7f057807a3f0 2024-04-25T19:31:20.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.153+0000 7f058f400640 1 -- 172.21.15.131:0/338726472 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f05880b6360 con 0x7f059806c5c0 2024-04-25T19:31:20.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.153+0000 7f0596000640 1 --2- 172.21.15.131:0/338726472 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f05780744e0 0x7f05780769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:20.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.153+0000 7f0597400640 1 --2- 172.21.15.131:0/338726472 >> [v2:172.21.15.195:6824/360782693,v1:172.21.15.195:6825/360782693] conn(0x7f057807a3f0 0x7f057807c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:20.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.154+0000 7f0597400640 1 --2- 172.21.15.131:0/338726472 >> [v2:172.21.15.195:6824/360782693,v1:172.21.15.195:6825/360782693] conn(0x7f057807a3f0 0x7f057807c840 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:20.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.155+0000 7f0596000640 1 --2- 172.21.15.131:0/338726472 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f05780744e0 0x7f05780769f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0584006fd0 tx=0x7f0584006bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:20.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.157+0000 7f058f400640 1 -- 172.21.15.131:0/338726472 <== osd.5 v2:172.21.15.195:6824/360782693 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0588031ec0 con 0x7f057807a3f0 2024-04-25T19:31:20.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.171+0000 7f0597e00640 1 -- 172.21.15.131:0/338726472 --> [v2:172.21.15.195:6824/360782693,v1:172.21.15.195:6825/360782693] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f05980c77b0 con 0x7f057807a3f0 2024-04-25T19:31:20.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.173+0000 7f058f400640 1 -- 172.21.15.131:0/338726472 <== osd.5 v2:172.21.15.195:6824/360782693 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f05980c77b0 con 0x7f057807a3f0 2024-04-25T19:31:20.174 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-25T19:31:20.174 INFO:teuthology.orchestra.run.smithi131.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T19:31:20.174 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-25T19:31:20.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.173+0000 7f0597e00640 1 -- 172.21.15.131:0/338726472 >> [v2:172.21.15.195:6824/360782693,v1:172.21.15.195:6825/360782693] conn(0x7f057807a3f0 msgr2=0x7f057807c840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:20.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.173+0000 7f0597e00640 1 --2- 172.21.15.131:0/338726472 >> [v2:172.21.15.195:6824/360782693,v1:172.21.15.195:6825/360782693] conn(0x7f057807a3f0 0x7f057807c840 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:20.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.173+0000 7f0597e00640 1 -- 172.21.15.131:0/338726472 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f05780744e0 msgr2=0x7f05780769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:20.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.173+0000 7f0597e00640 1 --2- 172.21.15.131:0/338726472 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f05780744e0 0x7f05780769f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0584006fd0 tx=0x7f0584006bc0 comp rx=0 tx=0).stop 2024-04-25T19:31:20.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.173+0000 7f0597e00640 1 -- 172.21.15.131:0/338726472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f059806c5c0 msgr2=0x7f059809d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:20.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.173+0000 7f0597e00640 1 --2- 172.21.15.131:0/338726472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f059806c5c0 0x7f059809d060 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0588009870 tx=0x7f05880046c0 comp rx=0 tx=0).stop 2024-04-25T19:31:20.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.173+0000 7f0597400640 1 -- 172.21.15.131:0/338726472 reap_dead start 2024-04-25T19:31:20.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.173+0000 7f0597e00640 1 -- 172.21.15.131:0/338726472 shutdown_connections 2024-04-25T19:31:20.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.173+0000 7f0597e00640 1 -- 172.21.15.131:0/338726472 >> 172.21.15.131:0/338726472 conn(0x7f05980ce3b0 msgr2=0x7f05980cf9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:20.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.174+0000 7f0597e00640 1 -- 172.21.15.131:0/338726472 shutdown_connections 2024-04-25T19:31:20.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.174+0000 7f0597e00640 1 -- 172.21.15.131:0/338726472 wait complete. 2024-04-25T19:31:20.200 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T19:31:20.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.474+0000 7fe414800640 1 Processor -- start 2024-04-25T19:31:20.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.474+0000 7fe414800640 1 -- start start 2024-04-25T19:31:20.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.476+0000 7fe414800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe40c1434d0 0x7fe40c070480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:20.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.477+0000 7fe414800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe40c1612f0 0x7fe40c0d12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:20.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.477+0000 7fe414800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe40c0709c0 con 0x7fe40c0d0ed0 2024-04-25T19:31:20.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.477+0000 7fe414800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fe40c1438e0 con 0x7fe40c1434d0 2024-04-25T19:31:20.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.477+0000 7fe414800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe40c06f3e0 con 0x7fe40c1612f0 2024-04-25T19:31:20.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.477+0000 7fe411e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe40c1434d0 0x7fe40c070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:20.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.477+0000 7fe411e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe40c1434d0 0x7fe40c070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:35066/0 (socket says 172.21.15.131:35066) 2024-04-25T19:31:20.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.477+0000 7fe411e00640 1 -- 172.21.15.131:0/1784737947 learned_addr learned my addr 172.21.15.131:0/1784737947 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:20.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.477+0000 7fe411400640 1 --1- 172.21.15.131:0/1784737947 >> v1:172.21.15.131:6789/0 conn(0x7fe40c0d0ed0 0x7fe40c160be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:57490/0 (socket says 172.21.15.131:57490) 2024-04-25T19:31:20.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.477+0000 7fe412800640 1 --2- 172.21.15.131:0/1784737947 >> v2:172.21.15.195:3300/0 conn(0x7fe40c1612f0 0x7fe40c0d12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:20.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.477+0000 7fe411e00640 1 -- 172.21.15.131:0/1784737947 >> v2:172.21.15.195:3300/0 conn(0x7fe40c1612f0 msgr2=0x7fe40c0d12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:20.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.477+0000 7fe411e00640 1 --2- 172.21.15.131:0/1784737947 >> v2:172.21.15.195:3300/0 conn(0x7fe40c1612f0 0x7fe40c0d12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:20.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.477+0000 7fe411e00640 1 -- 172.21.15.131:0/1784737947 >> v1:172.21.15.131:6789/0 conn(0x7fe40c0d0ed0 legacy=0x7fe40c160be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:20.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.478+0000 7fe411e00640 1 -- 172.21.15.131:0/1784737947 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe40c06f6c0 con 0x7fe40c1434d0 2024-04-25T19:31:20.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.478+0000 7fe410a00640 1 -- 172.21.15.131:0/1784737947 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2968122223 0 0) 0x7fe40c0709c0 con 0x7fe40c0d0ed0 2024-04-25T19:31:20.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.479+0000 7fe411e00640 1 --2- 172.21.15.131:0/1784737947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe40c1434d0 0x7fe40c070480 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe400009870 tx=0x7fe40002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d41354ab348a30 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:20.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.479+0000 7fe410a00640 1 -- 172.21.15.131:0/1784737947 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe400037070 con 0x7fe40c1434d0 2024-04-25T19:31:20.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.479+0000 7fe410a00640 1 -- 172.21.15.131:0/1784737947 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe400032440 con 0x7fe40c1434d0 2024-04-25T19:31:20.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.479+0000 7fe410a00640 1 -- 172.21.15.131:0/1784737947 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe400032810 con 0x7fe40c1434d0 2024-04-25T19:31:20.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.480+0000 7fe414800640 1 -- 172.21.15.131:0/1784737947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe40c1434d0 msgr2=0x7fe40c070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:20.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.480+0000 7fe414800640 1 --2- 172.21.15.131:0/1784737947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe40c1434d0 0x7fe40c070480 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe400009870 tx=0x7fe40002a2a0 comp rx=0 tx=0).stop 2024-04-25T19:31:20.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.480+0000 7fe414800640 1 -- 172.21.15.131:0/1784737947 shutdown_connections 2024-04-25T19:31:20.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.480+0000 7fe414800640 1 --2- 172.21.15.131:0/1784737947 >> v2:172.21.15.195:3300/0 conn(0x7fe40c1612f0 0x7fe40c0d12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:20.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.480+0000 7fe414800640 1 --2- 172.21.15.131:0/1784737947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe40c1434d0 0x7fe40c070480 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:20.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.480+0000 7fe414800640 1 -- 172.21.15.131:0/1784737947 >> 172.21.15.131:0/1784737947 conn(0x7fe40c0d1ae0 msgr2=0x7fe40c0d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:20.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.480+0000 7fe414800640 1 -- 172.21.15.131:0/1784737947 shutdown_connections 2024-04-25T19:31:20.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.480+0000 7fe414800640 1 -- 172.21.15.131:0/1784737947 wait complete. 2024-04-25T19:31:20.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.482+0000 7fe414800640 1 Processor -- start 2024-04-25T19:31:20.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.482+0000 7fe414800640 1 -- start start 2024-04-25T19:31:20.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.484+0000 7fe414800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe40c0d0ed0 0x7fe40c15e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:20.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.484+0000 7fe414800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe40c1434d0 0x7fe40c1f92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:20.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.484+0000 7fe414800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe40c1f9830 0x7fe40c0b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:20.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.484+0000 7fe414800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe40c06f090 con 0x7fe40c0d0ed0 2024-04-25T19:31:20.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.484+0000 7fe414800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe40c06fc80 con 0x7fe40c1434d0 2024-04-25T19:31:20.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.484+0000 7fe414800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe40c0b51a0 con 0x7fe40c1f9830 2024-04-25T19:31:20.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.484+0000 7fe411e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe40c0d0ed0 0x7fe40c15e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:20.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.484+0000 7fe411e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe40c0d0ed0 0x7fe40c15e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:35074/0 (socket says 172.21.15.131:35074) 2024-04-25T19:31:20.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.484+0000 7fe411e00640 1 -- 172.21.15.131:0/3695887690 learned_addr learned my addr 172.21.15.131:0/3695887690 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:20.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.484+0000 7fe411400640 1 --2- 172.21.15.131:0/3695887690 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe40c1434d0 0x7fe40c1f92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:20.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.485+0000 7fe412800640 1 --2- 172.21.15.131:0/3695887690 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe40c1f9830 0x7fe40c0b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:20.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.485+0000 7fe411e00640 1 -- 172.21.15.131:0/3695887690 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe40c1f9830 msgr2=0x7fe40c0b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:20.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.485+0000 7fe411e00640 1 --2- 172.21.15.131:0/3695887690 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe40c1f9830 0x7fe40c0b15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:20.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.485+0000 7fe411e00640 1 -- 172.21.15.131:0/3695887690 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe40c1434d0 msgr2=0x7fe40c1f92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:20.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.485+0000 7fe411e00640 1 --2- 172.21.15.131:0/3695887690 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe40c1434d0 0x7fe40c1f92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:20.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.485+0000 7fe411e00640 1 -- 172.21.15.131:0/3695887690 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe40c1f9f40 con 0x7fe40c0d0ed0 2024-04-25T19:31:20.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.485+0000 7fe411e00640 1 --2- 172.21.15.131:0/3695887690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe40c0d0ed0 0x7fe40c15e660 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe400000c00 tx=0x7fe4000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:20.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.485+0000 7fe406000640 1 -- 172.21.15.131:0/3695887690 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe400041020 con 0x7fe40c0d0ed0 2024-04-25T19:31:20.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.485+0000 7fe406000640 1 -- 172.21.15.131:0/3695887690 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4000306c0 con 0x7fe40c0d0ed0 2024-04-25T19:31:20.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.485+0000 7fe414800640 1 -- 172.21.15.131:0/3695887690 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe40c15f1d0 con 0x7fe40c0d0ed0 2024-04-25T19:31:20.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.485+0000 7fe406000640 1 -- 172.21.15.131:0/3695887690 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe400037040 con 0x7fe40c0d0ed0 2024-04-25T19:31:20.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.486+0000 7fe414800640 1 -- 172.21.15.131:0/3695887690 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe40c15f790 con 0x7fe40c0d0ed0 2024-04-25T19:31:20.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.487+0000 7fe414800640 1 -- 172.21.15.131:0/3695887690 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe40c050740 con 0x7fe40c0d0ed0 2024-04-25T19:31:20.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.488+0000 7fe406000640 1 -- 172.21.15.131:0/3695887690 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe400044020 con 0x7fe40c0d0ed0 2024-04-25T19:31:20.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.489+0000 7fe406000640 1 --2- 172.21.15.131:0/3695887690 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe3f00744b0 0x7fe3f00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:20.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.489+0000 7fe406000640 1 -- 172.21.15.131:0/3695887690 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7fe4000b5520 con 0x7fe40c0d0ed0 2024-04-25T19:31:20.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.490+0000 7fe411400640 1 --2- 172.21.15.131:0/3695887690 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe3f00744b0 0x7fe3f00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:20.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.491+0000 7fe411400640 1 --2- 172.21.15.131:0/3695887690 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe3f00744b0 0x7fe3f00769c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe40c160300 tx=0x7fe3fc007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:20.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.494+0000 7fe406000640 1 -- 172.21.15.131:0/3695887690 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe40004b070 con 0x7fe40c0d0ed0 2024-04-25T19:31:20.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.692+0000 7fe414800640 1 -- 172.21.15.131:0/3695887690 --> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fe40c070790 con 0x7fe3f00744b0 2024-04-25T19:31:20.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.693+0000 7fe406000640 1 -- 172.21.15.131:0/3695887690 <== mgr.4105 v2:172.21.15.195:6832/2541913764 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe40c070790 con 0x7fe3f00744b0 2024-04-25T19:31:20.695 INFO:teuthology.orchestra.run.smithi131.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T19:31:20.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.696+0000 7fe414800640 1 -- 172.21.15.131:0/3695887690 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe3f00744b0 msgr2=0x7fe3f00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:20.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.696+0000 7fe414800640 1 --2- 172.21.15.131:0/3695887690 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe3f00744b0 0x7fe3f00769c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe40c160300 tx=0x7fe3fc007c00 comp rx=0 tx=0).stop 2024-04-25T19:31:20.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.696+0000 7fe414800640 1 -- 172.21.15.131:0/3695887690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe40c0d0ed0 msgr2=0x7fe40c15e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:20.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.696+0000 7fe414800640 1 --2- 172.21.15.131:0/3695887690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe40c0d0ed0 0x7fe40c15e660 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe400000c00 tx=0x7fe4000046c0 comp rx=0 tx=0).stop 2024-04-25T19:31:20.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.696+0000 7fe414800640 1 -- 172.21.15.131:0/3695887690 shutdown_connections 2024-04-25T19:31:20.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.696+0000 7fe414800640 1 --2- 172.21.15.131:0/3695887690 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fe3f00744b0 0x7fe3f00769c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:20.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.696+0000 7fe414800640 1 --2- 172.21.15.131:0/3695887690 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe40c1f9830 0x7fe40c0b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:20.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.696+0000 7fe414800640 1 --2- 172.21.15.131:0/3695887690 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe40c1434d0 0x7fe40c1f92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:20.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.696+0000 7fe414800640 1 --2- 172.21.15.131:0/3695887690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe40c0d0ed0 0x7fe40c15e660 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:20.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.696+0000 7fe414800640 1 -- 172.21.15.131:0/3695887690 >> 172.21.15.131:0/3695887690 conn(0x7fe40c0d1ae0 msgr2=0x7fe40c0b56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:20.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.696+0000 7fe414800640 1 -- 172.21.15.131:0/3695887690 shutdown_connections 2024-04-25T19:31:20.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:20.696+0000 7fe414800640 1 -- 172.21.15.131:0/3695887690 wait complete. 2024-04-25T19:31:20.723 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T19:31:20.723 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T19:31:21.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.001+0000 7f2e6a400640 1 Processor -- start 2024-04-25T19:31:21.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.002+0000 7f2e6a400640 1 -- start start 2024-04-25T19:31:21.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.004+0000 7f2e6a400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2e640cd9a0 0x7f2e6415f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:21.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.004+0000 7f2e6a400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2e6406dce0 0x7f2e6415faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:21.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.004+0000 7f2e6a400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e640cdea0 con 0x7f2e640b0af0 2024-04-25T19:31:21.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.004+0000 7f2e6a400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f2e640ceab0 con 0x7f2e640cd9a0 2024-04-25T19:31:21.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.004+0000 7f2e6a400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2e640ce180 con 0x7f2e6406dce0 2024-04-25T19:31:21.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.004+0000 7f2e5aa00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f2e640b0af0 0x7f2e6406d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:57506/0 (socket says 172.21.15.131:57506) 2024-04-25T19:31:21.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.004+0000 7f2e5aa00640 1 -- 172.21.15.131:0/3317183108 learned_addr learned my addr 172.21.15.131:0/3317183108 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:31:21.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.005+0000 7f2e63e00640 1 --2- 172.21.15.131:0/3317183108 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2e6406dce0 0x7f2e6415faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:21.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.005+0000 7f2e63400640 1 --2- 172.21.15.131:0/3317183108 >> v2:172.21.15.195:3300/0 conn(0x7f2e640cd9a0 0x7f2e6415f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:21.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.005+0000 7f2e62a00640 1 -- 172.21.15.131:0/3317183108 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 613808666 0 0) 0x7f2e640cdea0 con 0x7f2e640b0af0 2024-04-25T19:31:21.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.005+0000 7f2e62a00640 1 -- 172.21.15.131:0/3317183108 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e48003520 con 0x7f2e640b0af0 2024-04-25T19:31:21.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.005+0000 7f2e62a00640 1 -- 172.21.15.131:0/3317183108 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2706682572 0 0) 0x7f2e48003520 con 0x7f2e640b0af0 2024-04-25T19:31:21.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.005+0000 7f2e62a00640 1 -- 172.21.15.131:0/3317183108 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2e6406dce0 msgr2=0x7f2e6415faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:21.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.005+0000 7f2e62a00640 1 --2- 172.21.15.131:0/3317183108 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2e6406dce0 0x7f2e6415faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:21.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.005+0000 7f2e62a00640 1 -- 172.21.15.131:0/3317183108 >> v2:172.21.15.195:3300/0 conn(0x7f2e640cd9a0 msgr2=0x7f2e6415f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:21.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.005+0000 7f2e62a00640 1 --2- 172.21.15.131:0/3317183108 >> v2:172.21.15.195:3300/0 conn(0x7f2e640cd9a0 0x7f2e6415f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:21.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.005+0000 7f2e62a00640 1 -- 172.21.15.131:0/3317183108 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e640ce460 con 0x7f2e640b0af0 2024-04-25T19:31:21.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.005+0000 7f2e62a00640 1 -- 172.21.15.131:0/3317183108 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7f2e4c001670 con 0x7f2e640b0af0 2024-04-25T19:31:21.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.005+0000 7f2e62a00640 1 -- 172.21.15.131:0/3317183108 >> v1:172.21.15.131:6789/0 conn(0x7f2e640b0af0 legacy=0x7f2e6406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:21.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.005+0000 7f2e62a00640 1 --2- 172.21.15.131:0/3317183108 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2e480039b0 0x7f2e48003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:21.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.005+0000 7f2e62a00640 1 --2- 172.21.15.131:0/3317183108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e48004340 0x7f2e48004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:21.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.005+0000 7f2e62a00640 1 --2- 172.21.15.131:0/3317183108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e48004ed0 0x7f2e4800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:21.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.005+0000 7f2e62a00640 1 -- 172.21.15.131:0/3317183108 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2e640ceab0 con 0x7f2e48004ed0 2024-04-25T19:31:21.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.005+0000 7f2e62a00640 1 -- 172.21.15.131:0/3317183108 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2e640ce180 con 0x7f2e48004340 2024-04-25T19:31:21.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.005+0000 7f2e62a00640 1 -- 172.21.15.131:0/3317183108 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2e4800bf00 con 0x7f2e480039b0 2024-04-25T19:31:21.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.006+0000 7f2e63e00640 1 --2- 172.21.15.131:0/3317183108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e48004ed0 0x7f2e4800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:21.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.006+0000 7f2e5aa00640 1 --2- 172.21.15.131:0/3317183108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e48004340 0x7f2e48004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:21.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.006+0000 7f2e63e00640 1 -- 172.21.15.131:0/3317183108 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2e480039b0 msgr2=0x7f2e48003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:21.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.006+0000 7f2e63e00640 1 --2- 172.21.15.131:0/3317183108 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2e480039b0 0x7f2e48003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:21.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.006+0000 7f2e63e00640 1 -- 172.21.15.131:0/3317183108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e48004340 msgr2=0x7f2e48004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:21.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.006+0000 7f2e63e00640 1 --2- 172.21.15.131:0/3317183108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e48004340 0x7f2e48004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:21.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.006+0000 7f2e63e00640 1 -- 172.21.15.131:0/3317183108 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e48003520 con 0x7f2e48004ed0 2024-04-25T19:31:21.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.006+0000 7f2e5aa00640 1 --2- 172.21.15.131:0/3317183108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e48004340 0x7f2e48004860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:31:21.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.007+0000 7f2e63e00640 1 --2- 172.21.15.131:0/3317183108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e48004ed0 0x7f2e4800b9c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f2e640cddd0 tx=0x7f2e48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7e2c180109b9ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:21.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.008+0000 7f2e62a00640 1 -- 172.21.15.131:0/3317183108 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c009c10 con 0x7f2e48004ed0 2024-04-25T19:31:21.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.008+0000 7f2e62a00640 1 -- 172.21.15.131:0/3317183108 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e5c036070 con 0x7f2e48004ed0 2024-04-25T19:31:21.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.008+0000 7f2e62a00640 1 -- 172.21.15.131:0/3317183108 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c031810 con 0x7f2e48004ed0 2024-04-25T19:31:21.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.008+0000 7f2e6a400640 1 -- 172.21.15.131:0/3317183108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e48004ed0 msgr2=0x7f2e4800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:21.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.008+0000 7f2e6a400640 1 --2- 172.21.15.131:0/3317183108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e48004ed0 0x7f2e4800b9c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f2e640cddd0 tx=0x7f2e48005830 comp rx=0 tx=0).stop 2024-04-25T19:31:21.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.008+0000 7f2e63e00640 1 -- 172.21.15.131:0/3317183108 reap_dead start 2024-04-25T19:31:21.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.008+0000 7f2e6a400640 1 -- 172.21.15.131:0/3317183108 shutdown_connections 2024-04-25T19:31:21.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.008+0000 7f2e6a400640 1 -- 172.21.15.131:0/3317183108 >> 172.21.15.131:0/3317183108 conn(0x7f2e64073090 msgr2=0x7f2e640734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:21.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.009+0000 7f2e6a400640 1 -- 172.21.15.131:0/3317183108 shutdown_connections 2024-04-25T19:31:21.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.009+0000 7f2e6a400640 1 -- 172.21.15.131:0/3317183108 wait complete. 2024-04-25T19:31:21.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.011+0000 7f2e6a400640 1 Processor -- start 2024-04-25T19:31:21.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.011+0000 7f2e6a400640 1 -- start start 2024-04-25T19:31:21.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.013+0000 7f2e6a400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e641f72e0 0x7f2e641f45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:21.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.013+0000 7f2e6a400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2e640aba70 0x7f2e640abe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:21.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.013+0000 7f2e6a400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e64146e40 0x7f2e64147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:21.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.013+0000 7f2e6a400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2e640cef40 con 0x7f2e64146e40 2024-04-25T19:31:21.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.013+0000 7f2e6a400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2e640b0f00 con 0x7f2e641f72e0 2024-04-25T19:31:21.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.013+0000 7f2e6a400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2e640cf0c0 con 0x7f2e640aba70 2024-04-25T19:31:21.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.013+0000 7f2e63e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e64146e40 0x7f2e64147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:21.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.013+0000 7f2e63e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e64146e40 0x7f2e64147250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:35102/0 (socket says 172.21.15.131:35102) 2024-04-25T19:31:21.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.013+0000 7f2e63e00640 1 -- 172.21.15.131:0/1789811092 learned_addr learned my addr 172.21.15.131:0/1789811092 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:21.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.013+0000 7f2e63400640 1 --2- 172.21.15.131:0/1789811092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e641f72e0 0x7f2e641f45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:21.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.013+0000 7f2e63e00640 1 -- 172.21.15.131:0/1789811092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2e640aba70 msgr2=0x7f2e640abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:21.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.013+0000 7f2e63e00640 1 --2- 172.21.15.131:0/1789811092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2e640aba70 0x7f2e640abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:21.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.013+0000 7f2e63e00640 1 -- 172.21.15.131:0/1789811092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e641f72e0 msgr2=0x7f2e641f45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:21.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.013+0000 7f2e63e00640 1 --2- 172.21.15.131:0/1789811092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e641f72e0 0x7f2e641f45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:21.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.013+0000 7f2e63e00640 1 -- 172.21.15.131:0/1789811092 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e64147790 con 0x7f2e64146e40 2024-04-25T19:31:21.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.014+0000 7f2e63e00640 1 --2- 172.21.15.131:0/1789811092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e64146e40 0x7f2e64147250 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c00e230 tx=0x7f2e5c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:21.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.014+0000 7f2e5be00640 1 -- 172.21.15.131:0/1789811092 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c009c10 con 0x7f2e64146e40 2024-04-25T19:31:21.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.014+0000 7f2e5be00640 1 -- 172.21.15.131:0/1789811092 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e5c045430 con 0x7f2e64146e40 2024-04-25T19:31:21.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.014+0000 7f2e5be00640 1 -- 172.21.15.131:0/1789811092 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c045800 con 0x7f2e64146e40 2024-04-25T19:31:21.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.014+0000 7f2e6a400640 1 -- 172.21.15.131:0/1789811092 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e640ac4f0 con 0x7f2e64146e40 2024-04-25T19:31:21.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.014+0000 7f2e6a400640 1 -- 172.21.15.131:0/1789811092 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e640acab0 con 0x7f2e64146e40 2024-04-25T19:31:21.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.015+0000 7f2e6a400640 1 -- 172.21.15.131:0/1789811092 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2e64050740 con 0x7f2e64146e40 2024-04-25T19:31:21.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.017+0000 7f2e5be00640 1 -- 172.21.15.131:0/1789811092 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2e5c005d10 con 0x7f2e64146e40 2024-04-25T19:31:21.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.018+0000 7f2e5be00640 1 --2- 172.21.15.131:0/1789811092 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2e400744b0 0x7f2e400769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:21.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.018+0000 7f2e5be00640 1 -- 172.21.15.131:0/1789811092 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f2e5c0b5ae0 con 0x7f2e64146e40 2024-04-25T19:31:21.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.018+0000 7f2e5be00640 1 --2- 172.21.15.131:0/1789811092 >> [v2:172.21.15.195:6816/439683850,v1:172.21.15.195:6817/439683850] conn(0x7f2e4007a3c0 0x7f2e4007c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:21.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.018+0000 7f2e5be00640 1 -- 172.21.15.131:0/1789811092 --> [v2:172.21.15.195:6816/439683850,v1:172.21.15.195:6817/439683850] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2e5c03de50 con 0x7f2e4007a3c0 2024-04-25T19:31:21.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.018+0000 7f2e5be00640 1 -- 172.21.15.131:0/1789811092 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f2e5c0ba2a0 con 0x7f2e64146e40 2024-04-25T19:31:21.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.018+0000 7f2e63400640 1 --2- 172.21.15.131:0/1789811092 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2e400744b0 0x7f2e400769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:21.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.019+0000 7f2e5aa00640 1 --2- 172.21.15.131:0/1789811092 >> [v2:172.21.15.195:6816/439683850,v1:172.21.15.195:6817/439683850] conn(0x7f2e4007a3c0 0x7f2e4007c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:21.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.020+0000 7f2e63400640 1 --2- 172.21.15.131:0/1789811092 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2e400744b0 0x7f2e400769c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2e641479e0 tx=0x7f2e54008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:21.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.020+0000 7f2e5aa00640 1 --2- 172.21.15.131:0/1789811092 >> [v2:172.21.15.195:6816/439683850,v1:172.21.15.195:6817/439683850] conn(0x7f2e4007a3c0 0x7f2e4007c810 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:21.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.022+0000 7f2e5be00640 1 -- 172.21.15.131:0/1789811092 <== osd.6 v2:172.21.15.195:6816/439683850 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2e5c03de50 con 0x7f2e4007a3c0 2024-04-25T19:31:21.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.037+0000 7f2e6a400640 1 -- 172.21.15.131:0/1789811092 --> [v2:172.21.15.195:6816/439683850,v1:172.21.15.195:6817/439683850] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2e640b5130 con 0x7f2e4007a3c0 2024-04-25T19:31:21.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.038+0000 7f2e5be00640 1 -- 172.21.15.131:0/1789811092 <== osd.6 v2:172.21.15.195:6816/439683850 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2e640b5130 con 0x7f2e4007a3c0 2024-04-25T19:31:21.039 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-25T19:31:21.039 INFO:teuthology.orchestra.run.smithi131.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T19:31:21.039 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-25T19:31:21.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.038+0000 7f2e6a400640 1 -- 172.21.15.131:0/1789811092 >> [v2:172.21.15.195:6816/439683850,v1:172.21.15.195:6817/439683850] conn(0x7f2e4007a3c0 msgr2=0x7f2e4007c810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:21.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.038+0000 7f2e6a400640 1 --2- 172.21.15.131:0/1789811092 >> [v2:172.21.15.195:6816/439683850,v1:172.21.15.195:6817/439683850] conn(0x7f2e4007a3c0 0x7f2e4007c810 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:21.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.038+0000 7f2e6a400640 1 -- 172.21.15.131:0/1789811092 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2e400744b0 msgr2=0x7f2e400769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:21.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.038+0000 7f2e6a400640 1 --2- 172.21.15.131:0/1789811092 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f2e400744b0 0x7f2e400769c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2e641479e0 tx=0x7f2e54008040 comp rx=0 tx=0).stop 2024-04-25T19:31:21.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.038+0000 7f2e6a400640 1 -- 172.21.15.131:0/1789811092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e64146e40 msgr2=0x7f2e64147250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:21.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.038+0000 7f2e6a400640 1 --2- 172.21.15.131:0/1789811092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e64146e40 0x7f2e64147250 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c00e230 tx=0x7f2e5c009750 comp rx=0 tx=0).stop 2024-04-25T19:31:21.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.038+0000 7f2e63e00640 1 -- 172.21.15.131:0/1789811092 reap_dead start 2024-04-25T19:31:21.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.039+0000 7f2e6a400640 1 -- 172.21.15.131:0/1789811092 shutdown_connections 2024-04-25T19:31:21.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.039+0000 7f2e6a400640 1 -- 172.21.15.131:0/1789811092 >> 172.21.15.131:0/1789811092 conn(0x7f2e64073090 msgr2=0x7f2e640b59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:21.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.039+0000 7f2e6a400640 1 -- 172.21.15.131:0/1789811092 shutdown_connections 2024-04-25T19:31:21.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.039+0000 7f2e6a400640 1 -- 172.21.15.131:0/1789811092 wait complete. 2024-04-25T19:31:21.067 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T19:31:21.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.337+0000 7f41f9600640 1 Processor -- start 2024-04-25T19:31:21.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.338+0000 7f41f9600640 1 -- start start 2024-04-25T19:31:21.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.340+0000 7f41f9600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f41f40cf2f0 0x7f41f40b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:21.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.340+0000 7f41f9600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f40b74d0 con 0x7f41f41608d0 2024-04-25T19:31:21.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.340+0000 7f41f9600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f40b77b0 con 0x7f41f415a810 2024-04-25T19:31:21.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.340+0000 7f41f9600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f41f406f870 con 0x7f41f40cf2f0 2024-04-25T19:31:21.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.340+0000 7f41f3e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f41f40cf2f0 0x7f41f40b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:21.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.340+0000 7f41f3e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f41f40cf2f0 0x7f41f40b6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:35106/0 (socket says 172.21.15.131:35106) 2024-04-25T19:31:21.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.340+0000 7f41f3e00640 1 -- 172.21.15.131:0/1970138609 learned_addr learned my addr 172.21.15.131:0/1970138609 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:21.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.340+0000 7f41f8c00640 1 --1- 172.21.15.131:0/1970138609 >> v1:172.21.15.131:6789/0 conn(0x7f41f41608d0 0x7f41f4160ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:57512/0 (socket says 172.21.15.131:57512) 2024-04-25T19:31:21.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.341+0000 7f41f3e00640 1 -- 172.21.15.131:0/1970138609 >> v1:172.21.15.195:6789/0 conn(0x7f41f415a810 legacy=0x7f41f40b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:21.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.341+0000 7f41f3e00640 1 -- 172.21.15.131:0/1970138609 >> v1:172.21.15.131:6789/0 conn(0x7f41f41608d0 legacy=0x7f41f4160ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:21.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.341+0000 7f41f3400640 1 -- 172.21.15.131:0/1970138609 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3855379144 0 0) 0x7f41f40b74d0 con 0x7f41f41608d0 2024-04-25T19:31:21.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.341+0000 7f41f3e00640 1 -- 172.21.15.131:0/1970138609 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f406f220 con 0x7f41f40cf2f0 2024-04-25T19:31:21.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.342+0000 7f41f3e00640 1 --2- 172.21.15.131:0/1970138609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41f40cf2f0 0x7f41f40b6e10 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f41f406f9f0 tx=0x7f41e402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6fea0f691fc69d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:21.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.342+0000 7f41f3400640 1 -- 172.21.15.131:0/1970138609 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e4036070 con 0x7f41f40cf2f0 2024-04-25T19:31:21.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.342+0000 7f41f3400640 1 -- 172.21.15.131:0/1970138609 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e4031600 con 0x7f41f40cf2f0 2024-04-25T19:31:21.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.342+0000 7f41f3400640 1 -- 172.21.15.131:0/1970138609 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e40319d0 con 0x7f41f40cf2f0 2024-04-25T19:31:21.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.343+0000 7f41f9600640 1 -- 172.21.15.131:0/1970138609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41f40cf2f0 msgr2=0x7f41f40b6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:21.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.343+0000 7f41f9600640 1 --2- 172.21.15.131:0/1970138609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41f40cf2f0 0x7f41f40b6e10 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f41f406f9f0 tx=0x7f41e402a7a0 comp rx=0 tx=0).stop 2024-04-25T19:31:21.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.343+0000 7f41f9600640 1 -- 172.21.15.131:0/1970138609 shutdown_connections 2024-04-25T19:31:21.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.343+0000 7f41f9600640 1 --2- 172.21.15.131:0/1970138609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41f40cf2f0 0x7f41f40b6e10 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:21.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.343+0000 7f41f9600640 1 -- 172.21.15.131:0/1970138609 >> 172.21.15.131:0/1970138609 conn(0x7f41f40d1720 msgr2=0x7f41f40d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:21.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.343+0000 7f41f9600640 1 -- 172.21.15.131:0/1970138609 shutdown_connections 2024-04-25T19:31:21.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.343+0000 7f41f9600640 1 -- 172.21.15.131:0/1970138609 wait complete. 2024-04-25T19:31:21.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.346+0000 7f41f9600640 1 Processor -- start 2024-04-25T19:31:21.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.346+0000 7f41f9600640 1 -- start start 2024-04-25T19:31:21.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.347+0000 7f41f9600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41f40cf2f0 0x7f41f4159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:21.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.347+0000 7f41f9600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41f415a810 0x7f41f41e8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:21.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.347+0000 7f41f9600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f41f41608d0 0x7f41f40cf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:21.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.347+0000 7f41f9600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f41f406fd00 con 0x7f41f415a810 2024-04-25T19:31:21.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.347+0000 7f41f9600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f41f415ac20 con 0x7f41f40cf2f0 2024-04-25T19:31:21.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.347+0000 7f41f9600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f41f406fe80 con 0x7f41f41608d0 2024-04-25T19:31:21.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.348+0000 7f41eb400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41f415a810 0x7f41f41e8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:21.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.348+0000 7f41eb400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41f415a810 0x7f41f41e8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:35108/0 (socket says 172.21.15.131:35108) 2024-04-25T19:31:21.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.348+0000 7f41eb400640 1 -- 172.21.15.131:0/296710379 learned_addr learned my addr 172.21.15.131:0/296710379 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:21.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.348+0000 7f41f3e00640 1 --2- 172.21.15.131:0/296710379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41f40cf2f0 0x7f41f4159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:21.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.348+0000 7f41f8c00640 1 --2- 172.21.15.131:0/296710379 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f41f41608d0 0x7f41f40cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:21.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.348+0000 7f41eb400640 1 -- 172.21.15.131:0/296710379 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f41f41608d0 msgr2=0x7f41f40cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:21.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.348+0000 7f41eb400640 1 --2- 172.21.15.131:0/296710379 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f41f41608d0 0x7f41f40cf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:21.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.348+0000 7f41eb400640 1 -- 172.21.15.131:0/296710379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41f40cf2f0 msgr2=0x7f41f4159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:21.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.348+0000 7f41eb400640 1 --2- 172.21.15.131:0/296710379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41f40cf2f0 0x7f41f4159450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:21.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.348+0000 7f41eb400640 1 -- 172.21.15.131:0/296710379 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f41e6ab0 con 0x7f41f415a810 2024-04-25T19:31:21.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.349+0000 7f41eb400640 1 --2- 172.21.15.131:0/296710379 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41f415a810 0x7f41f41e8670 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00c400 tx=0x7f41dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:21.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.349+0000 7f41f0c00640 1 -- 172.21.15.131:0/296710379 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc017070 con 0x7f41f415a810 2024-04-25T19:31:21.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.349+0000 7f41f0c00640 1 -- 172.21.15.131:0/296710379 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41dc0052d0 con 0x7f41f415a810 2024-04-25T19:31:21.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.349+0000 7f41f0c00640 1 -- 172.21.15.131:0/296710379 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc003830 con 0x7f41f415a810 2024-04-25T19:31:21.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.349+0000 7f41f9600640 1 -- 172.21.15.131:0/296710379 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41f41e6d90 con 0x7f41f415a810 2024-04-25T19:31:21.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.349+0000 7f41f9600640 1 -- 172.21.15.131:0/296710379 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41f41e7350 con 0x7f41f415a810 2024-04-25T19:31:21.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.350+0000 7f41f9600640 1 -- 172.21.15.131:0/296710379 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41f4050740 con 0x7f41f415a810 2024-04-25T19:31:21.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.352+0000 7f41f0c00640 1 -- 172.21.15.131:0/296710379 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f41dc01a070 con 0x7f41f415a810 2024-04-25T19:31:21.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.352+0000 7f41f0c00640 1 --2- 172.21.15.131:0/296710379 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f41d00744e0 0x7f41d00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:21.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.353+0000 7f41f0c00640 1 -- 172.21.15.131:0/296710379 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f41dc0941f0 con 0x7f41f415a810 2024-04-25T19:31:21.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.353+0000 7f41f3e00640 1 --2- 172.21.15.131:0/296710379 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f41d00744e0 0x7f41d00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:21.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.354+0000 7f41f3e00640 1 --2- 172.21.15.131:0/296710379 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f41d00744e0 0x7f41d00769f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f41e4033000 tx=0x7f41e4009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:21.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.358+0000 7f41f0c00640 1 -- 172.21.15.131:0/296710379 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f41dc05ed10 con 0x7f41f415a810 2024-04-25T19:31:21.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.556+0000 7f41f9600640 1 -- 172.21.15.131:0/296710379 --> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f41f406c770 con 0x7f41d00744e0 2024-04-25T19:31:21.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.557+0000 7f41f0c00640 1 -- 172.21.15.131:0/296710379 <== mgr.4105 v2:172.21.15.195:6832/2541913764 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f41f406c770 con 0x7f41d00744e0 2024-04-25T19:31:21.559 INFO:teuthology.orchestra.run.smithi131.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T19:31:21.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.560+0000 7f41f9600640 1 -- 172.21.15.131:0/296710379 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f41d00744e0 msgr2=0x7f41d00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:21.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.560+0000 7f41f9600640 1 --2- 172.21.15.131:0/296710379 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f41d00744e0 0x7f41d00769f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f41e4033000 tx=0x7f41e4009000 comp rx=0 tx=0).stop 2024-04-25T19:31:21.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.560+0000 7f41f9600640 1 -- 172.21.15.131:0/296710379 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41f415a810 msgr2=0x7f41f41e8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:21.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.560+0000 7f41f9600640 1 --2- 172.21.15.131:0/296710379 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41f415a810 0x7f41f41e8670 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00c400 tx=0x7f41dc00c8c0 comp rx=0 tx=0).stop 2024-04-25T19:31:21.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.560+0000 7f41f9600640 1 -- 172.21.15.131:0/296710379 shutdown_connections 2024-04-25T19:31:21.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.560+0000 7f41f9600640 1 --2- 172.21.15.131:0/296710379 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f41d00744e0 0x7f41d00769f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:21.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.560+0000 7f41f9600640 1 --2- 172.21.15.131:0/296710379 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f41f41608d0 0x7f41f40cf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:21.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.560+0000 7f41f9600640 1 --2- 172.21.15.131:0/296710379 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41f415a810 0x7f41f41e8670 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:21.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.560+0000 7f41f9600640 1 --2- 172.21.15.131:0/296710379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41f40cf2f0 0x7f41f4159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:21.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.560+0000 7f41f9600640 1 -- 172.21.15.131:0/296710379 >> 172.21.15.131:0/296710379 conn(0x7f41f40d1720 msgr2=0x7f41f40b1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:21.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.560+0000 7f41f9600640 1 -- 172.21.15.131:0/296710379 shutdown_connections 2024-04-25T19:31:21.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.560+0000 7f41f9600640 1 -- 172.21.15.131:0/296710379 wait complete. 2024-04-25T19:31:21.586 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T19:31:21.586 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T19:31:21.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.860+0000 7f85b3400640 1 Processor -- start 2024-04-25T19:31:21.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.861+0000 7f85b3400640 1 -- start start 2024-04-25T19:31:21.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.863+0000 7f85b3400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f85ac06dce0 0x7f85ac15f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:21.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.863+0000 7f85b3400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f85ac0b0af0 0x7f85ac15faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:21.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.863+0000 7f85b3400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85ac0cdea0 con 0x7f85ac0cd9a0 2024-04-25T19:31:21.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.863+0000 7f85b3400640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f85ac0ceab0 con 0x7f85ac06dce0 2024-04-25T19:31:21.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.863+0000 7f85b3400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f85ac0ce180 con 0x7f85ac0b0af0 2024-04-25T19:31:21.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.863+0000 7f85a3e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f85ac06dce0 0x7f85ac15f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:21.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.863+0000 7f85a3e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f85ac06dce0 0x7f85ac15f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:35118/0 (socket says 172.21.15.131:35118) 2024-04-25T19:31:21.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.863+0000 7f85a3e00640 1 -- 172.21.15.131:0/3621247398 learned_addr learned my addr 172.21.15.131:0/3621247398 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:21.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.863+0000 7f85b0a00640 1 --1- 172.21.15.131:0/3621247398 >> v1:172.21.15.131:6789/0 conn(0x7f85ac0cd9a0 0x7f85ac06d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:57514/0 (socket says 172.21.15.131:57514) 2024-04-25T19:31:21.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.864+0000 7f85a3e00640 1 -- 172.21.15.131:0/3621247398 >> v2:172.21.15.195:3300/0 conn(0x7f85ac0b0af0 msgr2=0x7f85ac15faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:21.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.864+0000 7f85b1400640 1 --2- 172.21.15.131:0/3621247398 >> v2:172.21.15.195:3300/0 conn(0x7f85ac0b0af0 0x7f85ac15faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:21.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.864+0000 7f85a3e00640 1 --2- 172.21.15.131:0/3621247398 >> v2:172.21.15.195:3300/0 conn(0x7f85ac0b0af0 0x7f85ac15faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:21.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.864+0000 7f85abe00640 1 -- 172.21.15.131:0/3621247398 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2352864585 0 0) 0x7f85ac0cdea0 con 0x7f85ac0cd9a0 2024-04-25T19:31:21.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.864+0000 7f85a3e00640 1 -- 172.21.15.131:0/3621247398 >> v1:172.21.15.131:6789/0 conn(0x7f85ac0cd9a0 legacy=0x7f85ac06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:21.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.864+0000 7f85a3e00640 1 -- 172.21.15.131:0/3621247398 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ac0ce460 con 0x7f85ac06dce0 2024-04-25T19:31:21.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.864+0000 7f85b1400640 1 --2- 172.21.15.131:0/3621247398 >> v2:172.21.15.195:3300/0 conn(0x7f85ac0b0af0 0x7f85ac15faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:31:21.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.865+0000 7f85a3e00640 1 --2- 172.21.15.131:0/3621247398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85ac06dce0 0x7f85ac15f360 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f85ac148020 tx=0x7f859402a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b995671218f0ccc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:21.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.865+0000 7f85abe00640 1 -- 172.21.15.131:0/3621247398 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594037070 con 0x7f85ac06dce0 2024-04-25T19:31:21.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.865+0000 7f85abe00640 1 -- 172.21.15.131:0/3621247398 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8594032440 con 0x7f85ac06dce0 2024-04-25T19:31:21.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.865+0000 7f85abe00640 1 -- 172.21.15.131:0/3621247398 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594032810 con 0x7f85ac06dce0 2024-04-25T19:31:21.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.866+0000 7f85b3400640 1 -- 172.21.15.131:0/3621247398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85ac06dce0 msgr2=0x7f85ac15f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:21.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.866+0000 7f85b3400640 1 --2- 172.21.15.131:0/3621247398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85ac06dce0 0x7f85ac15f360 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f85ac148020 tx=0x7f859402a280 comp rx=0 tx=0).stop 2024-04-25T19:31:21.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.866+0000 7f85b3400640 1 -- 172.21.15.131:0/3621247398 shutdown_connections 2024-04-25T19:31:21.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.866+0000 7f85b3400640 1 --2- 172.21.15.131:0/3621247398 >> v2:172.21.15.195:3300/0 conn(0x7f85ac0b0af0 0x7f85ac15faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:21.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.866+0000 7f85b3400640 1 --2- 172.21.15.131:0/3621247398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85ac06dce0 0x7f85ac15f360 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:21.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.866+0000 7f85b3400640 1 -- 172.21.15.131:0/3621247398 >> 172.21.15.131:0/3621247398 conn(0x7f85ac073090 msgr2=0x7f85ac0734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:21.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.866+0000 7f85b3400640 1 -- 172.21.15.131:0/3621247398 shutdown_connections 2024-04-25T19:31:21.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.866+0000 7f85b3400640 1 -- 172.21.15.131:0/3621247398 wait complete. 2024-04-25T19:31:21.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.868+0000 7f85b3400640 1 Processor -- start 2024-04-25T19:31:21.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.869+0000 7f85b3400640 1 -- start start 2024-04-25T19:31:21.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.870+0000 7f85b3400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85ac0b0af0 0x7f85ac144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:21.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.870+0000 7f85b3400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85ac0cd9a0 0x7f85ac157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:21.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.870+0000 7f85b3400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ac0b2700 0x7f85ac0b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:21.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.870+0000 7f85b3400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac0cef40 con 0x7f85ac0b0af0 2024-04-25T19:31:21.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.870+0000 7f85b3400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac0b0f00 con 0x7f85ac0b2700 2024-04-25T19:31:21.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.870+0000 7f85b3400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f85ac0cf0c0 con 0x7f85ac0cd9a0 2024-04-25T19:31:21.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.870+0000 7f85b0a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85ac0b0af0 0x7f85ac144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:21.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.870+0000 7f85b0a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85ac0b0af0 0x7f85ac144a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:35126/0 (socket says 172.21.15.131:35126) 2024-04-25T19:31:21.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.870+0000 7f85b0a00640 1 -- 172.21.15.131:0/2335167488 learned_addr learned my addr 172.21.15.131:0/2335167488 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:21.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.871+0000 7f85b0a00640 1 -- 172.21.15.131:0/2335167488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85ac0cd9a0 msgr2=0x7f85ac157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:21.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.871+0000 7f85b0a00640 1 --2- 172.21.15.131:0/2335167488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85ac0cd9a0 0x7f85ac157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:21.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.871+0000 7f85b0a00640 1 -- 172.21.15.131:0/2335167488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ac0b2700 msgr2=0x7f85ac0b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:21.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.871+0000 7f85b0a00640 1 --2- 172.21.15.131:0/2335167488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ac0b2700 0x7f85ac0b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:21.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.871+0000 7f85b0a00640 1 -- 172.21.15.131:0/2335167488 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ac0b3050 con 0x7f85ac0b0af0 2024-04-25T19:31:21.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.871+0000 7f85b0a00640 1 --2- 172.21.15.131:0/2335167488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85ac0b0af0 0x7f85ac144a10 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f859c00c460 tx=0x7f859c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:21.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.871+0000 7f85a9600640 1 -- 172.21.15.131:0/2335167488 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859c018070 con 0x7f85ac0b0af0 2024-04-25T19:31:21.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.871+0000 7f85a9600640 1 -- 172.21.15.131:0/2335167488 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f859c007500 con 0x7f85ac0b0af0 2024-04-25T19:31:21.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.871+0000 7f85a9600640 1 -- 172.21.15.131:0/2335167488 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859c004a20 con 0x7f85ac0b0af0 2024-04-25T19:31:21.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.871+0000 7f85b3400640 1 -- 172.21.15.131:0/2335167488 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85ac158090 con 0x7f85ac0b0af0 2024-04-25T19:31:21.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.872+0000 7f85b3400640 1 -- 172.21.15.131:0/2335167488 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85ac145660 con 0x7f85ac0b0af0 2024-04-25T19:31:21.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.872+0000 7f85b3400640 1 -- 172.21.15.131:0/2335167488 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f85ac050740 con 0x7f85ac0b0af0 2024-04-25T19:31:21.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.874+0000 7f85a9600640 1 -- 172.21.15.131:0/2335167488 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f859c004bc0 con 0x7f85ac0b0af0 2024-04-25T19:31:21.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.875+0000 7f85a9600640 1 --2- 172.21.15.131:0/2335167488 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f85880744b0 0x7f85880769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:21.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.875+0000 7f85a9600640 1 -- 172.21.15.131:0/2335167488 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f859c094310 con 0x7f85ac0b0af0 2024-04-25T19:31:21.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.875+0000 7f85a9600640 1 --2- 172.21.15.131:0/2335167488 >> [v2:172.21.15.195:6808/3283593923,v1:172.21.15.195:6809/3283593923] conn(0x7f858807a3c0 0x7f858807c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:21.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.875+0000 7f85a9600640 1 -- 172.21.15.131:0/2335167488 --> [v2:172.21.15.195:6808/3283593923,v1:172.21.15.195:6809/3283593923] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f858807cee0 con 0x7f858807a3c0 2024-04-25T19:31:21.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.875+0000 7f85a9600640 1 -- 172.21.15.131:0/2335167488 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f859c09b050 con 0x7f85ac0b0af0 2024-04-25T19:31:21.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.876+0000 7f85a3e00640 1 --2- 172.21.15.131:0/2335167488 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f85880744b0 0x7f85880769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:21.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.876+0000 7f85b1400640 1 --2- 172.21.15.131:0/2335167488 >> [v2:172.21.15.195:6808/3283593923,v1:172.21.15.195:6809/3283593923] conn(0x7f858807a3c0 0x7f858807c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:21.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.877+0000 7f85a3e00640 1 --2- 172.21.15.131:0/2335167488 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f85880744b0 0x7f85880769c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8594034000 tx=0x7f859402c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:21.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.877+0000 7f85b1400640 1 --2- 172.21.15.131:0/2335167488 >> [v2:172.21.15.195:6808/3283593923,v1:172.21.15.195:6809/3283593923] conn(0x7f858807a3c0 0x7f858807c810 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:21.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.879+0000 7f85a9600640 1 -- 172.21.15.131:0/2335167488 <== osd.7 v2:172.21.15.195:6808/3283593923 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f858807cee0 con 0x7f858807a3c0 2024-04-25T19:31:21.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.893+0000 7f85b3400640 1 -- 172.21.15.131:0/2335167488 --> [v2:172.21.15.195:6808/3283593923,v1:172.21.15.195:6809/3283593923] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f85ac15f7e0 con 0x7f858807a3c0 2024-04-25T19:31:21.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.894+0000 7f85a9600640 1 -- 172.21.15.131:0/2335167488 <== osd.7 v2:172.21.15.195:6808/3283593923 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f85ac15f7e0 con 0x7f858807a3c0 2024-04-25T19:31:21.896 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-25T19:31:21.896 INFO:teuthology.orchestra.run.smithi131.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T19:31:21.896 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-25T19:31:21.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.895+0000 7f85b3400640 1 -- 172.21.15.131:0/2335167488 >> [v2:172.21.15.195:6808/3283593923,v1:172.21.15.195:6809/3283593923] conn(0x7f858807a3c0 msgr2=0x7f858807c810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:21.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.895+0000 7f85b3400640 1 --2- 172.21.15.131:0/2335167488 >> [v2:172.21.15.195:6808/3283593923,v1:172.21.15.195:6809/3283593923] conn(0x7f858807a3c0 0x7f858807c810 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:21.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.895+0000 7f85b3400640 1 -- 172.21.15.131:0/2335167488 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f85880744b0 msgr2=0x7f85880769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:21.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.895+0000 7f85b3400640 1 --2- 172.21.15.131:0/2335167488 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f85880744b0 0x7f85880769c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8594034000 tx=0x7f859402c000 comp rx=0 tx=0).stop 2024-04-25T19:31:21.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.895+0000 7f85b3400640 1 -- 172.21.15.131:0/2335167488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85ac0b0af0 msgr2=0x7f85ac144a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:21.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.895+0000 7f85b3400640 1 --2- 172.21.15.131:0/2335167488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85ac0b0af0 0x7f85ac144a10 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f859c00c460 tx=0x7f859c00c920 comp rx=0 tx=0).stop 2024-04-25T19:31:21.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.895+0000 7f85b1400640 1 -- 172.21.15.131:0/2335167488 reap_dead start 2024-04-25T19:31:21.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.895+0000 7f85b3400640 1 -- 172.21.15.131:0/2335167488 shutdown_connections 2024-04-25T19:31:21.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.895+0000 7f85b3400640 1 -- 172.21.15.131:0/2335167488 >> 172.21.15.131:0/2335167488 conn(0x7f85ac073090 msgr2=0x7f85ac0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:21.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.895+0000 7f85b3400640 1 -- 172.21.15.131:0/2335167488 shutdown_connections 2024-04-25T19:31:21.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:21.895+0000 7f85b3400640 1 -- 172.21.15.131:0/2335167488 wait complete. 2024-04-25T19:31:21.922 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T19:31:22.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.176+0000 7fa66e200640 1 Processor -- start 2024-04-25T19:31:22.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.177+0000 7fa66e200640 1 -- start start 2024-04-25T19:31:22.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.179+0000 7fa66e200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa6680cf700 0x7fa66806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:22.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.179+0000 7fa66e200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa668071180 con 0x7fa6680cf2f0 2024-04-25T19:31:22.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.179+0000 7fa66e200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6680700e0 con 0x7fa668168720 2024-04-25T19:31:22.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.179+0000 7fa66e200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fa668070cf0 con 0x7fa6680cf700 2024-04-25T19:31:22.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.179+0000 7fa66ce00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fa6680cf2f0 0x7fa668168010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:57520/0 (socket says 172.21.15.131:57520) 2024-04-25T19:31:22.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.179+0000 7fa66ce00640 1 -- 172.21.15.131:0/1803045318 learned_addr learned my addr 172.21.15.131:0/1803045318 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:31:22.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.179+0000 7fa66d800640 1 --2- 172.21.15.131:0/1803045318 >> v2:172.21.15.195:3300/0 conn(0x7fa6680cf700 0x7fa66806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:22.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.180+0000 7fa667e00640 1 -- 172.21.15.131:0/1803045318 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2711416669 0 0) 0x7fa668071180 con 0x7fa6680cf2f0 2024-04-25T19:31:22.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.180+0000 7fa667e00640 1 -- 172.21.15.131:0/1803045318 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa64c003520 con 0x7fa6680cf2f0 2024-04-25T19:31:22.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.180+0000 7fa667e00640 1 -- 172.21.15.131:0/1803045318 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2842935100 0 0) 0x7fa64c003520 con 0x7fa6680cf2f0 2024-04-25T19:31:22.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.180+0000 7fa667e00640 1 -- 172.21.15.131:0/1803045318 >> v2:172.21.15.195:3300/0 conn(0x7fa6680cf700 msgr2=0x7fa66806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.180+0000 7fa667e00640 1 --2- 172.21.15.131:0/1803045318 >> v2:172.21.15.195:3300/0 conn(0x7fa6680cf700 0x7fa66806ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.180+0000 7fa667e00640 1 -- 172.21.15.131:0/1803045318 >> v1:172.21.15.195:6789/0 conn(0x7fa668168720 legacy=0x7fa66806c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.180+0000 7fa667e00640 1 -- 172.21.15.131:0/1803045318 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6680703c0 con 0x7fa6680cf2f0 2024-04-25T19:31:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.180+0000 7fa667e00640 1 -- 172.21.15.131:0/1803045318 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7fa658001670 con 0x7fa6680cf2f0 2024-04-25T19:31:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.180+0000 7fa667e00640 1 -- 172.21.15.131:0/1803045318 >> v1:172.21.15.131:6789/0 conn(0x7fa6680cf2f0 legacy=0x7fa668168010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.180+0000 7fa667e00640 1 --2- 172.21.15.131:0/1803045318 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa64c003a00 0x7fa64c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.180+0000 7fa667e00640 1 --2- 172.21.15.131:0/1803045318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa64c004800 0x7fa64c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.180+0000 7fa667e00640 1 --2- 172.21.15.131:0/1803045318 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa64c005270 0x7fa64c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.180+0000 7fa667e00640 1 -- 172.21.15.131:0/1803045318 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa668070cf0 con 0x7fa64c004800 2024-04-25T19:31:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.180+0000 7fa667e00640 1 -- 172.21.15.131:0/1803045318 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa64c00c190 con 0x7fa64c005270 2024-04-25T19:31:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.180+0000 7fa667e00640 1 -- 172.21.15.131:0/1803045318 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa64c00c390 con 0x7fa64c003a00 2024-04-25T19:31:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.181+0000 7fa65fe00640 1 --2- 172.21.15.131:0/1803045318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa64c004800 0x7fa64c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.181+0000 7fa66d800640 1 --2- 172.21.15.131:0/1803045318 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa64c005270 0x7fa64c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.181+0000 7fa65fe00640 1 -- 172.21.15.131:0/1803045318 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa64c003a00 msgr2=0x7fa64c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.181+0000 7fa65fe00640 1 --2- 172.21.15.131:0/1803045318 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa64c003a00 0x7fa64c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.181+0000 7fa65fe00640 1 -- 172.21.15.131:0/1803045318 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa64c005270 msgr2=0x7fa64c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.181+0000 7fa65fe00640 1 --2- 172.21.15.131:0/1803045318 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa64c005270 0x7fa64c00b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.181+0000 7fa65fe00640 1 -- 172.21.15.131:0/1803045318 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa64c003520 con 0x7fa64c004800 2024-04-25T19:31:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.181+0000 7fa66d800640 1 -- 172.21.15.131:0/1803045318 reap_dead start 2024-04-25T19:31:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.182+0000 7fa65fe00640 1 --2- 172.21.15.131:0/1803045318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa64c004800 0x7fa64c004c10 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fa650001750 tx=0x7fa64c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4cae66e976a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.182+0000 7fa667e00640 1 -- 172.21.15.131:0/1803045318 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa650001370 con 0x7fa64c004800 2024-04-25T19:31:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.182+0000 7fa667e00640 1 -- 172.21.15.131:0/1803045318 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6500052d0 con 0x7fa64c004800 2024-04-25T19:31:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.182+0000 7fa667e00640 1 -- 172.21.15.131:0/1803045318 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65002ab40 con 0x7fa64c004800 2024-04-25T19:31:22.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.183+0000 7fa66e200640 1 -- 172.21.15.131:0/1803045318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa64c004800 msgr2=0x7fa64c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:22.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.183+0000 7fa66e200640 1 --2- 172.21.15.131:0/1803045318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa64c004800 0x7fa64c004c10 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fa650001750 tx=0x7fa64c005830 comp rx=0 tx=0).stop 2024-04-25T19:31:22.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.183+0000 7fa66e200640 1 -- 172.21.15.131:0/1803045318 shutdown_connections 2024-04-25T19:31:22.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.183+0000 7fa66e200640 1 --2- 172.21.15.131:0/1803045318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa64c004800 0x7fa64c004c10 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:22.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.183+0000 7fa66e200640 1 -- 172.21.15.131:0/1803045318 >> 172.21.15.131:0/1803045318 conn(0x7fa6680d1720 msgr2=0x7fa6680d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:22.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.183+0000 7fa66e200640 1 -- 172.21.15.131:0/1803045318 shutdown_connections 2024-04-25T19:31:22.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.183+0000 7fa66e200640 1 -- 172.21.15.131:0/1803045318 wait complete. 2024-04-25T19:31:22.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.186+0000 7fa66e200640 1 Processor -- start 2024-04-25T19:31:22.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.186+0000 7fa66e200640 1 -- start start 2024-04-25T19:31:22.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.187+0000 7fa66e200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa64c004800 0x7fa66814d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:22.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.187+0000 7fa66e200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa668160d00 0x7fa668164bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:22.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.187+0000 7fa66e200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa668165100 0x7fa6681fa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:22.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.187+0000 7fa66e200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa668168d00 con 0x7fa64c004800 2024-04-25T19:31:22.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.187+0000 7fa66e200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa668070980 con 0x7fa668165100 2024-04-25T19:31:22.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.187+0000 7fa66e200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa668168e80 con 0x7fa668160d00 2024-04-25T19:31:22.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.187+0000 7fa66ce00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa64c004800 0x7fa66814d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:22.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.187+0000 7fa66ce00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa64c004800 0x7fa66814d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:35146/0 (socket says 172.21.15.131:35146) 2024-04-25T19:31:22.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.187+0000 7fa66ce00640 1 -- 172.21.15.131:0/1468945008 learned_addr learned my addr 172.21.15.131:0/1468945008 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:22.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.188+0000 7fa66ce00640 1 -- 172.21.15.131:0/1468945008 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa668160d00 msgr2=0x7fa668164bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:22.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.188+0000 7fa65fe00640 1 --2- 172.21.15.131:0/1468945008 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa668160d00 0x7fa668164bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:22.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.188+0000 7fa66ce00640 1 --2- 172.21.15.131:0/1468945008 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa668160d00 0x7fa668164bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:22.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.188+0000 7fa66ce00640 1 -- 172.21.15.131:0/1468945008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa668165100 msgr2=0x7fa6681fa0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:22.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.188+0000 7fa66d800640 1 --2- 172.21.15.131:0/1468945008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa668165100 0x7fa6681fa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:22.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.188+0000 7fa66ce00640 1 --2- 172.21.15.131:0/1468945008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa668165100 0x7fa6681fa0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:22.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.188+0000 7fa66ce00640 1 -- 172.21.15.131:0/1468945008 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa668165510 con 0x7fa64c004800 2024-04-25T19:31:22.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.188+0000 7fa66ce00640 1 --2- 172.21.15.131:0/1468945008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa64c004800 0x7fa66814d9e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fa65800c760 tx=0x7fa65800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:22.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.188+0000 7fa665600640 1 -- 172.21.15.131:0/1468945008 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa658018070 con 0x7fa64c004800 2024-04-25T19:31:22.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.189+0000 7fa665600640 1 -- 172.21.15.131:0/1468945008 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6580072d0 con 0x7fa64c004800 2024-04-25T19:31:22.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.189+0000 7fa665600640 1 -- 172.21.15.131:0/1468945008 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6580047e0 con 0x7fa64c004800 2024-04-25T19:31:22.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.189+0000 7fa66e200640 1 -- 172.21.15.131:0/1468945008 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6680aa480 con 0x7fa64c004800 2024-04-25T19:31:22.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.189+0000 7fa66e200640 1 -- 172.21.15.131:0/1468945008 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6680aaa40 con 0x7fa64c004800 2024-04-25T19:31:22.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.190+0000 7fa66e200640 1 -- 172.21.15.131:0/1468945008 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa668050740 con 0x7fa64c004800 2024-04-25T19:31:22.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.191+0000 7fa665600640 1 -- 172.21.15.131:0/1468945008 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa658004980 con 0x7fa64c004800 2024-04-25T19:31:22.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.192+0000 7fa665600640 1 --2- 172.21.15.131:0/1468945008 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa6440744b0 0x7fa6440769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:22.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.192+0000 7fa665600640 1 -- 172.21.15.131:0/1468945008 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7fa6580942a0 con 0x7fa64c004800 2024-04-25T19:31:22.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.193+0000 7fa65fe00640 1 --2- 172.21.15.131:0/1468945008 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa6440744b0 0x7fa6440769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:22.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.194+0000 7fa65fe00640 1 --2- 172.21.15.131:0/1468945008 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa6440744b0 0x7fa6440769c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa650032000 tx=0x7fa65002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:22.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.197+0000 7fa665600640 1 -- 172.21.15.131:0/1468945008 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa668165510 con 0x7fa64c004800 2024-04-25T19:31:22.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.381+0000 7fa66e200640 1 -- 172.21.15.131:0/1468945008 --> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fa66806fb60 con 0x7fa6440744b0 2024-04-25T19:31:22.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.382+0000 7fa665600640 1 -- 172.21.15.131:0/1468945008 <== mgr.4105 v2:172.21.15.195:6832/2541913764 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa66806fb60 con 0x7fa6440744b0 2024-04-25T19:31:22.384 INFO:teuthology.orchestra.run.smithi131.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T19:31:22.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.385+0000 7fa66e200640 1 -- 172.21.15.131:0/1468945008 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa6440744b0 msgr2=0x7fa6440769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:22.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.385+0000 7fa66e200640 1 --2- 172.21.15.131:0/1468945008 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa6440744b0 0x7fa6440769c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa650032000 tx=0x7fa65002e000 comp rx=0 tx=0).stop 2024-04-25T19:31:22.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.385+0000 7fa66e200640 1 -- 172.21.15.131:0/1468945008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa64c004800 msgr2=0x7fa66814d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:22.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.385+0000 7fa66e200640 1 --2- 172.21.15.131:0/1468945008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa64c004800 0x7fa66814d9e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fa65800c760 tx=0x7fa65800cc20 comp rx=0 tx=0).stop 2024-04-25T19:31:22.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.385+0000 7fa66e200640 1 -- 172.21.15.131:0/1468945008 shutdown_connections 2024-04-25T19:31:22.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.385+0000 7fa66e200640 1 --2- 172.21.15.131:0/1468945008 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fa6440744b0 0x7fa6440769c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:22.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.385+0000 7fa66e200640 1 --2- 172.21.15.131:0/1468945008 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa668160d00 0x7fa668164bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:22.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.385+0000 7fa66e200640 1 --2- 172.21.15.131:0/1468945008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa668165100 0x7fa6681fa0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:22.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.385+0000 7fa66e200640 1 --2- 172.21.15.131:0/1468945008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa64c004800 0x7fa66814d9e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:22.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.385+0000 7fa66e200640 1 -- 172.21.15.131:0/1468945008 >> 172.21.15.131:0/1468945008 conn(0x7fa6680d1720 msgr2=0x7fa6681626b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:22.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.386+0000 7fa66e200640 1 -- 172.21.15.131:0/1468945008 shutdown_connections 2024-04-25T19:31:22.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.386+0000 7fa66e200640 1 -- 172.21.15.131:0/1468945008 wait complete. 2024-04-25T19:31:22.415 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T19:31:22.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.683+0000 7fb5cb200640 1 Processor -- start 2024-04-25T19:31:22.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.684+0000 7fb5cb200640 1 -- start start 2024-04-25T19:31:22.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.686+0000 7fb5cb200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5cc0cf2f0 0x7fb5cc0b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:22.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.686+0000 7fb5cb200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5cc0b74d0 con 0x7fb5cc15a810 2024-04-25T19:31:22.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.686+0000 7fb5cb200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5cc0b77b0 con 0x7fb5cc1608d0 2024-04-25T19:31:22.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.686+0000 7fb5cb200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb5cc06f870 con 0x7fb5cc0cf2f0 2024-04-25T19:31:22.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.686+0000 7fb5c1400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fb5cc15a810 0x7fb5cc0b4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:57532/0 (socket says 172.21.15.131:57532) 2024-04-25T19:31:22.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.686+0000 7fb5c1400640 1 -- 172.21.15.131:0/3118336915 learned_addr learned my addr 172.21.15.131:0/3118336915 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:31:22.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.687+0000 7fb5c9e00640 1 --2- 172.21.15.131:0/3118336915 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5cc0cf2f0 0x7fb5cc0b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:22.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.687+0000 7fb5c9400640 1 -- 172.21.15.131:0/3118336915 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3920722099 0 0) 0x7fb5cc0b74d0 con 0x7fb5cc15a810 2024-04-25T19:31:22.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.687+0000 7fb5c9400640 1 -- 172.21.15.131:0/3118336915 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5b0003520 con 0x7fb5cc15a810 2024-04-25T19:31:22.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.687+0000 7fb5c9400640 1 -- 172.21.15.131:0/3118336915 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4275406629 0 0) 0x7fb5b0003520 con 0x7fb5cc15a810 2024-04-25T19:31:22.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.687+0000 7fb5c9400640 1 -- 172.21.15.131:0/3118336915 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5cc0cf2f0 msgr2=0x7fb5cc0b6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:22.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.687+0000 7fb5c9400640 1 --2- 172.21.15.131:0/3118336915 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5cc0cf2f0 0x7fb5cc0b6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:22.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.687+0000 7fb5c9400640 1 -- 172.21.15.131:0/3118336915 >> v1:172.21.15.195:6789/0 conn(0x7fb5cc1608d0 legacy=0x7fb5cc160ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:22.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.687+0000 7fb5c9400640 1 -- 172.21.15.131:0/3118336915 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5cc06f220 con 0x7fb5cc15a810 2024-04-25T19:31:22.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.687+0000 7fb5c9400640 1 -- 172.21.15.131:0/3118336915 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3984899733 0 0) 0x7fb5b4001670 con 0x7fb5cc15a810 2024-04-25T19:31:22.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.687+0000 7fb5c9400640 1 -- 172.21.15.131:0/3118336915 >> v1:172.21.15.131:6789/0 conn(0x7fb5cc15a810 legacy=0x7fb5cc0b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:22.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.687+0000 7fb5c9400640 1 --2- 172.21.15.131:0/3118336915 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5cc0cf2f0 0x7fb5b00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:22.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.687+0000 7fb5c9400640 1 --2- 172.21.15.131:0/3118336915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5b0003fb0 0x7fb5b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:22.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.688+0000 7fb5c9400640 1 --2- 172.21.15.131:0/3118336915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5b0004d40 0x7fb5b00051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:22.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.688+0000 7fb5c9400640 1 -- 172.21.15.131:0/3118336915 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc06f870 con 0x7fb5b0003fb0 2024-04-25T19:31:22.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.688+0000 7fb5c9400640 1 -- 172.21.15.131:0/3118336915 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b000bbb0 con 0x7fb5b0004d40 2024-04-25T19:31:22.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.688+0000 7fb5c9400640 1 -- 172.21.15.131:0/3118336915 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb5b000bdb0 con 0x7fb5cc0cf2f0 2024-04-25T19:31:22.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.688+0000 7fb5c1400640 1 --2- 172.21.15.131:0/3118336915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5b0003fb0 0x7fb5b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:22.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.688+0000 7fb5c9e00640 1 --2- 172.21.15.131:0/3118336915 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5cc0cf2f0 0x7fb5b00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:22.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.688+0000 7fb5ca800640 1 --2- 172.21.15.131:0/3118336915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5b0004d40 0x7fb5b00051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:22.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.688+0000 7fb5c1400640 1 -- 172.21.15.131:0/3118336915 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5cc0cf2f0 msgr2=0x7fb5b00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:22.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.688+0000 7fb5c1400640 1 --2- 172.21.15.131:0/3118336915 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5cc0cf2f0 0x7fb5b00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:22.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.688+0000 7fb5c1400640 1 -- 172.21.15.131:0/3118336915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5b0004d40 msgr2=0x7fb5b00051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:22.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.688+0000 7fb5c1400640 1 --2- 172.21.15.131:0/3118336915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5b0004d40 0x7fb5b00051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:22.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.688+0000 7fb5c1400640 1 -- 172.21.15.131:0/3118336915 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b0003520 con 0x7fb5b0003fb0 2024-04-25T19:31:22.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.689+0000 7fb5c1400640 1 --2- 172.21.15.131:0/3118336915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5b0003fb0 0x7fb5b0004800 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4007fd0 tx=0x7fb5b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd7fdab9d422d36 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:22.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.690+0000 7fb5c9400640 1 -- 172.21.15.131:0/3118336915 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4007c20 con 0x7fb5b0003fb0 2024-04-25T19:31:22.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.690+0000 7fb5c9400640 1 -- 172.21.15.131:0/3118336915 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b4005af0 con 0x7fb5b0003fb0 2024-04-25T19:31:22.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.690+0000 7fb5c9400640 1 -- 172.21.15.131:0/3118336915 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4007070 con 0x7fb5b0003fb0 2024-04-25T19:31:22.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.690+0000 7fb5cb200640 1 -- 172.21.15.131:0/3118336915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5b0003fb0 msgr2=0x7fb5b0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:22.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.690+0000 7fb5cb200640 1 --2- 172.21.15.131:0/3118336915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5b0003fb0 0x7fb5b0004800 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4007fd0 tx=0x7fb5b0005830 comp rx=0 tx=0).stop 2024-04-25T19:31:22.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.690+0000 7fb5ca800640 1 -- 172.21.15.131:0/3118336915 reap_dead start 2024-04-25T19:31:22.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.690+0000 7fb5cb200640 1 -- 172.21.15.131:0/3118336915 shutdown_connections 2024-04-25T19:31:22.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.690+0000 7fb5cb200640 1 -- 172.21.15.131:0/3118336915 >> 172.21.15.131:0/3118336915 conn(0x7fb5cc0d1720 msgr2=0x7fb5cc0d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:22.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.690+0000 7fb5cb200640 1 -- 172.21.15.131:0/3118336915 shutdown_connections 2024-04-25T19:31:22.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.691+0000 7fb5cb200640 1 -- 172.21.15.131:0/3118336915 wait complete. 2024-04-25T19:31:22.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.693+0000 7fb5cb200640 1 Processor -- start 2024-04-25T19:31:22.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.693+0000 7fb5cb200640 1 -- start start 2024-04-25T19:31:22.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.695+0000 7fb5cb200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5b0003fb0 0x7fb5cc0aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:22.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.695+0000 7fb5cb200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5cc153790 0x7fb5cc15f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:22.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.695+0000 7fb5cb200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5cc15fe90 0x7fb5cc15ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:22.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.695+0000 7fb5cb200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc0b6e10 con 0x7fb5cc153790 2024-04-25T19:31:22.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.695+0000 7fb5cb200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc15ac20 con 0x7fb5cc15fe90 2024-04-25T19:31:22.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.695+0000 7fb5cb200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb5cc0b6f90 con 0x7fb5b0003fb0 2024-04-25T19:31:22.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.695+0000 7fb5c1400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5cc153790 0x7fb5cc15f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:22.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.695+0000 7fb5c1400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5cc153790 0x7fb5cc15f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:35168/0 (socket says 172.21.15.131:35168) 2024-04-25T19:31:22.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.695+0000 7fb5c1400640 1 -- 172.21.15.131:0/700935152 learned_addr learned my addr 172.21.15.131:0/700935152 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:22.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.695+0000 7fb5c9e00640 1 --2- 172.21.15.131:0/700935152 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5b0003fb0 0x7fb5cc0aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:22.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.695+0000 7fb5ca800640 1 --2- 172.21.15.131:0/700935152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5cc15fe90 0x7fb5cc15ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:22.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.695+0000 7fb5c1400640 1 -- 172.21.15.131:0/700935152 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5b0003fb0 msgr2=0x7fb5cc0aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:22.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.695+0000 7fb5c1400640 1 --2- 172.21.15.131:0/700935152 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5b0003fb0 0x7fb5cc0aeb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:22.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.695+0000 7fb5c1400640 1 -- 172.21.15.131:0/700935152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5cc15fe90 msgr2=0x7fb5cc15ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:22.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.695+0000 7fb5c1400640 1 --2- 172.21.15.131:0/700935152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5cc15fe90 0x7fb5cc15ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:22.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.695+0000 7fb5c1400640 1 -- 172.21.15.131:0/700935152 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5cc0af050 con 0x7fb5cc153790 2024-04-25T19:31:22.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.696+0000 7fb5c1400640 1 --2- 172.21.15.131:0/700935152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5cc153790 0x7fb5cc15f950 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb5b400c1d0 tx=0x7fb5cc0b76a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:22.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.696+0000 7fb5c2a00640 1 -- 172.21.15.131:0/700935152 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4037040 con 0x7fb5cc153790 2024-04-25T19:31:22.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.696+0000 7fb5c2a00640 1 -- 172.21.15.131:0/700935152 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b40047e0 con 0x7fb5cc153790 2024-04-25T19:31:22.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.696+0000 7fb5c2a00640 1 -- 172.21.15.131:0/700935152 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4001670 con 0x7fb5cc153790 2024-04-25T19:31:22.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.696+0000 7fb5cb200640 1 -- 172.21.15.131:0/700935152 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5cc0af560 con 0x7fb5cc153790 2024-04-25T19:31:22.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.696+0000 7fb5cb200640 1 -- 172.21.15.131:0/700935152 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5cc0afb20 con 0x7fb5cc153790 2024-04-25T19:31:22.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.697+0000 7fb5cb200640 1 -- 172.21.15.131:0/700935152 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5cc050740 con 0x7fb5cc153790 2024-04-25T19:31:22.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.699+0000 7fb5c2a00640 1 -- 172.21.15.131:0/700935152 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb5b4004bb0 con 0x7fb5cc153790 2024-04-25T19:31:22.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.700+0000 7fb5c2a00640 1 --2- 172.21.15.131:0/700935152 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb5a80744b0 0x7fb5a80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:22.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.700+0000 7fb5c2a00640 1 -- 172.21.15.131:0/700935152 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7fb5b40b52d0 con 0x7fb5cc153790 2024-04-25T19:31:22.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.700+0000 7fb5c9e00640 1 --2- 172.21.15.131:0/700935152 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb5a80744b0 0x7fb5a80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:22.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.701+0000 7fb5c9e00640 1 --2- 172.21.15.131:0/700935152 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb5a80744b0 0x7fb5a80769c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009950 tx=0x7fb5bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:22.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.704+0000 7fb5c2a00640 1 -- 172.21.15.131:0/700935152 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb5b407fdd0 con 0x7fb5cc153790 2024-04-25T19:31:22.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.895+0000 7fb5cb200640 1 -- 172.21.15.131:0/700935152 --> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb5cc0ae8f0 con 0x7fb5a80744b0 2024-04-25T19:31:22.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.898+0000 7fb5c2a00640 1 -- 172.21.15.131:0/700935152 <== mgr.4105 v2:172.21.15.195:6832/2541913764 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13340 (secure 0 0 0) 0x7fb5cc0ae8f0 con 0x7fb5a80744b0 2024-04-25T19:31:22.903 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:31:22.903 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-04-25T19:31:22.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.900+0000 7fb5cb200640 1 -- 172.21.15.131:0/700935152 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb5a80744b0 msgr2=0x7fb5a80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:22.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.900+0000 7fb5cb200640 1 --2- 172.21.15.131:0/700935152 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb5a80744b0 0x7fb5a80769c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009950 tx=0x7fb5bc008040 comp rx=0 tx=0).stop 2024-04-25T19:31:22.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.900+0000 7fb5cb200640 1 -- 172.21.15.131:0/700935152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5cc153790 msgr2=0x7fb5cc15f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:22.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.900+0000 7fb5cb200640 1 --2- 172.21.15.131:0/700935152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5cc153790 0x7fb5cc15f950 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb5b400c1d0 tx=0x7fb5cc0b76a0 comp rx=0 tx=0).stop 2024-04-25T19:31:22.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.900+0000 7fb5cb200640 1 -- 172.21.15.131:0/700935152 shutdown_connections 2024-04-25T19:31:22.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.900+0000 7fb5cb200640 1 --2- 172.21.15.131:0/700935152 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fb5a80744b0 0x7fb5a80769c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:22.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.900+0000 7fb5cb200640 1 --2- 172.21.15.131:0/700935152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5cc15fe90 0x7fb5cc15ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:22.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.900+0000 7fb5cb200640 1 --2- 172.21.15.131:0/700935152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5cc153790 0x7fb5cc15f950 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:22.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.900+0000 7fb5cb200640 1 --2- 172.21.15.131:0/700935152 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5b0003fb0 0x7fb5cc0aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:22.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.900+0000 7fb5cb200640 1 -- 172.21.15.131:0/700935152 >> 172.21.15.131:0/700935152 conn(0x7fb5cc0d1720 msgr2=0x7fb5cc06ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:22.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.900+0000 7fb5cb200640 1 -- 172.21.15.131:0/700935152 shutdown_connections 2024-04-25T19:31:22.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:22.900+0000 7fb5cb200640 1 -- 172.21.15.131:0/700935152 wait complete. 2024-04-25T19:31:22.927 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2024-04-25T19:31:22.371533+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":251152,"kb_used_data":5832,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754723568,"statfs":{"total":773094113280,"available":772836933632,"internally_reserved":0,"allocated":5971968,"data_stored":3140112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":251055668},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004314"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":169,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T19:31:09.859422+0000","last_change":"2024-04-25T19:22:06.081655+0000","last_active":"2024-04-25T19:31:09.859422+0000","last_peered":"2024-04-25T19:31:09.859422+0000","last_clean":"2024-04-25T19:31:09.859422+0000","last_became_active":"2024-04-25T19:22:06.078999+0000","last_became_peered":"2024-04-25T19:22:06.078999+0000","last_unstale":"2024-04-25T19:31:09.859422+0000","last_undegraded":"2024-04-25T19:31:09.859422+0000","last_fullsized":"2024-04-25T19:31:09.859422+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T19:22:04.921147+0000","last_clean_scrub_stamp":"2024-04-25T19:22:04.921147+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:30.543734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574963,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1191936,"data_stored":835290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31772,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":598016,"data_stored":244922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31768,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":598016,"data_stored":244922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31768,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":598016,"data_stored":244922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31768,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":598016,"data_stored":244922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27612,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":598016,"data_stored":244922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31768,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":598016,"data_stored":244922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574962,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1191936,"data_stored":835290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T19:31:22.930 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T19:22:04.921147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=19, tm_min=22, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=19, tm_min=31, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T19:31:22.931 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T19:31:38.369 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:31:38.377 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:31:42.932 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T19:31:43.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.214+0000 7fad85e00640 1 Processor -- start 2024-04-25T19:31:43.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.214+0000 7fad85e00640 1 -- start start 2024-04-25T19:31:43.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.216+0000 7fad85e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fad800cf2f0 0x7fad800b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:43.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.216+0000 7fad85e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fad8015a810 0x7fad800b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:43.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.216+0000 7fad85e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad800b4e90 con 0x7fad801608d0 2024-04-25T19:31:43.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.216+0000 7fad85e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fad8006f870 con 0x7fad8015a810 2024-04-25T19:31:43.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.216+0000 7fad85e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fad800b74d0 con 0x7fad800cf2f0 2024-04-25T19:31:43.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.216+0000 7fad77e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fad8015a810 0x7fad800b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:43.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.216+0000 7fad77e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fad8015a810 0x7fad800b4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:53562/0 (socket says 172.21.15.131:53562) 2024-04-25T19:31:43.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.216+0000 7fad77e00640 1 -- 172.21.15.131:0/3813450603 learned_addr learned my addr 172.21.15.131:0/3813450603 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:43.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.217+0000 7fad84a00640 1 --2- 172.21.15.131:0/3813450603 >> v2:172.21.15.195:3300/0 conn(0x7fad800cf2f0 0x7fad800b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:43.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.217+0000 7fad77e00640 1 -- 172.21.15.131:0/3813450603 >> v2:172.21.15.195:3300/0 conn(0x7fad800cf2f0 msgr2=0x7fad800b6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:43.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.217+0000 7fad77e00640 1 --2- 172.21.15.131:0/3813450603 >> v2:172.21.15.195:3300/0 conn(0x7fad800cf2f0 0x7fad800b6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:43.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.217+0000 7fad77e00640 1 -- 172.21.15.131:0/3813450603 >> v1:172.21.15.195:6789/0 conn(0x7fad801608d0 legacy=0x7fad80160ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:43.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.217+0000 7fad77e00640 1 -- 172.21.15.131:0/3813450603 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad800b77b0 con 0x7fad8015a810 2024-04-25T19:31:43.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.217+0000 7fad84a00640 1 --2- 172.21.15.131:0/3813450603 >> v2:172.21.15.195:3300/0 conn(0x7fad800cf2f0 0x7fad800b6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:31:43.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.218+0000 7fad77e00640 1 --2- 172.21.15.131:0/3813450603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad8015a810 0x7fad800b4950 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fad800d26d0 tx=0x7fad6802c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b13d8045b851ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:43.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.218+0000 7fad7fe00640 1 -- 172.21.15.131:0/3813450603 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad680325a0 con 0x7fad8015a810 2024-04-25T19:31:43.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.218+0000 7fad7fe00640 1 -- 172.21.15.131:0/3813450603 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad68038070 con 0x7fad8015a810 2024-04-25T19:31:43.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.218+0000 7fad7fe00640 1 -- 172.21.15.131:0/3813450603 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad68032960 con 0x7fad8015a810 2024-04-25T19:31:43.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.219+0000 7fad85e00640 1 -- 172.21.15.131:0/3813450603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad8015a810 msgr2=0x7fad800b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:43.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.219+0000 7fad85e00640 1 --2- 172.21.15.131:0/3813450603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad8015a810 0x7fad800b4950 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fad800d26d0 tx=0x7fad6802c8e0 comp rx=0 tx=0).stop 2024-04-25T19:31:43.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.219+0000 7fad85e00640 1 -- 172.21.15.131:0/3813450603 shutdown_connections 2024-04-25T19:31:43.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.219+0000 7fad85e00640 1 --2- 172.21.15.131:0/3813450603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad8015a810 0x7fad800b4950 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:43.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.219+0000 7fad85e00640 1 --2- 172.21.15.131:0/3813450603 >> v2:172.21.15.195:3300/0 conn(0x7fad800cf2f0 0x7fad800b6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:43.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.219+0000 7fad85e00640 1 -- 172.21.15.131:0/3813450603 >> 172.21.15.131:0/3813450603 conn(0x7fad800d1720 msgr2=0x7fad800d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:43.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.219+0000 7fad85e00640 1 -- 172.21.15.131:0/3813450603 shutdown_connections 2024-04-25T19:31:43.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.219+0000 7fad85e00640 1 -- 172.21.15.131:0/3813450603 wait complete. 2024-04-25T19:31:43.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.221+0000 7fad85e00640 1 Processor -- start 2024-04-25T19:31:43.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.222+0000 7fad85e00640 1 -- start start 2024-04-25T19:31:43.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.223+0000 7fad85e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad800cf2f0 0x7fad801ea2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:43.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.223+0000 7fad85e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad8015a810 0x7fad8015be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:43.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.223+0000 7fad85e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad801608d0 0x7fad801e8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:43.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.223+0000 7fad85e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fad8015ac20 con 0x7fad800cf2f0 2024-04-25T19:31:43.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.223+0000 7fad85e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fad8006f500 con 0x7fad8015a810 2024-04-25T19:31:43.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.223+0000 7fad85e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fad8006fd00 con 0x7fad801608d0 2024-04-25T19:31:43.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.223+0000 7fad84a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad800cf2f0 0x7fad801ea2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:43.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.223+0000 7fad84a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad800cf2f0 0x7fad801ea2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:53564/0 (socket says 172.21.15.131:53564) 2024-04-25T19:31:43.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.223+0000 7fad84a00640 1 -- 172.21.15.131:0/3194156179 learned_addr learned my addr 172.21.15.131:0/3194156179 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:43.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.224+0000 7fad77e00640 1 --2- 172.21.15.131:0/3194156179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad8015a810 0x7fad8015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:43.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.224+0000 7fad84a00640 1 -- 172.21.15.131:0/3194156179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad801608d0 msgr2=0x7fad801e8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:43.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.224+0000 7fad84a00640 1 --2- 172.21.15.131:0/3194156179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad801608d0 0x7fad801e8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:43.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.224+0000 7fad84a00640 1 -- 172.21.15.131:0/3194156179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad8015a810 msgr2=0x7fad8015be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:43.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.224+0000 7fad84a00640 1 --2- 172.21.15.131:0/3194156179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad8015a810 0x7fad8015be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:43.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.224+0000 7fad84a00640 1 -- 172.21.15.131:0/3194156179 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad801ea810 con 0x7fad800cf2f0 2024-04-25T19:31:43.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.224+0000 7fad84a00640 1 --2- 172.21.15.131:0/3194156179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad800cf2f0 0x7fad801ea2d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fad7000c7f0 tx=0x7fad7000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:43.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.224+0000 7fad7d600640 1 -- 172.21.15.131:0/3194156179 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad70015070 con 0x7fad800cf2f0 2024-04-25T19:31:43.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.224+0000 7fad7d600640 1 -- 172.21.15.131:0/3194156179 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad70007820 con 0x7fad800cf2f0 2024-04-25T19:31:43.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.224+0000 7fad85e00640 1 -- 172.21.15.131:0/3194156179 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad8015ada0 con 0x7fad800cf2f0 2024-04-25T19:31:43.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.225+0000 7fad7d600640 1 -- 172.21.15.131:0/3194156179 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad70007bd0 con 0x7fad800cf2f0 2024-04-25T19:31:43.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.225+0000 7fad85e00640 1 -- 172.21.15.131:0/3194156179 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad8015b360 con 0x7fad800cf2f0 2024-04-25T19:31:43.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.226+0000 7fad85e00640 1 -- 172.21.15.131:0/3194156179 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad80050740 con 0x7fad800cf2f0 2024-04-25T19:31:43.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.227+0000 7fad7d600640 1 -- 172.21.15.131:0/3194156179 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fad70018070 con 0x7fad800cf2f0 2024-04-25T19:31:43.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.228+0000 7fad7d600640 1 --2- 172.21.15.131:0/3194156179 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fad5c0744e0 0x7fad5c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:43.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.229+0000 7fad7d600640 1 -- 172.21.15.131:0/3194156179 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7fad700950c0 con 0x7fad800cf2f0 2024-04-25T19:31:43.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.229+0000 7fad77e00640 1 --2- 172.21.15.131:0/3194156179 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fad5c0744e0 0x7fad5c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:43.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.230+0000 7fad77e00640 1 --2- 172.21.15.131:0/3194156179 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fad5c0744e0 0x7fad5c0769f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fad68037000 tx=0x7fad68032000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:43.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.233+0000 7fad7d600640 1 -- 172.21.15.131:0/3194156179 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fad7005fab0 con 0x7fad800cf2f0 2024-04-25T19:31:43.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.428+0000 7fad85e00640 1 -- 172.21.15.131:0/3194156179 --> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fad8006c770 con 0x7fad5c0744e0 2024-04-25T19:31:43.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.431+0000 7fad7d600640 1 -- 172.21.15.131:0/3194156179 <== mgr.4105 v2:172.21.15.195:6832/2541913764 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13345 (secure 0 0 0) 0x7fad8006c770 con 0x7fad5c0744e0 2024-04-25T19:31:43.432 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:31:43.433 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-04-25T19:31:43.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.433+0000 7fad85e00640 1 -- 172.21.15.131:0/3194156179 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fad5c0744e0 msgr2=0x7fad5c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:43.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.433+0000 7fad85e00640 1 --2- 172.21.15.131:0/3194156179 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fad5c0744e0 0x7fad5c0769f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fad68037000 tx=0x7fad68032000 comp rx=0 tx=0).stop 2024-04-25T19:31:43.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.433+0000 7fad85e00640 1 -- 172.21.15.131:0/3194156179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad800cf2f0 msgr2=0x7fad801ea2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:43.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.433+0000 7fad85e00640 1 --2- 172.21.15.131:0/3194156179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad800cf2f0 0x7fad801ea2d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fad7000c7f0 tx=0x7fad7000ccb0 comp rx=0 tx=0).stop 2024-04-25T19:31:43.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.433+0000 7fad85e00640 1 -- 172.21.15.131:0/3194156179 shutdown_connections 2024-04-25T19:31:43.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.433+0000 7fad85e00640 1 --2- 172.21.15.131:0/3194156179 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fad5c0744e0 0x7fad5c0769f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:43.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.433+0000 7fad85e00640 1 --2- 172.21.15.131:0/3194156179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad801608d0 0x7fad801e8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:43.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.433+0000 7fad85e00640 1 --2- 172.21.15.131:0/3194156179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad8015a810 0x7fad8015be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:43.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.433+0000 7fad85e00640 1 --2- 172.21.15.131:0/3194156179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad800cf2f0 0x7fad801ea2d0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:43.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.433+0000 7fad85e00640 1 -- 172.21.15.131:0/3194156179 >> 172.21.15.131:0/3194156179 conn(0x7fad800d1720 msgr2=0x7fad800d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:43.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.433+0000 7fad85e00640 1 -- 172.21.15.131:0/3194156179 shutdown_connections 2024-04-25T19:31:43.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.433+0000 7fad85e00640 1 -- 172.21.15.131:0/3194156179 wait complete. 2024-04-25T19:31:43.462 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2024-04-25T19:31:42.377854+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":251136,"kb_used_data":5832,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754723584,"statfs":{"total":773094113280,"available":772836950016,"internally_reserved":0,"allocated":5971968,"data_stored":3140112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":251055668},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003777"},"pg_stats":[{"pgid":"1.0","version":"50'74","reported_seq":180,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T19:31:23.180766+0000","last_change":"2024-04-25T19:31:23.180905+0000","last_active":"2024-04-25T19:31:23.180766+0000","last_peered":"2024-04-25T19:31:23.180766+0000","last_clean":"2024-04-25T19:31:23.180766+0000","last_became_active":"2024-04-25T19:22:06.078999+0000","last_became_peered":"2024-04-25T19:22:06.078999+0000","last_unstale":"2024-04-25T19:31:23.180766+0000","last_undegraded":"2024-04-25T19:31:23.180766+0000","last_fullsized":"2024-04-25T19:31:23.180766+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"50'74","last_scrub_stamp":"2024-04-25T19:31:23.180544+0000","last_deep_scrub":"50'74","last_deep_scrub_stamp":"2024-04-25T19:31:23.180544+0000","last_clean_scrub_stamp":"2024-04-25T19:31:23.180544+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:03:49.195579+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574967,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1191936,"data_stored":835290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31772,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":598016,"data_stored":244922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31768,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":598016,"data_stored":244922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31768,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":598016,"data_stored":244922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31768,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":598016,"data_stored":244922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27612,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":598016,"data_stored":244922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31768,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":598016,"data_stored":244922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574966,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1191936,"data_stored":835290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T19:31:43.463 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T19:31:43.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.713+0000 7f3674a00640 1 Processor -- start 2024-04-25T19:31:43.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.714+0000 7f3674a00640 1 -- start start 2024-04-25T19:31:43.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.715+0000 7f3674a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f367009ccc0 0x7f367006d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:43.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.715+0000 7f3674a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f367006ddf0 0x7f36701646c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:43.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.715+0000 7f3674a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3670164c00 0x7f3670165010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:43.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.715+0000 7f3674a00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f3670165550 con 0x7f3670164c00 2024-04-25T19:31:43.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.715+0000 7f3674a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f36700d31d0 con 0x7f367006ddf0 2024-04-25T19:31:43.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.715+0000 7f3674a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f36700d34b0 con 0x7f367009ccc0 2024-04-25T19:31:43.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.716+0000 7f366f200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3670164c00 0x7f3670165010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:43.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.716+0000 7f366f200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3670164c00 0x7f3670165010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:53574/0 (socket says 172.21.15.131:53574) 2024-04-25T19:31:43.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.716+0000 7f366f200640 1 -- 172.21.15.131:0/2391514162 learned_addr learned my addr 172.21.15.131:0/2391514162 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:43.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.716+0000 7f366f200640 1 -- 172.21.15.131:0/2391514162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f367009ccc0 msgr2=0x7f367006d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:43.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.716+0000 7f366f200640 1 --2- 172.21.15.131:0/2391514162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f367009ccc0 0x7f367006d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:43.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.716+0000 7f366f200640 1 -- 172.21.15.131:0/2391514162 >> v2:172.21.15.195:3300/0 conn(0x7f367006ddf0 msgr2=0x7f36701646c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:43.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.716+0000 7f366f200640 1 --2- 172.21.15.131:0/2391514162 >> v2:172.21.15.195:3300/0 conn(0x7f367006ddf0 0x7f36701646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:43.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.716+0000 7f366f200640 1 -- 172.21.15.131:0/2391514162 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36700d3790 con 0x7f3670164c00 2024-04-25T19:31:43.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.717+0000 7f366f200640 1 --2- 172.21.15.131:0/2391514162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3670164c00 0x7f3670165010 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3670073fc0 tx=0x7f366802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ea4043629c9535 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:43.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.718+0000 7f366de00640 1 -- 172.21.15.131:0/2391514162 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3668036070 con 0x7f3670164c00 2024-04-25T19:31:43.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.718+0000 7f366de00640 1 -- 172.21.15.131:0/2391514162 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3668031600 con 0x7f3670164c00 2024-04-25T19:31:43.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.718+0000 7f366de00640 1 -- 172.21.15.131:0/2391514162 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36680319d0 con 0x7f3670164c00 2024-04-25T19:31:43.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.718+0000 7f3674a00640 1 -- 172.21.15.131:0/2391514162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3670164c00 msgr2=0x7f3670165010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:43.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.718+0000 7f3674a00640 1 --2- 172.21.15.131:0/2391514162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3670164c00 0x7f3670165010 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3670073fc0 tx=0x7f366802a610 comp rx=0 tx=0).stop 2024-04-25T19:31:43.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.718+0000 7f3674a00640 1 -- 172.21.15.131:0/2391514162 shutdown_connections 2024-04-25T19:31:43.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.718+0000 7f3674a00640 1 --2- 172.21.15.131:0/2391514162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3670164c00 0x7f3670165010 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:43.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.718+0000 7f3674a00640 1 --2- 172.21.15.131:0/2391514162 >> v2:172.21.15.195:3300/0 conn(0x7f367006ddf0 0x7f36701646c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:43.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.718+0000 7f3674a00640 1 --2- 172.21.15.131:0/2391514162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f367009ccc0 0x7f367006d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:43.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.718+0000 7f3674a00640 1 -- 172.21.15.131:0/2391514162 >> 172.21.15.131:0/2391514162 conn(0x7f36700d0480 msgr2=0x7f36700d0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:43.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.718+0000 7f3674a00640 1 -- 172.21.15.131:0/2391514162 shutdown_connections 2024-04-25T19:31:43.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.719+0000 7f3674a00640 1 -- 172.21.15.131:0/2391514162 wait complete. 2024-04-25T19:31:43.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.721+0000 7f3674a00640 1 Processor -- start 2024-04-25T19:31:43.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.721+0000 7f3674a00640 1 -- start start 2024-04-25T19:31:43.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.722+0000 7f3674a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f367006ddf0 0x7f36700c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:43.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.722+0000 7f3674a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f367009ccc0 0x7f36701f5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:43.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.722+0000 7f3674a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3670164c00 0x7f36700b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:43.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.723+0000 7f3674a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f36700d1010 con 0x7f3670164c00 2024-04-25T19:31:43.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.723+0000 7f3674a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f36700b5220 con 0x7f367009ccc0 2024-04-25T19:31:43.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.723+0000 7f3674a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f36700d1190 con 0x7f367006ddf0 2024-04-25T19:31:43.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.723+0000 7f366f200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3670164c00 0x7f36700b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:43.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.723+0000 7f366f200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3670164c00 0x7f36700b37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:53580/0 (socket says 172.21.15.131:53580) 2024-04-25T19:31:43.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.723+0000 7f366f200640 1 -- 172.21.15.131:0/812528275 learned_addr learned my addr 172.21.15.131:0/812528275 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:43.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.723+0000 7f3665e00640 1 --2- 172.21.15.131:0/812528275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f367009ccc0 0x7f36701f5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:43.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.723+0000 7f366f200640 1 -- 172.21.15.131:0/812528275 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f367006ddf0 msgr2=0x7f36700c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:43.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.723+0000 7f366e800640 1 --2- 172.21.15.131:0/812528275 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f367006ddf0 0x7f36700c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:43.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.723+0000 7f366f200640 1 --2- 172.21.15.131:0/812528275 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f367006ddf0 0x7f36700c9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:43.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.723+0000 7f366f200640 1 -- 172.21.15.131:0/812528275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f367009ccc0 msgr2=0x7f36701f5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:43.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.723+0000 7f366f200640 1 --2- 172.21.15.131:0/812528275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f367009ccc0 0x7f36701f5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:43.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.723+0000 7f366f200640 1 -- 172.21.15.131:0/812528275 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367015fd90 con 0x7f3670164c00 2024-04-25T19:31:43.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.723+0000 7f366e800640 1 --2- 172.21.15.131:0/812528275 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f367006ddf0 0x7f36700c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:31:43.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.723+0000 7f3665e00640 1 --2- 172.21.15.131:0/812528275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f367009ccc0 0x7f36701f5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T19:31:43.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.724+0000 7f366f200640 1 --2- 172.21.15.131:0/812528275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3670164c00 0x7f36700b37d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3668034040 tx=0x7f3668004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:43.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.724+0000 7f3667400640 1 -- 172.21.15.131:0/812528275 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3668041020 con 0x7f3670164c00 2024-04-25T19:31:43.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.724+0000 7f3667400640 1 -- 172.21.15.131:0/812528275 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36680077a0 con 0x7f3670164c00 2024-04-25T19:31:43.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.724+0000 7f3667400640 1 -- 172.21.15.131:0/812528275 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3668036040 con 0x7f3670164c00 2024-04-25T19:31:43.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.724+0000 7f3674a00640 1 -- 172.21.15.131:0/812528275 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3670160070 con 0x7f3670164c00 2024-04-25T19:31:43.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.724+0000 7f3674a00640 1 -- 172.21.15.131:0/812528275 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3670160630 con 0x7f3670164c00 2024-04-25T19:31:43.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.725+0000 7f3674a00640 1 -- 172.21.15.131:0/812528275 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f367015fb00 con 0x7f3670164c00 2024-04-25T19:31:43.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.726+0000 7f3667400640 1 -- 172.21.15.131:0/812528275 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3668044020 con 0x7f3670164c00 2024-04-25T19:31:43.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.727+0000 7f3667400640 1 --2- 172.21.15.131:0/812528275 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f364c0744e0 0x7f364c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:43.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.727+0000 7f3667400640 1 -- 172.21.15.131:0/812528275 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f36680b5b50 con 0x7f3670164c00 2024-04-25T19:31:43.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.728+0000 7f366e800640 1 --2- 172.21.15.131:0/812528275 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f364c0744e0 0x7f364c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:43.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.729+0000 7f366e800640 1 --2- 172.21.15.131:0/812528275 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f364c0744e0 0x7f364c0769f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f366000a850 tx=0x7f3660008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:43.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.732+0000 7f3667400640 1 -- 172.21.15.131:0/812528275 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f366804b070 con 0x7f3670164c00 2024-04-25T19:31:43.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.918+0000 7f3674a00640 1 -- 172.21.15.131:0/812528275 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f3670076c60 con 0x7f3670164c00 2024-04-25T19:31:43.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.927+0000 7f3667400640 1 -- 172.21.15.131:0/812528275 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) ==== 123+0+0 (secure 0 0 0) 0x7f36680805d0 con 0x7f3670164c00 2024-04-25T19:31:43.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.929+0000 7f3674a00640 1 -- 172.21.15.131:0/812528275 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f364c0744e0 msgr2=0x7f364c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:43.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.929+0000 7f3674a00640 1 --2- 172.21.15.131:0/812528275 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f364c0744e0 0x7f364c0769f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f366000a850 tx=0x7f3660008040 comp rx=0 tx=0).stop 2024-04-25T19:31:43.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.929+0000 7f3674a00640 1 -- 172.21.15.131:0/812528275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3670164c00 msgr2=0x7f36700b37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:43.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.929+0000 7f3674a00640 1 --2- 172.21.15.131:0/812528275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3670164c00 0x7f36700b37d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3668034040 tx=0x7f3668004a40 comp rx=0 tx=0).stop 2024-04-25T19:31:43.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.930+0000 7f3674a00640 1 -- 172.21.15.131:0/812528275 shutdown_connections 2024-04-25T19:31:43.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.930+0000 7f3674a00640 1 --2- 172.21.15.131:0/812528275 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7f364c0744e0 0x7f364c0769f0 secure :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f366000a850 tx=0x7f3660008040 comp rx=0 tx=0).stop 2024-04-25T19:31:43.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.930+0000 7f3674a00640 1 --2- 172.21.15.131:0/812528275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3670164c00 0x7f36700b37d0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:43.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.930+0000 7f3674a00640 1 --2- 172.21.15.131:0/812528275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f367009ccc0 0x7f36701f5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:43.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.930+0000 7f3674a00640 1 --2- 172.21.15.131:0/812528275 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f367006ddf0 0x7f36700c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:43.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.930+0000 7f3674a00640 1 -- 172.21.15.131:0/812528275 >> 172.21.15.131:0/812528275 conn(0x7f36700d0480 msgr2=0x7f367009baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:43.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.930+0000 7f3674a00640 1 -- 172.21.15.131:0/812528275 shutdown_connections 2024-04-25T19:31:43.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:43.931+0000 7f3674a00640 1 -- 172.21.15.131:0/812528275 wait complete. 2024-04-25T19:31:43.956 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T19:31:43.956 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T19:31:44.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.214+0000 7fc8f6800640 1 Processor -- start 2024-04-25T19:31:44.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.215+0000 7fc8f6800640 1 -- start start 2024-04-25T19:31:44.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.217+0000 7fc8f6800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc8f00b4ea0 0x7fc8f00cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:44.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.217+0000 7fc8f6800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc8f0144370 0x7fc8f015e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:44.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.217+0000 7fc8f6800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8f00d1230 con 0x7fc8f006c5c0 2024-04-25T19:31:44.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.217+0000 7fc8f6800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fc8f00d06b0 con 0x7fc8f0144370 2024-04-25T19:31:44.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.217+0000 7fc8f6800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fc8f00d0990 con 0x7fc8f00b4ea0 2024-04-25T19:31:44.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.217+0000 7fc8f5400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fc8f006c5c0 0x7fc8f00b4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:59282/0 (socket says 172.21.15.131:59282) 2024-04-25T19:31:44.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.217+0000 7fc8f5400640 1 -- 172.21.15.131:0/2530556247 learned_addr learned my addr 172.21.15.131:0/2530556247 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-25T19:31:44.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.217+0000 7fc8f5e00640 1 --2- 172.21.15.131:0/2530556247 >> v2:172.21.15.131:3300/0 conn(0x7fc8f0144370 0x7fc8f015e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:44.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.218+0000 7fc8f4a00640 1 --2- 172.21.15.131:0/2530556247 >> v2:172.21.15.195:3300/0 conn(0x7fc8f00b4ea0 0x7fc8f00cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:44.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.218+0000 7fc8efe00640 1 -- 172.21.15.131:0/2530556247 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3225949048 0 0) 0x7fc8f00d1230 con 0x7fc8f006c5c0 2024-04-25T19:31:44.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.218+0000 7fc8efe00640 1 -- 172.21.15.131:0/2530556247 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8d4003520 con 0x7fc8f006c5c0 2024-04-25T19:31:44.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.218+0000 7fc8f5e00640 1 -- 172.21.15.131:0/2530556247 >> v2:172.21.15.195:3300/0 conn(0x7fc8f00b4ea0 msgr2=0x7fc8f00cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T19:31:44.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.218+0000 7fc8f5e00640 1 --2- 172.21.15.131:0/2530556247 >> v2:172.21.15.195:3300/0 conn(0x7fc8f00b4ea0 0x7fc8f00cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:44.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.218+0000 7fc8f5e00640 1 -- 172.21.15.131:0/2530556247 >> v1:172.21.15.131:6789/0 conn(0x7fc8f006c5c0 legacy=0x7fc8f00b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:44.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.218+0000 7fc8f5e00640 1 -- 172.21.15.131:0/2530556247 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f00d0c70 con 0x7fc8f0144370 2024-04-25T19:31:44.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.219+0000 7fc8f5e00640 1 --2- 172.21.15.131:0/2530556247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8f0144370 0x7fc8f015e770 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00b5550 tx=0x7fc8e802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19eb4898e454fa1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:44.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.219+0000 7fc8efe00640 1 -- 172.21.15.131:0/2530556247 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8037070 con 0x7fc8f0144370 2024-04-25T19:31:44.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.219+0000 7fc8efe00640 1 -- 172.21.15.131:0/2530556247 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc8e8032440 con 0x7fc8f0144370 2024-04-25T19:31:44.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.219+0000 7fc8efe00640 1 -- 172.21.15.131:0/2530556247 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e80327f0 con 0x7fc8f0144370 2024-04-25T19:31:44.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.220+0000 7fc8f6800640 1 -- 172.21.15.131:0/2530556247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8f0144370 msgr2=0x7fc8f015e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:44.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.220+0000 7fc8f6800640 1 --2- 172.21.15.131:0/2530556247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8f0144370 0x7fc8f015e770 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00b5550 tx=0x7fc8e802a1a0 comp rx=0 tx=0).stop 2024-04-25T19:31:44.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.220+0000 7fc8f6800640 1 -- 172.21.15.131:0/2530556247 shutdown_connections 2024-04-25T19:31:44.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.220+0000 7fc8f6800640 1 --2- 172.21.15.131:0/2530556247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8f0144370 0x7fc8f015e770 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:44.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.220+0000 7fc8f6800640 1 --2- 172.21.15.131:0/2530556247 >> v2:172.21.15.195:3300/0 conn(0x7fc8f00b4ea0 0x7fc8f00cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:44.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.220+0000 7fc8f6800640 1 -- 172.21.15.131:0/2530556247 >> 172.21.15.131:0/2530556247 conn(0x7fc8f00d1720 msgr2=0x7fc8f00d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:44.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.220+0000 7fc8f6800640 1 -- 172.21.15.131:0/2530556247 shutdown_connections 2024-04-25T19:31:44.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.220+0000 7fc8f6800640 1 -- 172.21.15.131:0/2530556247 wait complete. 2024-04-25T19:31:44.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.223+0000 7fc8f6800640 1 Processor -- start 2024-04-25T19:31:44.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.223+0000 7fc8f6800640 1 -- start start 2024-04-25T19:31:44.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.224+0000 7fc8f6800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8f006c5c0 0x7fc8f0146390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:44.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.224+0000 7fc8f6800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8f0144370 0x7fc8f015d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:44.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.224+0000 7fc8f6800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8f0160f20 0x7fc8f00af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:44.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.224+0000 7fc8f6800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f00d0450 con 0x7fc8f006c5c0 2024-04-25T19:31:44.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.224+0000 7fc8f6800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f00d02d0 con 0x7fc8f0144370 2024-04-25T19:31:44.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.224+0000 7fc8f6800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f0147760 con 0x7fc8f0160f20 2024-04-25T19:31:44.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.224+0000 7fc8f5400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8f006c5c0 0x7fc8f0146390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:44.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.225+0000 7fc8f5400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8f006c5c0 0x7fc8f0146390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:53590/0 (socket says 172.21.15.131:53590) 2024-04-25T19:31:44.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.225+0000 7fc8f5400640 1 -- 172.21.15.131:0/1795035285 learned_addr learned my addr 172.21.15.131:0/1795035285 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-25T19:31:44.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.225+0000 7fc8f4a00640 1 --2- 172.21.15.131:0/1795035285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8f0144370 0x7fc8f015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:44.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.225+0000 7fc8f5400640 1 -- 172.21.15.131:0/1795035285 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8f0160f20 msgr2=0x7fc8f00af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:44.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.225+0000 7fc8f5400640 1 --2- 172.21.15.131:0/1795035285 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8f0160f20 0x7fc8f00af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:44.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.225+0000 7fc8f5400640 1 -- 172.21.15.131:0/1795035285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8f0144370 msgr2=0x7fc8f015d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:44.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.225+0000 7fc8f5400640 1 --2- 172.21.15.131:0/1795035285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8f0144370 0x7fc8f015d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:44.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.225+0000 7fc8f5400640 1 -- 172.21.15.131:0/1795035285 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f015fe80 con 0x7fc8f006c5c0 2024-04-25T19:31:44.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.225+0000 7fc8f5400640 1 --2- 172.21.15.131:0/1795035285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8f006c5c0 0x7fc8f0146390 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000c390 tx=0x7fc8e000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:44.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.226+0000 7fc8ed600640 1 -- 172.21.15.131:0/1795035285 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0017070 con 0x7fc8f006c5c0 2024-04-25T19:31:44.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.226+0000 7fc8ed600640 1 -- 172.21.15.131:0/1795035285 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc8e0005ce0 con 0x7fc8f006c5c0 2024-04-25T19:31:44.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.226+0000 7fc8ed600640 1 -- 172.21.15.131:0/1795035285 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0007310 con 0x7fc8f006c5c0 2024-04-25T19:31:44.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.226+0000 7fc8f6800640 1 -- 172.21.15.131:0/1795035285 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f0160160 con 0x7fc8f006c5c0 2024-04-25T19:31:44.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.226+0000 7fc8f6800640 1 -- 172.21.15.131:0/1795035285 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f0160720 con 0x7fc8f006c5c0 2024-04-25T19:31:44.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.227+0000 7fc8f6800640 1 -- 172.21.15.131:0/1795035285 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8f00b30a0 con 0x7fc8f006c5c0 2024-04-25T19:31:44.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.228+0000 7fc8ed600640 1 -- 172.21.15.131:0/1795035285 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc8e001a070 con 0x7fc8f006c5c0 2024-04-25T19:31:44.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.229+0000 7fc8ed600640 1 --2- 172.21.15.131:0/1795035285 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc8d00744b0 0x7fc8d00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T19:31:44.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.229+0000 7fc8ed600640 1 -- 172.21.15.131:0/1795035285 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7fc8e0094400 con 0x7fc8f006c5c0 2024-04-25T19:31:44.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.230+0000 7fc8f4a00640 1 --2- 172.21.15.131:0/1795035285 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc8d00744b0 0x7fc8d00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T19:31:44.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.231+0000 7fc8f4a00640 1 --2- 172.21.15.131:0/1795035285 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc8d00744b0 0x7fc8d00769c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0138b80 tx=0x7fc8dc00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T19:31:44.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.233+0000 7fc8ed600640 1 -- 172.21.15.131:0/1795035285 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc8e005edf0 con 0x7fc8f006c5c0 2024-04-25T19:31:44.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.474+0000 7fc8f6800640 1 -- 172.21.15.131:0/1795035285 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8f015f340 con 0x7fc8f006c5c0 2024-04-25T19:31:44.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.475+0000 7fc8ed600640 1 -- 172.21.15.131:0/1795035285 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+3878 (secure 0 0 0) 0x7fc8e0065e20 con 0x7fc8f006c5c0 2024-04-25T19:31:44.477 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-25T19:31:44.477 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4706,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3512447940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":3512447940},{"type":"v1","addr":"172.21.15.195:6837","nonce":3512447940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2666088311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":2666088311},{"type":"v1","addr":"172.21.15.195:6836","nonce":2666088311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1450320216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1450320216},{"type":"v1","addr":"172.21.15.131:6834","nonce":1450320216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5754,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/129640740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":129640740},{"type":"v1","addr":"172.21.15.131:6835","nonce":129640740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[]} 2024-04-25T19:31:44.477 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 27 2024-04-25T19:31:44.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.478+0000 7fc8f6800640 1 -- 172.21.15.131:0/1795035285 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc8d00744b0 msgr2=0x7fc8d00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:44.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.478+0000 7fc8f6800640 1 --2- 172.21.15.131:0/1795035285 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc8d00744b0 0x7fc8d00769c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0138b80 tx=0x7fc8dc00b040 comp rx=0 tx=0).stop 2024-04-25T19:31:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.478+0000 7fc8f6800640 1 -- 172.21.15.131:0/1795035285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8f006c5c0 msgr2=0x7fc8f0146390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T19:31:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.478+0000 7fc8f6800640 1 --2- 172.21.15.131:0/1795035285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8f006c5c0 0x7fc8f0146390 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000c390 tx=0x7fc8e000c850 comp rx=0 tx=0).stop 2024-04-25T19:31:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.478+0000 7fc8f6800640 1 -- 172.21.15.131:0/1795035285 shutdown_connections 2024-04-25T19:31:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.478+0000 7fc8f6800640 1 --2- 172.21.15.131:0/1795035285 >> [v2:172.21.15.195:6832/2541913764,v1:172.21.15.195:6833/2541913764] conn(0x7fc8d00744b0 0x7fc8d00769c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.478+0000 7fc8f6800640 1 --2- 172.21.15.131:0/1795035285 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8f0160f20 0x7fc8f00af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.478+0000 7fc8f6800640 1 --2- 172.21.15.131:0/1795035285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8f0144370 0x7fc8f015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.478+0000 7fc8f6800640 1 --2- 172.21.15.131:0/1795035285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8f006c5c0 0x7fc8f0146390 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T19:31:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.478+0000 7fc8f6800640 1 -- 172.21.15.131:0/1795035285 >> 172.21.15.131:0/1795035285 conn(0x7fc8f00d1720 msgr2=0x7fc8f00d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T19:31:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.478+0000 7fc8f6800640 1 -- 172.21.15.131:0/1795035285 shutdown_connections 2024-04-25T19:31:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-25T19:31:44.478+0000 7fc8f6800640 1 -- 172.21.15.131:0/1795035285 wait complete. 2024-04-25T19:31:44.507 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-25T19:31:44.507 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T19:31:44.507 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T19:31:44.507 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T19:31:44.536 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T19:31:44.536 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T19:31:44.536 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T19:31:44.629 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T19:31:44.629 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T19:31:44.629 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T19:31:44.673 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T19:31:44.674 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T19:31:44.674 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T19:31:44.708 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T19:31:44.709 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T19:31:44.709 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T19:31:44.709 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T19:31:44.810 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T19:31:44.810 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T19:31:44.810 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T19:31:44.876 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T19:31:44.877 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T19:31:44.877 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T19:31:47.143 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-25T19:31:50.978 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T19:31:50.979 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T19:31:50.979 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T19:31:51.052 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T19:31:51.052 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T19:31:51.052 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T19:31:51.113 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T19:31:51.113 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T19:31:51.114 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T19:31:51.208 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T19:31:51.208 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T19:31:51.208 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T19:31:51.283 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T19:31:51.283 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T19:31:51.284 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T19:31:51.355 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T19:31:51.355 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T19:31:51.355 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T19:31:51.356 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T19:31:52.547 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-04-25T19:31:52.547 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-25T19:31:57.457 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T19:31:57.457 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T19:31:57.457 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T19:31:57.547 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T19:31:57.547 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T19:31:57.547 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T19:31:57.547 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T19:31:57.621 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T19:31:57.621 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T19:31:57.621 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T19:31:57.659 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T19:31:57.659 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T19:31:57.659 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T19:31:57.736 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T19:31:57.736 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T19:31:57.737 DEBUG:teuthology.orchestra.run.smithi131:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-25T19:31:57.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-04-25T19:31:57.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-04-25T19:31:57.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-04-25T19:31:57.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-04-25T19:31:57.839 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-25T19:31:57.839 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T19:31:58.068 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-25T19:31:58.068 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T19:31:58.200 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-25T19:31:58.200 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T19:31:58.343 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-25T19:31:58.343 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T19:31:58.488 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T19:31:58.489 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T19:31:58.735 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T19:31:58.735 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T19:31:58.865 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T19:31:58.865 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T19:31:59.019 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T19:31:59.019 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T19:31:59.229 INFO:tasks.ceph:Archiving mon data... 2024-04-25T19:31:59.230 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673308/data/mon.a.tgz 2024-04-25T19:31:59.230 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2024-04-25T19:31:59.285 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.adJ70bkfrc 2024-04-25T19:31:59.286 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.adJ70bkfrc 2024-04-25T19:31:59.443 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.adJ70bkfrc 2024-04-25T19:31:59.585 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.adJ70bkfrc is 240KB 2024-04-25T19:31:59.695 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.adJ70bkfrc 2024-04-25T19:31:59.751 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673308/data/mon.b.tgz 2024-04-25T19:31:59.752 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2024-04-25T19:31:59.810 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.kIiEpg6m9o 2024-04-25T19:31:59.810 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.kIiEpg6m9o 2024-04-25T19:31:59.978 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.kIiEpg6m9o 2024-04-25T19:32:00.121 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.kIiEpg6m9o is 241KB 2024-04-25T19:32:00.228 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.kIiEpg6m9o 2024-04-25T19:32:00.285 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673308/data/mon.c.tgz 2024-04-25T19:32:00.285 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2024-04-25T19:32:00.335 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.gTxoOrpuyD 2024-04-25T19:32:00.336 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.gTxoOrpuyD 2024-04-25T19:32:00.473 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.gTxoOrpuyD 2024-04-25T19:32:00.608 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.gTxoOrpuyD is 241KB 2024-04-25T19:32:00.711 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.gTxoOrpuyD 2024-04-25T19:32:00.770 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T19:32:00.770 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T19:32:00.778 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T19:32:00.914 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T19:32:00.974 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T19:32:00.974 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T19:32:00.976 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673308/remote/smithi131/crash 2024-04-25T19:32:00.976 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T19:32:01.066 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673308/remote/smithi195/crash 2024-04-25T19:32:01.067 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T19:32:01.153 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T19:32:01.153 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:32:01.161 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T19:32:01.269 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T19:32:01.354 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T19:32:01.443 INFO:tasks.ceph:Compressing logs... 2024-04-25T19:32:01.443 DEBUG:teuthology.orchestra.run.smithi131:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T19:32:01.451 DEBUG:teuthology.orchestra.run.smithi195:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T19:32:01.526 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46692.log 2024-04-25T19:32:01.527 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47332.log 2024-04-25T19:32:01.528 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.46692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39532.log 2024-04-25T19:32:01.529 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.47332.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46692.log.gz 2024-04-25T19:32:01.529 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48464.log 2024-04-25T19:32:01.530 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47332.log.gz 2024-04-25T19:32:01.530 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.39532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83359.log 2024-04-25T19:32:01.531 INFO:teuthology.orchestra.run.smithi131.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39532.log.gz 2024-04-25T19:32:01.531 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.48464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.41993.log 2024-04-25T19:32:01.532 INFO:teuthology.orchestra.run.smithi131.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48464.log.gz 2024-04-25T19:32:01.532 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.37865.log 2024-04-25T19:32:01.533 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.83359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44361.log 2024-04-25T19:32:01.533 INFO:teuthology.orchestra.run.smithi131.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.83359.log.gz 2024-04-25T19:32:01.534 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.2.41993.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.41993.log.gz 2024-04-25T19:32:01.534 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47686.log 2024-04-25T19:32:01.535 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84324.log 2024-04-25T19:32:01.535 INFO:teuthology.orchestra.run.smithi131.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44361.log.gz 2024-04-25T19:32:01.535 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T19:32:01.536 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.1.37865.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.37865.log.gz 2024-04-25T19:32:01.536 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T19:32:01.538 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T19:32:01.538 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T19:32:01.538 INFO:teuthology.orchestra.run.smithi195.stderr: 93.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T19:32:01.538 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T19:32:01.539 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.47686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38930.log 2024-04-25T19:32:01.540 INFO:teuthology.orchestra.run.smithi131.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47686.log.gz 2024-04-25T19:32:01.540 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.84324.log: gzip 88.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.84324.log.gz 2024-04-25T19:32:01.540 INFO:teuthology.orchestra.run.smithi131.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44319.log 2024-04-25T19:32:01.540 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.38930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42966.log 2024-04-25T19:32:01.540 INFO:teuthology.orchestra.run.smithi131.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.38930.log.gz 2024-04-25T19:32:01.540 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42756.log 2024-04-25T19:32:01.540 INFO:teuthology.orchestra.run.smithi131.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44319.log.gz 2024-04-25T19:32:01.544 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T19:32:01.544 INFO:teuthology.orchestra.run.smithi195.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T19:32:01.544 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.38264.log 2024-04-25T19:32:01.544 INFO:teuthology.orchestra.run.smithi195.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T19:32:01.544 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33192.log 2024-04-25T19:32:01.544 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.3.38264.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.38264.log.gz 2024-04-25T19:32:01.544 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T19:32:01.545 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44985.log 2024-04-25T19:32:01.545 INFO:teuthology.orchestra.run.smithi131.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42966.log.gz 2024-04-25T19:32:01.545 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42252.log 2024-04-25T19:32:01.545 INFO:teuthology.orchestra.run.smithi131.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42756.log.gz 2024-04-25T19:32:01.545 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.41989.log 2024-04-25T19:32:01.545 INFO:teuthology.orchestra.run.smithi131.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44985.log.gz 2024-04-25T19:32:01.546 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42252.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42252.log.gz 2024-04-25T19:32:01.546 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47248.log 2024-04-25T19:32:01.546 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.2.41989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.41989.log.gz 2024-04-25T19:32:01.546 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42924.log 2024-04-25T19:32:01.546 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.47248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43983.log 2024-04-25T19:32:01.546 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47248.log.gz 2024-04-25T19:32:01.548 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.33192.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.33192.log.gz 2024-04-25T19:32:01.548 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T19:32:01.548 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T19:32:01.548 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33319.log 2024-04-25T19:32:01.549 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48422.log 2024-04-25T19:32:01.549 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42924.log.gz 2024-04-25T19:32:01.549 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42546.log 2024-04-25T19:32:01.549 INFO:teuthology.orchestra.run.smithi131.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43983.log.gz 2024-04-25T19:32:01.549 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.48422.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48422.log.gz 2024-04-25T19:32:01.549 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82962.log 2024-04-25T19:32:01.550 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33399.log 2024-04-25T19:32:01.551 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41186.log 2024-04-25T19:32:01.551 INFO:teuthology.orchestra.run.smithi131.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42546.log.gz 2024-04-25T19:32:01.551 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.82962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84198.log 2024-04-25T19:32:01.551 INFO:teuthology.orchestra.run.smithi131.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.82962.log.gz 2024-04-25T19:32:01.552 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.41186.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41186.log.gz 2024-04-25T19:32:01.552 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83256.log 2024-04-25T19:32:01.552 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.33319.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.33319.log.gz 2024-04-25T19:32:01.553 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.33399.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.33399.log.gz 2024-04-25T19:32:01.553 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33148.log 2024-04-25T19:32:01.554 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.84198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45805.log 2024-04-25T19:32:01.554 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.84198.log.gz 2024-04-25T19:32:01.554 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.83256.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.83256.log.gz 2024-04-25T19:32:01.554 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45763.log 2024-04-25T19:32:01.556 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33439.log 2024-04-25T19:32:01.556 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.33148.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33148.log.gz 2024-04-25T19:32:01.556 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40568.log 2024-04-25T19:32:01.557 INFO:teuthology.orchestra.run.smithi131.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45805.log.gz 2024-04-25T19:32:01.557 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44819.log 2024-04-25T19:32:01.557 INFO:teuthology.orchestra.run.smithi131.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45763.log.gz 2024-04-25T19:32:01.558 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.33439.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33439.log.gz 2024-04-25T19:32:01.558 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.37846.log 2024-04-25T19:32:01.559 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45027.log 2024-04-25T19:32:01.559 INFO:teuthology.orchestra.run.smithi131.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40568.log.gz 2024-04-25T19:32:01.559 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83820.log 2024-04-25T19:32:01.559 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44819.log.gz 2024-04-25T19:32:01.559 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47206.log 2024-04-25T19:32:01.559 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45027.log.gz 2024-04-25T19:32:01.561 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.83820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83946.log 2024-04-25T19:32:01.561 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.83820.log.gz 2024-04-25T19:32:01.561 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.47206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43050.log 2024-04-25T19:32:01.562 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47206.log.gz 2024-04-25T19:32:01.562 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33279.log 2024-04-25T19:32:01.562 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.1.37846.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.37846.log.gz 2024-04-25T19:32:01.562 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.33279.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.33279.log.gz 2024-04-25T19:32:01.562 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.38260.log 2024-04-25T19:32:01.563 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.83946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38888.log 2024-04-25T19:32:01.564 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.83946.log.gz 2024-04-25T19:32:01.564 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43050.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43050.log.gz 2024-04-25T19:32:01.564 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47865.log 2024-04-25T19:32:01.565 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.38888.log: gzip -5 --verbose -- 88.6% /var/log/ceph/ceph-client.admin.42378.log -- replaced with /var/log/ceph/ceph-client.admin.38888.log.gz 2024-04-25T19:32:01.565 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-04-25T19:32:01.566 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T19:32:01.566 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.3.38260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.38260.log.gz 2024-04-25T19:32:01.567 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.47865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46597.log 2024-04-25T19:32:01.567 INFO:teuthology.orchestra.run.smithi131.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47865.log.gz 2024-04-25T19:32:01.567 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42378.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42378.log.gz 2024-04-25T19:32:01.567 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46057.log 2024-04-25T19:32:01.568 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.46597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45535.log 2024-04-25T19:32:01.568 INFO:teuthology.orchestra.run.smithi131.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46597.log.gz 2024-04-25T19:32:01.569 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T19:32:01.570 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.46057.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T19:32:01.570 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45535.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.46057.log.gz 2024-04-25T19:32:01.570 INFO:teuthology.orchestra.run.smithi131.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45535.log.gz 2024-04-25T19:32:01.570 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44899.log 2024-04-25T19:32:01.571 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33359.log 2024-04-25T19:32:01.571 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33239.log 2024-04-25T19:32:01.573 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45111.log 2024-04-25T19:32:01.573 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84366.log 2024-04-25T19:32:01.573 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44899.log.gz 2024-04-25T19:32:01.573 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45111.log: 87.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T19:32:01.573 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 88.4% --verbose -- replaced with /var/log/ceph/ceph-client.admin.45111.log.gz 2024-04-25T19:32:01.573 INFO:teuthology.orchestra.run.smithi131.stderr: -- /var/log/ceph/ceph-client.admin.83862.log 2024-04-25T19:32:01.574 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.33359.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33359.log.gz 2024-04-25T19:32:01.575 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.84366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48506.log 2024-04-25T19:32:01.575 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.84366.log.gz 2024-04-25T19:32:01.575 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.33239.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33239.log.gz 2024-04-25T19:32:01.575 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.83862.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.83862.log.gz 2024-04-25T19:32:01.576 INFO:teuthology.orchestra.run.smithi131.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.49016.log 2024-04-25T19:32:01.576 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.48506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40198.log 2024-04-25T19:32:01.576 INFO:teuthology.orchestra.run.smithi131.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48506.log.gz 2024-04-25T19:32:01.577 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.49016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40442.log 2024-04-25T19:32:01.577 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49016.log.gz 2024-04-25T19:32:01.578 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49012.log 2024-04-25T19:32:01.578 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40198.log.gz 2024-04-25T19:32:01.579 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82836.log 2024-04-25T19:32:01.579 INFO:teuthology.orchestra.run.smithi131.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40442.log.gz 2024-04-25T19:32:01.580 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.49012.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.0.49012.log.gz -5 2024-04-25T19:32:01.580 INFO:teuthology.orchestra.run.smithi131.stderr: --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T19:32:01.581 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.82836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46776.log 2024-04-25T19:32:01.581 INFO:teuthology.orchestra.run.smithi131.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.82836.log.gz 2024-04-25T19:32:01.582 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47416.log 2024-04-25T19:32:01.583 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.46776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40204.log 2024-04-25T19:32:01.583 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46776.log.gz 2024-04-25T19:32:01.584 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.47416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39530.log 2024-04-25T19:32:01.584 INFO:teuthology.orchestra.run.smithi131.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47416.log.gz 2024-04-25T19:32:01.585 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83046.log 2024-04-25T19:32:01.585 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40204.log.gz 2024-04-25T19:32:01.586 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.39530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48376.log 2024-04-25T19:32:01.586 INFO:teuthology.orchestra.run.smithi131.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39530.log.gz 2024-04-25T19:32:01.587 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.83046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47458.log 2024-04-25T19:32:01.587 INFO:teuthology.orchestra.run.smithi131.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.83046.log.gz 2024-04-25T19:32:01.588 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.48376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39868.log 2024-04-25T19:32:01.588 INFO:teuthology.orchestra.run.smithi131.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48376.log.gz 2024-04-25T19:32:01.589 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.47458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46734.log 2024-04-25T19:32:01.589 INFO:teuthology.orchestra.run.smithi131.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47458.log.gz 2024-04-25T19:32:01.590 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.39868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43008.log 2024-04-25T19:32:01.590 INFO:teuthology.orchestra.run.smithi131.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39868.log.gz 2024-04-25T19:32:01.591 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.46734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82658.log 2024-04-25T19:32:01.591 INFO:teuthology.orchestra.run.smithi131.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46734.log.gz 2024-04-25T19:32:01.592 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45595.log 2024-04-25T19:32:01.592 INFO:teuthology.orchestra.run.smithi131.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43008.log.gz 2024-04-25T19:32:01.593 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.82658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38412.log 2024-04-25T19:32:01.593 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.82658.log.gz 2024-04-25T19:32:01.594 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39867.log 2024-04-25T19:32:01.594 INFO:teuthology.orchestra.run.smithi131.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45595.log.gz 2024-04-25T19:32:01.595 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.38412.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T19:32:01.595 INFO:teuthology.orchestra.run.smithi131.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38412.log.gz 2024-04-25T19:32:01.596 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.39867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48069.log 2024-04-25T19:32:01.596 INFO:teuthology.orchestra.run.smithi131.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39867.log.gz 2024-04-25T19:32:01.597 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43521.log 2024-04-25T19:32:01.598 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.48069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40820.log 2024-04-25T19:32:01.599 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48069.log.gz 2024-04-25T19:32:01.599 INFO:teuthology.orchestra.run.smithi131.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T19:32:01.599 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83298.log 2024-04-25T19:32:01.599 INFO:teuthology.orchestra.run.smithi131.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43521.log.gz 2024-04-25T19:32:01.600 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83778.log 2024-04-25T19:32:01.601 INFO:teuthology.orchestra.run.smithi131.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40820.log.gz 2024-04-25T19:32:01.602 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.83298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38674.log 2024-04-25T19:32:01.602 INFO:teuthology.orchestra.run.smithi131.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.83298.log.gz 2024-04-25T19:32:01.602 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.83778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44529.log 2024-04-25T19:32:01.603 INFO:teuthology.orchestra.run.smithi131.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.83778.log.gz 2024-04-25T19:32:01.603 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.38674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38972.log 2024-04-25T19:32:01.604 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38674.log.gz 2024-04-25T19:32:01.605 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38508.log 2024-04-25T19:32:01.605 INFO:teuthology.orchestra.run.smithi131.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44529.log.gz 2024-04-25T19:32:01.605 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.38972.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38972.log.gz 2024-04-25T19:32:01.606 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41685.log 2024-04-25T19:32:01.606 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.38508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48239.log 2024-04-25T19:32:01.607 INFO:teuthology.orchestra.run.smithi131.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38508.log.gz 2024-04-25T19:32:01.607 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.41685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83694.log 2024-04-25T19:32:01.608 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41685.log.gz 2024-04-25T19:32:01.608 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.48239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47633.log 2024-04-25T19:32:01.609 INFO:teuthology.orchestra.run.smithi131.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48239.log.gz 2024-04-25T19:32:01.609 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.83694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43245.log 2024-04-25T19:32:01.610 INFO:teuthology.orchestra.run.smithi131.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.83694.log.gz 2024-04-25T19:32:01.610 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.47633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43647.log 2024-04-25T19:32:01.611 INFO:teuthology.orchestra.run.smithi131.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47633.log.gz 2024-04-25T19:32:01.611 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48283.log 2024-04-25T19:32:01.612 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43245.log.gz 2024-04-25T19:32:01.612 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40201.log 2024-04-25T19:32:01.613 INFO:teuthology.orchestra.run.smithi131.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43647.log.gz 2024-04-25T19:32:01.613 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.48283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39515.log 2024-04-25T19:32:01.613 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48283.log.gz 2024-04-25T19:32:01.614 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83503.log 2024-04-25T19:32:01.614 INFO:teuthology.orchestra.run.smithi131.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40201.log.gz 2024-04-25T19:32:01.615 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.39515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47290.log 2024-04-25T19:32:01.616 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39515.log.gz 2024-04-25T19:32:01.616 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.83503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47500.log 2024-04-25T19:32:01.617 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.83503.log.gz 2024-04-25T19:32:01.618 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.47290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83004.log 2024-04-25T19:32:01.618 INFO:teuthology.orchestra.run.smithi131.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47290.log.gz 2024-04-25T19:32:01.618 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.47500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38758.log 2024-04-25T19:32:01.618 INFO:teuthology.orchestra.run.smithi131.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47500.log.gz 2024-04-25T19:32:01.619 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.83004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45279.log 2024-04-25T19:32:01.619 INFO:teuthology.orchestra.run.smithi131.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.83004.log.gz 2024-04-25T19:32:01.620 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.38758.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T19:32:01.621 INFO:teuthology.orchestra.run.smithi131.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38758.log.gz 2024-04-25T19:32:01.621 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45279.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45279.log.gz 2024-04-25T19:32:01.622 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43390.log 2024-04-25T19:32:01.622 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48195.log 2024-04-25T19:32:01.623 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82574.log 2024-04-25T19:32:01.623 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43390.log.gz 2024-04-25T19:32:01.624 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.48195.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48195.log.gz 2024-04-25T19:32:01.625 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48590.log 2024-04-25T19:32:01.625 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.82574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40652.log 2024-04-25T19:32:01.626 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.82574.log.gz 2024-04-25T19:32:01.626 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.48590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39098.log 2024-04-25T19:32:01.627 INFO:teuthology.orchestra.run.smithi131.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48590.log.gz 2024-04-25T19:32:01.628 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40484.log 2024-04-25T19:32:01.628 INFO:teuthology.orchestra.run.smithi131.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40652.log.gz 2024-04-25T19:32:01.629 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.39098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44655.log 2024-04-25T19:32:01.629 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39098.log.gz 2024-04-25T19:32:01.630 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40484.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40484.log.gz 2024-04-25T19:32:01.630 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40904.log 2024-04-25T19:32:01.631 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44067.log 2024-04-25T19:32:01.631 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44655.log.gz 2024-04-25T19:32:01.632 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45237.log 2024-04-25T19:32:01.632 INFO:teuthology.orchestra.run.smithi131.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40904.log.gz 2024-04-25T19:32:01.633 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44067.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T19:32:01.634 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44067.log.gz 2024-04-25T19:32:01.634 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41048.log 2024-04-25T19:32:01.635 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45237.log.gz 2024-04-25T19:32:01.635 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48153.log 2024-04-25T19:32:01.637 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.41048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47374.log 2024-04-25T19:32:01.638 INFO:teuthology.orchestra.run.smithi131.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.41048.log.gz 2024-04-25T19:32:01.638 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.48153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42336.log 2024-04-25T19:32:01.638 INFO:teuthology.orchestra.run.smithi131.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48153.log.gz 2024-04-25T19:32:01.639 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.47374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38630.log 2024-04-25T19:32:01.640 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47374.log.gz 2024-04-25T19:32:01.641 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46954.log 2024-04-25T19:32:01.641 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42336.log.gz 2024-04-25T19:32:01.642 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.38630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47770.log 2024-04-25T19:32:01.642 INFO:teuthology.orchestra.run.smithi131.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38630.log.gz 2024-04-25T19:32:01.643 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.46954.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T19:32:01.643 INFO:teuthology.orchestra.run.smithi131.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46954.log.gz 2024-04-25T19:32:01.645 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.47770.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T19:32:01.645 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47770.log.gz 2024-04-25T19:32:01.646 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42462.log 2024-04-25T19:32:01.647 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45931.log 2024-04-25T19:32:01.649 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45493.log 2024-04-25T19:32:01.649 INFO:teuthology.orchestra.run.smithi131.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42462.log.gz 2024-04-25T19:32:01.650 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45931.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45931.log.gz 2024-04-25T19:32:01.651 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45493.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45493.log.gz 2024-04-25T19:32:01.652 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39182.log 2024-04-25T19:32:01.653 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42882.log 2024-04-25T19:32:01.655 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.39182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45451.log 2024-04-25T19:32:01.655 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39182.log.gz 2024-04-25T19:32:01.657 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42882.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42882.log.gz 2024-04-25T19:32:01.657 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45451.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T19:32:01.657 INFO:teuthology.orchestra.run.smithi131.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T19:32:01.658 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45451.log.gz 2024-04-25T19:32:01.659 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39526.log 2024-04-25T19:32:01.659 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84072.log 2024-04-25T19:32:01.661 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.39526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47728.log 2024-04-25T19:32:01.661 INFO:teuthology.orchestra.run.smithi131.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39526.log.gz 2024-04-25T19:32:01.662 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.84072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39866.log 2024-04-25T19:32:01.662 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.84072.log.gz 2024-04-25T19:32:01.664 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.47728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83904.log 2024-04-25T19:32:01.664 INFO:teuthology.orchestra.run.smithi131.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47728.log.gz 2024-04-25T19:32:01.665 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.39866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48548.log 2024-04-25T19:32:01.665 INFO:teuthology.orchestra.run.smithi131.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39866.log.gz 2024-04-25T19:32:01.666 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.83904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84595.log 2024-04-25T19:32:01.666 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.83904.log.gz 2024-04-25T19:32:01.667 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.48548.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48548.log.gz 2024-04-25T19:32:01.668 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83088.log 2024-04-25T19:32:01.670 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.84595.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.84595.log.gz 2024-04-25T19:32:01.670 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42714.log 2024-04-25T19:32:01.670 INFO:teuthology.orchestra.run.smithi195.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T19:32:01.671 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.83088.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.83088.log.gz 2024-04-25T19:32:01.671 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47542.log 2024-04-25T19:32:01.672 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82742.log 2024-04-25T19:32:01.673 INFO:teuthology.orchestra.run.smithi131.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42714.log.gz 2024-04-25T19:32:01.674 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.47542.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47542.log.gz 2024-04-25T19:32:01.674 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44697.log 2024-04-25T19:32:01.675 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.82742.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.82742.log.gz 2024-04-25T19:32:01.676 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48027.log 2024-04-25T19:32:01.677 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43605.log 2024-04-25T19:32:01.677 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44697.log.gz 2024-04-25T19:32:01.678 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.48027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40694.log 2024-04-25T19:32:01.678 INFO:teuthology.orchestra.run.smithi131.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48027.log.gz 2024-04-25T19:32:01.679 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43605.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43605.log.gz 2024-04-25T19:32:01.680 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40192.log 2024-04-25T19:32:01.681 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84535.log 2024-04-25T19:32:01.681 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40694.log.gz 2024-04-25T19:32:01.682 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83736.log 2024-04-25T19:32:01.682 INFO:teuthology.orchestra.run.smithi131.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40192.log.gz 2024-04-25T19:32:01.684 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.84535.log: gzip -5 --verbose 88.8% -- replaced with /var/log/ceph/ceph-client.admin.84535.log.gz 2024-04-25T19:32:01.684 INFO:teuthology.orchestra.run.smithi131.stderr: -- /var/log/ceph/ceph-client.admin.40400.log 2024-04-25T19:32:01.685 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.83736.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.83736.log.gz 2024-04-25T19:32:01.686 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38716.log 2024-04-25T19:32:01.686 INFO:teuthology.orchestra.run.smithi195.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T19:32:01.687 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44403.log 2024-04-25T19:32:01.687 INFO:teuthology.orchestra.run.smithi131.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40400.log.gz 2024-04-25T19:32:01.688 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.38716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40988.log 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38716.log.gz 2024-04-25T19:32:01.689 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-04-25T19:32:01.689 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44403.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44403.log.gz 2024-04-25T19:32:01.690 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T19:32:01.691 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45069.log 2024-04-25T19:32:01.691 INFO:teuthology.orchestra.run.smithi131.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40988.log.gz 2024-04-25T19:32:01.694 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.45069.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45069.log.gz 2024-04-25T19:32:01.695 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46860.log 2024-04-25T19:32:01.696 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43478.log 2024-04-25T19:32:01.698 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.46860.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46860.log.gz 2024-04-25T19:32:01.699 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83988.log 2024-04-25T19:32:01.699 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43478.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43478.log.gz 2024-04-25T19:32:01.701 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.83988.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.83988.log.gz 2024-04-25T19:32:01.701 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27090.log 2024-04-25T19:32:01.703 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83130.log 2024-04-25T19:32:01.704 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph.tmp-client.admin.27090.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27090.log.gz 2024-04-25T19:32:01.705 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48334.log 2024-04-25T19:32:01.706 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.83130.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.83130.log.gz 2024-04-25T19:32:01.707 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5/var/log/ceph/ceph-client.admin.48334.log: --verbose -- /var/log/ceph/ceph-client.admin.39056.log 2024-04-25T19:32:01.708 INFO:teuthology.orchestra.run.smithi131.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48334.log.gz 2024-04-25T19:32:01.709 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42840.log 2024-04-25T19:32:01.710 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.39056.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39056.log.gz 2024-04-25T19:32:01.711 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42798.log 2024-04-25T19:32:01.712 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42840.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42840.log.gz 2024-04-25T19:32:01.713 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44941.log 2024-04-25T19:32:01.713 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42798.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42798.log.gz 2024-04-25T19:32:01.714 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44151.log 2024-04-25T19:32:01.717 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44941.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44941.log.gz 2024-04-25T19:32:01.717 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33162.log 2024-04-25T19:32:01.717 INFO:teuthology.orchestra.run.smithi131.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44151.log.gz 2024-04-25T19:32:01.719 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40526.log 2024-04-25T19:32:01.720 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.33162.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.33162.log.gz 2024-04-25T19:32:01.721 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39859.log/var/log/ceph/ceph-client.admin.40526.log: 2024-04-25T19:32:01.722 INFO:teuthology.orchestra.run.smithi131.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40526.log.gz 2024-04-25T19:32:01.722 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45889.log 2024-04-25T19:32:01.725 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.39859.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39859.log.gz 2024-04-25T19:32:01.726 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.45889.log: /var/log/ceph/ceph-client.admin.45153.log 2024-04-25T19:32:01.726 INFO:teuthology.orchestra.run.smithi131.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45889.log.gz 2024-04-25T19:32:01.727 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43779.log 2024-04-25T19:32:01.728 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45153.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45153.log.gz 2024-04-25T19:32:01.729 INFO:teuthology.orchestra.run.smithi195.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T19:32:01.730 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48632.log 2024-04-25T19:32:01.730 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43779.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43779.log.gz 2024-04-25T19:32:01.731 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45679.log 2024-04-25T19:32:01.731 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.48632.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48632.log.gz 2024-04-25T19:32:01.732 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82397.log 2024-04-25T19:32:01.733 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45679.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.45679.log.gz 2024-04-25T19:32:01.734 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45321.log 2024-04-25T19:32:01.735 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.82397.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.82397.log.gz 2024-04-25T19:32:01.736 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84282.log 2024-04-25T19:32:01.737 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45321.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45321.log.gz 2024-04-25T19:32:01.738 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39224.log 2024-04-25T19:32:01.739 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.84282.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.84282.log.gz 2024-04-25T19:32:01.739 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39864.log 2024-04-25T19:32:01.741 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.39224.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39224.log.gz 2024-04-25T19:32:01.742 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.39864.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39864.log.gz 2024-04-25T19:32:01.742 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42588.log 2024-04-25T19:32:01.744 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46123.log 2024-04-25T19:32:01.745 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42588.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42588.log.gz 2024-04-25T19:32:01.746 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47584.log 2024-04-25T19:32:01.747 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.46123.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46123.log.gz 2024-04-25T19:32:01.748 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38800.log 2024-04-25T19:32:01.749 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.47584.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47584.log.gz 2024-04-25T19:32:01.750 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48716.log 2024-04-25T19:32:01.751 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.38800.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38800.log.gz 2024-04-25T19:32:01.751 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43863.log 2024-04-25T19:32:01.756 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.48716.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48716.log.gz 2024-04-25T19:32:01.756 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44235.log 2024-04-25T19:32:01.756 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43863.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43863.log.gz 2024-04-25T19:32:01.756 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84114.log 2024-04-25T19:32:01.756 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44235.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44235.log.gz 2024-04-25T19:32:01.757 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.84114.log: -- /var/log/ceph/ceph-client.admin.84156.log 2024-04-25T19:32:01.758 INFO:teuthology.orchestra.run.smithi131.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.84114.log.gz 2024-04-25T19:32:01.759 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33427.log 2024-04-25T19:32:01.760 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.84156.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.84156.log.gz 2024-04-25T19:32:01.761 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43737.log 2024-04-25T19:32:01.762 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.33427.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33427.log.gz 2024-04-25T19:32:01.764 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43737.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43737.log.gz 2024-04-25T19:32:01.764 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48824.log 2024-04-25T19:32:01.765 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47122.log 2024-04-25T19:32:01.767 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.48824.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48824.log.gz 2024-04-25T19:32:01.768 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83401.log 2024-04-25T19:32:01.768 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.47122.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47122.log.gz 2024-04-25T19:32:01.769 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40197.log 2024-04-25T19:32:01.770 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.83401.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.83401.log.gz 2024-04-25T19:32:01.771 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.40197.log: -- /var/log/ceph/ceph-client.admin.44613.log 2024-04-25T19:32:01.772 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40197.log.gz 2024-04-25T19:32:01.773 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43905.log 2024-04-25T19:32:01.774 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44613.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44613.log.gz 2024-04-25T19:32:01.775 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.43905.log: /var/log/ceph/ceph-client.admin.42168.log 2024-04-25T19:32:01.776 INFO:teuthology.orchestra.run.smithi131.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43905.log.gz 2024-04-25T19:32:01.777 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40736.log 2024-04-25T19:32:01.778 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42168.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42168.log.gz 2024-04-25T19:32:01.779 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39308.log 2024-04-25T19:32:01.781 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40736.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40736.log.gz 2024-04-25T19:32:01.781 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40778.log 2024-04-25T19:32:01.782 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.39308.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39308.log.gz 2024-04-25T19:32:01.783 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48758.log 2024-04-25T19:32:01.784 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40778.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40778.log.gz 2024-04-25T19:32:01.785 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44445.log 2024-04-25T19:32:01.787 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.48758.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.48758.log.gz/var/log/ceph/ceph-client.admin.44445.log: 2024-04-25T19:32:01.788 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40194.log 2024-04-25T19:32:01.788 INFO:teuthology.orchestra.run.smithi131.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44445.log.gz 2024-04-25T19:32:01.789 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83461.log 2024-04-25T19:32:01.790 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40194.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40194.log.gz 2024-04-25T19:32:01.791 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42504.log/var/log/ceph/ceph-client.admin.83461.log: 2024-04-25T19:32:01.795 INFO:teuthology.orchestra.run.smithi131.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.83461.log.gz 2024-04-25T19:32:01.795 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84408.log 2024-04-25T19:32:01.795 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42504.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42504.log.gz 2024-04-25T19:32:01.795 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42126.log/var/log/ceph/ceph-client.admin.84408.log: 2024-04-25T19:32:01.796 INFO:teuthology.orchestra.run.smithi131.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84408.log.gz 2024-04-25T19:32:01.797 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43563.log 2024-04-25T19:32:01.798 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42126.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42126.log.gz 2024-04-25T19:32:01.799 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.43563.log: /var/log/ceph/ceph-client.admin.45973.log 2024-04-25T19:32:01.800 INFO:teuthology.orchestra.run.smithi131.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43563.log.gz 2024-04-25T19:32:01.801 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44277.log 2024-04-25T19:32:01.802 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45973.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45973.log.gz 2024-04-25T19:32:01.803 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.44277.log: /var/log/ceph/ceph-client.admin.42294.log 2024-04-25T19:32:01.803 INFO:teuthology.orchestra.run.smithi131.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44277.log.gz 2024-04-25T19:32:01.804 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39350.log 2024-04-25T19:32:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42294.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42294.log.gz 2024-04-25T19:32:01.807 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5/var/log/ceph/ceph-client.admin.39350.log: --verbose -- /var/log/ceph/ceph-client.admin.48674.log 2024-04-25T19:32:01.807 INFO:teuthology.orchestra.run.smithi131.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39350.log.gz 2024-04-25T19:32:01.808 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84240.log 2024-04-25T19:32:01.810 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.48674.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48674.log.gz 2024-04-25T19:32:01.811 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.84240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82459.log 2024-04-25T19:32:01.811 INFO:teuthology.orchestra.run.smithi131.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.84240.log.gz 2024-04-25T19:32:01.812 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39266.log 2024-04-25T19:32:01.814 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.82459.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.82459.log.gz 2024-04-25T19:32:01.815 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.39266.log: -- /var/log/ceph/ceph-client.admin.84030.log 2024-04-25T19:32:01.815 INFO:teuthology.orchestra.run.smithi131.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39266.log.gz 2024-04-25T19:32:01.816 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45409.log 2024-04-25T19:32:01.818 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.84030.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.84030.log.gz 2024-04-25T19:32:01.818 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.45409.log: -- /var/log/ceph/ceph-client.0.46315.log 2024-04-25T19:32:01.819 INFO:teuthology.orchestra.run.smithi131.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45409.log.gz 2024-04-25T19:32:01.820 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47080.log 2024-04-25T19:32:01.821 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.46315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46315.log.gz 2024-04-25T19:32:01.822 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44739.log 2024-04-25T19:32:01.823 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.47080.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47080.log.gz 2024-04-25T19:32:01.824 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39140.log 2024-04-25T19:32:01.825 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44739.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44739.log.gz 2024-04-25T19:32:01.826 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46311.log 2024-04-25T19:32:01.827 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.39140.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39140.log.gz 2024-04-25T19:32:01.828 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44571.log 2024-04-25T19:32:01.828 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.46311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46311.log.gz 2024-04-25T19:32:01.829 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83214.log 2024-04-25T19:32:01.831 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44571.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44571.log.gz 2024-04-25T19:32:01.831 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47164.log 2024-04-25T19:32:01.832 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.83214.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.83214.log.gz 2024-04-25T19:32:01.834 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.47164.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47164.log.gz 2024-04-25T19:32:01.835 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46996.log 2024-04-25T19:32:01.836 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48111.log 2024-04-25T19:32:01.838 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.46996.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46996.log.gz 2024-04-25T19:32:01.838 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40149.log 2024-04-25T19:32:01.839 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.48111.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48111.log.gz 2024-04-25T19:32:01.840 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42672.log 2024-04-25T19:32:01.841 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40149.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40149.log.gz 2024-04-25T19:32:01.842 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43203.log 2024-04-25T19:32:01.843 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42672.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42672.log.gz 2024-04-25T19:32:01.844 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39531.log 2024-04-25T19:32:01.845 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43203.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43203.log.gz 2024-04-25T19:32:01.846 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.39531.log: /var/log/ceph/ceph-client.admin.42210.log 2024-04-25T19:32:01.846 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39531.log.gz 2024-04-25T19:32:01.847 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46818.log 2024-04-25T19:32:01.849 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42210.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42210.log.gz 2024-04-25T19:32:01.850 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44109.log/var/log/ceph/ceph-client.admin.46818.log: 2024-04-25T19:32:01.850 INFO:teuthology.orchestra.run.smithi131.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46818.log.gz 2024-04-25T19:32:01.852 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43287.log 2024-04-25T19:32:01.853 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44109.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44109.log.gz 2024-04-25T19:32:01.854 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43821.log 2024-04-25T19:32:01.854 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43287.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43287.log.gz 2024-04-25T19:32:01.855 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47038.log 2024-04-25T19:32:01.856 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43821.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43821.log.gz 2024-04-25T19:32:01.858 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.47038.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47038.log.gz 2024-04-25T19:32:01.858 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84493.log 2024-04-25T19:32:01.859 INFO:teuthology.orchestra.run.smithi195.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T19:32:01.860 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46015.log 2024-04-25T19:32:01.861 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.84493.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.84493.log.gz 2024-04-25T19:32:01.862 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82616.log 2024-04-25T19:32:01.863 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.46015.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46015.log.gz 2024-04-25T19:32:01.864 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38588.log 2024-04-25T19:32:01.866 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.82616.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.82616.log.gz 2024-04-25T19:32:01.866 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43347.log 2024-04-25T19:32:01.866 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.38588.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38588.log.gz 2024-04-25T19:32:01.867 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39524.log 2024-04-25T19:32:01.869 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43347.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43347.log.gz 2024-04-25T19:32:01.870 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39861.log 2024-04-25T19:32:01.870 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.39524.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39524.log.gz 2024-04-25T19:32:01.871 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42630.log 2024-04-25T19:32:01.872 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.39861.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39861.log.gz 2024-04-25T19:32:01.873 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84450.log 2024-04-25T19:32:01.874 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42630.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42630.log.gz 2024-04-25T19:32:01.875 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38313.log 2024-04-25T19:32:01.876 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.84450.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.84450.log.gz 2024-04-25T19:32:01.878 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.38313.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38313.log.gz 2024-04-25T19:32:01.878 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82878.log 2024-04-25T19:32:01.880 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T19:32:01.881 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.82878.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.82878.log.gz 2024-04-25T19:32:01.882 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose --/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.45365.log 2024-04-25T19:32:01.885 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82700.log 2024-04-25T19:32:01.885 INFO:teuthology.orchestra.run.smithi131.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T19:32:01.887 INFO:teuthology.orchestra.run.smithi131.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45365.log.gz 2024-04-25T19:32:01.887 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41533.log 2024-04-25T19:32:01.888 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.82700.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.82700.log.gz 2024-04-25T19:32:01.890 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39529.log 2024-04-25T19:32:01.890 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.41533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.41533.log.gz 2024-04-25T19:32:01.891 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83172.log 2024-04-25T19:32:01.892 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.39529.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39529.log.gz 2024-04-25T19:32:01.893 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45195.log 2024-04-25T19:32:01.894 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.83172.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.83172.log.gz 2024-04-25T19:32:01.895 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84635.log 2024-04-25T19:32:01.896 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45195.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45195.log.gz 2024-04-25T19:32:01.897 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33532.log 2024-04-25T19:32:01.897 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.84635.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.84635.log.gz 2024-04-25T19:32:01.898 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41552.log 2024-04-25T19:32:01.899 INFO:teuthology.orchestra.run.smithi195.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T19:32:01.900 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.33532.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33532.log.gz 2024-04-25T19:32:01.901 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40946.log 2024-04-25T19:32:01.901 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.41552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.41552.log.gz 2024-04-25T19:32:01.902 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40862.log 2024-04-25T19:32:01.903 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40946.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40946.log.gz 2024-04-25T19:32:01.904 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47945.log/var/log/ceph/ceph-client.admin.40862.log: 2024-04-25T19:32:01.905 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40862.log.gz 2024-04-25T19:32:01.906 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42420.log 2024-04-25T19:32:01.907 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.47945.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47945.log.gz 2024-04-25T19:32:01.908 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45721.log 2024-04-25T19:32:01.909 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42420.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42420.log.gz 2024-04-25T19:32:01.911 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45721.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45721.log.gz 2024-04-25T19:32:01.911 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43092.log 2024-04-25T19:32:01.913 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45847.log 2024-04-25T19:32:01.914 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43092.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43092.log.gz 2024-04-25T19:32:01.915 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44193.log 2024-04-25T19:32:01.916 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45847.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45847.log.gz 2024-04-25T19:32:01.917 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44025.log 2024-04-25T19:32:01.918 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44193.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44193.log.gz 2024-04-25T19:32:01.919 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39854.log 2024-04-25T19:32:01.919 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44025.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44025.log.gz 2024-04-25T19:32:01.920 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40203.log 2024-04-25T19:32:01.922 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.39854.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39854.log.gz 2024-04-25T19:32:01.923 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45637.log 2024-04-25T19:32:01.923 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40203.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40203.log.gz 2024-04-25T19:32:01.924 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84677.log 2024-04-25T19:32:01.925 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45637.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45637.log.gz 2024-04-25T19:32:01.926 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38844.log/var/log/ceph/ceph-client.admin.84677.log: 2024-04-25T19:32:01.927 INFO:teuthology.orchestra.run.smithi131.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.84677.log.gz 2024-04-25T19:32:01.928 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39510.log 2024-04-25T19:32:01.929 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.38844.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38844.log.gz 2024-04-25T19:32:01.930 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.39510.log: /var/log/ceph/ceph-client.admin.82920.log 2024-04-25T19:32:01.931 INFO:teuthology.orchestra.run.smithi131.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39510.log.gz 2024-04-25T19:32:01.932 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44487.log 2024-04-25T19:32:01.933 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.82920.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.82920.log.gz 2024-04-25T19:32:01.934 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40610.log 2024-04-25T19:32:01.935 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44487.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44487.log.gz 2024-04-25T19:32:01.936 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39852.log 2024-04-25T19:32:01.937 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40610.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40610.log.gz 2024-04-25T19:32:01.938 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39014.log 2024-04-25T19:32:01.939 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.39852.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39852.log.gz 2024-04-25T19:32:01.940 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.39014.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39014.log.gz 2024-04-25T19:32:01.958 INFO:teuthology.orchestra.run.smithi195.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T19:32:01.981 INFO:teuthology.orchestra.run.smithi195.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T19:32:01.982 INFO:teuthology.orchestra.run.smithi131.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T19:32:02.008 INFO:teuthology.orchestra.run.smithi195.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T19:32:02.011 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-04-25T19:32:02.011 INFO:teuthology.orchestra.run.smithi195.stderr:real 0m0.509s 2024-04-25T19:32:02.011 INFO:teuthology.orchestra.run.smithi195.stderr:user 0m2.234s 2024-04-25T19:32:02.011 INFO:teuthology.orchestra.run.smithi195.stderr:sys 0m0.284s 2024-04-25T19:32:02.096 INFO:teuthology.orchestra.run.smithi131.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T19:32:02.175 INFO:teuthology.orchestra.run.smithi131.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T19:32:02.179 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T19:32:02.183 INFO:teuthology.orchestra.run.smithi131.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T19:32:02.738 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-04-25T19:32:02.738 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-04-25T19:32:02.738 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-04-25T19:32:03.933 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T19:32:03.937 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-04-25T19:32:03.937 INFO:teuthology.orchestra.run.smithi131.stderr:real 0m2.440s 2024-04-25T19:32:03.937 INFO:teuthology.orchestra.run.smithi131.stderr:user 0m4.491s 2024-04-25T19:32:03.937 INFO:teuthology.orchestra.run.smithi131.stderr:sys 0m1.092s 2024-04-25T19:32:03.938 INFO:tasks.ceph:Archiving logs... 2024-04-25T19:32:03.938 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673308/remote/smithi131/log 2024-04-25T19:32:03.939 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T19:32:04.802 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673308/remote/smithi195/log 2024-04-25T19:32:04.803 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T19:32:05.189 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T19:32:05.198 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T19:32:05.199 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T19:32:05.206 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T19:32:05.349 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T19:32:05.360 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T19:32:05.361 DEBUG:teuthology.orchestra.run.smithi131:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T19:32:05.368 DEBUG:teuthology.orchestra.run.smithi195:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T19:32:05.416 INFO:teuthology.orchestra.run.smithi131.stderr:bash: line 1: ntpq: command not found 2024-04-25T19:32:05.422 INFO:teuthology.orchestra.run.smithi195.stderr:bash: line 1: ntpq: command not found 2024-04-25T19:32:05.427 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T19:32:05.427 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2024-04-25T19:32:05.427 INFO:teuthology.orchestra.run.smithi131.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 65 +1158us[+1153us] +/- 68ms 2024-04-25T19:32:05.427 INFO:teuthology.orchestra.run.smithi131.stdout:^* hv02.front.sepia.ceph.com 3 6 377 4 -1245us[-1247us] +/- 60ms 2024-04-25T19:32:05.427 INFO:teuthology.orchestra.run.smithi131.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 +278us[ +278us] +/- 68ms 2024-04-25T19:32:05.427 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T19:32:05.432 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T19:32:05.432 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2024-04-25T19:32:05.432 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 1 +950us[+1179us] +/- 37ms 2024-04-25T19:32:05.433 INFO:teuthology.orchestra.run.smithi195.stdout:^* hv02.front.sepia.ceph.com 3 6 377 1 -1481us[-1252us] +/- 60ms 2024-04-25T19:32:05.433 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 +79us[ +307us] +/- 68ms 2024-04-25T19:32:05.433 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T19:32:05.434 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T19:32:05.444 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T19:32:05.444 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T19:32:05.474 DEBUG:teuthology.orchestra.run.smithi131:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T19:32:05.688 DEBUG:teuthology.orchestra.run.smithi195:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T19:32:05.881 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T19:32:05.976 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T19:32:05.976 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T19:32:06.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T19:32:06.068 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T19:32:06.078 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T19:32:06.105 INFO:teuthology.task.internal:Duration was 1091.828926 seconds 2024-04-25T19:32:06.105 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T19:32:06.138 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T19:32:06.138 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T19:32:06.147 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T19:32:06.272 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T19:32:06.278 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T19:32:06.782 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T19:32:06.783 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi131.front.sepia.ceph.com 2024-04-25T19:32:06.783 DEBUG:teuthology.orchestra.run.smithi131:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T19:32:06.850 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T19:32:06.863 DEBUG:teuthology.orchestra.run.smithi195:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T19:32:06.949 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T19:32:06.949 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T19:32:06.957 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T19:32:07.040 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T19:32:07.040 DEBUG:teuthology.orchestra.run.smithi131:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T19:32:07.045 DEBUG:teuthology.orchestra.run.smithi195:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T19:32:07.217 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T19:32:07.230 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T19:32:07.231 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T19:32:07.314 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T19:32:07.402 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T19:32:07.412 DEBUG:teuthology.orchestra.run.smithi131:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T19:32:07.420 DEBUG:teuthology.orchestra.run.smithi195:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T19:32:07.510 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = core 2024-04-25T19:32:07.519 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = core 2024-04-25T19:32:07.560 DEBUG:teuthology.orchestra.run.smithi131:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T19:32:07.611 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T19:32:07.611 DEBUG:teuthology.orchestra.run.smithi195:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T19:32:07.666 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T19:32:07.666 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T19:32:07.677 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T19:32:07.679 DEBUG:teuthology.misc:Transferring archived files from smithi131:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673308/remote/smithi131 2024-04-25T19:32:07.679 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T19:32:07.776 DEBUG:teuthology.misc:Transferring archived files from smithi195:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673308/remote/smithi195 2024-04-25T19:32:07.776 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T19:32:07.872 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T19:32:07.872 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T19:32:07.880 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T19:32:07.937 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T19:32:07.950 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T19:32:07.950 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T19:32:07.990 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T19:32:07.991 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T19:32:07.998 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T19:32:08.048 INFO:teuthology.orchestra.run.smithi131.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 19:32 /home/ubuntu/cephtest 2024-04-25T19:32:08.054 INFO:teuthology.orchestra.run.smithi195.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 19:32 /home/ubuntu/cephtest 2024-04-25T19:32:08.059 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T19:32:08.069 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T19:32:08.171 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 client.1-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/asok_dump_tree} duration: 1091.8289256095886 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-04-25T19:32:08.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T19:32:08.253 INFO:teuthology.run:pass